A Review on Human-Centered Machine Learning for Decision Support in High-Stakes Domains
Main Article Content
Keywords
human-centered AI, machine learning, decision support systems, high-stakes decision-making, human –AI collaboration
Abstract
Machine learning is increasingly used to support important decisions in healthcare, public services, finance, and aviation. These systems can help with prediction, risk assessment, resource allocation, and professional decision-making. However, high accuracy does not always mean that a system is safe, fair, easy to understand, or suitable for real use. This paper reviews human-centered machine learning for decision support in high - stakes domains. It discusses common machine learning methods and several impo rtant human-centered requirements, including explainability, appropriate trust, usability, workflow integration, fairness, accountability, and human oversight. It also compares these requirements across different fields. Current studies show that many syst ems perform well in experiments or on historical data, but there is still limited evidence from real-world use. Explanations may increase trust, but they do not always improve decision quality. In some cases, they may even cause people to rely too much on wrong AI advice. Different fields also have different priorities. Healthcare focuses on patient safety, public services focus on fairness, finance focuses on rules and appeals, while aviation and manufacturing focus more on reliability, situation awareness, and skill retention. This paper argues that machine learning should support human judgment instead of replacing it.
References
- [1] Human–AI Collaboration Across Decision Support, Autonomous Systems, and LLM Agents: A Systematic Review and Collaboration Convergence Framework. https://www.mdpi.com/2071- 1050/18/11/5313
- [2] Artificial Intelligence for High-Stakes Decision Support: Architectures, Applications, and Deployment Challenges. https://al-kindipublishers.org/index.php/fcsai/article/view/12751
- [3] Explainable AI in Clinician-Facing Clinical Decision Support: A Critical Systematic Review and Evidence Map of Human-Centered Evaluations. https://www.isjtrend.com/article_243223.html
- [4] Human-Centered AI for Decision Support Systems: Enhancing Usability and Trustworthiness. https://www.mdpi.com/2079-8954/14/6/651
- [5] A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare. https://dl.acm.org/doi/abs/10.1145/3476089
- [6] Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. https://www.sciencedirect.com/science/article/abs/pii/S1566253519308103
- [7] Performance of predictive AI-based clinical decision support systems across clinical domains: A systematic review and meta-analysis. https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001310
- [8] Designing effective explainable AI: a human-centered evaluation of explanation formats in financial decision-making. https://www.frontiersin.org/journals/artificial- intelligence/articles/10.3389/frai.2026.1668029/full
- [9] Impact of automation level on airline pilots’ flying performance and visual scanning strategies: A full flight simulator study. https://www.sciencedirect.com/science/article/pii/S0003687024002333
