Explainable Human–AI Collaboration for Risk-Aware Clinical Decision Support in Transparent and Clinically Meaningful Heart Failure Mortality Prediction

Main Article Content

Amineh A. Khaddam

Abstract

Heart failure remains a major clinical challenge because of its substantial mortality risk and the difficulty of identifying patients who may require early clinical attention. Although machine learning models can support mortality prediction, clinical use requires more than accurate classification: the system must communicate uncertainty and rationale in a form that clinicians can critically evaluate. This study therefore reframes heart failure mortality prediction as a human–AI collaborative decision-support problem in which artificial intelligence provides structured risk evidence while the clinician retains responsibility for contextual interpretation and the final clinical decision. The proposed framework integrates CatBoost machine learning, risk-aware threshold optimization, and SHAP-based explainable artificial intelligence. The Heart Failure Clinical Records Dataset was used, with the temporal variable (time) excluded to reduce information leakage and to restrict prediction to patient characteristics available during clinical assessment. The CatBoost classifier was trained with class-balanced optimization and evaluated using an independent test set and five-fold stratified cross-validation. Youden's J statistic was used to identify a clinically oriented decision threshold, while SHAP generated population-level and patient-level explanations intended to support clinician verification of AI recommendations. The AI component achieved an ROC-AUC of 0.7818 on the independent test set and a mean cross-validation ROC-AUC of 0.7501 ± 0.1327. Threshold optimization identified a cut-off of 0.1844, increasing mortality recall to 89% and detecting 17 of 19 mortality cases. SHAP analysis identified serum creatinine, ejection fraction, and age among the strongest contributors to model output. At the patient level, the framework presents the predicted risk together with factors that increase or decrease that risk, creating an interaction point at which clinicians can accept, question, or override the AI recommendation using additional clinical context. Because this retrospective study did not include a clinician user study, the findings establish the technical feasibility and collaboration-readiness of the proposed interface rather than demonstrating improved human–AI team performance. Prospective evaluation with clinicians and external cohorts is required before real-world deployment.

Article Details

How to Cite
[1]
A. A. Khaddam, “Explainable Human–AI Collaboration for Risk-Aware Clinical Decision Support in Transparent and Clinically Meaningful Heart Failure Mortality Prediction”, Int. J. Appl. Inf. Manag., vol. 6, no. 4, pp. 459–472, Nov. 2026.
Section
Articles