A review of evaluation approaches for explainable AI with applications in cardiology

Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This r...

Descripción completa

Detalles Bibliográficos
Autores: Salih, Ahmed M., Boscolo Galazzo, Ilaria, Rauseo, Elisa, Lee, Aaron Mark, Lekadir, Karim, 1977-, Radeva, Petia, Petersen, Steffen E., Menegaz, Gloria, Gkontra, Polyxeni
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Institución:Universidad de Barcelona
Repositorio:Dipòsit Digital de la UB
OAI Identifier:oai:diposit.ub.edu:2445/227819
Acceso en línea:https://hdl.handle.net/2445/227819
Access Level:acceso abierto
Palabra clave:Intel·ligència artificial en medicina
Cardiologia
Medical artificial intelligence
Cardiology
Descripción
Sumario:Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models.