A review of evaluation approaches for explainable AI with applications in cardiology
Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This r...
| Authors: | , , , , , , , , |
|---|---|
| Format: | article |
| Status: | Published version |
| Publication Date: | 2024 |
| Country: | España |
| Institution: | Universidad de Barcelona |
| Repository: | Dipòsit Digital de la UB |
| OAI Identifier: | oai:diposit.ub.edu:2445/227819 |
| Online Access: | https://hdl.handle.net/2445/227819 |
| Access Level: | Open access |
| Keyword: | Intel·ligència artificial en medicina Cardiologia Medical artificial intelligence Cardiology |
| Summary: | Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models. |
|---|