Shangri–La: A medical case–based retrieval tool

Large amounts of medical visual data are produced in hospitals daily and made available continuously via publications in the scientific literature, representing the medical knowledge. However, it is not always easy to find the desired information and in clinical routine the time to fulfil an informa...

Descripción completa

Detalles Bibliográficos
Autores: García Seco de Herrera, Alba, Schaer, Roger, Müller, Henning
Tipo de recurso: artículo
Fecha de publicación:2018
País:España
Institución:Universidad Nacional de Educación a Distancia
Repositorio:e-spacio. Repositorio Institucional de la UNED
Idioma:inglés
OAI Identifier:oai:e-spacio.uned.es:20.500.14468/26369
Acceso en línea:https://hdl.handle.net/20.500.14468/26369
Access Level:acceso abierto
Palabra clave:12 Matemáticas::1203 Ciencia de los ordenadores ::1203.17 Informática
Medical visual information retrieval
ImageCLEF
Medical case retrieval
Query adaptive multi–modal fusion
Shangri–La
Classification
Descripción
Sumario:Large amounts of medical visual data are produced in hospitals daily and made available continuously via publications in the scientific literature, representing the medical knowledge. However, it is not always easy to find the desired information and in clinical routine the time to fulfil an information need is often very limited. Information retrieval systems are a useful tool to provide access to these documents/images in the biomedical literature related to information needs of medical professionals. Shangri–La is a medical retrieval system that can potentially help clinicians to make decisions on difficult cases. It retrieves articles from the biomedical literature when querying a case description and attached images. The system is based on a multimodal retrieval approach with a focus on the integration of visual information connected to text. The approach includes a query–adaptive multimodal fusion criterion that analyses if visual features are suitable to be fused with text for the retrieval. Furthermore, image modality information is integrated in the retrieval step. The approach is evaluated using the ImageCLEFmed 2013 medical retrieval benchmark and can thus be compared to other approaches. Results show that the final approach outperforms the best multimodal approach submitted to ImageCLEFmed 2013.