Fast anytime retrieval with confidence in large-scale temporal case bases

This work is about speeding up retrieval in Case-Based Reasoning (CBR) for large-scale case bases (CBs) comprised of temporally related cases in metric spaces. A typical example is a CB of electronic health records where consecutive sessions of a patient forms a sequence of related cases. k-Nearest...

Descripción completa

Detalles Bibliográficos
Autores: Mulayim, Mehmet Oguz, Arcos Rosell, Josep Lluís
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2020
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/234632
Acceso en línea:http://hdl.handle.net/10261/234632
Access Level:acceso abierto
Palabra clave:Large-scale case-based reasoning
Exact and approximate k-nearest neighbor search
Anytime algorithms
id ES_632428789e6f99f3d8d9deea58fb96ea
oai_identifier_str oai:digital.csic.es:10261/234632
network_acronym_str ES
network_name_str España
repository_id_str
spelling Fast anytime retrieval with confidence in large-scale temporal case basesMulayim, Mehmet OguzArcos Rosell, Josep LluísLarge-scale case-based reasoningExact and approximate k-nearest neighbor searchAnytime algorithmsThis work is about speeding up retrieval in Case-Based Reasoning (CBR) for large-scale case bases (CBs) comprised of temporally related cases in metric spaces. A typical example is a CB of electronic health records where consecutive sessions of a patient forms a sequence of related cases. k-Nearest Neighbors (kNN) search is a widely used algorithm in CBR retrieval. However, brute-force kNN is impossible for large CBs. As a contribution to efforts for speeding up kNN search, we introduce an anytime kNN search methodology and algorithm. Anytime Lazy kNN finds exact kNNs when allowed to run to completion with remarkable gain in execution time by avoiding unnecessary neighbor assessments. For applications where the gain in exact kNN search may not suffice, it can be interrupted earlier and it returns best-so-far kNNs together with a confidence value attached to each neighbor. We describe the algorithm and methodology to construct a probabilistic model that we use both to estimate confidence upon interruption and to automatize the interruption at desired confidence thresholds. We present the results of experiments conducted with publicly available datasets. The results show superior gains compared to brute-force search. We reach to an average gain of 87.18% with 0.98 confidence and to 96.84% with 0.70 confidence.This work has been funded by the project Playing and Singing for the Recovering Brain: Efficacy of Enriched Social-Motivational Musical Interventions in Stroke Rehabilitation (Play&Sing), Spain, 201729.31, Fundació La Marató de TV3, Spain; and, by the project Innobrain, Spain, COMRDI-151-0017 (RIS3CAT comunitats), and Feder, Spain funds.Elsevier BVMinisterio de Ciencia e Innovación (España)Fundació La Marató de TV3Consejo Superior de Investigaciones Científicas [https://ror.org/02gfc7t72]2021202120202021info:eu-repo/semantics/articlehttp://purl.org/coar/resource_type/c_6501Postprintinfo:eu-repo/semantics/acceptedVersionhttp://hdl.handle.net/10261/234632reponame:DIGITAL.CSIC. Repositorio Institucional del CSICinstname:Consejo Superior de Investigaciones Científicas (CSIC)Ingléshttp://dx.doi.org/10.1016/j.knosys.2020.106374Síinfo:eu-repo/semantics/openAccessoai:digital.csic.es:10261/2346322026-05-22T06:33:51Z
dc.title.none.fl_str_mv Fast anytime retrieval with confidence in large-scale temporal case bases
title Fast anytime retrieval with confidence in large-scale temporal case bases
spellingShingle Fast anytime retrieval with confidence in large-scale temporal case bases
Mulayim, Mehmet Oguz
Large-scale case-based reasoning
Exact and approximate k-nearest neighbor search
Anytime algorithms
title_short Fast anytime retrieval with confidence in large-scale temporal case bases
title_full Fast anytime retrieval with confidence in large-scale temporal case bases
title_fullStr Fast anytime retrieval with confidence in large-scale temporal case bases
title_full_unstemmed Fast anytime retrieval with confidence in large-scale temporal case bases
title_sort Fast anytime retrieval with confidence in large-scale temporal case bases
dc.creator.none.fl_str_mv Mulayim, Mehmet Oguz
Arcos Rosell, Josep Lluís
author Mulayim, Mehmet Oguz
author_facet Mulayim, Mehmet Oguz
Arcos Rosell, Josep Lluís
author_role author
author2 Arcos Rosell, Josep Lluís
author2_role author
dc.contributor.none.fl_str_mv Ministerio de Ciencia e Innovación (España)
Fundació La Marató de TV3
Consejo Superior de Investigaciones Científicas [https://ror.org/02gfc7t72]
dc.subject.none.fl_str_mv Large-scale case-based reasoning
Exact and approximate k-nearest neighbor search
Anytime algorithms
topic Large-scale case-based reasoning
Exact and approximate k-nearest neighbor search
Anytime algorithms
description This work is about speeding up retrieval in Case-Based Reasoning (CBR) for large-scale case bases (CBs) comprised of temporally related cases in metric spaces. A typical example is a CB of electronic health records where consecutive sessions of a patient forms a sequence of related cases. k-Nearest Neighbors (kNN) search is a widely used algorithm in CBR retrieval. However, brute-force kNN is impossible for large CBs. As a contribution to efforts for speeding up kNN search, we introduce an anytime kNN search methodology and algorithm. Anytime Lazy kNN finds exact kNNs when allowed to run to completion with remarkable gain in execution time by avoiding unnecessary neighbor assessments. For applications where the gain in exact kNN search may not suffice, it can be interrupted earlier and it returns best-so-far kNNs together with a confidence value attached to each neighbor. We describe the algorithm and methodology to construct a probabilistic model that we use both to estimate confidence upon interruption and to automatize the interruption at desired confidence thresholds. We present the results of experiments conducted with publicly available datasets. The results show superior gains compared to brute-force search. We reach to an average gain of 87.18% with 0.98 confidence and to 96.84% with 0.70 confidence.
publishDate 2020
dc.date.none.fl_str_mv 2020
2021
2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/article
http://purl.org/coar/resource_type/c_6501
Postprint
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10261/234632
url http://hdl.handle.net/10261/234632
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv http://dx.doi.org/10.1016/j.knosys.2020.106374

dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Elsevier BV
publisher.none.fl_str_mv Elsevier BV
dc.source.none.fl_str_mv reponame:DIGITAL.CSIC. Repositorio Institucional del CSIC
instname:Consejo Superior de Investigaciones Científicas (CSIC)
instname_str Consejo Superior de Investigaciones Científicas (CSIC)
reponame_str DIGITAL.CSIC. Repositorio Institucional del CSIC
collection DIGITAL.CSIC. Repositorio Institucional del CSIC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869409550342291456
score 15,811543