A benchmark for end-user structured data exploration and search user interfaces

During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems' user interfaces help their users. One of the key factors faci...

Descripción completa

Detalles Bibliográficos
Autores: García González, Roberto, Gil Iranzo, Rosa María, Bakke, Eirik, Karger, David R.
Tipo de recurso: artículo
Estado:Versión enviada para evaluación y publicación
Fecha de publicación:2020
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10459.1/69484
Acceso en línea:https://doi.org/10.1016/j.websem.2020.100610
http://hdl.handle.net/10459.1/69484
Access Level:acceso abierto
Palabra clave:Benchmark
User experience
Usability
id ES_47287313d024eee16e79805ced71b2eb
oai_identifier_str oai:recercat.cat:10459.1/69484
network_acronym_str ES
network_name_str España
repository_id_str
spelling A benchmark for end-user structured data exploration and search user interfacesGarcía González, RobertoGil Iranzo, Rosa MaríaBakke, EirikKarger, David R.BenchmarkUser experienceUsabilityDuring the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems' user interfaces help their users. One of the key factors facilitating the advancement of research in a particular field is the ability to compare the performance of different approaches. Though there are many such benchmarks in Semantic Web fields that have experienced significant improvements, this is not the case for Semantic Web user interfaces for data exploration. We propose and demonstrate the use of a benchmark for evaluating such user interfaces, which includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We have applied the benchmark to four such systems. Moreover, all the required resources to apply the benchmark are openly available online. We intend to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools.Elsevier2020202020202020info:eu-repo/semantics/articleinfo:eu-repo/semantics/submittedVersionapplication/pdfhttps://doi.org/10.1016/j.websem.2020.100610http://hdl.handle.net/10459.1/69484http://hdl.handle.net/10459.1/69484reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésVersió preprint del document publicat a: https://doi.org/10.1016/j.websem.2020.100610Journal of Web Semantics, 2020, vol. 65, p. 100610(c) Elsevier, 2020info:eu-repo/semantics/openAccessoai:recercat.cat:10459.1/694842026-05-29T05:05:01Z
dc.title.none.fl_str_mv A benchmark for end-user structured data exploration and search user interfaces
title A benchmark for end-user structured data exploration and search user interfaces
spellingShingle A benchmark for end-user structured data exploration and search user interfaces
García González, Roberto
Benchmark
User experience
Usability
title_short A benchmark for end-user structured data exploration and search user interfaces
title_full A benchmark for end-user structured data exploration and search user interfaces
title_fullStr A benchmark for end-user structured data exploration and search user interfaces
title_full_unstemmed A benchmark for end-user structured data exploration and search user interfaces
title_sort A benchmark for end-user structured data exploration and search user interfaces
dc.creator.none.fl_str_mv García González, Roberto
Gil Iranzo, Rosa María
Bakke, Eirik
Karger, David R.
author García González, Roberto
author_facet García González, Roberto
Gil Iranzo, Rosa María
Bakke, Eirik
Karger, David R.
author_role author
author2 Gil Iranzo, Rosa María
Bakke, Eirik
Karger, David R.
author2_role author
author
author
dc.subject.none.fl_str_mv Benchmark
User experience
Usability
topic Benchmark
User experience
Usability
description During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems' user interfaces help their users. One of the key factors facilitating the advancement of research in a particular field is the ability to compare the performance of different approaches. Though there are many such benchmarks in Semantic Web fields that have experienced significant improvements, this is not the case for Semantic Web user interfaces for data exploration. We propose and demonstrate the use of a benchmark for evaluating such user interfaces, which includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We have applied the benchmark to four such systems. Moreover, all the required resources to apply the benchmark are openly available online. We intend to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools.
publishDate 2020
dc.date.none.fl_str_mv 2020
2020
2020
2020
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/submittedVersion
format article
status_str submittedVersion
dc.identifier.none.fl_str_mv https://doi.org/10.1016/j.websem.2020.100610
http://hdl.handle.net/10459.1/69484
http://hdl.handle.net/10459.1/69484
url https://doi.org/10.1016/j.websem.2020.100610
http://hdl.handle.net/10459.1/69484
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Versió preprint del document publicat a: https://doi.org/10.1016/j.websem.2020.100610
Journal of Web Semantics, 2020, vol. 65, p. 100610
dc.rights.none.fl_str_mv (c) Elsevier, 2020
info:eu-repo/semantics/openAccess
rights_invalid_str_mv (c) Elsevier, 2020
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869407276193808384
score 15,81155

Similares en LA Referencia