Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment

This study explores the implementation of the analytic hierarchy process in usability evaluations, specifically focusing on user interface assessment during software development phases. Addressing the challenge of diverse and unstandardized evaluation methodologies, our research develops and applies...

ver descrição completa

Detalhes bibliográficos
Autores: Talero-Sarmiento, Leonardo, González Capdevila, Marc, Granollers i Saltiveri, Toni, Lamos-Diaz, Henry, Pistili-Rodrigues, Karine
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Recursos:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10459.1/466136
Acesso em linha:https://doi.org/10.3390/bdcc8060069
https://hdl.handle.net/10459.1/466136
Access Level:acceso abierto
Palavra-chave:Heuristic evaluation
Usability testing
Analytic hierarchy process
Usability
Algorithm efficiency
id ES_f99be1c7dfdd776eb2bdd1302bc1e84a
oai_identifier_str oai:recercat.cat:10459.1/466136
network_acronym_str ES
network_name_str España
repository_id_str
spelling Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability AssessmentTalero-Sarmiento, LeonardoGonzález Capdevila, MarcGranollers i Saltiveri, ToniLamos-Diaz, HenryPistili-Rodrigues, KarineHeuristic evaluationUsability testingAnalytic hierarchy processUsabilityAlgorithm efficiencyThis study explores the implementation of the analytic hierarchy process in usability evaluations, specifically focusing on user interface assessment during software development phases. Addressing the challenge of diverse and unstandardized evaluation methodologies, our research develops and applies a tailored algorithm that simplifies heuristic prioritization. This novel method combines the analytic hierarchy process framework with a bespoke algorithm that leverages transitive properties for efficient pairwise comparisons, significantly reducing the evaluative workload. The algorithm is designed to facilitate the estimation of heuristic relevance regardless of the number of items per heuristic or the item scale, thereby streamlining the evaluation process. Rigorous simulation testing of this tailored algorithm is complemented by its empirical application, where seven usability experts evaluate a web interface. This practical implementation demonstrates our method’s ability to decrease the necessary comparisons and simplify the complexity and workload associated with the traditional prioritization process. Additionally, it improves the accuracy and relevance of the user interface usability heuristic testing results. By prioritizing heuristics based on their importance as determined by the Usability Testing Leader—rather than merely depending on the number of items, scale, or heuristics—our approach ensures that evaluations focus on the most critical usability aspects from the start. The findings from this study highlight the importance of expert-driven evaluations for gaining a thorough understanding of heuristic UI assessment, offering a wider perspective than user-perception-based methods like the questionnaire approach. Our research contributes to advancing UI evaluation methodologies, offering an organized and effective framework for future usability testing endeavors.This research was funded by the Colombian Bureau of Science (Minciencias, Ministerio de Ciencia, Tecnología e Innovación), grant number BPIN 2019000100019—CDP 820MDPI2024info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttps://doi.org/10.3390/bdcc8060069https://hdl.handle.net/10459.1/466136reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésReproducció del document publicat a https://doi.org/10.3390/bdcc8060069Big Data and Cognitive Computation, 2024, vol. 8, núm. 6, 69cc-by (c) Leonardo Talero-Sarmiento et al., 2024Attribution 4.0 Internationalinfo:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by/4.0/oai:recercat.cat:10459.1/4661362026-05-29T05:05:01Z
dc.title.none.fl_str_mv Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
title Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
spellingShingle Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
Talero-Sarmiento, Leonardo
Heuristic evaluation
Usability testing
Analytic hierarchy process
Usability
Algorithm efficiency
title_short Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
title_full Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
title_fullStr Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
title_full_unstemmed Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
title_sort Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment
dc.creator.none.fl_str_mv Talero-Sarmiento, Leonardo
González Capdevila, Marc
Granollers i Saltiveri, Toni
Lamos-Diaz, Henry
Pistili-Rodrigues, Karine
author Talero-Sarmiento, Leonardo
author_facet Talero-Sarmiento, Leonardo
González Capdevila, Marc
Granollers i Saltiveri, Toni
Lamos-Diaz, Henry
Pistili-Rodrigues, Karine
author_role author
author2 González Capdevila, Marc
Granollers i Saltiveri, Toni
Lamos-Diaz, Henry
Pistili-Rodrigues, Karine
author2_role author
author
author
author
dc.subject.none.fl_str_mv Heuristic evaluation
Usability testing
Analytic hierarchy process
Usability
Algorithm efficiency
topic Heuristic evaluation
Usability testing
Analytic hierarchy process
Usability
Algorithm efficiency
description This study explores the implementation of the analytic hierarchy process in usability evaluations, specifically focusing on user interface assessment during software development phases. Addressing the challenge of diverse and unstandardized evaluation methodologies, our research develops and applies a tailored algorithm that simplifies heuristic prioritization. This novel method combines the analytic hierarchy process framework with a bespoke algorithm that leverages transitive properties for efficient pairwise comparisons, significantly reducing the evaluative workload. The algorithm is designed to facilitate the estimation of heuristic relevance regardless of the number of items per heuristic or the item scale, thereby streamlining the evaluation process. Rigorous simulation testing of this tailored algorithm is complemented by its empirical application, where seven usability experts evaluate a web interface. This practical implementation demonstrates our method’s ability to decrease the necessary comparisons and simplify the complexity and workload associated with the traditional prioritization process. Additionally, it improves the accuracy and relevance of the user interface usability heuristic testing results. By prioritizing heuristics based on their importance as determined by the Usability Testing Leader—rather than merely depending on the number of items, scale, or heuristics—our approach ensures that evaluations focus on the most critical usability aspects from the start. The findings from this study highlight the importance of expert-driven evaluations for gaining a thorough understanding of heuristic UI assessment, offering a wider perspective than user-perception-based methods like the questionnaire approach. Our research contributes to advancing UI evaluation methodologies, offering an organized and effective framework for future usability testing endeavors.
publishDate 2024
dc.date.none.fl_str_mv 2024
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv https://doi.org/10.3390/bdcc8060069
https://hdl.handle.net/10459.1/466136
url https://doi.org/10.3390/bdcc8060069
https://hdl.handle.net/10459.1/466136
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Reproducció del document publicat a https://doi.org/10.3390/bdcc8060069
Big Data and Cognitive Computation, 2024, vol. 8, núm. 6, 69
dc.rights.none.fl_str_mv cc-by (c) Leonardo Talero-Sarmiento et al., 2024
Attribution 4.0 International
info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by/4.0/
rights_invalid_str_mv cc-by (c) Leonardo Talero-Sarmiento et al., 2024
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869425110042017792
score 15.811543

Registos relacionados