Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction

Context: The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to...

ver descrição completa

Detalhes bibliográficos
Autores: Ferreira, Juan M., Rodríguez, Francy D., Santos, Adrián, Dieste, Oscar, Juristo, Natalia, Acuña Castillo, Silvia Teresita
Formato: artículo
Fecha de publicación:2022
País:España
Recursos:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/711837
Acesso em linha:http://hdl.handle.net/10486/711837
https://dx.doi.org/10.1109/TSE.2022.3149586
Access Level:acceso abierto
Palavra-chave:effectiveness
efficiency
experimental software engineering
family of experiments
satisfaction
Usability mechanism
Informática
id ES_ed3c2ffa7efff5a9176fe494b33f8d7f
oai_identifier_str oai:repositorio.uam.es:10486/711837
network_acronym_str ES
network_name_str España
repository_id_str
spelling Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfactionFerreira, Juan M.Rodríguez, Francy D.Santos, AdriánDieste, OscarJuristo, NataliaAcuña Castillo, Silvia Teresitaeffectivenessefficiencyexperimental software engineeringfamily of experimentssatisfactionUsability mechanismInformáticaContext: The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to depend on the usability feature and suggest priorities with respect to their implementation depending on how they promote user performance. Objectives: We use a family of three experiments to increase the precision and generalization of the results in the baseline experiment and provide findings regarding the impact on user performance of the Abort Operation, Progress Feedback and Preferences usability mechanisms. Method: We conduct two replications of the baseline experiment in academic settings. We analyse the data of 366 experimental subjects and apply aggregation (meta-analysis) procedures. Results: We find that the Abort Operation and Preferences usability mechanisms appear to improve system usability a great deal with respect to efficiency, effectiveness and user satisfaction. Conclusions: We find that the family of experiments further corroborates the results of the baseline experiment. Most of the results are statistically significant, and, because of the large number of experimental subjects, the evidence that we gathered in the replications is sufficient to outweigh other experimentsThis work was funded in part by the FEDER/Spanish Ministry of Science and Innovation-Research State Agency (MASSIVE) under Grants RTI2018- 095255-B-I00 and PGC2018-097265-B-I00, and in part by the R&D pro gramme of Madrid FORTE, under Grant P2018/TCS-4314IEEEDepartamento de Ingeniería InformáticaEscuela Politécnica Superior20222022-02-08research articlehttp://purl.org/coar/resource_type/c_2df8fbb1VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/711837https://dx.doi.org/10.1109/TSE.2022.3149586reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/7118372026-06-23T12:46:27Z
dc.title.none.fl_str_mv Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
title Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
spellingShingle Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
Ferreira, Juan M.
effectiveness
efficiency
experimental software engineering
family of experiments
satisfaction
Usability mechanism
Informática
title_short Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
title_full Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
title_fullStr Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
title_full_unstemmed Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
title_sort Impact of usability mechanisms: a family of experiments on efficiency, effectiveness and user satisfaction
dc.creator.none.fl_str_mv Ferreira, Juan M.
Rodríguez, Francy D.
Santos, Adrián
Dieste, Oscar
Juristo, Natalia
Acuña Castillo, Silvia Teresita
author Ferreira, Juan M.
author_facet Ferreira, Juan M.
Rodríguez, Francy D.
Santos, Adrián
Dieste, Oscar
Juristo, Natalia
Acuña Castillo, Silvia Teresita
author_role author
author2 Rodríguez, Francy D.
Santos, Adrián
Dieste, Oscar
Juristo, Natalia
Acuña Castillo, Silvia Teresita
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv Departamento de Ingeniería Informática
Escuela Politécnica Superior
dc.subject.none.fl_str_mv effectiveness
efficiency
experimental software engineering
family of experiments
satisfaction
Usability mechanism
Informática
topic effectiveness
efficiency
experimental software engineering
family of experiments
satisfaction
Usability mechanism
Informática
description Context: The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to depend on the usability feature and suggest priorities with respect to their implementation depending on how they promote user performance. Objectives: We use a family of three experiments to increase the precision and generalization of the results in the baseline experiment and provide findings regarding the impact on user performance of the Abort Operation, Progress Feedback and Preferences usability mechanisms. Method: We conduct two replications of the baseline experiment in academic settings. We analyse the data of 366 experimental subjects and apply aggregation (meta-analysis) procedures. Results: We find that the Abort Operation and Preferences usability mechanisms appear to improve system usability a great deal with respect to efficiency, effectiveness and user satisfaction. Conclusions: We find that the family of experiments further corroborates the results of the baseline experiment. Most of the results are statistically significant, and, because of the large number of experimental subjects, the evidence that we gathered in the replications is sufficient to outweigh other experiments
publishDate 2022
dc.date.none.fl_str_mv 2022
2022-02-08
dc.type.none.fl_str_mv research article
http://purl.org/coar/resource_type/c_2df8fbb1
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10486/711837
https://dx.doi.org/10.1109/TSE.2022.3149586
url http://hdl.handle.net/10486/711837
https://dx.doi.org/10.1109/TSE.2022.3149586
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv IEEE
publisher.none.fl_str_mv IEEE
dc.source.none.fl_str_mv reponame:Biblos-e Archivo. Repositorio Institucional de la UAM
instname:Universidad Autónoma de Madrid
instname_str Universidad Autónoma de Madrid
reponame_str Biblos-e Archivo. Repositorio Institucional de la UAM
collection Biblos-e Archivo. Repositorio Institucional de la UAM
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869423436612239360
score 15,300719

Registos relacionados