Mutation Testing on An Object-Oriented Framework: An Experience Report

Context: The increasing presence of Object–Oriented (OO) programs in industrial systems is progressively drawing the attention of mutation researchers toward this paradigm. However, while the number of research contributions in this topic is plentiful, the number of empirical results is still margin...

Descripción completa

Detalles Bibliográficos
Autores: Segura Rueda, Sergio, Hierons, Robert M., Benavides Cuevas, David Felipe, Ruiz Cortés, Antonio
Tipo de recurso: artículo
Estado:Versión enviada para evaluación y publicación
Fecha de publicación:2011
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/24600
Acceso en línea:http://hdl.handle.net/11441/24600
https://doi.org/10.1016/j.infsof.2011.03.006
Access Level:acceso abierto
Palabra clave:Mutation testing
test adequacy
test data generation
automated analysis
feature models
id ES_d769ddacd130d019f06f05e098e0685e
oai_identifier_str oai:idus.us.es:11441/24600
network_acronym_str ES
network_name_str España
repository_id_str
spelling Mutation Testing on An Object-Oriented Framework: An Experience ReportSegura Rueda, SergioHierons, Robert M.Benavides Cuevas, David FelipeRuiz Cortés, AntonioMutation testingtest adequacytest data generationautomated analysisfeature modelsContext: The increasing presence of Object–Oriented (OO) programs in industrial systems is progressively drawing the attention of mutation researchers toward this paradigm. However, while the number of research contributions in this topic is plentiful, the number of empirical results is still marginal and mostly provided by researchers rather than practitioners. Objective: This article reports our experience using mutation testing to measure the effectiveness of an automated test data generator from a user perspective. Method: In our study, we applied both traditional and class-level mutation operators to FaMa, an open source Java framework currently being used for research and commercial purposes. We also compared and contrasted our results with the data obtained from some motivating faults found in the literature and two real tools for the analysis of feature models, FaMa and SPLOT. Results: Our results are summarized in a number of lessons learned supporting previous isolated results as well as new findings that hopefully will motivate further research in the field. Conclusion: We conclude that mutation testing is an effective and affordable technique to measure the effectiveness of test mechanisms in OO systems. We found, however, several practical limitations in current tool support that should be addressed to facilitate the work of testers. We also missed specific techniques and tools to apply mutation testing at the system level.CICYT TIN2009-07366Junta de Andalucía TIC-2533Junta de Andalucía TIC-5906ElsevierLenguajes y Sistemas InformáticosTIC205: Ingeniería del Software Aplicada2011info:eu-repo/semantics/articleinfo:eu-repo/semantics/submittedVersionapplication/pdfapplication/pdfhttp://hdl.handle.net/11441/24600https://doi.org/10.1016/j.infsof.2011.03.006reponame:idUS. Depósito de Investigación de la Universidad de Sevillainstname:Universidad de Sevilla (US)InglésInformation And Software Technology, 53 (10), 1124-1136TIN2009-07366TIC-2533TIC-5906http://dx.doi.org/10.1016/j.infsof.2011.03.006info:eu-repo/semantics/openAccessoai:idus.us.es:11441/246002026-06-17T12:51:07Z
dc.title.none.fl_str_mv Mutation Testing on An Object-Oriented Framework: An Experience Report
title Mutation Testing on An Object-Oriented Framework: An Experience Report
spellingShingle Mutation Testing on An Object-Oriented Framework: An Experience Report
Segura Rueda, Sergio
Mutation testing
test adequacy
test data generation
automated analysis
feature models
title_short Mutation Testing on An Object-Oriented Framework: An Experience Report
title_full Mutation Testing on An Object-Oriented Framework: An Experience Report
title_fullStr Mutation Testing on An Object-Oriented Framework: An Experience Report
title_full_unstemmed Mutation Testing on An Object-Oriented Framework: An Experience Report
title_sort Mutation Testing on An Object-Oriented Framework: An Experience Report
dc.creator.none.fl_str_mv Segura Rueda, Sergio
Hierons, Robert M.
Benavides Cuevas, David Felipe
Ruiz Cortés, Antonio
author Segura Rueda, Sergio
author_facet Segura Rueda, Sergio
Hierons, Robert M.
Benavides Cuevas, David Felipe
Ruiz Cortés, Antonio
author_role author
author2 Hierons, Robert M.
Benavides Cuevas, David Felipe
Ruiz Cortés, Antonio
author2_role author
author
author
dc.contributor.none.fl_str_mv Lenguajes y Sistemas Informáticos
TIC205: Ingeniería del Software Aplicada
dc.subject.none.fl_str_mv Mutation testing
test adequacy
test data generation
automated analysis
feature models
topic Mutation testing
test adequacy
test data generation
automated analysis
feature models
description Context: The increasing presence of Object–Oriented (OO) programs in industrial systems is progressively drawing the attention of mutation researchers toward this paradigm. However, while the number of research contributions in this topic is plentiful, the number of empirical results is still marginal and mostly provided by researchers rather than practitioners. Objective: This article reports our experience using mutation testing to measure the effectiveness of an automated test data generator from a user perspective. Method: In our study, we applied both traditional and class-level mutation operators to FaMa, an open source Java framework currently being used for research and commercial purposes. We also compared and contrasted our results with the data obtained from some motivating faults found in the literature and two real tools for the analysis of feature models, FaMa and SPLOT. Results: Our results are summarized in a number of lessons learned supporting previous isolated results as well as new findings that hopefully will motivate further research in the field. Conclusion: We conclude that mutation testing is an effective and affordable technique to measure the effectiveness of test mechanisms in OO systems. We found, however, several practical limitations in current tool support that should be addressed to facilitate the work of testers. We also missed specific techniques and tools to apply mutation testing at the system level.
publishDate 2011
dc.date.none.fl_str_mv 2011
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/submittedVersion
format article
status_str submittedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11441/24600
https://doi.org/10.1016/j.infsof.2011.03.006
url http://hdl.handle.net/11441/24600
https://doi.org/10.1016/j.infsof.2011.03.006
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Information And Software Technology, 53 (10), 1124-1136
TIN2009-07366
TIC-2533
TIC-5906
http://dx.doi.org/10.1016/j.infsof.2011.03.006
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:idUS. Depósito de Investigación de la Universidad de Sevilla
instname:Universidad de Sevilla (US)
instname_str Universidad de Sevilla (US)
reponame_str idUS. Depósito de Investigación de la Universidad de Sevilla
collection idUS. Depósito de Investigación de la Universidad de Sevilla
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869421000675819520
score 15.301603

Similares en LA Referencia