Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03

Variability determines the ability of software applications to be configured and customized. A common need during the development of variability–intensive systems is the automated analysis of their underlying variability models, e.g. detecting contradictory configuration options. The analysis operat...

Descripción completa

Detalles Bibliográficos
Autores: Segura Rueda, Sergio, Durán Toro, Amador, Sánchez Jerez, Ana Belén, Le Berre, Daniel, Lonca, Emmanuel, Ruiz Cortés, Antonio
Tipo de recurso: informe técnico
Estado:Versión publicada
Fecha de publicación:2013
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/128775
Acceso en línea:https://hdl.handle.net/11441/128775
Access Level:acceso abierto
Palabra clave:Software testing
Metamorphic testing
Automated testing
Software variability
id ES_4d9d4dee4aa670caa27f3996de461c2f
oai_identifier_str oai:idus.us.es:11441/128775
network_acronym_str ES
network_name_str España
repository_id_str
spelling Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03Segura Rueda, SergioDurán Toro, AmadorSánchez Jerez, Ana BelénLe Berre, DanielLonca, EmmanuelRuiz Cortés, AntonioSoftware testingMetamorphic testingAutomated testingSoftware variabilityVariability determines the ability of software applications to be configured and customized. A common need during the development of variability–intensive systems is the automated analysis of their underlying variability models, e.g. detecting contradictory configuration options. The analysis operations that are performed on variability models are often very complex, which hinders the testing of the corresponding analysis tools and makes difficult, often infeasible, to determine the correctness of their outputs, i.e. the well–known oracle problem in software testing. In this technical report, we present a generic approach for the automated detection of faults in variability analysis tools overcoming the oracle problem. Our work enables the generation of random variability models together with the exact set of valid configurations represented by these models. These test data are generated from scratch using step–wise transformations and assuring that certain constraints (a.k.a. metamorphic relations) hold at each step. To show the feasibility and generalizability of our approach, we used to automatically test several analysis tools in three variability domains: feature models, CUDF documents and Boolean formulas. Among other results, we detected 19 real bugs in seven out of the 15 tools under test.Lenguajes y Sistemas InformáticosTIC205: Ingeniería del Software Aplicada2013info:eu-repo/semantics/reportinfo:eu-repo/semantics/publishedVersionapplication/pdfapplication/pdfhttps://hdl.handle.net/11441/128775reponame:idUS. Depósito de Investigación de la Universidad de Sevillainstname:Universidad de Sevilla (US)Inglésinfo:eu-repo/semantics/openAccessoai:idus.us.es:11441/1287752026-06-17T12:51:07Z
dc.title.none.fl_str_mv Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
title Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
spellingShingle Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
Segura Rueda, Sergio
Software testing
Metamorphic testing
Automated testing
Software variability
title_short Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
title_full Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
title_fullStr Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
title_full_unstemmed Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
title_sort Automated Metamorphic Testing on the Analysis of Software Variability: Technical Report ISA-2013-TR-03
dc.creator.none.fl_str_mv Segura Rueda, Sergio
Durán Toro, Amador
Sánchez Jerez, Ana Belén
Le Berre, Daniel
Lonca, Emmanuel
Ruiz Cortés, Antonio
author Segura Rueda, Sergio
author_facet Segura Rueda, Sergio
Durán Toro, Amador
Sánchez Jerez, Ana Belén
Le Berre, Daniel
Lonca, Emmanuel
Ruiz Cortés, Antonio
author_role author
author2 Durán Toro, Amador
Sánchez Jerez, Ana Belén
Le Berre, Daniel
Lonca, Emmanuel
Ruiz Cortés, Antonio
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv Lenguajes y Sistemas Informáticos
TIC205: Ingeniería del Software Aplicada
dc.subject.none.fl_str_mv Software testing
Metamorphic testing
Automated testing
Software variability
topic Software testing
Metamorphic testing
Automated testing
Software variability
description Variability determines the ability of software applications to be configured and customized. A common need during the development of variability–intensive systems is the automated analysis of their underlying variability models, e.g. detecting contradictory configuration options. The analysis operations that are performed on variability models are often very complex, which hinders the testing of the corresponding analysis tools and makes difficult, often infeasible, to determine the correctness of their outputs, i.e. the well–known oracle problem in software testing. In this technical report, we present a generic approach for the automated detection of faults in variability analysis tools overcoming the oracle problem. Our work enables the generation of random variability models together with the exact set of valid configurations represented by these models. These test data are generated from scratch using step–wise transformations and assuring that certain constraints (a.k.a. metamorphic relations) hold at each step. To show the feasibility and generalizability of our approach, we used to automatically test several analysis tools in three variability domains: feature models, CUDF documents and Boolean formulas. Among other results, we detected 19 real bugs in seven out of the 15 tools under test.
publishDate 2013
dc.date.none.fl_str_mv 2013
dc.type.none.fl_str_mv info:eu-repo/semantics/report
info:eu-repo/semantics/publishedVersion
format report
status_str publishedVersion
dc.identifier.none.fl_str_mv https://hdl.handle.net/11441/128775
url https://hdl.handle.net/11441/128775
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.source.none.fl_str_mv reponame:idUS. Depósito de Investigación de la Universidad de Sevilla
instname:Universidad de Sevilla (US)
instname_str Universidad de Sevilla (US)
reponame_str idUS. Depósito de Investigación de la Universidad de Sevilla
collection idUS. Depósito de Investigación de la Universidad de Sevilla
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869407703458119680
score 15,300724

Similares en LA Referencia