Metamorphic Testing: A Literature Review - Version 1.3 (Technical Report ISA-16-TR-02)

A test oracle determines whether a test execution reveals a fault, often by comparing the observed program output to the expected output. This is not always practical, for example when a program’s input-output relation is complex and difficult to capture formally. Metamorphic testing provides an alt...

Descripción completa

Detalles Bibliográficos
Autores: Segura Rueda, Sergio, Fraser, Gordon, Sánchez Jerez, Ana Belén, Ruiz Cortés, Antonio
Tipo de recurso: informe técnico
Estado:Versión publicada
Fecha de publicación:2016
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/135051
Acceso en línea:https://hdl.handle.net/11441/135051
Access Level:acceso abierto
Palabra clave:Metamorphic testing
Oracle problem
Surveys
Descripción
Sumario:A test oracle determines whether a test execution reveals a fault, often by comparing the observed program output to the expected output. This is not always practical, for example when a program’s input-output relation is complex and difficult to capture formally. Metamorphic testing provides an alternative, where correctness is not determined by checking an individual concrete output, but by applying a transformation to a test input and observing how the program output “morphs” into a different one as a result. Since the introduction of such metamorphic relations in 1998, many contributions on metamorphic testing have been made, and the technique has seen successful applications in a variety of domains, ranging from web services to computer graphics. This technical report provides a comprehensive literature review on metamorphic testing: It summarises the research results and application areas, and analyses common practice in empirical studies of metamorphic testing as well as the main open challenges.