Performance mutation testing: hypothesis and open questions

Performance bugs are common, costly, and elusive. Performance tests aim to detect performance bugs by running the program with specific inputs and determining whether the observed behaviour is acceptable. There not exist mechanisms, however, to assess the effectiveness of performance tests. Mutation...

Descripción completa

Detalles Bibliográficos
Autores: Sánchez Jerez, Ana Belén, Delgado Pérez, Pedro, Segura Rueda, Sergio, Medina Bulo, Inmaculada
Tipo de recurso: artículo
Estado:Versión enviada para evaluación y publicación
Fecha de publicación:2018
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/135056
Acceso en línea:https://hdl.handle.net/11441/135056
https://doi.org/10.1016/j.infsof.2018.06.015
Access Level:acceso abierto
Palabra clave:Performance testing
Mutation testing
Performance bugs
Descripción
Sumario:Performance bugs are common, costly, and elusive. Performance tests aim to detect performance bugs by running the program with specific inputs and determining whether the observed behaviour is acceptable. There not exist mechanisms, however, to assess the effectiveness of performance tests. Mutation testing is a technique to evaluate and enhance functional test suites by seeding artificial faults in the program under test. In this new idea paper, we explore the applicability of mutation testing to assess and improve performance tests. This novel approach is motivated with examples and open questions.