TANDEM: A Taxonomy and a Dataset of Real-World Performance Bugs

The detection of performance bugs, like those causing an unexpected execution time, has gained much attention in the last years due to their potential impact in safety-critical and resource-constrained applications. Much effort has been put on trying to understand the nature of performance bugs in d...

ver descrição completa

Detalhes bibliográficos
Autores: Sánchez Jerez, Ana Belén, Delgado Pérez, Pedro, Medina Bulo, Inmaculada, Segura Rueda, Sergio
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2020
País:España
Recursos:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/135105
Acesso em linha:https://hdl.handle.net/11441/135105
https://doi.org/10.1109/ACCESS.2020.3000928
Access Level:acceso abierto
Palavra-chave:Performance bugs
Performance testing
Dataset
Taxonomy
Descrição
Resumo:The detection of performance bugs, like those causing an unexpected execution time, has gained much attention in the last years due to their potential impact in safety-critical and resource-constrained applications. Much effort has been put on trying to understand the nature of performance bugs in different domains as a starting point for the development of effective testing techniques. However, the lack of a widely accepted classification scheme of performance faults and, more importantly, the lack of well-documented and understandable datasets makes it difficult to draw rigorous and verifiable conclusions widely accepted by the community. In this paper, we present TANDEM, a dual contribution related to real-world performance bugs. Firstly, we propose a taxonomy of performance bugs based on a thorough systematic review of the related literature, divided into three main categories: effects, causes and contexts of bugs. Secondly, we provide a complete collection of fully documented real-world performance bugs. Together, these contributions pave the way for the development of stronger and reproducible research results on performance testing.