FlakyLoc: flakiness localization for reliable test suites in web applications
Web application testing is a great challenge due to the management of complex asynchronous communications, the concurrency between the clients-servers, and the heterogeneity of resources employed. It is difficult to ensure that a test case is re-running in the same conditions because it can be execu...
| Autores: | , , , , |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2020 |
| País: | España |
| Institución: | Universidad de Oviedo (UNIOVI) |
| Repositorio: | RUO. Repositorio Institucional de la Universidad de Oviedo |
| Idioma: | inglés |
| OAI Identifier: | oai:digibuo.uniovi.es:10651/57031 |
| Acceso en línea: | http://hdl.handle.net/10651/57031 https://dx.doi.org/10.13052/jwe1540-9589.1927 |
| Access Level: | acceso abierto |
| Palabra clave: | Software testing and debugging Spectrum-based localization Web applications Test flakiness |
| id |
ES_a1dbc951d17f2e669f958b91ee86ee45 |
|---|---|
| oai_identifier_str |
oai:digibuo.uniovi.es:10651/57031 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
FlakyLoc: flakiness localization for reliable test suites in web applicationsMorán Barbón, Jesús|||0000-0002-7544-3901Augusto Alonso, Cristian|||0000-0001-6140-1375Bertolino, AntoniaRiva Álvarez, Claudio A. de la|||0000-0001-5592-9683Tuya González, Pablo Javier|||0000-0002-1091-934XSoftware testing and debuggingSpectrum-based localizationWeb applicationsTest flakinessWeb application testing is a great challenge due to the management of complex asynchronous communications, the concurrency between the clients-servers, and the heterogeneity of resources employed. It is difficult to ensure that a test case is re-running in the same conditions because it can be executed in undesirable ways according to several environmental factors that are not easy to fine-grain control such as network bottlenecks, memory issues or screen resolution. These environmental factors can cause flakiness, which occurs when the same test case sometimes obtains one test outcome and other times another outcome in the same application due to the execution of environmental factors. The tester usually stops relying on flaky test cases because their outcome varies during the re-executions. To fix and reduce the flakiness it is very important to locate and understand which environmental factors cause the flakiness. This paper is focused on the localization of the root cause of flakiness in web applications based on the characterization of the different environmental factors that are not controlled during testing. The root cause of flakiness is located by means of spectrum-based localization techniques that analyse the test execution under different combinations of the environmental factors that can trigger the flakiness. This technique is evaluated with an educational web platform called FullTeaching. As a result, our technique was able to locate automatically the root cause of flakiness and provide enough information to both understand it and fix it.Este trabajo fue financiado en parte por el Ministerio de Economía y Competitividad de España bajo proyecto TestEAMoS (TIN2016-76956-C3-1-R) y proyecto POLOLAS (TIN2016- 76956-C3-2-R), fondos FEDER, y por el Proyecto Europeo ElasTest en el Horizonte 2020 programa de investigación e innovación (GA No. 731535).River Publishers20202020-01-01journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articlehttp://hdl.handle.net/10651/57031https://dx.doi.org/10.13052/jwe1540-9589.1927reponame:RUO. Repositorio Institucional de la Universidad de Oviedoinstname:Universidad de Oviedo (UNIOVI)InglésengEuropean Commission http://dx.doi.org/10.13039/501100000780 Horizon 2020 Framework Programme 731535open accesshttp://purl.org/coar/access_right/c_abf2Attribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:digibuo.uniovi.es:10651/570312026-06-07T06:38:51Z |
| dc.title.none.fl_str_mv |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| title |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| spellingShingle |
FlakyLoc: flakiness localization for reliable test suites in web applications Morán Barbón, Jesús|||0000-0002-7544-3901 Software testing and debugging Spectrum-based localization Web applications Test flakiness |
| title_short |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| title_full |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| title_fullStr |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| title_full_unstemmed |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| title_sort |
FlakyLoc: flakiness localization for reliable test suites in web applications |
| dc.creator.none.fl_str_mv |
Morán Barbón, Jesús|||0000-0002-7544-3901 Augusto Alonso, Cristian|||0000-0001-6140-1375 Bertolino, Antonia Riva Álvarez, Claudio A. de la|||0000-0001-5592-9683 Tuya González, Pablo Javier|||0000-0002-1091-934X |
| author |
Morán Barbón, Jesús|||0000-0002-7544-3901 |
| author_facet |
Morán Barbón, Jesús|||0000-0002-7544-3901 Augusto Alonso, Cristian|||0000-0001-6140-1375 Bertolino, Antonia Riva Álvarez, Claudio A. de la|||0000-0001-5592-9683 Tuya González, Pablo Javier|||0000-0002-1091-934X |
| author_role |
author |
| author2 |
Augusto Alonso, Cristian|||0000-0001-6140-1375 Bertolino, Antonia Riva Álvarez, Claudio A. de la|||0000-0001-5592-9683 Tuya González, Pablo Javier|||0000-0002-1091-934X |
| author2_role |
author author author author |
| dc.subject.none.fl_str_mv |
Software testing and debugging Spectrum-based localization Web applications Test flakiness |
| topic |
Software testing and debugging Spectrum-based localization Web applications Test flakiness |
| description |
Web application testing is a great challenge due to the management of complex asynchronous communications, the concurrency between the clients-servers, and the heterogeneity of resources employed. It is difficult to ensure that a test case is re-running in the same conditions because it can be executed in undesirable ways according to several environmental factors that are not easy to fine-grain control such as network bottlenecks, memory issues or screen resolution. These environmental factors can cause flakiness, which occurs when the same test case sometimes obtains one test outcome and other times another outcome in the same application due to the execution of environmental factors. The tester usually stops relying on flaky test cases because their outcome varies during the re-executions. To fix and reduce the flakiness it is very important to locate and understand which environmental factors cause the flakiness. This paper is focused on the localization of the root cause of flakiness in web applications based on the characterization of the different environmental factors that are not controlled during testing. The root cause of flakiness is located by means of spectrum-based localization techniques that analyse the test execution under different combinations of the environmental factors that can trigger the flakiness. This technique is evaluated with an educational web platform called FullTeaching. As a result, our technique was able to locate automatically the root cause of flakiness and provide enough information to both understand it and fix it. |
| publishDate |
2020 |
| dc.date.none.fl_str_mv |
2020 2020-01-01 |
| dc.type.none.fl_str_mv |
journal article http://purl.org/coar/resource_type/c_6501 AM http://purl.org/coar/version/c_ab4af688f83e57aa |
| dc.type.openaire.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/10651/57031 https://dx.doi.org/10.13052/jwe1540-9589.1927 |
| url |
http://hdl.handle.net/10651/57031 https://dx.doi.org/10.13052/jwe1540-9589.1927 |
| dc.language.none.fl_str_mv |
Inglés eng |
| language_invalid_str_mv |
Inglés |
| language |
eng |
| dc.relation.none.fl_str_mv |
European Commission http://dx.doi.org/10.13039/501100000780 Horizon 2020 Framework Programme 731535 |
| dc.rights.none.fl_str_mv |
open access http://purl.org/coar/access_right/c_abf2 Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ |
| dc.rights.openaire.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
open access http://purl.org/coar/access_right/c_abf2 Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ |
| eu_rights_str_mv |
openAccess |
| dc.publisher.none.fl_str_mv |
River Publishers |
| publisher.none.fl_str_mv |
River Publishers |
| dc.source.none.fl_str_mv |
reponame:RUO. Repositorio Institucional de la Universidad de Oviedo instname:Universidad de Oviedo (UNIOVI) |
| instname_str |
Universidad de Oviedo (UNIOVI) |
| reponame_str |
RUO. Repositorio Institucional de la Universidad de Oviedo |
| collection |
RUO. Repositorio Institucional de la Universidad de Oviedo |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869415214686928896 |
| score |
15,301603 |