Analysing agreement among different evaluators in god class and feature envy detection

The automatic detection of Design Smells has evolved in parallel to the evolution of automatic refactoring tools. There was a huge rise in research activity regarding Design Smell detection from 2010 to the present. However, it should be noted that the adoption of Design Smell detection in real soft...

Descripción completa

Detalles Bibliográficos
Autores: Alkharabsheh, Khalid, Alawadi, Sadi, Crespo González Carvajal, Yania, Manso-Martínez, Mª Esperanza, Taboada González, José Ángel
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universidad de Santiago de Compostela (USC)
Repositorio:Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Idioma:inglés
OAI Identifier:oai:minerva.usc.gal:10347/27240
Acceso en línea:http://hdl.handle.net/10347/27240
Access Level:acceso abierto
id ES_7750ed9f2dcfaaa6a9a711bc7b1289ee
oai_identifier_str oai:minerva.usc.gal:10347/27240
network_acronym_str ES
network_name_str España
repository_id_str
spelling Analysing agreement among different evaluators in god class and feature envy detectionAlkharabsheh, KhalidAlawadi, SadiCrespo González Carvajal, YaniaManso-Martínez, Mª EsperanzaTaboada González, José ÁngelThe automatic detection of Design Smells has evolved in parallel to the evolution of automatic refactoring tools. There was a huge rise in research activity regarding Design Smell detection from 2010 to the present. However, it should be noted that the adoption of Design Smell detection in real software development practice is not comparable to the adoption of automatic refactoring tools. On the basis of the assumption that it is the objectiveness of a refactoring operation as opposed to the subjectivity in definition and identification of Design Smells that makes the difference, in this paper, the lack of agreement between different evaluators when detecting Design Smells is empirically studied. To do so, a series of experiments and studies were designed and conducted to analyse the concordance in Design Smell detection of different persons and tools, including a comparison between them. This work focuses on two well known Design Smells : God Class and Feature Envy . Concordance analysis is based on the Kappa statistic for inter-rater agreement (particularly Kappa-Fleiss ). The results obtained show that there is no agreement in detection in general, and, in those cases where a certain agreement appears, it is considered to be a fair or poor degree of agreement, according to a Kappa-Fleiss interpretation scale. This seems to confirm that there is a subjective component which makes the raters evaluate the presence of Design Smells differently. The study also raises the question of a lack of training and experience regarding Design SmellsIEEEUniversidade de Santiago de Compostela. Centro de Investigación en Tecnoloxías da Información20212021-01-0120212021-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10347/27240reponame:Minerva. Repositorio Institucional de la Universidad de Santiago de Compostelainstname:Universidad de Santiago de Compostela (USC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2© 2021 by the authors.This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/http://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:minerva.usc.gal:10347/272402026-06-15T12:47:27Z
dc.title.none.fl_str_mv Analysing agreement among different evaluators in god class and feature envy detection
title Analysing agreement among different evaluators in god class and feature envy detection
spellingShingle Analysing agreement among different evaluators in god class and feature envy detection
Alkharabsheh, Khalid
title_short Analysing agreement among different evaluators in god class and feature envy detection
title_full Analysing agreement among different evaluators in god class and feature envy detection
title_fullStr Analysing agreement among different evaluators in god class and feature envy detection
title_full_unstemmed Analysing agreement among different evaluators in god class and feature envy detection
title_sort Analysing agreement among different evaluators in god class and feature envy detection
dc.creator.none.fl_str_mv Alkharabsheh, Khalid
Alawadi, Sadi
Crespo González Carvajal, Yania
Manso-Martínez, Mª Esperanza
Taboada González, José Ángel
author Alkharabsheh, Khalid
author_facet Alkharabsheh, Khalid
Alawadi, Sadi
Crespo González Carvajal, Yania
Manso-Martínez, Mª Esperanza
Taboada González, José Ángel
author_role author
author2 Alawadi, Sadi
Crespo González Carvajal, Yania
Manso-Martínez, Mª Esperanza
Taboada González, José Ángel
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade de Santiago de Compostela. Centro de Investigación en Tecnoloxías da Información
description The automatic detection of Design Smells has evolved in parallel to the evolution of automatic refactoring tools. There was a huge rise in research activity regarding Design Smell detection from 2010 to the present. However, it should be noted that the adoption of Design Smell detection in real software development practice is not comparable to the adoption of automatic refactoring tools. On the basis of the assumption that it is the objectiveness of a refactoring operation as opposed to the subjectivity in definition and identification of Design Smells that makes the difference, in this paper, the lack of agreement between different evaluators when detecting Design Smells is empirically studied. To do so, a series of experiments and studies were designed and conducted to analyse the concordance in Design Smell detection of different persons and tools, including a comparison between them. This work focuses on two well known Design Smells : God Class and Feature Envy . Concordance analysis is based on the Kappa statistic for inter-rater agreement (particularly Kappa-Fleiss ). The results obtained show that there is no agreement in detection in general, and, in those cases where a certain agreement appears, it is considered to be a fair or poor degree of agreement, according to a Kappa-Fleiss interpretation scale. This seems to confirm that there is a subjective component which makes the raters evaluate the presence of Design Smells differently. The study also raises the question of a lack of training and experience regarding Design Smells
publishDate 2021
dc.date.none.fl_str_mv 2021
2021-01-01
2021
2021-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10347/27240
url http://hdl.handle.net/10347/27240
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
http://creativecommons.org/licenses/by/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv IEEE
publisher.none.fl_str_mv IEEE
dc.source.none.fl_str_mv reponame:Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
instname:Universidad de Santiago de Compostela (USC)
instname_str Universidad de Santiago de Compostela (USC)
reponame_str Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
collection Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869411113944219648
score 15.812455

Similares en LA Referencia