Research assessment under debate: disentangling the interest around the DORA declaration on Twitter

[EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified,...

Descripción completa

Detalles Bibliográficos
Autores: Orduña-Malea, Enrique|||0000-0002-1989-8477, Bautista-Puig, Núria
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/219984
Acceso en línea:https://riunet.upv.es/handle/10251/219984
Access Level:acceso abierto
Palabra clave:DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
id ES_098bb83d208fa1eabdc3b5ebaeff7e71
oai_identifier_str oai:riunet.upv.es:10251/219984
network_acronym_str ES
network_name_str España
repository_id_str
spelling Research assessment under debate: disentangling the interest around the DORA declaration on TwitterOrduña-Malea, Enrique|||0000-0002-1989-8477Bautista-Puig, NúriaDORA declarationScientometricsSocial media metricsTwitterResearch evaluation[EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.Conselleria de Innovacion, Universidades, Ciencia y Sociedad Digital, Generalitat Valenciana, GV/2021/141, Enrique Orduna-Malea.Springer-VerlagDepartamento de Comunicación Audiovisual, Documentación e Historia del ArteFacultad de Bellas ArtesGENERALITAT VALENCIANARepositorio Institucional de la Universitat Politècnica de València Riunet20242024-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/219984reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengGeneralitat Valenciana https://doi.org/10.13039/501100003359 GV%2F2021%2F141 Posicionamiento académico web de las universidades españolas: diseño y aplicación de un modelo de análisis multinivel y multidimensional (UniverSEO)open accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/2199842026-06-13T07:49:27Z
dc.title.none.fl_str_mv Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
spellingShingle Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
Orduña-Malea, Enrique|||0000-0002-1989-8477
DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
title_short Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_full Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_fullStr Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_full_unstemmed Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_sort Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
dc.creator.none.fl_str_mv Orduña-Malea, Enrique|||0000-0002-1989-8477
Bautista-Puig, Núria
author Orduña-Malea, Enrique|||0000-0002-1989-8477
author_facet Orduña-Malea, Enrique|||0000-0002-1989-8477
Bautista-Puig, Núria
author_role author
author2 Bautista-Puig, Núria
author2_role author
dc.contributor.none.fl_str_mv Departamento de Comunicación Audiovisual, Documentación e Historia del Arte
Facultad de Bellas Artes
GENERALITAT VALENCIANA
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
topic DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
description [EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.
publishDate 2024
dc.date.none.fl_str_mv 2024
2024-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/219984
url https://riunet.upv.es/handle/10251/219984
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Generalitat Valenciana https://doi.org/10.13039/501100003359 GV%2F2021%2F141 Posicionamiento académico web de las universidades españolas: diseño y aplicación de un modelo de análisis multinivel y multidimensional (UniverSEO)
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Springer-Verlag
publisher.none.fl_str_mv Springer-Verlag
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869403111916830720
score 15,81155

Similares en LA Referencia