Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability

As the preponderance of journal rankings becomes increasingly more frequent and prominent in academic decision making, such rankings in broad discipline categories is taking on an increasingly important role. The paper focuses on the robustness of rankings of academic journal quality and research im...

Descripción completa

Detalles Bibliográficos
Autores: Chang, Chia-Lin, McAleer, Michael
Tipo de recurso: informe técnico
Fecha de publicación:2012
País:España
Institución:Universidad Complutense de Madrid (UCM)
Repositorio:Docta Complutense
Idioma:inglés
OAI Identifier:oai:docta.ucm.es:20.500.14352/49090
Acceso en línea:https://hdl.handle.net/20.500.14352/49090
Access Level:acceso abierto
Palabra clave:C18
C43
C81
Y10
Research assessment measures
impact factor
IFI
C3PO
PI-BETA
STAR
Eigenfactor
Article Influence
h-index
5YD2
ESC
harmonic mean of the ranks
Statistics & Probability
robust journal rankings.
Bases de datos (Biblioteconomía y Documentación)
Econometría (Economía)
Recuperación de la información
1203.12 Bancos de Datos
5302 Econometría
id ES_5ea0423ffc2e3cfcd2f8eb9706ccf908
oai_identifier_str oai:docta.ucm.es:20.500.14352/49090
network_acronym_str ES
network_name_str España
repository_id_str
spelling Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & ProbabilityChang, Chia-LinMcAleer, MichaelC18C43C81Y10Research assessment measuresimpact factorIFIC3POPI-BETASTAREigenfactorArticle Influenceh-index5YD2ESCharmonic mean of the ranksStatistics & Probabilityrobust journal rankings.Bases de datos (Biblioteconomía y Documentación)Econometría (Economía)Recuperación de la información1203.12 Bancos de Datos5302 EconometríaAs the preponderance of journal rankings becomes increasingly more frequent and prominent in academic decision making, such rankings in broad discipline categories is taking on an increasingly important role. The paper focuses on the robustness of rankings of academic journal quality and research impact using on the widely-used Thomson Reuters ISI Web of Science citations database (ISI) for the Statistics & Probability category. The paper analyses 110 ISI international journals in Statistics & Probability using quantifiable Research Assessment Measures (RAMs), and highlights the similarities and differences in various RAMs, which are based on alternative transformations of citations and influence. Alternative RAMs may be calculated annually or updated daily to determine When, Where and How (frequently) published papers are cited (see Chang et al. (2011a, b, c), Chang et al. (2012)). The RAMs are grouped in four distinct classes that include impact factor, mean citations and non-citations, journal policy, number of high quality papers, and journal influence and article influence. These classes include the most widely used RAMs, namely the classic 2-year impact factor including journal self citations (2YIF), 2-year impact factor excluding journal self citations (2YIF*), 5-year impact factor including journal self citations (5YIF), Eigenfactor (or Journal Influence), Article Influence, h-index, PI-BETA (Papers Ignored - By Even The Authors), 5YD2 (= 5YIF/2YIF) as a measure of citations longevity, and Escalating Self Citations (ESC) as a measure of increasing journal self citations. The paper highlights robust rankings based on the harmonic mean of the ranks of RAMs across the 4 classes. It is shown that focusing solely on the 2-year impact factor (2YIF) of a journal, which partly answers the question as to When published papers are cited, to the exclusion of other informative RAMs, which answer Where and How (frequently) published papers are cited, can lead to a distorted evaluation of journal quality, impact and influence relative to the more robust harmonic mean of the ranks.Universidad Complutense de Madrid20122012-05-0120122012-05-01technical reporthttp://purl.org/coar/resource_type/c_18ghinfo:eu-repo/semantics/reportapplication/pdfhttps://hdl.handle.net/20.500.14352/49090reponame:Docta Complutenseinstname:Universidad Complutense de Madrid (UCM)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Atribución-NoComercial 3.0 Españahttps://creativecommons.org/licenses/by-nc/3.0/es/info:eu-repo/semantics/openAccessoai:docta.ucm.es:20.500.14352/490902026-06-02T12:44:21Z
dc.title.none.fl_str_mv Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
title Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
spellingShingle Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
Chang, Chia-Lin
C18
C43
C81
Y10
Research assessment measures
impact factor
IFI
C3PO
PI-BETA
STAR
Eigenfactor
Article Influence
h-index
5YD2
ESC
harmonic mean of the ranks
Statistics & Probability
robust journal rankings.
Bases de datos (Biblioteconomía y Documentación)
Econometría (Economía)
Recuperación de la información
1203.12 Bancos de Datos
5302 Econometría
title_short Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
title_full Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
title_fullStr Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
title_full_unstemmed Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
title_sort Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability
dc.creator.none.fl_str_mv Chang, Chia-Lin
McAleer, Michael
author Chang, Chia-Lin
author_facet Chang, Chia-Lin
McAleer, Michael
author_role author
author2 McAleer, Michael
author2_role author
dc.contributor.none.fl_str_mv Universidad Complutense de Madrid
dc.subject.none.fl_str_mv C18
C43
C81
Y10
Research assessment measures
impact factor
IFI
C3PO
PI-BETA
STAR
Eigenfactor
Article Influence
h-index
5YD2
ESC
harmonic mean of the ranks
Statistics & Probability
robust journal rankings.
Bases de datos (Biblioteconomía y Documentación)
Econometría (Economía)
Recuperación de la información
1203.12 Bancos de Datos
5302 Econometría
topic C18
C43
C81
Y10
Research assessment measures
impact factor
IFI
C3PO
PI-BETA
STAR
Eigenfactor
Article Influence
h-index
5YD2
ESC
harmonic mean of the ranks
Statistics & Probability
robust journal rankings.
Bases de datos (Biblioteconomía y Documentación)
Econometría (Economía)
Recuperación de la información
1203.12 Bancos de Datos
5302 Econometría
description As the preponderance of journal rankings becomes increasingly more frequent and prominent in academic decision making, such rankings in broad discipline categories is taking on an increasingly important role. The paper focuses on the robustness of rankings of academic journal quality and research impact using on the widely-used Thomson Reuters ISI Web of Science citations database (ISI) for the Statistics & Probability category. The paper analyses 110 ISI international journals in Statistics & Probability using quantifiable Research Assessment Measures (RAMs), and highlights the similarities and differences in various RAMs, which are based on alternative transformations of citations and influence. Alternative RAMs may be calculated annually or updated daily to determine When, Where and How (frequently) published papers are cited (see Chang et al. (2011a, b, c), Chang et al. (2012)). The RAMs are grouped in four distinct classes that include impact factor, mean citations and non-citations, journal policy, number of high quality papers, and journal influence and article influence. These classes include the most widely used RAMs, namely the classic 2-year impact factor including journal self citations (2YIF), 2-year impact factor excluding journal self citations (2YIF*), 5-year impact factor including journal self citations (5YIF), Eigenfactor (or Journal Influence), Article Influence, h-index, PI-BETA (Papers Ignored - By Even The Authors), 5YD2 (= 5YIF/2YIF) as a measure of citations longevity, and Escalating Self Citations (ESC) as a measure of increasing journal self citations. The paper highlights robust rankings based on the harmonic mean of the ranks of RAMs across the 4 classes. It is shown that focusing solely on the 2-year impact factor (2YIF) of a journal, which partly answers the question as to When published papers are cited, to the exclusion of other informative RAMs, which answer Where and How (frequently) published papers are cited, can lead to a distorted evaluation of journal quality, impact and influence relative to the more robust harmonic mean of the ranks.
publishDate 2012
dc.date.none.fl_str_mv 2012
2012-05-01
2012
2012-05-01
dc.type.none.fl_str_mv technical report
http://purl.org/coar/resource_type/c_18gh
dc.type.openaire.fl_str_mv info:eu-repo/semantics/report
format report
dc.identifier.none.fl_str_mv https://hdl.handle.net/20.500.14352/49090
url https://hdl.handle.net/20.500.14352/49090
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Atribución-NoComercial 3.0 España
https://creativecommons.org/licenses/by-nc/3.0/es/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Atribución-NoComercial 3.0 España
https://creativecommons.org/licenses/by-nc/3.0/es/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Docta Complutense
instname:Universidad Complutense de Madrid (UCM)
instname_str Universidad Complutense de Madrid (UCM)
reponame_str Docta Complutense
collection Docta Complutense
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869409141894676480
score 15,811543

Similares en LA Referencia