Manipulating the alpha level cannot cure significance testing
We argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels...
| Autores: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Tipo de recurso: | artículo |
| Estado: | Versión publicada |
| Fecha de publicación: | 2017 |
| País: | España |
| Institución: | Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya) |
| Repositorio: | Recercat. Dipósit de la Recerca de Catalunya |
| OAI Identifier: | oai:recercat.cat:2445/149084 |
| Acceso en línea: | https://hdl.handle.net/2445/149084 |
| Access Level: | acceso abierto |
| Palabra clave: | Tests d'hipòtesi (Estadística) Statistical hypothesis testing |
| id |
ES_2662e9ed7b74b8ef24b91caba2fb409f |
|---|---|
| oai_identifier_str |
oai:recercat.cat:2445/149084 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Manipulating the alpha level cannot cure significance testingTrafimow, DavidAmrhein, ValentinAreshenkoff, Corson N.Barrera-Causil, Carlos J.Beh, Eric J.Bilgiç, Yusuf K.Bono Cabré, RoserBradley, Michael T.Briggs, William M.Cepeda-Freyre, Héctor A.Chaigneau, Sergio E.Ciocca, Daniel R.Correa, Juan Carlosde Boer, Michiel R.Dhar, Subhra SankarDolgov, IgorGómez Benito, JuanaGrendar, MarianGrice, James W.Guerrero Giménez, Martín E.Gutiérrez, AndrésHuedo-Medina, Tania B.Jaffe, KlausJanyan, ArminaKarimnezhad, AliKorner-Nievergelt, FränziKosugi, KojiLachmair, MartinLedesma, Rubén D.Limongi, RobertoLiuzza, Marco TullioLombardo, RosariaMarks, MichaelMeinlschmidt, GuntherNalborczyk, LadislasNguyen, Hung T.Ospina, RaydonalPérez-González, José D.Pfister, RolandRahona, Juan JoséCousineau, DenisTests d'hipòtesi (Estadística)Statistical hypothesis testingWe argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and determining sample sizes much more directly than significance testing does; but none of the statistical tools should replace significance testing as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, or implications for applications. To boil all this down to a binary decision based on a p-value threshold of .05, .01, .005, or anything else, is not acceptable.PeerJ2020202020172020info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersion22 p.application/pdfapplication/pdfhttps://hdl.handle.net/2445/149084Articles publicats en revistes (Psicologia Social i Psicologia Quantitativa)reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésReproducció del document publicat a: https://doi.org/10.7287/peerj.preprints.3411v1PeerJ, 2017, vol. 5, p. e3411v3https://doi.org/10.7287/peerj.preprints.3411v1cc-by (c) Trafimow, D. et al., 2017http://creativecommons.org/licenses/by/3.0/esinfo:eu-repo/semantics/openAccessoai:recercat.cat:2445/1490842026-05-29T05:05:01Z |
| dc.title.none.fl_str_mv |
Manipulating the alpha level cannot cure significance testing |
| title |
Manipulating the alpha level cannot cure significance testing |
| spellingShingle |
Manipulating the alpha level cannot cure significance testing Trafimow, David Tests d'hipòtesi (Estadística) Statistical hypothesis testing |
| title_short |
Manipulating the alpha level cannot cure significance testing |
| title_full |
Manipulating the alpha level cannot cure significance testing |
| title_fullStr |
Manipulating the alpha level cannot cure significance testing |
| title_full_unstemmed |
Manipulating the alpha level cannot cure significance testing |
| title_sort |
Manipulating the alpha level cannot cure significance testing |
| dc.creator.none.fl_str_mv |
Trafimow, David Amrhein, Valentin Areshenkoff, Corson N. Barrera-Causil, Carlos J. Beh, Eric J. Bilgiç, Yusuf K. Bono Cabré, Roser Bradley, Michael T. Briggs, William M. Cepeda-Freyre, Héctor A. Chaigneau, Sergio E. Ciocca, Daniel R. Correa, Juan Carlos de Boer, Michiel R. Dhar, Subhra Sankar Dolgov, Igor Gómez Benito, Juana Grendar, Marian Grice, James W. Guerrero Giménez, Martín E. Gutiérrez, Andrés Huedo-Medina, Tania B. Jaffe, Klaus Janyan, Armina Karimnezhad, Ali Korner-Nievergelt, Fränzi Kosugi, Koji Lachmair, Martin Ledesma, Rubén D. Limongi, Roberto Liuzza, Marco Tullio Lombardo, Rosaria Marks, Michael Meinlschmidt, Gunther Nalborczyk, Ladislas Nguyen, Hung T. Ospina, Raydonal Pérez-González, José D. Pfister, Roland Rahona, Juan José Cousineau, Denis |
| author |
Trafimow, David |
| author_facet |
Trafimow, David Amrhein, Valentin Areshenkoff, Corson N. Barrera-Causil, Carlos J. Beh, Eric J. Bilgiç, Yusuf K. Bono Cabré, Roser Bradley, Michael T. Briggs, William M. Cepeda-Freyre, Héctor A. Chaigneau, Sergio E. Ciocca, Daniel R. Correa, Juan Carlos de Boer, Michiel R. Dhar, Subhra Sankar Dolgov, Igor Gómez Benito, Juana Grendar, Marian Grice, James W. Guerrero Giménez, Martín E. Gutiérrez, Andrés Huedo-Medina, Tania B. Jaffe, Klaus Janyan, Armina Karimnezhad, Ali Korner-Nievergelt, Fränzi Kosugi, Koji Lachmair, Martin Ledesma, Rubén D. Limongi, Roberto Liuzza, Marco Tullio Lombardo, Rosaria Marks, Michael Meinlschmidt, Gunther Nalborczyk, Ladislas Nguyen, Hung T. Ospina, Raydonal Pérez-González, José D. Pfister, Roland Rahona, Juan José Cousineau, Denis |
| author_role |
author |
| author2 |
Amrhein, Valentin Areshenkoff, Corson N. Barrera-Causil, Carlos J. Beh, Eric J. Bilgiç, Yusuf K. Bono Cabré, Roser Bradley, Michael T. Briggs, William M. Cepeda-Freyre, Héctor A. Chaigneau, Sergio E. Ciocca, Daniel R. Correa, Juan Carlos de Boer, Michiel R. Dhar, Subhra Sankar Dolgov, Igor Gómez Benito, Juana Grendar, Marian Grice, James W. Guerrero Giménez, Martín E. Gutiérrez, Andrés Huedo-Medina, Tania B. Jaffe, Klaus Janyan, Armina Karimnezhad, Ali Korner-Nievergelt, Fränzi Kosugi, Koji Lachmair, Martin Ledesma, Rubén D. Limongi, Roberto Liuzza, Marco Tullio Lombardo, Rosaria Marks, Michael Meinlschmidt, Gunther Nalborczyk, Ladislas Nguyen, Hung T. Ospina, Raydonal Pérez-González, José D. Pfister, Roland Rahona, Juan José Cousineau, Denis |
| author2_role |
author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author |
| dc.subject.none.fl_str_mv |
Tests d'hipòtesi (Estadística) Statistical hypothesis testing |
| topic |
Tests d'hipòtesi (Estadística) Statistical hypothesis testing |
| description |
We argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and determining sample sizes much more directly than significance testing does; but none of the statistical tools should replace significance testing as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, or implications for applications. To boil all this down to a binary decision based on a p-value threshold of .05, .01, .005, or anything else, is not acceptable. |
| publishDate |
2017 |
| dc.date.none.fl_str_mv |
2017 2020 2020 2020 |
| dc.type.none.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.none.fl_str_mv |
https://hdl.handle.net/2445/149084 |
| url |
https://hdl.handle.net/2445/149084 |
| dc.language.none.fl_str_mv |
Inglés |
| language_invalid_str_mv |
Inglés |
| dc.relation.none.fl_str_mv |
Reproducció del document publicat a: https://doi.org/10.7287/peerj.preprints.3411v1 PeerJ, 2017, vol. 5, p. e3411v3 https://doi.org/10.7287/peerj.preprints.3411v1 |
| dc.rights.none.fl_str_mv |
cc-by (c) Trafimow, D. et al., 2017 http://creativecommons.org/licenses/by/3.0/es info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
cc-by (c) Trafimow, D. et al., 2017 http://creativecommons.org/licenses/by/3.0/es |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
22 p. application/pdf application/pdf |
| dc.publisher.none.fl_str_mv |
PeerJ |
| publisher.none.fl_str_mv |
PeerJ |
| dc.source.none.fl_str_mv |
Articles publicats en revistes (Psicologia Social i Psicologia Quantitativa) reponame:Recercat. Dipósit de la Recerca de Catalunya instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya) |
| instname_str |
Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya) |
| reponame_str |
Recercat. Dipósit de la Recerca de Catalunya |
| collection |
Recercat. Dipósit de la Recerca de Catalunya |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869404818806669312 |
| score |
15,81155 |