1. Главная
  2. Ресурсы
  3. Библиотечный поиск
Many Labs 2:InvestigatingVariation inReplicability AcrossSamples and Settings Richard KleinMichelangelo VianelloFred Hasselman2018 год

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings
статья из журнала

Полный текстСтраница публикацииПубликация в OpenAlex
Аннотация: We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance ( p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion ( p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.
Год издания: 2018
Авторы: Richard Klein, Michelangelo Vianello, Fred Hasselman, Byron G. Adams, Reginald B. Adams, Sinan Alper, Mark Aveyard, Jordan Axt, Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Mihály Berkics, Michael J. Bernstein, Daniel R. Berry, Olga Białobrzeska, Evans Dami Binan, Konrad Bocian, Mark J. Brandt, Robert Busching, Anna Cabak Rédei, Huajian Cai, Fanny Cambier, Katarzyna Cantarero, Cheryl L. Carmichael, Francisco Céric, Jesse Chandler, Jen‐Ho Chang, Armand Chatard, Eva E. Chen, Winnee Cheong, David C. Cicero, Sharon Coen, Jennifer A. Coleman, Brian Collisson, Morgan Conway, Katherine S. Corker, Paul Curran, Fiery Cushman, Zubairu Kwambo Dagona, Ilker Dalgar, Anna Dalla Rosa, William E. Davis, Maaike de Bruijn, Leander De Schutter, Thierry Devos, Marieke de Vries, Canay Doğulu, Nerisa Dozo, Kristin Nicole Dukes, Yarrow Dunham, Kevin Durrheim, Charles R. Ebersole, John E. Edlund, Anja Eller, Alexander Scott English, Carolyn Finck, Natalia Frankowska, Miguel-Ángel Freyre, Michael Friedman, Elisa Maria Galliani, Joshua C. Gandi, Tanuka Ghoshal, Steffen R. Giessner, Tripat Gill, Timo Gnambs, Ángel Gómez, Roberto González, Jesse Graham, Jon Grahe, Ivan Grahek, Eva G. T. Green, Kakul Hai, Matthew Haigh, Elizabeth L. Haines, Michael P. Hall, Marie E. Heffernan, Joshua A. Hicks, Petr Houdek, Jeffrey R. Huntsinger, Ho Phi Huynh, Hans IJzerman, Yoel Inbar, Åse Innes-Ker, William Jiménez‐Leal, Melissa-Sue John, Jennifer A. Joy-Gaba, Roza Gizem Kamiloglu, Heather Barry Kappes, Serdar Karabatı, Haruna Karick, Victor N. Keller, Anna Kende, Nicolas Kervyn, Goran Knežević, Carrie Kovacs, Lacy E. Krueger, German Kurapov, Jamie Kurtz, Daniël Lakens, Ljiljana B. Lazarević, Carmel Levitan, Neil A. Lewis, Samuel Lins, Nikolette P. Lipsey, Joy E. Losee, Esther Maassen, Angela T. Maitner, Winfrida Malingumu, Robyn K. Mallett, Satia A. Marotta, Janko Međedović, Fernando Mena-Pacheco, Taciano L. Milfont, Wendy L. Morris, Sean C. Murphy, Andriy Myachykov, Nick Neave, Koen Ilja Neijenhuijs, A. Nelson, Félix Neto, Austin Nichols, Aaron Ocampo, Susan O’Donnell, Haruka Oikawa, Masanori Oikawa, Elsie Ong, Gábor Orosz, Małgorzata Osowiecka, Grant Packard, Rolando Pérez Sánchez, Boban Petrović, Ronaldo Pilati, Brad Pinter, Lysandra Podesta, Gabrielle Pogge, Monique Pollmann, Abraham M. Rutchick, Patricio Saavedra, Alexander K. Saeri, Erika Salomon, Kathleen Schmidt, Felix D. Schönbrodt, Maciej Sekerdej, David Sirlopú, Jeanine Skorinko, Michael Smith, Vanessa Smith‐Castro, K.C.H.J. Smolders, Agata Sobków, Walter Sowden, Philipp Spachtholz, Manini Srivastava, Troy G. Steiner, Jeroen Stouten, Chris Street, Oskar Sundfelt, Stephanie Szeto, Ewa Szumowska, Andrew C. W. Tang, Norbert K. Tanzer, Morgan J. Tear, Jordan E. Theriault, Manuela Thomae, David Torres, Jakub Traczyk, Joshua M. Tybur, Adrienn Ujhelyi, Robbie C. M. van Aert, Marcel A. L. M. van Assen, Marije van der Hulst, Paul A. M. Van Lange, Anna van 't Veer, Alejandro Vásquez Echeverría, Leigh Ann Vaughn, Alexandra Vázquez, Luis Diego Vega, Catherine Verniers, Mark Verschoor, Ingrid Voermans, Marek Vranka, Cheryl Alyssa Welch, Aaron L. Wichman, Lisa A. Williams, Michael Wood, Julie A. Woodzicka, Marta Katarzyna Wronska, Liane Young, John M. Zelenski, Zhijia Zeng, Brian A. Nosek
Издательство: SAGE Publishing
Источник: Advances in Methods and Practices in Psychological Science
Ключевые слова: Impact of Technology on Adolescents, Digital Mental Health Interventions, Social Media and Politics
Другие ссылки: Advances in Methods and Practices in Psychological Science (PDF)
Advances in Methods and Practices in Psychological Science (HTML)
HAL (Le Centre pour la Communication Scientifique Directe) (HTML)
EUR Research Repository (Erasmus University Rotterdam) (HTML)
Open Repository of the University of Porto (University of Porto) (PDF)
Open Repository of the University of Porto (University of Porto) (HTML)
Radboud Repository (Radboud University) (PDF)
Radboud Repository (Radboud University) (HTML)
research.tue.nl (PDF)
research.tue.nl (HTML)
research.vu.nl (PDF)
research.vu.nl (HTML)
VU Research Portal (PDF)
VU Research Portal (HTML)
VU Research Portal (HTML)
Ghent University Academic Bibliography (Ghent University) (HTML)
Monash University Research Portal (Monash University) (HTML)
Research portal (Tilburg University) (HTML)
Research portal (Tilburg University) (PDF)
Research portal (Tilburg University) (HTML)
Ghent University Academic Bibliography (Ghent University) (PDF)
Ghent University Academic Bibliography (Ghent University) (HTML)
pure.tue.nl (HTML)
Monash University Research Portal (Monash University) (PDF)
Monash University Research Portal (Monash University) (HTML)
Wiardi Beckman Foundation (Wiardi Beckman Foundation) (HTML)
VU Research Portal (HTML)
Padua Research Archive (University of Padova) (PDF)
Padua Research Archive (University of Padova) (HTML)
UNSWorks (University of New South Wales, Sydney, Australia) (HTML)
Radboud Repository (Radboud University) (HTML)
Investigative News in Education (Universidad de Costa Rica) (PDF)
Investigative News in Education (Universidad de Costa Rica) (HTML)
London School of Economics and Political Science Research Online (London School of Economics and Political Science) (HTML)
Northumbria Research Link (Northumbria University) (HTML)
Lirias (KU Leuven) (PDF)
Lirias (KU Leuven) (HTML)
Data Archiving and Networked Services (DANS) (PDF)
Data Archiving and Networked Services (DANS) (HTML)
Wiardi Beckman Foundation (Wiardi Beckman Foundation) (PDF)
Wiardi Beckman Foundation (Wiardi Beckman Foundation) (HTML)