Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Klein, Richard; Vianello, Michelangelo; Hasselman, Fred; G. Adams, Byron; B. Adams, Reginald; Alper, Sinan; Aveyard, Mark; Axt, Jordan; T. Babalola, Mayowa; Bahník, Štěpán; Batra, Rishtee; Berkics, Mihály; J. Bernstein, Michael; R. Berry, Daniel; Białobrzeska, Olga; Dami Binan, Evans; Bocian, Konrad; J. Brandt, Mark; Busching, Robert; Cabak Rédei, Anna; Cai, Huajian; Cambier, Fanny; Cantarero, Katarzyna; L. Carmichael, Cheryl; Cerić, Francisco; Chandler, Jesse; Chang, Jen‐Ho; Chatard, Armand; E. Chen, Eva; Cheong, Winnee; C. Cicero, David; Coen, Sharon; A. Coleman, Jennifer; Collisson, Brian; Conway, Morgan; S. Corker, Katherine; Curran, Paul; Cushman, Fiery; Kwambo Dagona, Zubairu; Dalḡar, İlker; Dalla Rosa, Anna; E. Davis, William; de Bruijn, Maaike; De Schutter, Leander; Devos, Thierry; de Vries, Marieke; Doğulu, Canay; Dozo, Nerisa; Nicole Dukes, Kristin; Dunham, Yarrow; Durrheim, Kevin; R. Ebersole, Charles; E. Edlund, John; Eller, Anja; Scott English, Alexander; Finck, Carolyn; Frankowska, Natalia; Freyre, Miguel-Ángel; Friedman, Mike; Maria Galliani, Elisa; C. Gandi, Joshua; Ghoshal, Tanuka; R. Giessner, Steffen; Gill, Tripat; Gnambs, Timo; Gómez, Ángel; González, Roberto; Graham, Jesse; Grahe, Jon; Grahek, Ivan; G. T. Green, Eva; Hai, Kakul; Haigh, Matthew; L. Haines, Elizabeth; P. Hall, Michael; E. Heffernan, Marie; A. Hicks, Joshua; Houdek, Petr; R. Huntsinger, Jeffrey; Phi Huynh, Ho; IJzerman, Hans; Inbar, Yoel; Innes-Ker, Åse; Jiménez‐Leal, William; John, Melissa-Sue; A. Joy-Gaba, Jennifer; Gizem Kamiloglu, Roza; Barry Kappes, Heather; Karabatı, Serdar; Karick, Haruna; N. Keller, Victor; Kende, Anna; Kervyn, Nicolas; Knežević, Goran; Kovacs, Carrie; E. Krueger, Lacy; Kurapov, German; Kurtz, Jamie; Lakens, Daniël; B. Lazarević, Ljiljana; Levitan, Carmel; A. Lewis, Neil; Lins, Samuel; P. Lipsey, Nikolette; E. Losee, Joy; Maassen, Esther; T. Maitner, Angela; Malingumu, Winfrida; K. Mallett, Robyn; A. Marotta, Satia; Međedović, Janko; Mena-Pacheco, Fernando; L. Milfont, Taciano; L. Morris, Wendy; C. Murphy, Sean; Myachykov, Andriy; Neave, Nick; Ilja Neijenhuijs, Koen; Nelson, A.; Neto, Félix; Nichols, Austin; Ocampo, Aaron; O’Donnell, Susan; Oikawa, Haruka; Oikawa, Masanori; Ong, Elsie; Orosz, Gábor; Osowiecka, Małgorzata; Packard, Grant; Pérez Sánchez, Rolando; Petrović, Boban; Pilati, Ronaldo; Pinter, Brad; Podesta, Lysandra; Pogge, Gabrielle; Pollmann, Monique; M. Rutchick, Abraham; Saavedra, Patricio; K. Saeri, Alexander; Salomon, Erika; Schmidt, Kathleen; D. Schönbrodt, Felix; Sekerdej, Maciej; Sirlopú, David; Skorinko, Jeanine; Smith, Michael; Smith‐Castro, Vanessa; Smolders, K.C.H.J.; Sobków, Agata; J. Sowden, Walter; Spachtholz, Philipp; Srivastava, Manini; G. Steiner, Troy; Stouten, Jeroen; Street, Chris; Sundfelt, Oskar; Szeto, Stephanie; Szumowska, Ewa; C. W. Tang, Andrew; K. Tanzer, Norbert; J. Tear, Morgan; E. Theriault, Jordan; Thomae, Manuela; Torres, David; Traczyk, Jakub; M. Tybur, Joshua; Ujhelyi, Adrienn; C. M. van Aert, Robbie; A. L. M. van Assen, Marcel; van der Hulst, Marije; A. M. Van Lange, Paul; van 't Veer, Anna; Vásquez Echeverría, Alejandro; Ann Vaughn, Leigh; Vázquez, Alexandra; Diego Vega, Luis; Verniers, Catherine; Verschoor, Mark; Voermans, Ingrid; Vranka, Marek; Alyssa Welch, Cheryl; L. Wichman, Aaron; A. Williams, Lisa; Wood, Michael; A. Woodzicka, Julie; Katarzyna Wronska, Marta; Young, Liane; M. Zelenski, John; Zhijia, Zeng; A. Nosek, Brian

doi:10.1177/2515245918810225

Public

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Published in Advances in Methods and Practices in Psychological Science • Dec 1, 2018

Authors:

Richard Klein

Michelangelo Vianello

Fred Hasselman

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,3...

Subject

Statistics

Replication (statistics)

Statistical significance

Research Assistant

AI chat, annotations, notes & similar papers

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!