Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

Breznau, Nate; Mark Rinke, Eike; Wuttke, Alexander; Hoang Viet Nguyen, Hung; Adem, Muna; Adriaans, Jule; Álvarez-Benjumea, Amalia; Kenneth Andersen, Henrik; Auer, Daniel; Azevedo, Flávio; Bahnsen, Oke; Balzer, Dave; Bauer, Gerrit; Cornelius Bauer, Paul; Baumann, Markus; Baute, Sharon; Benoit, Verena; Bernauer, Julian; Berning, Carl; Berthold, Anna; S. Bethke, Felix; Biegert, Thomas; Blinzler, Katharina; N. Blumenberg, Johannes; Bobzien, Licia; Bohman, Andrea; Bol, Thijs; Bostic, Amie; Brzozowska, Zuzanna; Burgdorf, Katharina; Burger, Klaus; Busch, Kathrin; Carlos Castillo, Juan; Chan, Nathan; Christmann, Pablo; Connelly, Roxanne; S. Czymara, Christian; Damian, Elena; Ecker, Alejandro; Edelmann, Achim; A. Eger, Maureen; Ellerbrock, Simon; Forke, Anna; Förster, Andrea; Gaasendam, Chris; Gavras, Konstantin; Gayle, Vernon; Gessler, Theresa; Gnambs, Timo; Godefroidt, Amélie; Grömping, Max; Groß, Martin; Gruber, Stefan; Gummer, Tobias; Hadjar, Andreas; Paul Heisig, Jan; Hellmeier, Sebastian; Heyne, Stefanie; Hirsch, Magdalena; Hjerm, Mikael; Hochman, Oshrat; Hövermann, Andreas; Hunger, Sophia; Hunkler, Christian; Huth-Stöckle, Nora; S. Ignácz, Zsófia; Jacobs, Laura; Jacobsen, Jannes; Jaeger, Bastian; Jungkunz, Sebastian; Jungmann, Nils; Kauff, Mathias; Kleinert, Manuel; Klinger, Julia; Kolb, Jan-Philipp; Kołczyńska, Marta; Kuk, John; Kunißen, Katharina; Kurti Sinatra, Dafina; Langenkamp, Alexander; M. Lersch, Philipp; Löbel, Lea-Maria; Lutscher, Philipp; Mader, Matthias; E. Madia, Joan; Malancu, Natalia; Maldonado, Luis; Marahrens, Helge; Martin, Nicole; Martinez, Paul; Mayerl, Jochen; J. Mayorga, Oscar; McManus, Patricia; McWagner, Kyle; Meeusen, Cecil; Meierrieks, Daniel; Mellon, Jonathan; Merhout, Friedolin; Merk, Samuel; Meyer, Daniel; Micheli, Leticia; Mijs, Jonathan; Moya, Cristóbal; Neunhoeffer, Marcel; Nüst, Daniel; Nygård, Olav; Ochsenfeld, Fabian; Otte, Gunnar; Pechenkina, Anna; Prosser, Christopher; Raes, Louis; Ralston, Kevin; R. Ramos, Miguel; Roets, Arne; Rogers, Jonathan; Ropers, Guido; Samuel, Robin; Sand, Gregor; Schachter, Ariela; Schaeffer, Merlin; Schieferdecker, David; Schlueter, Elmar; Schmidt, Regine; Schmidt, Katja; Schmidt‐Catran, Alexander; Schmiedeberg, Claudia; Schneider, Jürgen; Schoonvelde, Martijn; Schulte-Cloos, Julia; Schumann, Sandy; Schunck, Reinhard; Schupp, Jürgen; Seuring, Julian; Silber, Henning; W. A. Sleegers, Willem; Sonntag, Nico; Staudt, Alexander; Steiber, Nadia; D. Steiner, Nils; Sternberg, Sebastian; Stiers, Dieter; Stojmenovska, Dragana; Storz, Nora; Striessnig, Erich; Stroppe, Anne-Kathrin; Teltemann, Janna; Tibajev, Andrey; Tung, Brian; Vagni, Giacomo; Van Assche, Jasper; van der Linden, Meta; van der Noll, Jolanda; Van Hootegem, Arno; Vogtenhuber, Stefan; Voicu, Bogdan; M. A. Wagemans, Fieke; Wehl, Nadja; Werner, Hannah; M. Wiernik, Brenton; Winter, Fabian; Wolf, Christof; Yamada, Yuki; Zhang, Nan; Ziller, Conrad; Zins, Stefan; Żółtak, Tomasz

doi:10.1073/pnas.2203150119

Public

Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

Published in Proceedings of the National Academy of Sciences • Oct 28, 2022

Authors:

Nate Breznau

Eike Mark Rinke

Alexander Wuttke

Abstract

This study explores how researchers' analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during...

Subject

Data science

Universe

Computer science

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!