Putting the self in self-correction : findings from the loss-of-confidence project

Rohrer, Julia M. and Tierney, Warren and Uhlmann, Eric L. and DeBruine, Lisa M. and Heyman, Tom and Jones, Benedict and Schmukle, Stefan C. and Silberzahn, Raphael and Willén, Rebecca M. and Carlsson, Rickard and Lucas, Richard E. and Strand, Julia and Vazire, Simine and Witt, Jessica K. and Zentall, Thomas R. and Chabris, Christopher F. and Yarkoni, Tal (2021) Putting the self in self-correction : findings from the loss-of-confidence project. Perspectives on Psychological Science, 16 (6). pp. 1255-1269. ISSN 1745-6924 (https://doi.org/10.1177/1745691620964106)

[thumbnail of Rohrer-etal-PPS-2021-Putting-the-self-in-self-correction-findings-from-the-loss-of-confidence-project]
Preview
 Text. Filename: Rohrer_etal_PPS_2021_Putting_the_self_in_self_correction_findings_from_the_loss_of_confidence_project.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (423kB)| Preview

Abstract

Science is often perceived to be a self-correcting enterprise. In principle, the assessment of scientific claims is supposed to proceed in a cumulative fashion, with the reigning theories of the day progressively approximating truth more accurately over time. In practice, however, cumulative self-correction tends to proceed less efficiently than one might naively suppose. Far from evaluating new evidence dispassionately and infallibly, individual scientists often cling stubbornly to prior findings. Here we explore the dynamics of scientific self-correction at an individual rather than collective level. In 13 written statements, researchers from diverse branches of psychology share why and how they have lost confidence in one of their own published findings. We qualitatively characterize these disclosures and explore their implications. A cross-disciplinary survey suggests that such loss-of-confidence sentiments are surprisingly common among members of the broader scientific population yet rarely become part of the public record. We argue that removing barriers to self-correction at the individual level is imperative if the scientific community as a whole is to achieve the ideal of efficient self-correction.

ORCID iDs

Rohrer, Julia M., Tierney, Warren, Uhlmann, Eric L., DeBruine, Lisa M., Heyman, Tom, Jones, Benedict ORCID logoORCID: https://orcid.org/0000-0001-7777-0220, Schmukle, Stefan C., Silberzahn, Raphael, Willén, Rebecca M., Carlsson, Rickard, Lucas, Richard E., Strand, Julia, Vazire, Simine, Witt, Jessica K., Zentall, Thomas R., Chabris, Christopher F. and Yarkoni, Tal;
CORE (COnnecting REpositories)