Estimating the reproducibility of psychological science

Abstract

Empirically analyzing empirical evidence One of the central goals in any scientific endeavor is to understand causality. Experiments that seek to demonstrate a cause/effect relation most often manipulate the postulated causal factor. Aarts et al. describe the replication of 100 experiments reported in papers published in 2008 in three high-ranking psychology journals. Assessing whether the replication and the original experiment yielded the same result according to several criteria, they find that about one-third to one-half of the original findings were also observed in the replication study. Science , this issue 10.1126/science.aac4716

Shown for reading. Its publisher allows quoting it, not republishing it.

Cited by papers we hold 89

• A metric of knowledge as information compression reflects reproducibility predictions for biomedical experiments · 2025
  Not checked
• Transparency, quality, and statistical consistency of meta-analytic systematic reviews in clinical child and adolescent psychology (2022–2024): study protocol for a meta-review · 2025
  Not checked
• Diversity and Disagreement · 2024
  Not checked
• Leakage and the reproducibility crisis in machine-learning-based science · 2023
  No notice
• THINGS-data, a multimodal collection of large-scale datasets for investigating object representations in human brain and behavior · 2023
  No notice
• How representative are student convenience samples? A study of literacy and numeracy skills in 32 countries. · 2022
  Not checked
• The Power of Microbiome Studies: Some Considerations on Which Alpha and Beta Metrics to Use and How to Report Results · 2022
  No notice
• Longitudinal touchscreen use across early development is associated with faster exogenous and reduced endogenous attention control · 2021
  Not checked
• Barriers and facilitators to qualitative data sharing in the United States: A survey of qualitative researchers. · 2021
  Not checked
• Investigating the replicability of preclinical cancer biology · 2021
  No notice
• Variability in Human-Animal Interaction Research · 2021
  Not checked
• Don't Just Judge the Spelling! The Influence of Spelling on Assessing Second-Language Student Essays · 2021
  Not checked
• Preference uncertainty accounts for developmental effects on susceptibility to peer influence in adolescence · 2021
  Not checked
• Why we dehumanize illegal immigrants: A US mixed-methods study. · 2021
  Not checked
• Power contours: Optimising sample size and precision in experimental psychology and human neuroscience. · 2021
  No notice
• Challenges for assessing replicability in preclinical cancer biology · 2021
  No notice
• Data sharing practices and data availability upon request differ across scientific disciplines · 2021
  No notice
• Violating the normality assumption may be the lesser of two evils · 2021
  No notice
• An investigation of irreproducibility in maximum likelihood phylogenetic inference · 2020
  Not checked
• Questionable research practices may have little effect on replicability · 2020
  Not checked

and 69 more

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.