Glossary // Glossary term Technical

Replication

Repeating a study, with new data, to test whether its finding recurs. In a large coordinated project that repeated 100 published psychology studies, replication effects were on average about half the size of the originals, and 36% of replications reached statistical significance compared with 97% of the originals. A failed replication does not by itself show that an original effect is false, but findings that have not been independently replicated warrant more cautious wording.

Where the site uses it

  • Methods: signals, inference and the limits of detecting a state change

    How one could reason about recording a catharsis-like change of state: signals, features, inference and context, baselines, self-report, error costs and ethics, and why every step stays uncertain. Nothing on this site measures anyone.

  • Evidence ledger

    Every public claim on this site with its type, evidence level, confidence, sources and review date, and an appraisal of each reference. How claims are graded, how art is kept apart from evidence, and how to report a problem.

Studies behind it

The works the definition rests on, with the level of evidence each was appraised at.

  • Open Science Collaboration (2015). Estimating the reproducibility of psychological science. doi:10.1126/science.aac4716

    Level D Experiment

    Supports the claims that replication effects were about half the size of the original effects and that 36% of replications were statistically significant versus 97% of originals. Graded D because it mixes experimental and correlational replications and describes research practice in a sample of journals, not an intervention; what counts as a successful replication is itself debated.