Studies // Cited work

False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant

Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.

Level B Experiment doi:10.1177/0956797611417632

What this study supports

Supports the claim that undisclosed flexibility in data collection, analysis and reporting can raise false-positive rates far above the nominal level. The experiments were deliberate demonstrations; the paper does not estimate how common such practices are.

Who was studied
Computer simulations plus two experiments demonstrating flexible analysis.
Design
Experiment
Level of evidence
Controlled studies: randomised or experimental designs, and syntheses of correlational work.

Claims that rest on it

No claim in the ledger rests on this work yet.