It’s really easy not to find any mind-changing evidence… just don’t go looking for it. Cassie Kozyrkov When testing hypotheses, there are two types of errors one can make: finding a relationship where one does not exist (false positive), and finding no relationship where one does exist (false negative). Statistical power measures how hard you…
Anna Dreber Almenberg, part of Replication Markets’ experiment design team, is the Johan Björkman Professor of Economics at the Stockholm School of Economics. She took time recently to answer a few questions about her interest in the field of research replication. What got you thinking about replications and markets? For me it all started when…
If you’ve just read What is a high-quality replication, you know that our replications will be high-power — usually much higher than the original study — but not quite the “100 replications” ideal set out by DARPA: Assume 100 replications of this study were performed, and a weighted average of their results (i.e., a meta-analysis) was…
What is high quality replication?
In brief: A good-faith, high-power attempt to reproduce a previously-observed finding.