Announcing Round 0 Survey Winners

By Louisa Tran

First results are in! The results are in for Round 0 Surveys… We had good participation, with 226 participants providing us answers to 12 surveys. Keep it up! Although we won’t show the survey estimates just yet, they were similar to the market estimates — a good sign. Because the markets will take nearly a…

Predicting Replication of Published Studies

By Louisa Tran

The social and behavioral sciences, some say, have a “replication crisis.” When researchers attempt to reproduce results of published papers, sometimes the original conclusions do not hold up. Replication studies are conducted using the same methods and standards laid out in the published paper. They use new participants and often a larger sample size. Researchers…

What do I forecast?

By Charles Twardy

If you’ve just read What is a high-quality replication, you know that our replications will be high-power — usually much higher than the original study — but not quite the “100 replications” ideal set out by DARPA: Assume 100 replications of this study were performed, and a weighted average of their results (i.e., a meta-analysis) was…