{"id":1081,"date":"2019-07-09T08:00:22","date_gmt":"2019-07-09T08:00:22","guid":{"rendered":"http:\/\/replicationmarkets.com\/?p=1081"},"modified":"2019-09-04T09:05:08","modified_gmt":"2019-09-04T13:05:08","slug":"on-the-replication-crisis","status":"publish","type":"post","link":"https:\/\/replicationmarkets.org\/index.php\/2019\/07\/09\/on-the-replication-crisis\/","title":{"rendered":"On the Replication Crisis"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

\u201cStanding on the shoulders of giants\u201d<\/strong> \u2013 this phrase, attributed to Bernard of Chartres and prominently used by Isaac Newton, emphasises the role of past discoveries in ongoing scientific research.\u00a0<\/span><\/p>

\u00a0<\/span><\/p>

For modern research, where communication is predominately done through scientific publications, a high reliability of published findings is instrumental. <\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

In 2005, John Ioannidis argued in an influential essay that a large fraction of published findings are false \u2013 a claim that has been supported by recent systematic replication studies in several research fields.<\/strong>\u00a0<\/span>The Replication Project: Psychology (RPP), for instance, found that only 36 of 100 replicated studies came to the same conclusions as the originals.\u00a0<\/span><\/p>

Key factors which contribute to a low rate of replicability include low power, publication bias, flexible experimental or statistical designs that permit \u2018p-hacking\u2019, and low pre-study odds for the tested hypotheses – i.e. the testing of \u2018unlikely\u2019 hypothesis.\u00a0<\/span><\/p>

\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

It informs the design of conventions and policies in scientific research, but also the use of research findings by decision makers. Our engagement with DARPA\u2019s SCORE programme is driven by our desire to contribute to this knowledge.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

\u201cStanding on the shoulders of giants\u201d \u2013 this phrase, attributed to Bernard of Chartres and prominently used by Isaac Newton, emphasises the role of past discoveries in ongoing scientific research.  For modern research, where communication is predominately done through scientific publications, a high reliability of published findings is instrumental. Yet surprisingly little is known about…<\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[21,14],"tags":[62,52,36,63],"class_list":["post-1081","post","type-post","status-publish","format-standard","hentry","category-metascience","category-replication","tag-reliability","tag-replication-crisis","tag-results","tag-score"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/posts\/1081","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/comments?post=1081"}],"version-history":[{"count":5,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/posts\/1081\/revisions"}],"predecessor-version":[{"id":1086,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/posts\/1081\/revisions\/1086"}],"wp:attachment":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/media?parent=1081"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/categories?post=1081"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/tags?post=1081"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}