{"id":5029,"date":"2020-10-15T08:01:25","date_gmt":"2020-10-15T12:01:25","guid":{"rendered":"http:\/\/replicationmarkets.com\/?page_id=5029"},"modified":"2020-10-22T15:59:22","modified_gmt":"2020-10-22T19:59:22","slug":"evaluating-covid-19-preprints","status":"publish","type":"page","link":"https:\/\/replicationmarkets.org\/index.php\/rm-c19\/blog\/evaluating-covid-19-preprints\/","title":{"rendered":"Evaluating COVID-19 Preprints"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"5029\" class=\"elementor elementor-5029\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-297ed53 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"297ed53\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-00b7272\" data-id=\"00b7272\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-2aa43c0 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"2aa43c0\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-2b7aca0\" data-id=\"2b7aca0\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-8862c91 elementor-view-default elementor-widget elementor-widget-icon\" data-id=\"8862c91\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"icon.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-icon-wrapper\">\n\t\t\t<a class=\"elementor-icon\" href=\"https:\/\/replicationmarkets.com\/index.php\/rm-c19\/#top\">\n\t\t\t<svg xmlns:dc=\"http:\/\/purl.org\/dc\/elements\/1.1\/\" xmlns:cc=\"http:\/\/creativecommons.org\/ns#\" xmlns:rdf=\"http:\/\/www.w3.org\/1999\/02\/22-rdf-syntax-ns#\" xmlns:svg=\"http:\/\/www.w3.org\/2000\/svg\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" xmlns:sodipodi=\"http:\/\/sodipodi.sourceforge.net\/DTD\/sodipodi-0.dtd\" xmlns:inkscape=\"http:\/\/www.inkscape.org\/namespaces\/inkscape\" sodipodi:docname=\"covid19 white.svg\" inkscape:version=\"1.0 (4035a4fb49, 2020-05-01)\" id=\"svg8\" viewBox=\"0 0 183.41393 179.21959\" height=\"179.21959mm\" width=\"183.41393mm\"><defs id=\"defs2\"><\/defs><metadata><\/metadata><g transform=\"translate(-16.360884,-59.707809)\" id=\"layer1\" inkscape:groupmode=\"layer\" inkscape:label=\"Layer 1\"><g id=\"g942\"><circle style=\"opacity:0.729;fill:none;fill-opacity:0;stroke:#000000;stroke-width:20.8;stroke-linecap:round;stroke-linejoin:round;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:0;paint-order:fill markers stroke\" id=\"path10\" cx=\"-36.511204\" cy=\"167.24745\" r=\"65.748955\" transform=\"rotate(-45)\"><\/circle><circle style=\"fill:none;fill-opacity:0;fill-rule:evenodd;stroke:#000000;stroke-width:0.264583;stroke-opacity:0\" id=\"path822\" cx=\"-31.748699\" cy=\"165.39537\" r=\"67.071877\" transform=\"rotate(-45)\"><\/circle><circle style=\"fill:none;fill-opacity:0;fill-rule:evenodd;stroke-width:0.264583\" id=\"path826\" cx=\"-25.663288\" cy=\"203.23079\" r=\"74.215622\" transform=\"rotate(-45)\"><\/circle><circle style=\"opacity:0.755;fill:none;fill-opacity:0;fill-rule:evenodd;stroke:#000000;stroke-width:10;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:0\" id=\"path828\" cx=\"-28.441402\" cy=\"174.25893\" r=\"64.029167\" transform=\"rotate(-45)\"><\/circle><circle style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.365;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\" id=\"path832\" cx=\"-27.647633\" cy=\"183.78392\" r=\"72.495834\" transform=\"rotate(-45)\"><\/circle><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" id=\"g840\" transform=\"rotate(-45,120.15911,159.01755)\"><path inkscape:connector-curvature=\"0\" id=\"path834\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"translate(-9.5835122,2.642392)\" id=\"g840-5\"><path inkscape:connector-curvature=\"0\" id=\"path834-7\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-8\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(45,109.94069,135.75923)\" id=\"g840-1\"><path inkscape:connector-curvature=\"0\" id=\"path834-4\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-4\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(90,113.5014,143.01755)\" id=\"g840-8\"><path inkscape:connector-curvature=\"0\" id=\"path834-2\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-87\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(135,114.40457,145.60732)\" id=\"g840-86\"><path inkscape:connector-curvature=\"0\" id=\"path834-3\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-1\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(180,115.19678,147.99641)\" id=\"g840-3\"><path inkscape:connector-curvature=\"0\" id=\"path834-9\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-2\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(-135,115.94306,149.68782)\" id=\"g840-32\"><path inkscape:connector-curvature=\"0\" id=\"path834-0\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-23\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><g style=\"fill:none;stroke:#ffffff;stroke-opacity:1\" transform=\"rotate(-90,116.61151,152.88172)\" id=\"g840-50\"><path inkscape:connector-curvature=\"0\" id=\"path834-5\" d=\"m 119.98854,75.014584 c 0,-15.08125 0,-15.08125 0,-15.08125\" style=\"fill:none;stroke:#ffffff;stroke-width:6.365;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><path inkscape:connector-curvature=\"0\" id=\"path836-7\" d=\"m 107.68542,60.197917 c 24.60624,0 24.60624,0 24.60624,0\" style=\"fill:none;stroke:#ffffff;stroke-width:6.265;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1\"><\/path><\/g><circle style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path954\" cx=\"111.24284\" cy=\"149.31761\" r=\"13.626041\"><\/circle><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971\" cx=\"57.414581\" cy=\"149.31761\" rx=\"7.9375\" ry=\"12.435416\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-3\" cx=\"164.30623\" cy=\"149.31761\" rx=\"7.9375\" ry=\"12.435416\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38\" cx=\"-94.593758\" cy=\"111.24284\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(-90)\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38-7\" cx=\"-201.63655\" cy=\"111.24284\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(-90)\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38-0\" cx=\"-237.32564\" cy=\"-25.915459\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(-135)\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38-0-4\" cx=\"-129.74968\" cy=\"-27.973438\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(-135)\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38-0-4-1\" cx=\"-25.908098\" cy=\"-183.63121\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(135)\"><\/ellipse><ellipse style=\"fill:none;fill-rule:evenodd;stroke:#ffffff;stroke-width:6.26499987;stroke-miterlimit:4;stroke-dasharray:none;stroke-opacity:1;opacity:1\" id=\"path971-38-0-4-1-1\" cx=\"79.984077\" cy=\"-181.01198\" rx=\"7.9375\" ry=\"12.435416\" transform=\"rotate(135)\"><\/ellipse><\/g><\/g><\/svg>\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-754e1fa\" data-id=\"754e1fa\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-f711541 elementor-widget elementor-widget-nav-menu\" data-id=\"f711541\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"nav-menu.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-7cfb4fa elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"7cfb4fa\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-9561ff6\" data-id=\"9561ff6\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-d24d9e7 elementor-widget elementor-widget-heading\" data-id=\"d24d9e7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Replication Markets' New Experiment: Evaluating COVID-19 Preprints<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9aa61fb elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"9aa61fb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-ee3162b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"ee3162b\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-66 elementor-top-column elementor-element elementor-element-b8fce0f\" data-id=\"b8fce0f\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c84bb33 elementor-widget elementor-widget-text-editor\" data-id=\"c84bb33\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><strong>Call to <span style=\"text-decoration: line-through;\">Action<\/span> Evaluation!<\/strong><\/p>\n<p>Replication Markets (RM) invites citizen scientists to make forecasts about COVID-19 preprints that have been discussed on social media. We need a variety of perspectives and voices like yours. As a participant, you will predict which preprints are:<\/p>\n<ul>\n<li>Most likely to be published<\/li>\n<li>Most likely to be cited<\/li>\n<li>Most likely to be replicated<\/li>\n<li>Most likely to have a public health impact<\/li>\n<\/ul>\n<p>We need your viewpoint, as well as insights from people with different backgrounds. Nobody has expertise in every relevant field, and experts are sometimes outperformed by generalists.<\/p>\n<p><strong>Goals<\/strong><\/p>\n<p>Thousands of scientists have responded to the pandemic by studying the virus, the disease, and the impact on society, writing preprints far faster than they can be reviewed. Today there are nearly 10,000 COVID-19 preprints registered on two of the largest preprint servers,&nbsp;<a href=\"https:\/\/www.biorxiv.org\/\" target=\"_blank\" rel=\"noopener\">bioRxiv.org<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/www.medrxiv.org\/\" target=\"_blank\" rel=\"noopener\">medRxiv.org<\/a>. We are experimenting with additional mechanisms to discover and evaluate scientific work.<\/p>\n<p>Our findings will contribute to the wider body of scientific knowledge about forecasting, and possibly to the more immediate cause of rating and reviewing preprints. RM will make all its data available for analysis.<\/p>\n<p><b>Track Record<\/b><\/p>\n<p><b>Our research team, and others, have already demonstrated the scientific potential of crowdsourcing forecasts through surveys and prediction markets. <\/b>You can read a bit about our recently completed forecasting for 3,000 research claims, funded by DARPA SCORE <a href=\"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rsos.200566\" target=\"_blank\" rel=\"noopener\">https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rsos.200566<\/a>, or review prior published Replication Forecasting research: <a href=\"https:\/\/www.citationfuture.com\/\" target=\"_blank\" rel=\"noopener\">https:\/\/www.citationfuture.com\/<\/a>.<\/p>\n<p><strong>How it Works<\/strong><\/p>\n<p>You will be asked to use both surveys and a play-money market, with real payouts totaling over $14,000. Payouts are distributed among the most accurate of its anticipated 100+ forecasters. There is no cost to play the Replication Markets. Average winnings will depend on the number of participants, and their accuracy.<\/p>\n<p>In the Surveys, you will be asked to answer a handful of questions about 10 papers. You may go back for as many extra batches of 10 papers as you like.<\/p>\n<p>In the Markets, you will receive points to bet as you wish across the 400 papers. <strong>Successful forecasters generally adjust their assessments in response to further news, discussions, and other bets.<\/strong><\/p>\n<p>Our project needs forecasters like you with knowledge and judgment. We hope you will enjoy participating.<\/p>\n<p><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7a784a1 elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"7a784a1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-3b12191 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"3b12191\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-c82dc71\" data-id=\"c82dc71\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-3f92b99 elementor-align-start elementor-icon-list--layout-traditional elementor-list-item-link-full_width elementor-widget elementor-widget-icon-list\" data-id=\"3f92b99\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"icon-list.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"elementor-icon-list-items\">\n\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item\">\n\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-icon\">\n\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"far fa-calendar-alt\"><\/i>\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text\">October 15, 2020<\/span>\n\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-f8e92e1\" data-id=\"f8e92e1\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1ae6a5b elementor-widget elementor-widget-text-editor\" data-id=\"1ae6a5b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h4>Mike Bishop<\/h4>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-0c9d7dd elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0c9d7dd\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1e973c1\" data-id=\"1e973c1\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-63f9b4e elementor-align-center elementor-mobile-align-center elementor-widget elementor-widget-button\" data-id=\"63f9b4e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-md\" href=\"https:\/\/covid19.replicationmarkets.com\/app\/login\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Sign up to participate<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1cb8c4c elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"1cb8c4c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-5111b85 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"5111b85\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-25 elementor-inner-column elementor-element elementor-element-b9b27fe\" data-id=\"b9b27fe\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-25 elementor-inner-column elementor-element elementor-element-4aad2aa\" data-id=\"4aad2aa\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-25 elementor-inner-column elementor-element elementor-element-db0ffe2\" data-id=\"db0ffe2\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7d47f77 elementor-widget elementor-widget-text-editor\" data-id=\"7d47f77\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><a href=\"https:\/\/replicationmarkets.com\/index.php\/rm-c19\/blog\/multichoice-publication-markets\/\" target=\"_blank\" rel=\"noopener\">Next<\/a>\u00a0<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-25 elementor-inner-column elementor-element elementor-element-564a927\" data-id=\"564a927\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ce8ab65 elementor-view-default elementor-widget elementor-widget-icon\" data-id=\"ce8ab65\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"icon.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-icon-wrapper\">\n\t\t\t<div class=\"elementor-icon\">\n\t\t\t<i aria-hidden=\"true\" class=\"fas fa-chevron-right\"><\/i>\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-33 elementor-top-column elementor-element elementor-element-a1df6e7\" data-id=\"a1df6e7\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1d86b0e elementor-widget elementor-widget-wp-widget-custom-twitter-feeds-widget\" data-id=\"1d86b0e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"wp-widget-custom-twitter-feeds-widget.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\n<!-- Custom Twitter Feeds by Smash Balloon -->\n<div id=\"ctf\" class=\" ctf ctf-type-usertimeline ctf-rebranded ctf-feed-1  ctf-styles ctf-list ctf-regular-style\"   data-ctfshortcode=\"{&quot;feed&quot;:1}\"   data-ctfdisablelinks=\"false\" data-ctflinktextcolor=\"#\" data-header-size=\"small\" data-feedid=\"1\" data-postid=\"5029\"  data-feed=\"1\" data-ctfintents=\"1\"  data-ctfneeded=\"1\">\n            <div id=\"ctf\" class=\"ctf\">\n            <div class=\"ctf-error\">\n                <div class=\"ctf-error-user\">\n\t\t\t\t\tTwitter feed is not available at the moment.                <\/div>\n            <\/div>\n        <\/div>\n\t\t    <div class=\"ctf-tweets\">\n   \t\t    <\/div>\n    \n<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-76aef86 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"76aef86\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-top-column elementor-element elementor-element-5337274\" data-id=\"5337274\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-eee36b9 elementor-widget elementor-widget-nav-menu\" data-id=\"eee36b9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"nav-menu.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-top-column elementor-element elementor-element-441f4df\" data-id=\"441f4df\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7083a1b elementor-widget elementor-widget-text-editor\" data-id=\"7083a1b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>There is NO COST to participate in Replication Markets.<\/p>\n<p>This research is supported (in part) by the Fetzer Franklin Fund of the John E. Fetzer Memorial Trust. It uses a platform developed for DARPA SCORE, and some staff are supported by SCORE while working on this. We are grateful for their support.<br><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Replication Markets&#8217; New Experiment: Evaluating COVID-19 Preprints Call to Action Evaluation! Replication Markets (RM) invites citizen scientists to make forecasts about COVID-19 preprints that have been discussed on social media. We need a variety of perspectives and voices like yours. As a participant, you will predict which preprints are: Most likely to be published Most&hellip;<\/p>\n","protected":false},"author":8,"featured_media":0,"parent":5014,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"elementor_canvas","meta":{"footnotes":""},"class_list":["post-5029","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/pages\/5029","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/comments?post=5029"}],"version-history":[{"count":19,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/pages\/5029\/revisions"}],"predecessor-version":[{"id":5137,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/pages\/5029\/revisions\/5137"}],"up":[{"embeddable":true,"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/pages\/5014"}],"wp:attachment":[{"href":"https:\/\/replicationmarkets.org\/index.php\/wp-json\/wp\/v2\/media?parent=5029"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}