File Download
  Links for fulltext
     (May Require Subscription)
Supplementary

Article: The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

TitleThe pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
Authors
KeywordsMethodology
Meta-science
Crowdsourcing science
Research transparency
Reproducibility
Replication
Issue Date2016
Citation
Journal of Experimental Social Psychology, 2016, v. 66, p. 55-67 How to Cite?
Abstract© 2015 The Authors This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had â in the pipelineâ as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed.
Persistent Identifierhttp://hdl.handle.net/10722/242675
ISSN
2023 Impact Factor: 3.2
2023 SCImago Journal Rankings: 1.841
ISI Accession Number ID

 

DC FieldValueLanguage
dc.contributor.authorSchweinsberg, Martin-
dc.contributor.authorMadan, Nikhil-
dc.contributor.authorVianello, Michelangelo-
dc.contributor.authorSommer, S. Amy-
dc.contributor.authorJordan, Jennifer-
dc.contributor.authorTierney, Warren-
dc.contributor.authorAwtrey, Eli-
dc.contributor.authorZhu, Luke Lei-
dc.contributor.authorDiermeier, Daniel-
dc.contributor.authorHeinze, Justin E.-
dc.contributor.authorSrinivasan, Malavika-
dc.contributor.authorTannenbaum, David-
dc.contributor.authorBivolaru, Eliza-
dc.contributor.authorDana, Jason-
dc.contributor.authorDavis-Stober, Clintin P.-
dc.contributor.authordu Plessis, Christilene-
dc.contributor.authorGronau, Quentin F.-
dc.contributor.authorHafenbrack, Andrew C.-
dc.contributor.authorLiao, Eko Yi-
dc.contributor.authorLy, Alexander-
dc.contributor.authorMarsman, Maarten-
dc.contributor.authorMurase, Toshio-
dc.contributor.authorQureshi, Israr-
dc.contributor.authorSchaerer, Michael-
dc.contributor.authorThornley, Nico-
dc.contributor.authorTworek, Christina M.-
dc.contributor.authorWagenmakers, Eric Jan-
dc.contributor.authorWong, Lynn-
dc.contributor.authorAnderson, Tabitha-
dc.contributor.authorBauman, Christopher W.-
dc.contributor.authorBedwell, Wendy L.-
dc.contributor.authorBrescoll, Victoria-
dc.contributor.authorCanavan, Andrew-
dc.contributor.authorChandler, Jesse J.-
dc.contributor.authorCheries, Erik-
dc.contributor.authorCheryan, Sapna-
dc.contributor.authorCheung, Felix-
dc.contributor.authorCimpian, Andrei-
dc.contributor.authorClark, Mark A.-
dc.contributor.authorCordon, Diana-
dc.contributor.authorCushman, Fiery-
dc.contributor.authorDitto, Peter H.-
dc.contributor.authorDonahue, Thomas-
dc.contributor.authorFrick, Sarah E.-
dc.contributor.authorGamez-Djokic, Monica-
dc.contributor.authorGrady, Rebecca Hofstein-
dc.contributor.authorGraham, Jesse-
dc.contributor.authorGu, Jun-
dc.contributor.authorHahn, Adam-
dc.contributor.authorHanson, Brittany E.-
dc.contributor.authorHartwich, Nicole J.-
dc.contributor.authorHein, Kristie-
dc.contributor.authorInbar, Yoel-
dc.contributor.authorJiang, Lily-
dc.contributor.authorKellogg, Tehlyr-
dc.contributor.authorKennedy, Deanna M.-
dc.contributor.authorLegate, Nicole-
dc.contributor.authorLuoma, Timo P.-
dc.contributor.authorMaibuecher, Heidi-
dc.contributor.authorMeindl, Peter-
dc.contributor.authorMiles, Jennifer-
dc.contributor.authorMislin, Alexandra-
dc.contributor.authorMolden, Daniel C.-
dc.contributor.authorMotyl, Matt-
dc.contributor.authorNewman, George-
dc.contributor.authorNgo, Hoai Huong-
dc.contributor.authorPackham, Harvey-
dc.contributor.authorRamsay, Philip S.-
dc.contributor.authorRay, Jennifer L.-
dc.contributor.authorSackett, Aaron M.-
dc.contributor.authorSellier, Anne Laure-
dc.contributor.authorSokolova, Tatiana-
dc.contributor.authorSowden, Walter-
dc.contributor.authorStorage, Daniel-
dc.contributor.authorSun, Xiaomin-
dc.contributor.authorVan Bavel, Jay J.-
dc.contributor.authorWashburn, Anthony N.-
dc.contributor.authorWei, Cong-
dc.contributor.authorWetter, Erik-
dc.contributor.authorWilson, Carlos T.-
dc.contributor.authorDarroux, Sophie Charlotte-
dc.contributor.authorUhlmann, Eric Luis-
dc.date.accessioned2017-08-10T10:51:17Z-
dc.date.available2017-08-10T10:51:17Z-
dc.date.issued2016-
dc.identifier.citationJournal of Experimental Social Psychology, 2016, v. 66, p. 55-67-
dc.identifier.issn0022-1031-
dc.identifier.urihttp://hdl.handle.net/10722/242675-
dc.description.abstract© 2015 The Authors This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had â in the pipelineâ as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed.-
dc.languageeng-
dc.relation.ispartofJournal of Experimental Social Psychology-
dc.rightsThis work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.-
dc.subjectMethodology-
dc.subjectMeta-science-
dc.subjectCrowdsourcing science-
dc.subjectResearch transparency-
dc.subjectReproducibility-
dc.subjectReplication-
dc.titleThe pipeline project: Pre-publication independent replications of a single laboratory's research pipeline-
dc.typeArticle-
dc.description.naturepublished_or_final_version-
dc.identifier.doi10.1016/j.jesp.2015.10.001-
dc.identifier.scopuseid_2-s2.0-84977144634-
dc.identifier.volume66-
dc.identifier.spage55-
dc.identifier.epage67-
dc.identifier.eissn1096-0465-
dc.identifier.isiWOS:000381166900007-
dc.identifier.issnl0022-1031-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats