Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-12-03T20:04:52.708Z Has data issue: false hasContentIssue false
  • English
  • Français

What Is a Replication?

Published online by Cambridge University Press:  01 January 2022

Edouard Machery
Get access Rights & Permissions [Opens in a new window]

Abstract

This article develops a new, general account of replication (the Resampling Account of replication). I argue that a replication is an experiment that resamples the experimental components of an original experiment that are treated as random factors and that the function of replications is, narrowly, to assess the reliability of the replicated experiments. On this basis, I argue that the common notion of conceptual replication is confused and that the ongoing controversy about the relative value of direct and conceptual replications should be dissolved.

Type
Research Article
Information
Philosophy of Science , Volume 87 , Issue 4 , October 2020 , pp. 545 - 567
Copyright
Copyright © The Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Asendorpf, Jens B., et al. 2013. “Recommendations for Increasing Replicability in Psychology.” European Journal of Personality 27:108–19.CrossRefGoogle Scholar
Bargh, John. 2012. “Priming Effects Replicate Just Fine, Thanks.” Psychology Today, May 11. http://www.psychologytoday.com/us/blog/the-natural-unconscious/201205/priming-effects-replicate-just-fine-thanks.Google Scholar
Baumeister, Roy F., Tice, Dianne M., and Vohs, Kathleen D.. 2018. “The Strength Model of Self-Regulation: Conclusions from the Second Decade of Willpower Research.” Perspectives on Psychological Science 13:141–45.CrossRefGoogle ScholarPubMed
Begley, C. Glenn, and Ellis, Lee M.. 2012. “Drug Development: Raise Standards for Preclinical Cancer Research.” Nature 483:531–33.CrossRefGoogle ScholarPubMed
Bogen, James, and Woodward, James. 1988. “Saving the Phenomena.” Philosophical Review 97:303–52.CrossRefGoogle Scholar
Bonett, Douglas G. 2012. “Replication-Extension Studies.” Current Directions in Psychological Science 21:409–12.CrossRefGoogle Scholar
Camerer, Colin F., et al. 2016. “Evaluating Replicability of Laboratory Experiments in Economics.” Science 351:1433–36.CrossRefGoogle ScholarPubMed
Cesario, Joseph. 2014. “Priming, Replication, and the Hardest Science.” Perspectives on Psychological Science 9:40–48.CrossRefGoogle ScholarPubMed
Chambers, Christopher D. 2017. The Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice. Princeton, NJ: Princeton University Press.Google Scholar
Colaço, David. 2019. “An Investigation of Scientific Phenomena.” PhD diss., University of Pittsburgh.Google Scholar
Collins, Harry M. 1985. Changing Order. London: Sage.Google Scholar
Crandall, Christian S., and Sherman, Jeffrey W.. 2016. “On the Scientific Superiority of Conceptual Replications for Scientific Progress.” Journal of Experimental Social Psychology 66:93–99.CrossRefGoogle Scholar
Gigerenzer, Gerd, and Hoffrage, Ulrich. 1995. “How to Improve Bayesian Reasoning without Instruction: Frequency Formats.” Psychological Review 102:684–704.CrossRefGoogle Scholar
Gilbert, Daniel T., King, Gary, Pettigrew, Stephen, and Wilson, Timothy. 2016. “Comment on ‘Estimating the Reproducibility of Psychological Science.’” Science 351:1037.CrossRefGoogle Scholar
Hacking, Ian. 1992. “The Self-Vindication of the Laboratory Sciences.” In Science as Practice and Culture, ed. Pickering, Andrew, 29–64. Chicago: Cambridge University Press.Google Scholar
Hüffmeier, Joachim, Mazei, Jens, and Schultze, Thomas. 2016. “Reconceptualizing Replication as a Sequence of Different Studies: A Replication Typology.” Journal of Experimental Social Psychology 66:81–92.CrossRefGoogle Scholar
Judd, Charles M., Westfall, Jacob, and Kenny, David A.. 2012. “Treating Stimuli as a Random Factor in Social Psychology: A New and Comprehensive Solution to a Pervasive but Largely Ignored Problem.” Journal of Personality and Social Psychology 103:54–69.CrossRefGoogle ScholarPubMed
Kenny, David A. 1985. “Quantitative Methods for Social Psychology.” In Handbook of Social Psychology, Vol. 1, ed. Gardner, Lindzey and Aronson, Elliot, 487–508. New York: Random House.Google Scholar
Lovett, Adam, and Munger, Kevin. 2019. “Validity, Prediction and the Problem of Replicability.” Unpublished manuscript, Center for Open Science. https://osf.io/yzghn/.Google Scholar
Lynch, John G. Jr., Bradlow, Eric T., Huber, Joel C., and Lehmann, Donald R.. 2015. “Reflections on the Replication Corner: In Praise of Conceptual Replications.” International Journal of Research in Marketing 32:333–42.CrossRefGoogle Scholar
Machery, Edouard. 2008. “The Folk Concept of Intentional Action: Philosophical and Experimental Issues.” Mind and Language 23:165–89.CrossRefGoogle Scholar
Machery, Edouard. 2017. Philosophy within Its Proper Bounds. Oxford: Oxford University Press.CrossRefGoogle Scholar
Machery, Edouard, and Doris, John M.. 2017. “An Open Letter to Our Students: Doing Interdisciplinary Moral Psychology.” In Moral Psychology: A Multidisciplinary Guide, ed. Voyer, Benjamin and Tarantola, Tor, 119–43. Berlin: Springer.Google Scholar
Machery, Edouard, and Zalla, Tiziana. 2015. “The Concept of Intentional Action in High Functioning Autism.” Oxford Studies in Experimental Philosophy 1:152–72.Google Scholar
McAllister, James W. 1997. “Phenomena and Patterns in Data Sets.” Erkenntnis 47:217–28.CrossRefGoogle Scholar
Nosek, Brian. 2016. “Let’s Not Mischaracterize Replication Studies: Authors.” Retraction Watch. http://retractionwatch.com/2016/03/07/lets-not-mischaracterize-replication-studies-authors/.Google Scholar
Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349:1422–25.Google Scholar
Pashler, Harold, and Harris, Christine R.. 2012. “Is the Replicability Crisis Overblown? Three Arguments Examined.” Perspectives on Psychological Science 7:531–36.CrossRefGoogle ScholarPubMed
Richter, Martin L., and Seay, Mary B.. 1987. “ANOVA Designs with Subjects and Stimuli as Random Effects: Applications to Prototype Effect on Recognition Memory.” Journal of Personality and Social Psychology 53:470–80.CrossRefGoogle Scholar
Romero, Felipe. 2016. “Can the Behavioral Sciences Self-Correct? A Social Epistemic Study.” Studies in History and Philosophy of Science A 60:55–69.CrossRefGoogle ScholarPubMed
Schmidt, Stefan. 2009. “Shall We Really Do It Again? The Powerful Concept of Replication Is Neglected in the Social Sciences.” Review of General Psychology 13:90–100.CrossRefGoogle Scholar
Schmidt, Stefan. 2017. “Replication.” In Toward a More Perfect Psychology: Improving Trust, Accuracy, and Transparency in Research, ed. Makel, Matthew C. and Plucker, Jonathan A., 233–53. Washington, DC: American Psychological Association.Google Scholar
Schnall, Simone. 2014. “Moral Intuitions, Replication, and the Scientific Study of Human Nature.” Edge, November 18. https://www.edge.org/conversation/simone_schnall-simone-schnall-moral-intuitions-replication-and-the-scientific-study-of.Google Scholar
Scoville, William B., and Milner, Brenda. 1957. “Loss of Recent Memory after Bilateral Hippocampal Lesions.” Journal of Neurology, Neurosurgery, and Psychiatry 20:11–21.CrossRefGoogle ScholarPubMed
Shnabel, Nurit, and Nadler, Arie. 2008. “A Needs-Based Model of Reconciliation: Satisfying the Differential Emotional Needs of Victim and Perpetrator as a Key to Promoting Reconciliation.” Journal of Personality and Social Psychology 94:116–32.CrossRefGoogle ScholarPubMed
Simons, Daniel J. 2014. “The Value of Direct Replication.” Perspectives on Psychological Science 9:76–80.CrossRefGoogle ScholarPubMed
Simons, Daniel J., Shoda, Yuichi, and Lindsay, D. Stephen. 2017. “Constraints on Generality (COG): A Proposed Addition to All Empirical Papers.” Perspectives on Psychological Science 12:1123–28.CrossRefGoogle ScholarPubMed
Squire, Larry R. 2009. “The Legacy of Patient HM for Neuroscience.” Neuron 61:6–9.CrossRefGoogle Scholar
Stroebe, Wolfgang, and Strack, Fritz. 2014. “The Alleged Crisis and the Illusion of Exact Replication.” Perspectives on Psychological Science 9:59–71.CrossRefGoogle ScholarPubMed
Tversky, Amos, and Kahneman, Daniel. 1982. “Evidential Impact of Base Rates.” In Judgment under Uncertainty: Heuristics and Biases, ed. Kahneman, Daniel, Slovic, Paul, and Tversky, Amos, 153–60. Cambridge: Cambridge University Press.Google Scholar
Wells, Gary L., and Windschitl, Paul D.. 1999. “Stimulus Sampling and Social Psychological Experimentation.” Personality and Social Psychology Bulletin 25:1115–25.CrossRefGoogle Scholar
Wimsatt, William C. 2007. Re-engineering Philosophy for Limited Beings: Piecewise Approximations to Reality. Cambridge, MA: Harvard University Press.CrossRefGoogle Scholar