Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-26T18:10:39.218Z Has data issue: false hasContentIssue false
  • English
  • Français

The Likelihood Principle and the Reliability of Experiments

Published online by Cambridge University Press:  01 April 2022

Andrew Backe
Andrew Backe*
Affiliation:
University of Pittsburgh
*
†Department of History and Philosophy of Science, 1017 Cathedral of Learning, University of Pittsburgh, Pittsburgh, PA 15260.
Get access Rights & Permissions [Opens in a new window]

Abstract

The likelihood principle of Bayesian statistics implies that information about the stopping rule used to collect evidence does not enter into the statistical analysis. This consequence confers an apparent advantage on Bayesian statistics over frequentist statistics. In the present paper, I argue that information about the stopping rule is nevertheless of value for an assessment of the reliability of the experiment, which is a pre-experimental measure of how well a contemplated procedure is expected to discriminate between hypotheses. I show that, when reliability assessments enter into inquiries, some stopping rules prescribing optional stopping are unacceptable to both Bayesians and frequentists.

Type
Probability and Statistical Inference
Information
Philosophy of Science , Volume 66 , Issue S3: Supplement. Proceedings of the 1998 Biennial Meetings of the Philosophy of Science Association. Part I: Contributed Papers Sep., 1999 , 1999 , pp. S354 - S361
Copyright
Copyright © 1999 by the Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

‡

This paper developed out of discussions with Deborah Mayo. I thank both her and Merrilee Salmon for commenting on earlier drafts. I also thank Teddy Seidenfeld for his comments and guidance on recent drafts.

References

Anscombe, F. J. (1954), “Fixed-Sample-Size Analysis of Sequential Observations”, Biometrics 10: 89–100.CrossRefGoogle Scholar
Armitage, Peter (1975), Sequential Medical Trials, 2nd ed. New York: John Wiley & Sons.Google Scholar
Berger, James O. and Wolpert, Robert (1984), The Likelihood Principle. Hayward, CA: Institute of Mathematical Statistics.Google Scholar
Birnbaum, Alan (1962), “On the Foundations of Statistical Inference”, Journal of the American Statistical Association 57: 269–306.CrossRefGoogle Scholar
Cornfield, Jerome (1966), “A Bayesian Test of Some Classical Hypotheses—With Applications To Sequential Clinical Trials”, Journal of the American Statistical Association 61: 577–594.Google Scholar
Edwards, Ward, Lindman, Harold, and Savage, Leonard (1963), “Bayesian Statistical Inference for Psychological Research”, Psychological Review 70: 193–242.10.1037/h0044139CrossRefGoogle Scholar
Hacking, Ian (1965), Logic of Statistical Inference. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Kadane, Joseph B., Schervish, Mark, and Seidenfeld, Teddy (1996), “Reasoning to a Foregone Conclusion”, Journal of the American Statistical Association 91: 1228–1235.CrossRefGoogle Scholar
Kerridge, D. (1963), “Bounds for the Frequency of Misleading Bayes Inferences”, Annals of Mathematical Statistics 34: 1109–1110.CrossRefGoogle Scholar
Mayo, Deborah G. (1996), Error and the Growth of Experimental Knowledge. Chicago: University of Chicago Press.CrossRefGoogle Scholar
Neyman, Jerzy and Pearson, Egon (1933), “On the Problem of the Most Efficient Tests of Statistical Hypotheses”, Philosophical Transactions of the Royal Society (A) 231: 289–337.Google Scholar
Savage, Leonard (1962), The Foundations of Statistical Inference. London: Methuen.Google Scholar
Wald, Abraham (1947), Sequential Analysis. New York: John Wiley & Sons.Google Scholar