Hostname: page-component-cd9895bd7-dk4vv Total loading time: 0 Render date: 2024-12-25T04:59:38.191Z Has data issue: false hasContentIssue false

Policy relevance of Bayesian statistics overestimated?

Published online by Cambridge University Press:  01 November 2004

Gert Jan van der Wilt
Affiliation:
University Medical Centre Nijmegen
Maroeska Rovers
Affiliation:
University Medical Centre Utrecht
Huub Straatman
Affiliation:
University Medical Centre Nijmegen
Sjoukje van der Bij
Affiliation:
University Medical Centre Nijmegen
Paul van den Broek
Affiliation:
University Medical Centre Nijmegen
Gerhard Zielhuis
Affiliation:
University Medical Centre Nijmegen

Abstract

Objectives: The observed posterior probability distributions regarding the benefits of surgery for otitis media with effusion (OME) with expected probability distributions, using Bayes' theorem are compared.

Methods: Postal questionnaires were used to assess prior and posterior probability distributions among ear-nose-throat (ENT) surgeons in the Netherlands.

Results: In their prior probability estimates, ENT surgeons were quite optimistic with respect to the effectiveness of tube insertion in the treatment of OME. The trial showed no meaningful benefit of tubes on hearing and language development. Posterior probabilities calculated on the basis of prior probability estimates and trial results differed widely from those, elicited empirically 1 year after completion of the trial and dissemination of the results.

Conclusions: ENT surgeons did not adjust their opinion about the benefits of surgical treatment of glue ears to the extent that they should have done according to Bayes' theorem. Users of the results of Bayesian analyses, notably policy-makers, should realize that Bayes' theorem is prescriptive and not necessarily descriptively correct. Health policy decisions should not be based on the untested assumption that health-care professionals use new evidence to adjust their subjective beliefs in a Bayesian manner.

Type
GENERAL ESSAYS
Copyright
© 2004 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Berger JO. 1980. Statistical decision theory and Bayesian analysis. New York: Springer-Verlag
Luce BR, Tina Shih Y-Ch, Claxton K. 2001 Bayesian approaches to technology assessment and decision making. Int J Technol Assess Health Care. 17: 1122.Google Scholar
Rovers MM, Straatman H, Ingels K, et al. 2001 The effect of short-term ventilation tubes versus watchful waiting on hearing in young children with persistent otitis media with effusion: A randomized trial. Ear Hear. 22: 191199.Google Scholar
Spiegelhalter DJ, Myles JP, Jones DR, et al. 2000 Bayesian methods in health technology assessment: A review. Health Technol Assess. 4: 1130.Google Scholar