Hostname: page-component-586b7cd67f-rdxmf Total loading time: 0 Render date: 2024-11-28T20:02:19.888Z Has data issue: false hasContentIssue false
  • English
  • Français

Can electronic routine data act as a surrogate for patient-assessed outcome measures?

Published online by Cambridge University Press:  02 March 2005

Hayley A. Hutchings ,
Wai-Yee Cheung ,
John G. Williams ,
David Cohen ,
Mirella F. Longo  and
Ian Russell
Hayley A. Hutchings
Affiliation:
University of Wales Swansea
Wai-Yee Cheung
Affiliation:
University of Wales Swansea
John G. Williams
Affiliation:
University of Wales Swansea
David Cohen
Affiliation:
University of Glamorgan
Mirella F. Longo
Affiliation:
University of Glamorgan
Ian Russell
Affiliation:
University of Wales Bangor and Velindre NHS Trust
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives: There has been a rapid growth in the use of patient-assessed outcomes (PAOs) that are measured in the assessment of health technologies. The process of collection of such measures can be costly, and there may be problems associated with the ability of the patient to complete them. The use of electronically stored routine data may reduce costs and overcome the problems associated with patient completion. The feasibility of using routine data surrogates for the UK Inflammatory Bowel Disease Questionnaire (UKIBDQ) and the Short Form 36 (SF-36) was examined.

Methods: Clinical terms and codes for the UKIBDQ and SF-36 questions were identified, and data from electronic routine sources were sought on patients participating in a randomized controlled trial. The presence or absence of relevant symptoms was used to generate surrogate scores, which were compared with the original scores.

Results: Most questions in the UKIBDQ and SF-36 were codable but only one third of the terms were recorded routinely in electronic form. The surrogate total IBDQ score had reasonable reliability (Kuder–Richardson coefficient = 0.51), but this reliability could not be determined for the SF-36. Intraclass correlations between routine and designed data were poor to weak.

Conclusions: Although electronic routine data sources had the capacity to develop surrogate measures for patient assessed outcomes, there was evidence of wide underutilization of coding systems leading to an underreporting of symptoms. This finding is consistent with previous literature where only poor correlations were illustrated between patient assessed outcomes and surrogate scoring of symptoms.

Keywords

Patient assessed outcomeInflammatory bowel diseaseRoutine dataFeasibility
Type
RESEARCH REPORTS
Information
International Journal of Technology Assessment in Health Care , Volume 21 , Issue 1 , January 2005 , pp. 138 - 143
Copyright
© 2005 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Addington-Hall J, Kalra L. 2001 Who should measure quality of life? BMJ. 322: 1417– 1420.Google Scholar
Academy of Colleges Information Group. 2001. Specification of core requirements for clinical information systems in support of secondary care. Available at: www.aomrc.org.uk; Accessed:
Bakken Henry S, Lush M, Costantino M, et al. 1997 Health status measurement in computer-based patient record systems. Nurs Admin Q. 21: 50– 60.Google Scholar
Bakken Henry S, Morris J, Holzemer W. 1997 Using structured text and templates to capture health status outcomes in the electronic health record. J Qual Improv. 23: 667– 677.Google Scholar
Brazier J, Harper R, Jones N, et al. 1992 Validating the SF-36 health survey questionnaire: A new outcome measure for primary care. BMJ. 305: 160– 164.Google Scholar
Carr A, Gibson B, Robinson P. 2001 Is quality of life determined by expectations or experience? BMJ. 322: 1240– 1243.Google Scholar
Cheung W-Y, Garratt A, Russell I, Williams J. 2000 The UK IBDQ- A British version of the inflammatory bowel disease questionnaire: Development and validation. J Clin Epidemiol. 53: 297– 306.Google Scholar
Cole L, Houston S. 1997 Integrating information technology with an outcomes management program. Crit Care Nurs Q. 19: 71– 79.Google Scholar
Deyo R, Diehr P, Patrick D. 1991 Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials. 12: 142S– 158S.Google Scholar
Department Of Health. The NHS Plan—a plan for investment, a plan for reform. London: Stationary Office; July 2000.
Department Of Health. 2001. Building the information core: Implementing the NHS plan. London: Department of Health;
Dolin R. 1997 Outcome analysis: Considerations for an electronic health record. M.D. Computing. 14: 50– 56.Google Scholar
Galland R, Magee T, Berridge D, et al. 1998 Accuracy of centrally recorded OPCS codes for vascular surgery in the United Kingdom. Eur J Vasc Endovasc Surg. 16: 415– 418.Google Scholar
Galland R, Whatling P, Crook T, Magee T. 2000 Regional variation in varicose vein operations in England 1989-1996. Ann R Coll Surg Engl. 82: 275– 279.Google Scholar
Garratt A, Schmidt L, Mackintosh A, Fitzpatrick. 2002 Quality of life measurements: Bibliographic study of patient assessed health outcome measures. BMJ. 234: 1417– 1419.Google Scholar
Higginson I, Carr A. 2001 Using quality of life measures in the clinical setting. BMJ. 322: 1297– 1300.Google Scholar
Johnson R, Hornbrook M, Nichols G. 1994 Replicating the chronic disease score (CDS) from automated pharmacy data. J Clin Epidemiol. 47: 1191– 1199.Google Scholar
Johnston R. 2000 Implementation of a computer-based patient record and an outcomes data-collection system at the Department of Orthopaedic Surgery, University of Iowa. J Bone Joint Surg Am. 82: 1502– 1506.Google Scholar
Mann R, Williams J. 2003 Standards in medical record keeping. Clin Med. 3: 329– 332.Google Scholar
Medical Outcomes Trust. 1994. SF-36 Health Survey Scoring Manual for English Language Adaptations. Australia/New Zealand, Canada, United Kingdom. Boston, MA: Medical Outcomes Trust;
Moher D, Schulz K, Altman D. 2001 The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 357: 1191– 1194.Google Scholar
National Health Service Information Authority. Clinical terminology and classification services. Available at: http://www.coding.nhsia.nhs.uk.
Office of Population Censuses and Surveys. 1990. Tabular list of the classification of surgical operations and procedures. 4th revision. London: HMSO;
Pollock AM, Vickers N. 2000 Reducing DCO registration through electronic matching of cancer registry data and routine hospital data. Br J Cancer. 82: 712– 717.Google Scholar
Rietman L, Hendricks H. 2000 Speaking the same language: Improving evaluation of patient-focused outcomes using standardized terminology. Top Health Inform Manage. 20: 35– 43.Google Scholar
Streiner G, Norman R. 1995. Health measurement scales. A practical guide to their development and use. Oxford: Oxford University Press;
Ware J, Sherbourne C. 1992 The MOS 36-item short form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 30: 473– 483.Google Scholar
Welsh Assembly Government. 2002. Informing healthcare-towards a knowledge-based NHS. Cardiff: Welsh Assembly Government;
Whitman G. 2002 Outcomes research. Getting started, defining outcomes, a framework, and data sources. Crit Care Nurs Clin N Am. 14: 261– 268.Google Scholar
World Health Organization. 1992. International statistical classification of diseases and related health problems. 10th revision. Geneva: World Health Organization;
Williams J, Morgan J, Howlett P, Severs M. 1993 Let there be light. Br J Healthcare Comput. 10: 30– 32.Google Scholar
Williams J, Cheung W, Russell I, et al. 2000 Open access follow up for inflammatory bowel disease: Pragmatic randomised trial and cost effectiveness study. BMJ. 320: 544– 548.Google Scholar
Williams J, Cheung W, Cohen D, et al. 2003 Can randomized trials rely on existing electronic data? A feasibility study to explore the value of routine data in health technology assessment. Health Technol Assess. 7 (26).Google Scholar
Wilson I, Cleary P. 1995 Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. JAMA. 273: 59– 65.Google Scholar
Zielstorff R. 1995 Capturing and using clinical outcome data: Implications for information systems design. J Am Med Informatics Assoc. 2: 191– 196.Google Scholar