Objectives: This study aims to provide the first estimates of the costs and effects of the large scale introduction of autologous transfusion technologies into the United Kingdom National Health Service.

Methods: A model was constructed to allow disparate data sources to be combined to produce estimates of the scale, costs, and effects of introducing four interventions. The interventions considered were preparing patients for surgery (PPS) clinics, preoperative autologous donation (PAD), intraoperative cell salvage (ICS), and postoperative cell salvage (PoCS).

Results: The key determinants of cost per operation are the anticipated level of reductions in blood use, the mean level of blood use, mean length of stay, and the cost of the technology. The results show the potential for considerable reductions in blood use. The greatest reductions are anticipated to be through the use of PPS and ICS. Vascular surgery, transplant surgery, and cardiothoracic surgery appear to be the specialties that will benefit most from the technologies.

Conclusions: Several simplifications were used in the production of these estimates; consequently, caution should be used in their interpretation and use. Despite the drawbacks in the methods used in the study, the model shows the scale of the issue, the importance of gathering better data, and the form that data must take. Such preliminary modeling exercises are essential for rational policy development and to direct future research and discussion among stakeholders.

Objectives: Chondral defects of the knee cartilage are prevalent. Autologous chondrocyte implantation (ACI) and mosaicplasty are increasingly used to treat symptomatic knee defects. This study assessed the costs and health status outcomes after ACI and mosaicplasty.

Methods: Patients were eligible to participate in this cross-sectional study if they received ACI or mosaicplasty at the Royal National Orthopaedic Hospital between 1997 and 2001 or were on a waiting list for ACI. Secondary-care resource use was collected to 2 years postoperatively using a resource collection proforma. Participants responded to postal questions about sociodemographic characteristics and knee-related (Modified Cincinnati Knee Rating System) and general health status (EQ-5D).

Results: Fifty-three ACI, twenty mosaicplasty, and twenty-two patients waiting for ACI participated. The average cost per patient was higher for ACI (£10,600: 95 percent confidence interval [CI], £10,036–£11,214) than mosaicplasty (£7,948: 95 percent CI, £6,957–£9,243). Postoperatively, ACI and mosaicplasty patients (combined) experienced better health status than those waiting for ACI. ACI patients tended to have better health status outcomes than mosaicplasty patients (not statistically significant). Estimated average EQ-5D social tariff improvements for quality-adjusted life year (QALY) calculations were 0.23 (ACI) and 0.06 (mosaicplasty). Average costs per QALY were £23,043 (ACI) and £66,233 (mosaicplasty). The incremental cost effectiveness ratio (ICER) for providing ACI over mosaicplasty was £16,349.

Conclusions: Average costs were higher for ACI than mosaicplasty. However, both the estimated cost per QALY and ICER for providing ACI over mosaicplasty fell beneath an implicit English funding threshold of £30,000 per QALY. Prospective studies should include measures of utility to confirm the estimated cost utility ratios of ACI and mosaicplasty.

Objectives: Health Technology Assessment (HTA) is defined as a policy research approach that examines the short- and long-term social consequences of the application or use of technology. Internationally different institutions have translated this definition to local contexts. In Denmark, HTA is comprehensive with focus on four aspects of the problem in question (technology [clinical evidence], economy, patient, and organization). The objective of this study is to study how the application of HTA differs across leading countries and to study the extent to which Danish HTA reports differ from foreign HTAs.

Methods: A sample of 433 HTA reports published in the period 1989–2002 by eleven leading institutions or agencies in Denmark and eight other countries were reviewed. We looked at the characteristics of the HTA with respect to focus on the four main aspects and the manner in which each aspect has been approached.

Results: The study shows health technology procedures to be the most common type of health technology assessed in HTAs and literature review to be the most often used method of analysis. Policy recommendations are only present in approximately half of the HTA reports.

Conclusions: In the HTAs one generally sees a great focus on the clinical aspect of health technologies, leaving the economic, the patient-related, and the organizational aspect much more unanalyzed. The Danish HTAs generally have a wider scope than HTAs produced in other countries and tend to focus more frequently on patient-related and organizational dimensions.

Objectives: To outline the development, structure, data assumptions, and application of an Australian economic model for stroke (Model of Resource Utilization, Costs, and Outcomes for Stroke [MORUCOS]).

Methods: The model has a linked spreadsheet format with four modules to describe the disease burden and treatment pathways, estimate prevalence-based and incidence-based costs, and derive life expectancy and quality of life consequences. The model uses patient-level, community-based, stroke cohort data and macro-level simulations. An interventions module allows options for change to be consistently evaluated by modifying aspects of the other modules. To date, model validation has included sensitivity testing, face validity, and peer review. Further validation of technical and predictive accuracy is needed. The generic pathway model was assessed by comparison with a stroke subtypes (ischemic, hemorrhagic, or undetermined) approach and used to determine the relative cost-effectiveness of four interventions.

Results: The generic pathway model produced lower costs compared with a subtypes version (total average first-year costs/case AUD$15,117 versus AUD$17,786, respectively). Optimal evidence-based uptake of anticoagulation therapy for primary and secondary stroke prevention and intravenous thrombolytic therapy within 3 hours of stroke were more cost-effective than current practice (base year, 1997).

Conclusions: MORUCOS is transparent and flexible in describing Australian stroke care and can effectively be used to systematically evaluate a range of different interventions. Adjusting results to account for stroke subtypes, as they influence cost estimates, could enhance the generic model.

Objectives: This study aimed to produce valid patient-based UK National Health Service (NHS) costs for adults with cystic fibrosis to identify differences between hospital- and home-based treatments for infections.

Methods: A costing study was carried out in adults with cystic fibrosis (CF) in the United Kingdom, who required intravenous antibiotic treatments for respiratory infections, administered either at home or in the hospital. The perspective was that of the NHS hospital trust. Data were collected retrospectively for each patient for 1 year using clinical records. Data were collected for 116 adults with CF between 2000 and 2001, when 42,382 treatment days (454 courses) of intravenous antibiotics were administered; 213 courses with intention-to-treat at home and 241 courses with intention-to-treat in the hospital. The mean length of a course was 15.3 days.

Results: Patients who had >60 percent of courses at home over 1 year had a mean cost of £13,528, compared with £22,609 for patients who had >60 percent of courses in the hospital, and a mean cost of £19,927 for patients who had an equal mix of home and hospital care (p = .0001).

Conclusions: The key cost-generating events in CF respiratory infections are hospital admissions. Future studies assessing costs should concentrate on factors affecting admissions, length of stay, staff input, and alternative methods of home-care provision, rather than marginal effects, such as using different antibiotics.

Objectives: The use of ultrasonography and computed tomography (CT) in the diagnosis of appendicitis in adult patients was compared.

Methods: Systematic review and meta-analysis of current evidence in two clinical situations: unselected nonpregnant, adult patients with symptoms of appendicitis, and more selective use in only those patients who still have an equivocal diagnosis subsequent to routine clinical investigations.

Results: Meta-analysis of eligible studies shows CT to have better sensitivity and specificity than ultrasound in both clinical situations.

Conclusions: Application of these findings in clinical practice and/or policy would need to evaluate the better diagnostic performance of CT against its cost and availability. In addition, it is imperative that future studies be conducted in patient populations that are well-defined with respect to prior investigations. Sequelae of false-negative and false-positive diagnoses should also be evaluated.

Objectives: The aim of the Consensus on Health Economic Criteria (CHEC) project is to develop a criteria list for assessment of the methodological quality of economic evaluations in systematic reviews. The criteria list resulting from this CHEC project should be regarded as a minimum standard.

Methods: The criteria list has been developed using a Delphi method. Three Delphi rounds were needed to reach consensus. Twenty-three international experts participated in the Delphi panel.

Results: The Delphi panel achieved consensus over a generic core set of items for the quality assessment of economic evaluations. Each item of the CHEC-list was formulated as a question that can be answered by yes or no. To standardize the interpretation of the list and facilitate its use, the project team also provided an operationalization of the criteria list items.

Conclusions: There was consensus among a group of international experts regarding a core set of items that can be used to assess the quality of economic evaluations in systematic reviews. Using this checklist will make future systematic reviews of economic evaluations more transparent, informative, and comparable. Consequently, researchers and policy-makers might use these systematic reviews more easily. The CHEC-list can be downloaded freely from http://www.beoz.unimaas.nl/chec/.

Objectives: The potential of routine data for health technology assessment (HTA) in the United Kingdom was assessed.

Methods: Compiled were a comprehensive list of routine databases, their classification according to data characteristics, literature review on their current use, and their comparison with key topics identified as priorities for HTA.

Results: Two hundred seventy health-care databases for England or the English regions were identified. Twenty-four included data on both health technology and patient health state. Eleven found some published use in effectiveness evaluation. Of 140 prioritized health technologies, only 22 could be identified in routine databases.

Conclusions: Routine data are plentiful but of limited use in HTA. The data sets usually do not include the effect of treatments. Coding is inadequate, and confidentiality regulations will make matters worse. Both need urgent attention.

Objectives: Prospect theory (PT) hypothesizes that people judge states relative to a reference point, usually assumed to be their current health. States better than the reference point are valued on a concave portion of the utility function; worse states are valued on a convex portion. Using prospectively collected utility scores, the objective is to test empirically implications of PT.

Methods: Osteoarthritis (OA) patients undergoing total hip arthroplasty periodically provided standard gamble scores for three OA hypothetical states describing mild, moderate, and severe OA as well as their subjectively defined current state (SDCS). Our hypothesis was that most patients improved between the pre- and postsurgery assessments. According to PT, scores for hypothetical states previously > SDCS but now < SDCS should be lower at the postsurgery assessment.

Results: Fourteen patients met the criteria for testing the hypothesis. Predictions were confirmed for 0 patients; there was no change or mixed results for 6 patients (42.9 percent); and scores moved in the direction opposite to that predicted by PT for 8 patients (57.1 percent).

Conclusions: In general, the direction and magnitude of the changes in hypothetical-state scores do not conform to the predictions of PT.

Objectives: This study aimed to validate the accuracy of data retrieved in a prospective multicenter trial, the purpose of which was an economic evaluation of two techniques of surgery for colon cancer.

Methods: Within the Swedish contribution of the COLOR trial (Colon Cancer Open or Laparoscopic Resection), an economic evaluation of open versus laparoscopic surgical techniques was conducted. Data were collected by case record forms (CRF), patient diaries, and telephone surveys every 2 weeks. The study period was 12 weeks, and the perspective was societal. Data from the first consecutive forty patients to complete the health economic study protocol were validated. Retrieved data were compared with data from medical records and data from local social security offices for agreement.

Results: Statistically significant differences were found for duration of anesthesia, length of surgery, number of outpatient consultations by doctors and district nurses, complication rate, and the use of central venous lines. No significant differences were observed concerning length of hospital stay, disposable instruments cost, and time off work, all of which heavily influence total costs.

Conclusions: The present method of data collection regarding resources used in this setting seems to produce accurate data for economic evaluation; however, relative to complication rates, the method did not retrieve accurate data.

Background: Despite a clear call for greater input from health technology assessment (HTA) in the areas of clinical practice and policy making, there are currently very few formal training programs. The objectives of our Consortium were to (i) develop a master's level program in HTA, (ii) test its content with a group of Canadian and European students, and (iii) evaluate the Program's strengths and weaknesses.

Objectives: This study presents the results of our evaluation of the first edition of the Master's Program (2001–2003).

Methods: The evaluation relied on (i) a self-administered student questionnaire for each course (n = 142), (ii) interviews with students (n = 10), and (iii) interviews with internship supervisors (n = 5).

Results: A vast majority of students were satisfied with the course content and particularly appreciated the exercises and materials presented in an intensive format. However, they needed more systematic feedback from faculty members and recommended increasing the methodology content. The six key characteristics of the program are (i) flexible format adapted to the needs of skilled professionals, (ii) continuous interaction between HTA users and producers, (iii) international academic and professional collaboration, (iv) partnership with HTA agencies, (v) global approach to evidence-based methods and practices, and (vi) multidisciplinary approach.

Conclusions: Despite the numerous organizational barriers inherent to creating an international program and several areas for improvement in the Program itself, the Ulysses Project was successful in attaining its objectives. Because there is a growing need for human resources with special training in HTA, further efforts need to be devoted to strengthening the international research capacity in HTA.

Objectives: The objective of physician continuing medical education (CME) is to help them keep abreast of advances in patient care, to accept new more-beneficial care, and discontinue use of existing lower-benefit diagnostic and therapeutic interventions. The goal of this review was to examine effectiveness of current CME tools and techniques in changing physician clinical practices and improving patient health outcomes.

Methods: Results of published systematic reviews were examined to determine the spectrum from most- to least-effective CME techniques. We searched multiple databases, from 1 January 1984 to 30 October 2004, for English-language, peer-reviewed meta-analyses and other systematic reviews of CME programs that alter physician behavior and/or patient outcomes.

Results: Twenty-six reviews met inclusion criteria, that is, were either formal meta-analyses or other systematic reviews. Interactive techniques (audit/feedback, academic detailing/outreach, and reminders) are the most effective at simultaneously changing physician care and patient outcomes. Clinical practice guidelines and opinion leaders are less effective. Didactic presentations and distributing printed information only have little or no beneficial effect in changing physician practice.

Conclusions: Even though the most-effective CME techniques have been proven, use of least-effective ones predominates. Such use of ineffective CME likely reduces patient care quality and raises costs for all, the worst of both worlds.

Objectives: The aim of this investigation was to study the effect of general practitioners' (GP's) characteristics on two decisions: whether to have the Helicobacter pylori rapid test (HPRT) in the office laboratory and whether to use this test or a similar hospital-based serological test in a typical clinical situation described in a vignette.

Methods: Discrete choice analysis with binary logit models were used to predict the probability that a general practice has the HPRT, as well as the GP's probability of using the HPRT or a similar test in this clinical situation.

Results: We found that the number of consultations per week has a positive effect on the probability of having the HPRT, indicating that the size of the practice affects the decision to have such a test in the repertoire. Furthermore, four variables significantly increased the probability of using one of the lab tests: more if located in urban practices, more by solo practitioners, more when the GP stated a high probability for H. pylori associated disease, and more when the GP had the rapid test available in the practice. In our analysis, the remuneration system is endogenous and does not have a significant effect on the two decisions.

Conclusions: Our study demonstrates that characteristics of the GP affect the availability and use of a specific laboratory analysis.

Objectives: The convergent validity between utility assessment methods was assessed.

Methods: Investigated were patients with esophageal cancer treated surgically with curative intent. Patients were interviewed in a period from 3 to 12 months after surgical resection. Patients evaluated their actual health and seven other states. Visual analogue scale (VAS) and standard gamble (SG) utilities were obtained for the health states in an interview. Patients also indicated whether or not they preferred death to living in a health state (worse than dead [WTD] preferences).

Results: Fifty patients completed the interview. Convergent validity was excellent at the aggregate and individual level. However, the relation between VAS and SG differed strongly across individuals. On a scale from 0 (dead) to 100 (perfect health), SG scores were lower for patients with WTD preferences (mean difference d=35; p=.002); however, VAS scores did not vary by WTD preferences.

Conclusions: In general, there is good agreement between VAS and SG measures, although patients disagree about how the VAS and SG are related. The standard gamble varied by WTD preferences, however, the VAS did not.

Objectives: A review of the Alberta Heritage Foundation for Medical Research's (AHFMR) 6-month Health Technology Skills Development Program was undertaken within an international context with the purpose of describing and assessing the current program, further formalizing the program based on identified opportunities for improvement, and enhancing collaborative linkages with other agencies. The objectives of the review were to (i) compare the AHFMR program with similar programs in other health technology assessment (HTA) agencies internationally; (ii) assess the value of the program; (iii) identify program strengths and opportunities for improvement; and (iv) review, critique, and recommend enhancements to the program model and role description.

Methods: The review involved a qualitative study design that included a survey of the Skills Development Program participants' experience and perceptions; semistructured interviews with program stakeholders, and a written survey of HTA agencies/programs in other Canadian and international jurisdictions.

Conclusions: The review concluded that the program was successful and valued by participants, the Foundation, and stakeholders in the policy and research communities. Findings suggest participant products have a potential for broad influence, including impact on funding decisions related to technology diffusion, influence through publications and presentations, and knowledge transfer in the participants' disciplines and employment settings. The main opportunity for enhancement was to differentiate the program into two streams according to different needs of participants, specifically between those who desire to be HTA producers and/or make HTA their careers, and those who desire to apply HTA in their employment capacity as policy or clinical decision-makers.

Objectives: During the past decade, telehealth has enjoyed a plethora of public funding and publication outlets around the world. Yet, rhetoric appears to be outpacing the actual diffusion and utilization of telehealth technologies for patient care. Several barriers, such as reimbursement and legal/regulatory issues, are commonly cited as impeding the successful deployment of this innovation. However, two separate studies carried out in Michigan that controlled for these barriers point out a more significant initial gatekeeper to the deployment of telehealth, namely providers.

Methods: Multiple data collection strategies were used in both the telehospice and telepsychiatry projects, including utilization logs, surveys, telehospice nursing notes, cost frame data collection, patient interviews, caregiver interviews and focus groups, and videotaped visits.

Results: This study summarizes data from the two studies to support the hypothesis that the provider is the most important initial gatekeeper for telemedicine.

Conclusions: The implications from this conclusion have important consequences for health system deployment strategies. Specifically, telemedicine project managers must keep providers' needs (ease of use and incentives) in mind when designing a telemedicine system.

Objectives: There is relatively little evidence on the test–retest reliability of utility scores derived from multiattribute measures. The objective was to estimate test–retest reliability for Health Utilities Index Mark 2 (HUI2) and Mark 3 (HUI3) utility scores in patients recovering from hip fracture.

Methods: We enrolled an inception cohort of hip fracture patients within 3 to 5 days of surgery. Baseline assessments included the Functional Independence Measure (FIM™), Folstein Mini-Mental State Examinations, and the HUI2 and HUI3 questionnaire. Follow-up assessments at 1, 3, and 6 months also included a global change question. Test–retest reliability was assessed as agreement between 3- and 6-month scores using the intraclass correlation coefficient (ICC). Two approaches were used to classify patients as stable; a third approach based on the generalizability theory was also used. Patients were classified as stable if their FIM™ overall scores changed by 10 points or fewer and if they classified themselves as having experienced no or only a little change according to their global change question.

Results: Complete data at both the 3- and 6-month assessments based on self-report were available for 196 patients; 141 patients with complete data were classified as stable. The ICCs for HUI2 and HUI3 for stable patients were 0.71 and 0.72; the ICCs derived from the generalizability theory were 0.76 and 0.77.

Conclusions: Test–retest reliability for HUI in this cohort was similar to reliability estimates for other preference-based multiattribute and generic health-profile measures—in the acceptable range for making valid group-level comparisons.

Objectives: A mechanism to increase the influence of Health Technology Assessments (HTAs) on hospital policy decisions was developed.

Methods: We describe the process and results of an experiment in which a local in-hospital HTA unit was created to provide sound evidence on technology acquisition issues, and to formulate locally appropriate policy recommendations. The Unit consists of a small technical staff that accesses and synthesizes the evidence incorporating local health and economic data, and a Policy Committee that develops policy recommendations based on this evidence. It represents administration, health-care professionals, patients, and representatives of the clinical disciplines affected by each issue. The level of success of the Unit was independently evaluated.

Results: To date, 16 reports have been completed, each within 2–4 months. Five recommended unrestricted use, seven recommended rejection, and four recommended very limited use of the technology in question. All have been incorporated into hospital policy. Budget impact is estimated at approximately $3 million of savings per year.

Conclusions: This local in-house HTA agency has had a major impact on the adoption of new technology. Probable reasons for success are (i) relevance (selection of topics by administration with on-site production of HTAs allowing them to incorporate local data and reflect local needs), (ii) timeliness, and (iii) formulation of policy reflecting community values by a local representative committee. Because over one third of all health-care costs are incurred in the hospital, diffusion of this model could have a significant effect on the quantity and quality of health-care spending.

Objectives: The aim of this study was to assist and facilitate introduction and development of a health technology assessment (HTA) program in Romania.

Methods: Mentoring of an initiative group in Romania was provided by an HTA program in Canada. Mentoring activities included provision of HTA materials, participation in local seminars, facilitating contact with HTA and funding organizations, and in-house training of a professional from Romania.

Results: Since 1998, when the relationship was initiated, the Romanian group has been successful in developing an understanding of HTA and awareness of its utility among various decision-makers in the health system. Currently, although the need for HTA in Romania exists and interest in developing this activity has been officially expressed, HTA is still early in its development phase. The mentoring support helped to identify and define the need for HTA in Romania. Continuation of the existing relationship can be expected to strengthen the expertise in this country. However, while mentoring has been a valuable activity, it is not, by itself, sufficient to ensure development of an HTA program in Romania. The actions and decisions that could lead to implementing HTA in Romania depend on the local context.

Conclusions: Mentoring services assisted the initiative group in promoting HTA in Romania. The implementation of HTA in Romania has not happened yet, and efforts need to continue to sustain the existing momentum. However, success in implementing an HTA program will depend on essential factors such as local political, economical, and educational support for this initiative and others like it.

Background: The hazard ratio (HR) is the most appropriate measure for time to event outcomes such as survival. In systematic reviews, HRs can be calculated either from the raw trial data obtained as part of an individual patient data (IPD) meta-analysis or from the appropriate trial-level summary statistics. However, the information required for the latter are seldom reported in sufficient detail to allow reviewers to calculate HRs. In contrast, the median survival and survival rates at specific time points are frequently presented. We aimed to evaluate retrospectively the performance of meta-analyses using median survival times and survival rates by comparing them with meta-analyses using IPD to calculate HRs.

Methods: IPD from thirteen published meta-analyses (MAs) in cancers with high mortality rates were used. Median survival and survival rates were calculated from the IPD rather than taken from publications so that the same trials, patients, and extended follow-up are used in each analysis.

Results and Conclusions: We show that using median survival times or survival rates at a particular point in time are not reasonable surrogate measures for meta-analyses of survival outcomes and that, wherever possible, HRs should be calculated. Individual trial publications reporting on time to event outcomes, therefore, should provide more detailed statistical information, preferably logHRs and their variances, or their estimators.