Objectives: Patient production losses occur when individuals’ capacities to work, whether paid or unpaid, are impaired by illness, treatment, disability, or death. There is controversy about whether and how to include patient production losses in economic evaluations in health care. Patient production losses have not previously been considered when evaluating medications for reimbursement under the U.K. National Health Service. Proposals for value-based assessment of health technologies in the United Kingdom created renewed interest in whether and how to include costs from a wider societal perspective, such as patient production losses, within economic evaluation of healthcare interventions.

Methods: A narrative review was undertaken of theoretical, ethical, and policy issues that might inform decisions that involve the normative question of whether or not to include patient production losses in economic evaluation.

Results: It seems difficult to reconcile the implications of including patient production losses with the objectives of a healthcare system dedicated to providing universal healthcare coverage without regard to patients’ ability to pay.

Conclusions: Tax payer funded healthcare systems may legitimately adopt maximands other than health gain, but these will be at the opportunity cost of less than maximum health gains.

Background: The importance of economic evaluation in decision making is growing with increasing budgetary pressures on health systems. Diverse economic evidence is available for a range of interventions across national contexts within Europe, but little attention has been given to identifying evidence gaps that, if filled, could contribute to more efficient allocation of resources. One objective of the Research Agenda for Health Economic Evaluation project is to determine the most important methodological evidence gaps for the ten highest burden conditions in the European Union (EU), and to suggest ways of filling these gaps.

Methods: The highest burden conditions in the EU by Disability Adjusted Life Years were determined using the Global Burden of Disease study. Clinical interventions were identified for each condition based on published guidelines, and economic evaluations indexed in MEDLINE were mapped to each intervention. A panel of public health and health economics experts discussed the evidence during a workshop and identified evidence gaps.

Results: The literature analysis contributed to identifying cross-cutting methodological and technical issues, which were considered by the expert panel to derive methodological research priorities.

Conclusions: The panel suggests a research agenda for health economics which incorporates the use of real-world evidence in the assessment of new and existing interventions; increased understanding of cost-effectiveness according to patient characteristics beyond the “-omics” approach to inform both investment and disinvestment decisions; methods for assessment of complex interventions; improved cross-talk between economic evaluations from health and other sectors; early health technology assessment; and standardized, transferable approaches to economic modeling.

Objectives: For medical devices, benefits other than direct clinical effects may have a large impact on the patients’ well-being, but a standardized method for measuring these benefits is unavailable. The objective was to explore potential patient benefits provided by medical devices, and to assess the relative preferences of these benefits in the general Swedish population.

Methods: To identify attributes of patient benefit, healthcare personnel within a wide range of disease areas were interviewed. The generalized attributes were then validated among healthcare personnel, patient organizations, and manufacturers; in two pilot studies in the general population; and in two rounds of cognitive interviews. The general population's preferences of the attributes were measured with a usability-tested questionnaire in a final responding sample of 3,802 individuals, representative of the Swedish population.

Results: Twenty attributes were identified, encompassing aspects of integrity, sense of security, social participation, and convenience. When measuring the relative preferences, the response rate was 37.0 percent, and the results showed that the attributes with the highest preferences concerned reliability, reduced need for assistance, and sense of control of the illness/disability.

Conclusions: A set of twenty attributes of patient benefit relevant to users of medical devices was identified and validated. A questionnaire for patient-reported assessment of the benefits provided by a medical device was developed, based on the attributes. The questionnaire, designated MedTech20, provides a generic measurement method for the evaluation of medical devices used in a wide range of diseases/disabilities.

Objectives: This study was designed to assess the sensitivity of three Ovid MEDLINE search filters developed to identify studies reporting health state utility values (HSUVs), to improve the performance of the best performing filter, and to validate resulting search filters.

Methods: Three quasi-gold standard sets (QGS1, QGS2, QGS3) of relevant studies were harvested from reviews of studies reporting HSUVs. The performance of three initial filters was assessed by measuring their relative recall of studies in QGS1. The best performing filter was then developed further using QGS2. This resulted in three final search filters (FSF1, FSF2, and FSF3), which were validated using QGS3.

Results: FSF1 (sensitivity maximizing) retrieved 132/139 records (sensitivity: 95 percent) in the QGS3 validation set. FSF1 had a number needed to read (NNR) of 842. FSF2 (balancing sensitivity and precision) retrieved 128/139 records (sensitivity: 92 percent) with a NNR of 502. FSF3 (precision maximizing) retrieved 123/139 records (sensitivity: 88 percent) with a NNR of 383.

Conclusions: We have developed and validated a search filter (FSF1) to identify studies reporting HSUVs with high sensitivity (95 percent) and two other search filters (FSF2 and FSF3) with reasonably high sensitivity (92 percent and 88 percent) but greater precision, resulting in a lower NNR. These seem to be the first validated filters available for HSUVs. The availability of filters with a range of sensitivity and precision options enables researchers to choose the filter which is most appropriate to the resources available for their specific research.

Objectives: Our study addresses the important issue of estimating treatment costs from historical data. It is a problem frequently faced by health technology assessment analysts. We compared four approaches used to estimate current costs when good quality contemporary data are not available using liver transplantation as an example.

Methods: First, the total cost estimates extracted for patients from a cohort study, conducted in the 1990s, were inflated using a published inflation multiplier. Second, resource use estimates from the cohort study were extracted for hepatitis C patients and updated using current unit costs. Third, expert elicitation was carried out to identify changes in clinical practice over time and quantify current resource use. Fourth, routine data on resource use were obtained from National Health Service Blood and Transplant (NHSBT).

Results: The first two methods did not account for changes in clinical practice. Also the first was not specific to hepatitis patients. The use of experts confirmed significant changes in clinical practice. However, the quantification of resource use using experts is challenging as clinical specialists may not have a complete overview of clinical pathway. The NHSBT data are the most accurate reflection of transplantation and posttransplantation phase; however, data were not available for the whole pathway of care. The best estimate of total cost, combining NHSBT data and expert elicitation, is £121,211.

Discussion: Observational data from routine care are potentially the most reliable reflection of current resource use. Efforts should be made to make such data readily available and accessible to researchers. Expert elicitation provided reasonable estimates.

Objectives: Multicomponent interventions (MCIs), consisting of at least two interventions, are common in rehabilitation and other healthcare fields. When the effectiveness of the MCI versus that of its single interventions is comparable or unknown, evidence of their expected incremental cost-effectiveness can be helpful in deciding which intervention to recommend. As such evidence often is unavailable this study proposes an approach to estimate what is more cost-effective; the MCI or the single intervention(s).

Methods: We reviewed the literature for potential methods. Of those identified, headroom analysis was selected as the most suitable basis for developing the approach, based on the criteria of being able to estimate the cost-effectiveness of the single interventions versus that of the MCI (a) within a limited time frame, (b) in the absence of full data, and (c) taking into account carry-over and interaction effects. We illustrated the approach with an MCI for cancer survivors.

Results: The approach starts with analyzing the costs of the MCI. Given a specific willingness-to-pay-value, it is analyzed how much effectiveness the MCI would need to generate to be considered cost-effective, and if this is likely to be attained. Finally, the cost-effectiveness of the single interventions relative to the potential of the MCI for being cost-effective can be compared.

Conclusions: A systematic approach using headroom analysis was developed for estimating whether an MCI is likely to be more cost effective than one (or more) of its single interventions.

Objectives: The study aims to develop an understanding of the views of children and adolescents, parents, and professionals on upper limb prosthetic devices to develop and improve device design. Previous research has found that children are dissatisfied with prostheses but has relied heavily on parent proxy reports and quantitative measures (such as questionnaires) to explore their views.

Methods: Thirty-four participants (eight children aged 8–15 years with upper limb difference, nine parents, eight prosthetists, and nine occupational therapists) contributed to the development of new devices through the BRIDGE methodology of participatory design, using focus groups and interviews.

Results: The study identified areas for improving prostheses from the perspective of children and adolescents, developed prototypes based on these and gained feedback on the prototypes from the children and other stakeholders (parents and professionals) of paediatric upper limb prostheses. Future device development needs to focus on ease of use, versatility, appearance, and safety.

Conclusions: This study has demonstrated that children and adolescents can and should be involved as equal partners in the development of daily living equipment and that rapid prototyping (three-dimensional printing or additive manufacturing), used within a participatory design framework, can be a useful tool for facilitating this.

Objectives: The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis.

Methods: Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale.

Results: All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account.

Conclusions: Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Objectives: Exoskeletons are electromechanical devices that are worn by a human operator to increase their physical performance. Several exoskeletons have been developed to restore functional movements, such as walking, for those with paralysis due to neurological impairment. However, existing exoskeletons have limitations with respect to affordability, size, weight, speed, and efficiency, which may reduce their functional application. Therefore, the aim of this scoping review is to collect and narratively synthesize the perspectives of users of exoskeleton technology.

Methods: A systematic literature search was conducted across several healthcare related online databases.

Results: A total of 4,619 articles were identified, of which 51 were selected for full review. Only three studies were identified that met the inclusion criteria. Of these, one showed an incongruence between users’ expectations and experiences of device use; another reported perspectives on potential rather than actual device use, ranking design features in order of perceived importance; and the other reported ratings of ease of device use in training.

Conclusions: The heterogeneity of studies included within this review, leave the authors unable to suggest consensus as to user perspectives of exoskeleton technology. However, it is apparent that users are able to suggest priorities for exoskeleton design and that users’ perspectives of exoskeleton technology might change in response to experience of use. The authors, therefore, suggest that exoskeleton design should be an iterative process, whereby user perspectives are sought, incorporated and refined by tangible experience, to ensure that devices developed are acceptable to and usable by the populations they seek to re-enable.

Objectives: The aim of this study was to evaluate whether ostomy industry patent activity (PA) is associated with patient outcomes and healthcare costs.

Methods: Two groups of ostomy pouch users based on manufacturer PA (low or high) were compared in terms of ostomy-related wear patterns, adverse events, and healthcare expenditure. Using Swedish registry data, all patients with newly formed stomas were divided between each group and were followed during a 2-year period (2011–12). Propensity score matching and parametric duration analysis were used to compare outcomes between patients of similar characteristics such as sex, age, and ostomy surgery type.

Results: In both one- and two-piece systems, the high PA group had significantly lower monthly ostomy-related expenditure than the low PA group (one-piece: 197.47 EUR versus 233.34 EUR; two-piece: 164.00 EUR versus 278.98 EUR). Fewer pouch and skin wafer purchases per month were an important driver of cost differences. Both groups had similar likelihood of purchasing dermatological products for skin complications over time.

Conclusions: PA in the ostomy care industry was associated with reduced healthcare costs, but not necessarily with fewer skin complications. It suggests that there is a health economic benefit from products made by patent intensive companies which may differentiate them from generic comparators, but more research is needed to understand the impact of activities conducive to medical innovation on health outcomes.

Objectives: Coverage decisions are decisions by third party payers about whether and how much to pay for technologies or services, and under what conditions. Given their complexity, a systematic and transparent approach is needed. The DECIDE (Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence) Project, a GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group initiative funded by the European Union, has developed GRADE Evidence to Decision (EtD) framework for different types of decisions, including coverage ones.

Methods: We used an iterative approach, including brainstorming to generate ideas, consultation with stakeholders, user testing, and pilot testing of the framework.

Results: The general structure of the EtD includes formulation of the question, an assessment using twelve criteria, and conclusions. Criteria that are relevant for coverage decisions are similar to those for clinical recommendations from a population perspective. Important differences between the two include the decision-making processes, accountability, and the nature of the judgments that need to be made for some criteria. Although cost-effectiveness is a key consideration when making coverage decisions, it may not be the determining factor. Strength of recommendation is not directly linked to the type of coverage decisions, but when there are important uncertainties, it may be possible to cover an intervention for a subgroup, in the context of research, with price negotiation, or with restrictions.

Conclusions: The EtD provides a systematic and transparent approach for making coverage decisions. It helps ensure consideration of key criteria that determine whether a technology or service should be covered and that judgments are informed by the best available evidence.

Objectives: The Scottish Health Technologies Group (SHTG) produces rapid reviews on nonmedicine technologies to inform advice for decision making in the National Health Service in Scotland (NHSScotland). This study describes our experiences and lessons learned in adapting for NHSScotland two rapid Relative Effectiveness Assessments (REAs) produced as part of the European Network for Health Technology Assessment (EUnetHTA) project to test collaborative preparation and then local adaptation.

Methods: The REAs were examined for their relevance to NHSScotland and the feasibility of their adaptation evaluated using a screening toolkit. Some supplementary literature searches were conducted and additional background information on epidemiology and the specific technologies was sought. To inform decision making within Scotland, it was also necessary to identify and review cost-effective analyses.

Results: Robust evidence reviews were delivered for NHSScotland. Time saved was less than anticipated, partly due to the need to add in health economic information, and partly because of attempts to supplement and update the EUnetHTA material. The preparation of an accompanying advice statement for NHSScotland enabled the inclusion of local contextual information.

Conclusions: Collaborative production and adaptation of HTAs is feasible and would be aided by the inclusion of cost-effectiveness analyses in the original work. Agencies should develop clear processes for adapting such reviews for their context with the focus on selecting appropriate topics for adaptation, avoiding unnecessary supplementation of the original work, and ensuring local ownership of final advice.

Objectives: The evaluation of telemedicine from the patient's point of view has focused on the patient pathway and patient satisfaction. However, research in this field does not provide us with the means to assess a patient's perception of the procedure if their reasoning ability is impaired. In this study, we use direct observation of a patient's behavior and mood to assess their perception of an oral teleconsultation procedure.

Methods: This study has been conducted in the context of a pilot project using an asynchronous teleconsultation to improve access to dental care for the dependent elderly, disabled people, and prisoners, some of whom may be cognitively impaired. We use a direct observation form consisting of five behavioral variables and eight affect variables to reflect the patient's experience of the oral teleconsultation procedure.

Results: A total of 135 patients were evaluated; 10 refused the procedure. Psychotic patients (n = 33) had a somewhat negative experience during the oral teleconsultation procedure. Patients who were not psychotic had a positive experience; this decreased as we moved from the autonomous to the semi-autonomous and then to the dependent sub-group. Some gender differences were also noted.

Conclusions: Improving evidence on evaluating the acceptance of the cognitively impaired is required to improve the technology development process so that it can be translated into an improved patient experience and adherence. Although the study was specifically focused on teledentistry, the approach described in this study could be adapted to other forms of teleconsultation.

Objectives: The headroom method was introduced for the very early evaluation of the potential value of new technologies. It allows for establishing a ceiling price for technologies to still be cost-effective by combining the maximum effect a technology might yield, the maximum willingness-to-pay (WTP) for this effect, and potential downstream expenses and savings. Although the headroom method is QALY-based, not all innovations are expected to result in QALY gain.

Methods: This study explores the feasibility and usefulness of the headroom method in the evaluation of technologies that are unlikely to result in QALY gain. This will be illustrated with the diagnostic trajectory of complex pediatric neurology (CPN).

Results: Our headroom analysis showed a large room for improvement in the current diagnostic trajectory of CPN in terms of diagnostic yield. Combining this with a maximum WTP value for an additional diagnosis and the potential downstream expenses and savings, resulted in a total headroom of €15,028. This indicates that a new technology in this particular diagnostic trajectory, might be cost-effective as long as its costs do not exceed €15,028.

Conclusions: The headroom method seems a useful tool in the very early evaluation of medical technologies, also in cases when immediate QALY gain is unlikely. It allows for allocating healthcare resources to those technologies that are most promising. It should be kept in mind, however, that the headroom assumes an optimistic scenario, and for that reason cannot guarantee future cost-effectiveness. It might be most useful for ruling out those technologies that are unlikely to be cost-effective.

Objectives: The aim of this study was to review 5 years of activity from a new system devised by the National Institute for Health and Care Excellence (NICE), for assessing medical devices and diagnostics aimed at identifying and speeding adoption of technologies with clinical and cost advantages, compared with current practice in the United Kingdom healthcare system.

Methods: All eligible notified technologies were classified using the Food and Drug Administration and Global Medical Device Nomenclature nomenclatures. Decisions about selecting technologies for full assessment to produce NICE recommendations were reviewed, along with the reasons given to companies for not selecting products.

Results: Between 2009 and 2014, 186 technologies were notified (46 percent therapeutic and 54 percent diagnostic). Thirty-nine were judged ineligible (no regulatory approval), and 147 were considered by an independent committee. Of these, eighty (54 percent) were not selected for full assessment, most commonly because of insufficient evidence (86 percent): there were uncertainties specifically about benefits to the health service (54 percent), to patients (39 percent), and about cost (24 percent). The remaining 67 were selected and assessed for Medical Technology guidance (52 percent) (noninferior and/or lower cost consequences than current practice), for Diagnostics guidance (43 percent) or other NICE recommendations about adoption and use. Classifying technologies by two different systems showed no selection bias for any technology type or disease area.

Conclusions: Identifying new or under-used devices and diagnostics with potential benefits and promoting their adoption is important to health services in the United Kingdom and worldwide. This new system offers a means of fostering both uptake and further research. Lack of research data on new products is a major obstacle to evaluation.

Objectives: The evaluation of public health interventions poses some challenges. As a consequence, health technology assessment (HTA) methods for public health interventions (PHI) have to be adapted. This study aimed to summarize the available guidance on methods for HTA of PHI.

Methods: We systematically searched for methodological guidance on HTA of PHIs. Our focus was on research synthesis methods to evaluate effectiveness. Relevant information was synthesized narratively in a standardized way.

Results: Only four guidance documents were identified specifically for HTAs of PHI. The approaches used for HTAs of PHIs are broader and more flexible than those for medical interventions. For this reason, there is a tendency to identify the intervention components and context factors that influence the effectiveness and transferability of an intervention rather than to assess its effectiveness in general. The details in the guidance vary without justification. Unjustified heterogeneity between the different guidance approaches is most pronounced for quality assessment, assessment of applicability, and methods to integrate qualitative and quantitative evidence. Descriptions for the assessment of integrity, heterogeneity, sustainability, context factors, and applicability are often vague.

Conclusions: The heterogeneity in approaches indicates that there is currently no consensus on methods to deal with the challenges of the PHI evaluations. A possible explanation for this may be that the methods are not sufficiently developed, and advantages and disadvantages of a certain method in relation to the research question (e.g., broad/focused) have not yet been sufficiently evaluated.

Objectives: Zika virus (ZikaV) is currently one of the most important emerging viruses in the world which has caused outbreaks and epidemics and has also been associated with severe clinical manifestations and congenital malformations. Traditional approaches to combat the ZikaV outbreak are not effective for detection and control. The aim of this study is to propose a cloud-based system to prevent and control the spread of Zika virus disease using integration of mobile phones and Internet of Things (IoT).

Methods: A Naive Bayesian Network (NBN) is used to diagnose the possibly infected users, and Google Maps Web service is used to provide the geographic positioning system (GPS)-based risk assessment to prevent the outbreak. It is used to represent each ZikaV infected user, mosquito-dense sites, and breeding sites on the Google map that helps the government healthcare authorities to control such risk-prone areas effectively and efficiently.

Results: The performance and accuracy of the proposed system are evaluated using dataset for 2 million users. Our system provides high accuracy for initial diagnosis of different users according to their symptoms and appropriate GPS-based risk assessment.

Conclusions: The cloud-based proposed system contributed to the accurate NBN-based classification of infected users and accurate identification of risk-prone areas using Google Maps.

Objectives: Traditional economic evaluations for most health technology assessments (HTAs) have previously not included environmental outcomes. With the growing interest in reducing the environmental impact of human activities, the need to consider how to include environmental outcomes into HTAs has increased. We present a simple method of doing so.

Methods: We adapted an existing clinical-economic model to include environmental outcomes (carbon dioxide [CO2] emissions) to predict the consequences of adding insulin to an oral antidiabetic (OAD) regimen for patients with type 2 diabetes mellitus (T2DM) over 30 years, from the United Kingdom payer perspective. Epidemiological, efficacy, healthcare costs, utility, and carbon emissions data were derived from published literature. A scenario analysis was performed to explore the impact of parameter uncertainty.

Results: The addition of insulin to an OAD regimen increases costs by 2,668 British pounds per patient and is associated with 0.36 additional quality-adjusted life-years per patient. The insulin-OAD combination regimen generates more treatment and disease management-related CO2 emissions per patient (1,686 kg) than the OAD-only regimen (310 kg), but generates fewer emissions associated with treating complications (3,019 kg versus 3,337 kg). Overall, adding insulin to OAD therapy generates an extra 1,057 kg of CO2 emissions per patient over 30 years.

Conclusions: The model offers a simple approach for incorporating environmental outcomes into health economic analyses, to support a decision-maker's objective of reducing the environmental impact of health care. Further work is required to improve the accuracy of the approach; in particular, the generation of resource-specific environmental impacts.

Objectives: To investigate the use, challenges and opportunities associated with using patient-reported outcomes (PROs) in studies with patients with rare lysosomal storage diseases (LSDs), we conducted interviews with researchers and health technology assessment (HTA) experts, and developed the methods for a systematic review of the literature. The purpose of the review is to identify the psychometrically sound generic and disease-specific PROs used in studies with patients with five LSDs of interest: Fabry, Gaucher (Type I), Niemann-Pick (Type B) and Pompe diseases, and mucopolysaccharidosis (Types I and II).

Methods: Researchers and HTA experts who responded to an email invitation participated in a telephone interview. We used qualitative content analysis to analyze the anonymized transcripts. We conducted a comprehensive literature search for studies that used PROs to investigate burden of disease or to assess the impact of interventions across the five LSDs of interest.

Results: Interviews with seven researchers and six HTA experts representing eight countries revealed five themes. These were: (i) the importance of using psychometrically sound PROs in studies with rare diseases, (ii) the paucity of disease-specific PROs, (iii) the importance of having PRO data for economic analyses, (iv) practical and psychometric limitations of existing PROs, and (v) suggestions for new PROs. The systematic review has been completed.

Conclusions: The interviews highlight current challenges and opportunities experienced by researchers and HTA experts involved in work with rare LSDs. The ongoing systematic review will highlight the experience, opportunities, and limitations of PROs in LSDs and provide suggestions for future research.

Objectives: Although consideration of ethical issues is recognized as a crucial part of health technology assessment, ethics analysis for HTA is generally perceived as methodologically underdeveloped in comparison to other HTA domains. The aim of our study is (i) to verify existing tools for quality assessment of ethics analyses for HTA, (ii) to consider some arguments for and against the need for quality assessment tools for ethics analyses for HTA, and (iii) to propose a preliminary set of criteria that could be used for assessing the quality of ethics analyses for HTA.

Methods: We systematically reviewed the literature, reviewed HTA organizations’ Web sites, and solicited views from thirty-two experts in the field of ethics for HTA.

Results: The database and HTA agency Web site searches yielded 420 references (413 from databases, seven from HTA Web sites). No formal instruments for assessing the quality of ethics analyses for HTA purposes were identified. Thirty-two experts in the field of ethics for HTA from ten countries, who were brought together at two workshops held in Edmonton (Canada) and Cologne (Germany) confirmed the findings from the literature.

Conclusions: Generating a quality assessment tool for ethics analyses in HTA would confer considerable benefits, including methodological alignment with other areas of HTA, increase in transparency and transferability of ethics analyses, and provision of common language between the various participants in the HTA process. We propose key characteristics of quality assessment tools for this purpose, which can be applied to ethics analyses for HTA purposes.