PP205 The Use Of Real-World Evidence To Support National Institute For Health And Care Excellence Medical Technology Submissions

Abstract

Introduction

Although randomized controlled trials (RCTs) are recognized as providing the highest level of clinical evidence, few medical device RCTs are available due to underfunding or inherent challenges associated with trial design. This study examines the extent to which real-world evidence (RWE) supports the recommendations made by the National Institute for Health and Care Excellence Medical Technologies Evaluation Programme (MTEP).

Methods

All MTEP guidance documents published online prior to October 2020 were reviewed. The “case for adoption” recommendation, type of clinical data, and clinical critiques for each MTEP submission were extracted and categorized. RWE was defined as studies with neither blinding nor prospective selection or control of patient characteristics.

Results

Of the MTEP submissions reviewed, 34 of 45 (76%) received a positive recommendation. Independent of outcome, all submissions included RWE, but only 19 (42%) utilized RCT evidence (15 were recommended and four were not). Meta-analyses of RWE were used whenever possible. The most common clinical critiques in unsuccessful submissions were the following: (i) not generalizable to the United Kingdom National Health Service (NHS); (ii) low quality; (iii) likelihood of bias; (iv) trial design faults; (v) uncertain benefit; and (vi) evidence unrelated to scope.

Conclusions

This study suggests that while the use of RCTs has not always led to a positive recommendation, RWE can be valuable in decision-making. Evidence that is generalizable to the NHS, is related to the scope, and shows clear indication of benefit is more likely to positively influence MTEP decision-making.