OP77 Conducting Rapid Assessments: Lessons From 25 Years Of Good Practice

Abstract

Introduction:

The Health Technology Assessment (HTA) Program at the Institute of Health Economics (IHE) has conducted rapid assessments (RAs) for 25 years. The presentation draws on this experience to chart the evolution of RAs over a 25-year relationship between a policy maker and an arms-length HTA agency to quantify the effects of this partnership on the RAs produced.

Methods:

The number, types, and methodological attributes of RAs produced over a 25-year partnership with a single requestor were reviewed. The reasons for developmental changes in RA products over time were charted to document the push-pull tension between requestor needs and HTA best practice. The elements contributing to the relevance and impact, or not, of the RAs were also identified.

Results:

Results demonstrated the dynamic relationship required for HTA researchers to meet best practice and requestor needs. As literature search spans lengthened and data analyses became more complex, limitations were imposed on RAs to fulfill the requirements of timeliness, utility, and best practice. Adaptations were driven by requestor, researcher, and the external policy environment. Facilitators of RA utility for HTA requestors include: asking focused, well-articulated questions; specifying the request's purpose; providing detailed information about local context and other relevant issues; and understanding the risk of bias associated with RAs. Considerations for HTA doers include: assembling a team using a triage process; involving requestors throughout RA development; negotiating deliverables and timelines using a HTA product matrix; transparently reporting methods; narratively describing methodological issues; and internally reviewing the draft RAs.

Conclusions:

RAs are a useful component of HTA programs. To keep these products relevant and useful, HTA agencies must allow RAs to evolve according to need, but with grounding in good practice. Negotiating the line between rigor and relevance is a key skill for HTA agencies. Having the right team is helpful.