OP30 Model for ASsessing The Value Of AI In Medical Imaging (MAS-AI)

Abstract

Introduction

Artificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, assessment of the value of these new technologies is still unclear and no agreed international HTA-based guideline exists. Therefore, a Model for ASsessing the value of AI (MAS-AI) in medical imaging was developed by a multidisciplinary group of experts and patient representatives.

Methods

The MAS-AI guideline is based on four steps. First a literature review of existing guides, evaluations, and assessments of the value of AI in the field of medical imaging (5,890 studies were assessed with 86 studies included in the scoping review). Next, interviews with leading researchers in AI in Denmark. The third step was two workshops where decision-makers, patient organizations and researchers discussed crucial topics when evaluating AI. Between workshops, the multidisciplinary team revised the model according to comments from workshop-participants. Last step is a validation workshop in Canada.

Results

The MAS-AI guideline has three parts. There are two steps covering nine domains and then advises for the evaluation process. Step 1 contains a description of patients, how the AI-model was developed, and initial ethical and legal considerations. Finishing the four domains in Step 1 is a prerequisite for moving to step 2. In step 2, a multidisciplinary assessment of outcomes of the AI-application is done for the five remaining domains: safety, clinical aspects, economics, organizational aspects and patient aspects. The last part, is five advices to facilitate a good evaluation process.

Conclusions

We have developed an HTA based framework to support the prospective phase while introducing novel AI technologies into healthcare in medical imaging. MAS-AI can assist HTA organizations (and companies) in selecting the relevant domains and outcome measures in the assessment of AI applications. It is important to ensure uniform and valid decisions regarding the adoption of AI technology with a structured process and tool. MAS-AI can help support these decisions and provide greater transparency for all parties involved.