PP133 Developing A Novel Multifaceted Graphical Visualization For Treatment Ranking Within An Interactive Network Meta-Analysis Application

Abstract

Introduction

Network meta-analysis (NMA) is a key methodology for comparing the effectiveness of multiple interventions or treatments simultaneously. This project aimed to ascertain current methods and visualizations for treatment ranking within an NMA framework and to subsequently develop a novel graphic within MetaInsight (an interactive NMA web application), to aid clinicians and stakeholders when making decisions regarding the “best” intervention(s) for their patient(s).

Methods

Current literature on the methodology or visualization of treatment ranking published in the last 10 years was collated and studied. Based on the literature, a novel graphical visualization was developed using RShiny (RStudio, PBC) and integrated within MetaInsight, which is currently hosted on shinyapps.io.

Results

Bayesian analyses produce rank probabilities from which mean or median rank and surface under the cumulative ranking curve can be calculated. For frequentist analyses the p-value is available. The simpler methods may be easier to interpret, but they are often more unstable and do not encompass the whole analysis (and vice versa). To aid interpretation and facilitate sensitivity analysis, an interactive graphic was developed that presents rankings alongside treatment effect and study quality results.

Conclusions

Treatment ranking is useful, but the results should be interpreted cautiously, and the visualization should be transparent and all-encompassing. A ‘living’ version of MetaInsight, with treatment ranking, would allow interested parties to follow the evidence base as it grows.