228 Visualizing impact: Operationalizing community engagement evaluation using the RE-AIM framework

Abstract

Objectives/Goals: We operationalized our evaluation using the RE-AIM framework, by defining its dimensions as nodes within a net effect diagram in the form of radar charts to visually display group variation among nodes. This enhanced our ability to measure the reach, effectiveness, and implementation of our efforts in under-resourced Los Angeles communities. Methods/Study Population: We applied the RE-AIM framework to guide the operationalization of evaluation methods, defining the RE-AIM dimensions generally with a focus on reach, effectiveness, and implementation. We developed and defined a standardized scoring system for metrics that contributed to the RE-AIM dimensions of focus, using data from our activities such as health education workshops targeting diverse, under-resourced populations in Los Angeles. Our standardized scoring system ranged from 1 to 5, reflecting the degree of success within each metric/dimension. Scores were mapped in net effect diagrams in the form of radar charts to enable comparative analysis and visualization, highlighting a variety of grouped variables (i.e., language, locations, and adaptation). Results/Anticipated Results: The operationalized and developed scoring system allowed us to standardize assessment across the RE-AIM dimensions, making it possible to visualize our impact through net effect diagrams. These diagrams illustrated variations in reach, effectiveness, and implementation across different community engagement activities stratified by group variables, providing insights into our impact and areas for adjustment. Preliminary results suggest that the net effect diagram effectively captures both broad and nuanced impacts and serves as a viable application of the RE-AIM framework. The use of standardized scoring enhances data comparability and offers a dynamic visual tool for monitoring ongoing and future initiatives while serving as a tool to display and report our impact. Discussion/Significance of Impact: Operationalizing evaluation with the RE-AIM framework and implementing a standardized scoring system allows us to visualize and monitor effectiveness in real time. This system supports data-driven decision-making for our sustainable, impactful community engagement initiatives ultimately contributing to our goal of improving health equity.