236 Mixed-method approaches to evaluating UIC’s CTSA Hub

Abstract

Objectives/Goals: The University of Illinois Chicago’s Center for Clinical and Translational Science has implemented an innovative approach to program evaluation. We blend high-impact quantitative and in-depth qualitative approaches to identify local and national impacts and areas for improvement that are not captured solely by traditional quantitative methods. Methods/Study Population: CCTS manages service requests and investigator demographics through an in-house system that our evaluation program utilizes to report on service requests, investigator satisfaction, and investigator demographics to service groups, CTSA and campus leadership, and other stakeholders throughout the year. Through this system, we are able to regularly survey and interview investigators about their experiences and solicit feedback about the service process. During interviews, we focus on questions about receiving services, recommendations for CCTS and colleagues, and plans to work with CCTS in the future. This mixed-methods approach helps us lay the foundation to expand evaluation beyond reporting and establish a robust CQI program that focuses both on CCTS staff needs and improving investigator experiences. Results/Anticipated Results: Soliciting both quantitative and qualitative feedback from investigators has enabled our service groups to make significant changes to their internal processes to ensure that investigators are aware of services and supports available. Our quantitative data show us that investigators return time and again to CCTS for services and supports. Yet the feedback we receive through short, targeted interviews also helps identify challenges that investigators experience that could improve the services they come to us to receive. We have already used this system to recommend improved marketing of existing services within certain service groups that were highly requested by investigators, which increased utilization of that service. Discussion/Significance of Impact: Our mixed-method approach to evaluation allows us to easily and rapidly identify areas for improvement within our service groups, an instrumental part of implementing a CQI program that is focused on staff-identified areas of improvement. This approach can be easily replicated by other CTSA hubs with minimal impact to existing resources.