117 Applying the Competency Index for Clinical Research Professionals (CICRP) for Educational Program Evaluation

Abstract

OBJECTIVES/GOALS: To demonstrate the value of the Competency Index for Clinical Research Professional (CICRP) as a tool in program evaluation using a pre- and post- design to evaluate student perceived self-efficacy in clinical trial competencies at program entry and at program completion. METHODS/STUDY POPULATION: Using a separate-sample pre-post study design, we administered the CICRP questionnaire to students in the entry and exit courses of the Master of Clinical Research (MCR) Program during the 2021-2022 academic year, using QualtricsTM (Provo, Utah) survey instrument for use on desktop or mobile device. We included the 20 CICRP competency items asking students to rate their self-efficacy in performing each item using a Likert Scale (from 0-10) (0=not at all confident; 10= extremely confident). Links to the survey were included in the courses for the foundational entry course and for the final culminating project course. RESULTS/ANTICIPATED RESULTS: Overall, 54 students took the CICRP during the entry course and 56 during the exit. Cronbach’s alpha for each assessment ranged from 0.93 to 0.98. Both the Welch’s two-sample t-test and Wilcoxon rank-sum test show very significant differences between the group of students entering the program and leaving the program (p value < 0.001). A significant increase in mean CICRP total score is seen at each experience level between program entry and program exit (p<0.001) A linear regression, adjusting for available covariates, individuals taking the exit course have a mean CICRP total score 92.690 (p value < 0.001) higher than individuals taking the entry course. DISCUSSION/SIGNIFICANCE: Competency indices have been used to measure self-efficacy in translational research scientists, thus the use of CICRP to measure self-efficacy can be useful in assessing whether our competency-based program is meeting the JTF Competency needs of students.