P.070 Using AI to revolutionize clinical training through OSCE-GPT: a focused exploration of user feedback on otolaryngology and neurology cases

Abstract

Background: OSCE-GPT (https://learnmedicine.ca/) is an AI-based app that integrates history, physical exam, and relevant components for case guidance across medical disciplines to help trainees improve clinical skills. With global users across 60+ countries, this preliminary quality improvement study gathers user feedback on neurology and otolaryngology cases. Methods: A survey was distributed to users at the University of Ottawa and Cumming School of Medicine. Participants provided insights on the app’s use, perceived benefits, and suggested improvements. Results: Using 5-point Likert scales, 13 respondents, 9 of which evaluated an otolaryngology case, rated the overall usefulness of the learning tool 4.57± 0.51 (1=very poor, 5=very good), with a score of 4.00±0.65 relative to other teaching methods, such as didactic lectures or grand rounds (1=much worse, 5=much better). Users noted realistic interactions and self-paced learning as beneficial factors. Areas for improvement included a more fluid transition between physical exams and history, geographic variations in cases, and the addition of elements such as non-verbal patient cues or emotional. Conclusions: This study demonstrates utility of OSCE-GPT for medical trainees, particularly for otolaryngology and neurology cases. As cases continue to be added, feedback will be implemented to further improve user experience.