Simulation-based education in Canadian emergency medicine (EM) has been expanding for many years. This month's CJEM includes three papers that help readers understand both the collaborative expansion and some of the ongoing challenges. While local siloed innovations may have driven much of the initial development of simulation-based education, the current innovations are functioning to bring individuals and sites together with common goals and processes. Despite this collective forward movement, there are clear challenges that have come with the increased expectations of simulation, and there is still much work to be done.
In this issue of CJEM, Caners et al.Reference Caners, Baylis, Heyd and Chan1 demonstrate for us how the development of the novel EMSimCases Free Open Access Medical Education site, with its simulation case database and other resources for simulation educators, has fostered a culture of sharing and collaboration across the country. Simultaneously, Baylis et al.Reference Baylis, Heyd and Thoma2 articulate an innovative response to the problem of site or person-specific case development and structure, by harnessing a national group of educators and stakeholders in the creation of a standardized national simulation case template. Via diffusion from site leads to local simulation educators across training sites in Canada, this template is already being used broadly. The combination of a standardized case template and a reputable, peer-reviewed platform for sharing, suddenly brings all simulation educators together in the creation, revision, and implementation of simulation-based education. This has given training programs with limited resources or experience the opportunity to engage in simulation-based training without re-inventing the wheel. The outcome will be an educational experience across Canada that is more standardized and consistent between sites.
Increasing use and availability of simulation has come with increased expectations of what we can do with simulation. In our recent transition to competency-based medical education (CBME)Reference Sherbino, Bandiera and Doyle3 and the clear demand for accountability and documentation of competence, there is motivation for some of our assessments to be performed in the simulated environment. To supplement workplace-based assessment in the heterogeneous and clinically unpredictable emergency department, the simulation-based assessment has been encouraged as a mechanism of standardized assessment across programs, for both summative and formative intents, without any resultant harm or alterations to real-patient care.Reference Hall, Chaplin and McColl4 It makes intuitive sense to many that trainee performance in the simulated environment would be a surrogate for real-world performance. In this issue of CJEM, however, Prudhomme et al.Reference Prudhomme, O'Brien, McConnell, Dudek and Cheung5 highlight the complexities of the relationship between simulation-based assessment and real-world performance. They found, in fact, a minimal correlation between trainee assessments of the same Entrustable Professional Activities (EPAs) in the simulated environment as compared to the real world. So while there is evidence supporting the correlation between performance in simulated and real-world environments, particularly in procedural domains,Reference Brydges, Hatala, Zendejas, Erwin and Cook6 the relationship is clearly more complicated when looking at broad multi-dimensional skills like resuscitation.
So, if simulation is being used with increasing frequency, consistency, and more complex expectations across the country, how can we respond to the challenges that may arise? Following in the collaborative spirit of Caners et al.Reference Caners, Baylis, Heyd and Chan1 and Baylis et al.,Reference Baylis, Heyd and Thoma2 the Emergency Medicine National Simulation Education Researchers Collaborative (EM-SERC)Reference Chaplin, Thoma and Petrosoniak7 and others engaging in both research and evaluation studies can engage in multi-site simulation studies to start asking these important questions. In addition to encouraging the use of simulation for assessment, the transition to CBME has brought a substantial increase in assessment data. Thoma et al.Reference Thoma, Hall and Clark8 have encouraged us to use these data for evaluation recently with a national study aggregating and analysing EPA assessments across Canadian training programs with an aim to understand EPA assessment patterns and progression decisions. Moving forward, as more assessment data emerges from the simulation environment, we can use these data to compare qualitative and quantitative assessment data from both environments to understand their relationship and contributions.
In summary, we need to continue to move forward with our use of simulation, share cases and experiences using sites like EMSimCases,Reference Caners, Baylis, Heyd and Chan1 and use a national case template,Reference Baylis, Heyd and Thoma2 while doing so with an awareness that there are challenges with the increased use of simulation that are still to be addressed. Overall, the understanding that we are all moving forward as group, with shared goals and prioritiesReference Chaplin, Thoma and Petrosoniak7 rather than as siloed institutions, is certainly reassuring. Being able to work and speak as one gives global credibility and the potential to answer tough questions through national collaboration and research. Overall, we hope that EM education will be enhanced by ongoing collaborative efforts to standardize our approach to simulation and critically explore its strengths and limitations.
You have
Access
Simulation-based education in Canadian emergency medicine (EM) has been expanding for many years. This month's CJEM includes three papers that help readers understand both the collaborative expansion and some of the ongoing challenges. While local siloed innovations may have driven much of the initial development of simulation-based education, the current innovations are functioning to bring individuals and sites together with common goals and processes. Despite this collective forward movement, there are clear challenges that have come with the increased expectations of simulation, and there is still much work to be done.
In this issue of CJEM, Caners et al.Reference Caners, Baylis, Heyd and Chan1 demonstrate for us how the development of the novel EMSimCases Free Open Access Medical Education site, with its simulation case database and other resources for simulation educators, has fostered a culture of sharing and collaboration across the country. Simultaneously, Baylis et al.Reference Baylis, Heyd and Thoma2 articulate an innovative response to the problem of site or person-specific case development and structure, by harnessing a national group of educators and stakeholders in the creation of a standardized national simulation case template. Via diffusion from site leads to local simulation educators across training sites in Canada, this template is already being used broadly. The combination of a standardized case template and a reputable, peer-reviewed platform for sharing, suddenly brings all simulation educators together in the creation, revision, and implementation of simulation-based education. This has given training programs with limited resources or experience the opportunity to engage in simulation-based training without re-inventing the wheel. The outcome will be an educational experience across Canada that is more standardized and consistent between sites.
Increasing use and availability of simulation has come with increased expectations of what we can do with simulation. In our recent transition to competency-based medical education (CBME)Reference Sherbino, Bandiera and Doyle3 and the clear demand for accountability and documentation of competence, there is motivation for some of our assessments to be performed in the simulated environment. To supplement workplace-based assessment in the heterogeneous and clinically unpredictable emergency department, the simulation-based assessment has been encouraged as a mechanism of standardized assessment across programs, for both summative and formative intents, without any resultant harm or alterations to real-patient care.Reference Hall, Chaplin and McColl4 It makes intuitive sense to many that trainee performance in the simulated environment would be a surrogate for real-world performance. In this issue of CJEM, however, Prudhomme et al.Reference Prudhomme, O'Brien, McConnell, Dudek and Cheung5 highlight the complexities of the relationship between simulation-based assessment and real-world performance. They found, in fact, a minimal correlation between trainee assessments of the same Entrustable Professional Activities (EPAs) in the simulated environment as compared to the real world. So while there is evidence supporting the correlation between performance in simulated and real-world environments, particularly in procedural domains,Reference Brydges, Hatala, Zendejas, Erwin and Cook6 the relationship is clearly more complicated when looking at broad multi-dimensional skills like resuscitation.
So, if simulation is being used with increasing frequency, consistency, and more complex expectations across the country, how can we respond to the challenges that may arise? Following in the collaborative spirit of Caners et al.Reference Caners, Baylis, Heyd and Chan1 and Baylis et al.,Reference Baylis, Heyd and Thoma2 the Emergency Medicine National Simulation Education Researchers Collaborative (EM-SERC)Reference Chaplin, Thoma and Petrosoniak7 and others engaging in both research and evaluation studies can engage in multi-site simulation studies to start asking these important questions. In addition to encouraging the use of simulation for assessment, the transition to CBME has brought a substantial increase in assessment data. Thoma et al.Reference Thoma, Hall and Clark8 have encouraged us to use these data for evaluation recently with a national study aggregating and analysing EPA assessments across Canadian training programs with an aim to understand EPA assessment patterns and progression decisions. Moving forward, as more assessment data emerges from the simulation environment, we can use these data to compare qualitative and quantitative assessment data from both environments to understand their relationship and contributions.
In summary, we need to continue to move forward with our use of simulation, share cases and experiences using sites like EMSimCases,Reference Caners, Baylis, Heyd and Chan1 and use a national case template,Reference Baylis, Heyd and Thoma2 while doing so with an awareness that there are challenges with the increased use of simulation that are still to be addressed. Overall, the understanding that we are all moving forward as group, with shared goals and prioritiesReference Chaplin, Thoma and Petrosoniak7 rather than as siloed institutions, is certainly reassuring. Being able to work and speak as one gives global credibility and the potential to answer tough questions through national collaboration and research. Overall, we hope that EM education will be enhanced by ongoing collaborative efforts to standardize our approach to simulation and critically explore its strengths and limitations.
Competing interests
None declared.