Incorporating emerging knowledge into Emergency Medical Service (EMS) competency assessments is critical to reflect current evidence-based out-of-hospital care. However, a standardized approach is needed to incorporate new evidence into EMS competency assessments because of the rapid pace of knowledge generation.

The objective was to develop a framework to evaluate and integrate new source material into EMS competency assessments.

The National Registry of Emergency Medical Technicians (National Registry) and the Prehospital Guidelines Consortium (PGC) convened a panel of experts. A Delphi method, consisting of virtual meetings and electronic surveys, was used to develop a Table of Evidence matrix that defines sources of EMS evidence. In Round One, participants listed all potential sources of evidence available to inform EMS education. In Round Two, participants categorized these sources into: (a) levels of evidence quality; and (b) type of source material. In Round Three, the panel revised a proposed Table of Evidence. Finally, in Round Four, participants provided recommendations on how each source should be incorporated into competency assessments depending on type and quality. Descriptive statistics were calculated with qualitative analyses conducted by two independent reviewers and a third arbitrator.

In Round One, 24 sources of evidence were identified. In Round Two, these were classified into high- (n = 4), medium- (n = 15), and low-quality (n = 5) of evidence, followed by categorization by purpose into providing recommendations (n = 10), primary research (n = 7), and educational content (n = 7). In Round Three, the Table of Evidence was revised based on participant feedback. In Round Four, the panel developed a tiered system of evidence integration from immediate incorporation of high-quality sources to more stringent requirements for lower-quality sources.

The Table of Evidence provides a framework for the rapid and standardized incorporation of new source material into EMS competency assessments. Future goals are to evaluate the application of the Table of Evidence framework in initial and continued competency assessments.

In a 2015 report, the Institute of Medicine (IOM; Washington, DC USA), now the National Academy of Medicine (NAM; Washington, DC USA), stated that the field of Emergency Medical Services (EMS) exhibits signs of fragmentation; an absence of system-wide coordination and planning; and a lack of federal, state, and local accountability. The NAM recommended clarifying what roles the federal government, state governments, and local communities play in the oversight and evaluation of EMS system performance, and how they may better work together to improve care.

This systematic literature review and environmental scan addresses NAM’s recommendations by answering two research questions: (1) what aspects of EMS systems are most measured in the peer-reviewed and grey literatures, and (2) what do these measures and studies suggest for high-quality EMS oversight?

To answer these questions, a systematic literature review was conducted in the PubMed (National Center for Biotechnology Information, National Institutes of Health; Bethesda, Maryland USA), Web of Science (Thomson Reuters; New York, New York USA), SCOPUS (Elsevier; Amsterdam, Netherlands), and EMBASE (Elsevier; Amsterdam, Netherlands) databases for peer-reviewed literature and for grey literature; targeted web searches of 10 EMS-related government agencies and professional organizations were performed. Inclusion criteria required peer-reviewed literature to be published between 1966-2016 and grey literature to be published between 1996-2016. A total of 1,476 peer-reviewed titles were reviewed, 76 were retrieved for full-text review, and 58 were retained and coded in the qualitative software Dedoose (Manhattan Beach, California USA) using a codebook of themes. Categorizations of measure type and level of application were assigned to the extracted data. Targeted websites were systematically reviewed and 115 relevant grey literature documents were retrieved.

A total of 58 peer-reviewed articles met inclusion criteria; 46 included process, 36 outcomes, and 18 structural measures. Most studies applied quality measures at the personnel level (40), followed by the agency (28) and system of care (28), and few at the oversight level (5). Numerous grey literature articles provided principles for high-quality EMS oversight.

Limited quality measurement at the oversight level is an important gap in the peer-reviewed literature. The grey literature is ahead in this realm and can guide the policy and research agenda for EMS oversight quality measurement.

TaymourRK, AbirM, ChamberlinM, DunneRB, LowellM, WahlK, ScottJ. Policy, Practice, and Research Agenda for Emergency Medical Services Oversight: A Systematic Review and Environmental Scan. Prehosp Disaster Med. 2018;33(1):89–97.

Research suggests Emergency Medical Services (EMS) over-use in urban cities is partly due to substance users with limited access to medical/social services. Recent efforts to deliver brief, motivational messages to encourage these individuals to enter treatment have not considered EMS providers.

Little research has been done with EMS providers who serve substance-using patients. The EMS providers were interviewed about participating in a pilot program where they would be trained to screen their patients for substance abuse and encourage them to enter drug treatment.

Qualitative interviews were conducted with Baltimore City Fire Department (BCFD; Baltimore, Maryland USA) EMS providers (N=22). Topics included EMS misuse, work demands, and views on participating in the pilot program. Interviews were transcribed and analyzed using grounded theory and constant-comparison.

Participants were mostly white (68.1%); male (68.2%); with Advanced Life Skills training (90.9%). Mean age was 37.5 years. Providers described the “frequent flyer problem” (eg, EMS over-use by a few repeat non-emergent cases). Providers expressed disappointment with local health delivery due to resource limitations and being excluded from decision making within their administration, leading to reduced team morale and burnout. Nonetheless, providers acknowledged they are well-positioned to intervene with substance-using patients because they are in direct contact and have built rapport with them. They noted patients might be most receptive to motivational messages immediately after overdose revival, which several called “hitting their bottom.” Several stated that involvement with the proposed study would be facilitated by direct incorporation into EMS providers’ current workflow. Many recommended that research team members accompany EMS providers while on-call to observe their day-to-day work. Barriers identified by the providers included time constraints to intervene, limited knowledge of substance abuse treatment modalities, and fearing negative repercussions from supervisors and/or patients. Despite reservations, several EMS providers expressed inclination to deliver brief motivational messages to encourage substance-using patients to consider treatment, given adequate training and skill-building.

Emergency Medical Service providers may have many demands, including difficult case time/resource limitations. Even so, participants recognized their unique position as first responders to deliver motivational, harm-reduction messages to substance-using patients during transport. With incentivized training, implementing this program could be life- and cost-saving, improving emergency and behavioral health services. Findings will inform future efforts to connect substance users with drug treatment, potentially reducing EMS over-use in Baltimore.

Maragh-Bass AC , Fields JC , McWilliams J , Knowlton AR . Challenges and Opportunities to Engaging Emergency Medical Service Providers in Substance Use Research: A Qualitative Study. Prehosp Disaster Med. 2017;32(2):148–155.