Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-29T01:55:12.118Z Has data issue: false hasContentIssue false

Implementation should be a standard component of practice guidelines and guidance documents

Published online by Cambridge University Press:  02 March 2023

Joshua K. Schaffzin*
Affiliation:
Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio Division of Infectious Diseases, Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio
Emily E. Sickbert-Bennett
Affiliation:
Division of Infectious Diseases, Department of Medicine, UNC- Chapel Hill, Chapel Hill, North Carolina Department of Infection Prevention, UNC Medical Center, Chapel Hill, North Carolina
Valerie M. Deloney
Affiliation:
Society for Healthcare Epidemiology of America (SHEA), Arlington, Virginia
David J. Weber
Affiliation:
Division of Infectious Diseases, Department of Medicine, UNC- Chapel Hill, Chapel Hill, North Carolina Department of Infection Prevention, UNC Medical Center, Chapel Hill, North Carolina
*
Author for correspondence: Joshua K Schaffzin, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Type
Commentary
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Studies have demonstrated that guidelines that include implementation instructions or tools are more likely to be utilized in practice Reference Murthy, Shepperd and Clarke1,Reference Okelo, Butz and Sharma2 and presumably lead to desirable outcomes. Nonetheless, systematic evaluations of clinical practice guidelines have repeatedly demonstrated low applicability, meaning inadequate provision of tools to implement and sustain recommended practices. Reference Gagliardi and Brouwers3 This situation has been reflected in a recent evaluation of surgical site infection (SSI) prevention guidelines using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) tool. Reference Brouwers, Kho and Browman4,Reference Gillespie, Bull, Walker, Lin, Roberts and Chaboyer5

Understanding how others have implemented recommended practices can help healthcare organizations translate evidence into practice by identifying strategies that others have used to successfully enact changes and spread them broadly. Reference Tabak, Khoong, Chambers and Brownson6 Historically, practice guidelines and guidance documents have summarized and reported evidence supporting the adoption of specific practices. But adopting a practice is not the same as implementing it, Reference Krein, Olmsted and Hofer7 and the absence of information to assist with implementation of a recommended practice may delay adoption and, therefore, fail to achieve the intended outcome. Reference Nilsen, Stahl, Roback and Cairney8

To better link adoption and implementation, we propose that information and resources to assist with the implementation of recommended practices be a standard part of all practice guidelines and guidance documents. In this commentary, we provide arguments to support inclusion of implementation recommendations in all practice guidelines and guidance documents, counter possible perceived deficiencies in the available evidence, and offer suggestions for incorporating implementation tools and resources into existing guidance formats.

For the purposes of this document, we use the terms ‘practice guideline’ and ‘guidance document’ to refer to any recommendations-based document (eg, guideline, expert guidance, consensus statement) and ‘implementation’ to mean “methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice.” Reference Eccles and Mittman9 A comprehensive discussion of implementation science and practice is beyond the scope of this commentary; however, we encourage readers to access materials available through SHEA (https://learningce.shea-online.org/search?text=implement; https://ortp.guidelinecentral.com/) and published materials. Reference Damschroder, Aron, Keith, Kirsh, Alexander and Lowery10Reference Livorsi, Drainoni and Reisinger13

Benefits

High-quality evidence, such as that derived from well-conducted randomized clinical trials, is thought to drive the ‘what’ of practice but does little to explain the ‘how.’ Implementation science (the study of methods to promote implementation) Reference Eccles and Mittman9 seeks to drive the ‘how.’ Combining high-quality evidence with strategies, tools, and resources demonstrated to be effective in incorporating these evidence-based interventions into routine clinical practice could reap substantial benefits. For example, a published trial demonstrated a decreased presence of 3 multidrug-resistant organisms and Clostridioides difficile and lower incidence of transmission to subsequent patients when rooms were disinfected with a quaternary ammonium product (or bleach for C. difficile) followed by ultraviolet C irradiation (absolute risk reduction, 17.4%). The coverage with UV-C irradiation was ∼55% (2,848 rooms of 5,178 rooms in the intention-to-treat cohort). Reference Anderson, Chen and Weber14 In a recently published study on UV-C program implementation, irradiation of 86% of isolation rooms was achieved by utilizing devices with shorter disinfection cycles and a targeted approach to disinfect high-priority rooms. Reference Schaffzin, Wilhite, Li, Finney, Ankrum and Moore15 It is tempting to speculate how the benefit of the first study’s interventions would increase if room coverage could be improved using the approach in the latter trial. Similar large-scale impacts could be envisioned in antimicrobial stewardship, in which implementation research has shown interventions like telehealth for rural facilities Reference Stevenson, Banks and Stryczek16,Reference Wilson, Banks and Crnich17 and handshake stewardship Reference MacBrayne, Williams and Levek18 to be effective on a small scale. The feasibility (eg, time spent developing and executing the intervention) and qualitative experiential data (eg, stakeholders’ perception of the intervention) reported could guide an institution to translate the evidence into action locally. The World Health Organization has recognized the need for implementation tools by publishing guides that accompany guidelines. The 2009 hand hygiene guideline established the widely adopted WHO Five Moments. 19 The implementation guide offers ways to adhere to the Five Moments (eg, sink placement in room design, availability of hand sanitizer, monitoring systems, etc), enabling maximal prevention opportunity. 20 Additional implementation guides have been developed for a variety of areas, including healthcare provider vaccination 21 and surgical safety. 22

Many facilities invest in implementation, and online resources are available to learn methodology. However, smaller and independent facilities and practices may not have access to these. When guidance documents provide evidence-based strategies for implementation, they likely help facilities justify the necessary infrastructure investment. Healthcare facilities are judged according to their outcomes, both financially and publicly. The push for transparency is important to ensure that high-quality care is provided to all. To this end, regulatory authorities like the US Centers for Medicare and Medicaid Services (CMS) and accrediting organizations like The Joint Commission emphasize using evidence-based guidance to create policies. 23 A written policy without effective implementation does not necessarily translate into practice. 24 Thus, implementing evidence-based practices would enable facilities to adhere to CMS and Joint Commission standards effectively, improve outcomes, and create safer healthcare environments for patients and staff.

Evidence availability and quality

A large volume of literature has been published detailing implementation principles, methods, validity, and applicability. It is likely that for any question raised in a practice guideline or guidance document, there will be evidence-based strategies to address it directly or in general, or a systematic review that provides an overview of previous experience. Reference Pereira, Silva, Carvalho, Zanghelini and Barreto25 Although the literature includes many single-center quality improvement (QI) reports, studies reporting results from large-scale networks and multifacility collaborations have demonstrated the means and impact of implementing evidence-based recommendations. Efforts have been published and utilized widely that have reduced healthcare-associated infection (HAI) rates, including central-line–associated bloodstream infection, Reference Berenholtz, Lubomski and Weeks26 surgical-site infection, Reference Schaffzin, Harte and Marquette27,Reference Schweizer, Chiang and Septimus28 and catheter-associated urinary tract infection, Reference Mody, Greene and Meddings29,Reference Saint, Greene and Krein30 as well as patient exposure to broad-spectrum antibiotics. Reference Hartley, Kuhn and Valley31 The tools and other resources that were developed as part of these large-scale collaborations are prime examples of implementation evidence that should be incorporated into guidance.

Limiting guidelines to GRADE (Grading of Recommendations Assessment, Development and Evaluation) Reference Guyatt, Oxman, Schunemann, Tugwell and Knottnerus32 standards may exclude important insights, particularly for implementation. GRADE is often used to determine the inclusion of evidence in guidelines and is designed to favor randomized trials and to a lesser extent cohort or other observational studies. It is most applicable for safety and efficacy of therapeutics and vaccines in part because the US Food and Drug Administration requires such trials for approval or authorization. Randomized trials are less common in implementation science and infection prevention, and GRADE would classify much of the literature as ‘low quality.’

Evidence for infection prevention practices and implementation is composed of a wider variety of study designs (eg, case–control or retrospective cohort). These studies are well conducted and appropriately designed, making them valid for answering important epidemiologic and practical questions and to guide practice. Acknowledging that restrictive literature review and evidence-grading methodologies can limit guidance development, especially in fields that face feasibility or ethical limitations for research topics (eg, infection prevention and healthcare epidemiology), the Society for Healthcare Epidemiology of America (SHEA) has developed documents such as expert guidance and consensus statements to provide recommendations that are important to the safety of patients and healthcare personnel but are derived from published papers using a broader selection of validated study designs. Implementation evidence fits well within these guidance documents. The Infection Prevention in the Anesthesia Workplace expert guidance included an implementation section Reference Munoz-Price, Bowdle and Johnston33 as did a webinar discussing implementation in general and for the guidance document’s recommendations. 34 Similarly, a companion guide was generated for implementing the COVID-19 Vaccine as a Condition of Employment Multi-Society Consensus Statement. Reference Schaffzin, Murthy and Deloney35 The 2014 and 2022 versions of the SHEA Compendium of Strategies to Prevent Healthcare-Associated Infections in Acute-Care Hospitals included implementation recommendations in all sections, and the latter will include a dedicated implementation chapter. 36,Reference Yokoe, Anderson and Berenholtz37

Guidance format

To operationalize this change, it is necessary to consider how implementation might be presented within current practice guideline and guidance document formats. An implementation effort’s success relies heavily on 2 key factors: the context of the work (local factors such as operational support, informatics resources, familiarity and experience, willingness to change, safety culture, etc) Reference Geerligs, Rankin, Shepherd and Butow38Reference Tomoaia-Cotisel, Scammon and Waitzman41 and the conceptual framework utilized for the effort. In 2010, Saint et al Reference Saint, Howell and Krein40 articulated the importance of conceptual framework as it pertains to infection prevention by assessing the failure of Semmelweiss’ conclusive hand hygiene data to become standard practice. They speculated that it was due to 3 factors: a delay in publication, offending those who challenged his findings, and lack of a conceptual framework. Germ theory had yet to be proposed, and providers struggled to find a way to link “infective vapors” to hand hygiene. Reference Saint, Howell and Krein40

In most current guidance, recommended practices are prescriptive by design, providing an action facilities or healthcare personnel should perform for improved outcomes. Guidance for implementation by its nature should not be prescriptive. Rather, it should make it easy for institutions to understand a framework used to generate evidence to help them determine how to proceed locally, such as identifying local factors that would affect implementation and choosing a framework likely to be successful. Summarizing others’ experiences can help facilities decide which path to follow. Reference Schaffzin, Murthy and Deloney35 Similarly, evidence utilized need not be specific to the area in which the guidance is concentrated. For example, strategies used to guide consumer choices have been used to improve adherence to infection prevention interventions such as hand hygiene. Reference Bradt43Reference van Roekel, Reinhard and Grimmelikhuijsen45 Provision of source evidence may prove helpful to end users.

In conclusion, robust evidence of methods utilized to implement evidence-based practices is widely available and can generate meaningful guidance. Standardizing the expectation that practice guidelines and guidance documents will include implementation recommendations will help generate more robust research on how to put recommendations reliably and sustainably into practice, will enhance the impact of practice guidelines and guidance, and will create safer environments for patients and staff.

Acknowledgments

Financial support

No financial support was provided relevant to this article.

Conflicts of interest

All authors report no conflicts of interest relevant to this article.

Footnotes

a

Current address: Children’s Hospital of Eastern Ontario, University of Ottawa, Ottawa, ON, Canada.

References

Murthy, L, Shepperd, S, Clarke, MJ, et al. Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians. Cochrane Database Syst Rev 2012:CD009401.CrossRefGoogle Scholar
Okelo, SO, Butz, AM, Sharma, R, et al. Interventions to modify healthcare provider adherence to asthma guidelines: a systematic review. Pediatrics 2013;132:517534.CrossRefGoogle Scholar
Gagliardi, AR, Brouwers, MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability. BMJ Open 2015;5:e007047.CrossRefGoogle ScholarPubMed
Brouwers, MC, Kho, ME, Browman, GP, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 2010;182:E839E842.CrossRefGoogle ScholarPubMed
Gillespie, BM, Bull, C, Walker, R, Lin, F, Roberts, S, Chaboyer, W. Quality appraisal of clinical guidelines for surgical site infection prevention: a systematic review. PloS One 2018;13:e0203354.CrossRefGoogle ScholarPubMed
Tabak, RG, Khoong, EC, Chambers, DA, Brownson, RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med 2012;43:337350.CrossRefGoogle ScholarPubMed
Krein, SL, Olmsted, RN, Hofer, TP, et al. Translating infection prevention evidence into practice using quantitative and qualitative research. Am J Infect Control 2006;34:507512.CrossRefGoogle ScholarPubMed
Nilsen, P, Stahl, C, Roback, K, Cairney, P. Never the twain shall meet? A comparison of implementation science and policy implementation research. Implement Sci 2013;8:63.CrossRefGoogle ScholarPubMed
Eccles, M, Mittman, B. Welcome to implementation science. Implement Sci 2006;1:1.CrossRefGoogle Scholar
Damschroder, LJ, Aron, DC, Keith, RE, Kirsh, SR, Alexander, JA, Lowery, JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50.CrossRefGoogle Scholar
Powell, BJ, Waltz, TJ, Chinman, MJ, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015;10:21.CrossRefGoogle ScholarPubMed
Curran, GM. Implementation science made too simple: a teaching tool. Implement Sci Commun 2020;1:27.CrossRefGoogle ScholarPubMed
Livorsi, DJ, Drainoni, ML, Reisinger, HS, et al. Leveraging implementation science to advance antibiotic stewardship practice and research. Infect Control Hosp Epidemiol 2022;43:139146.CrossRefGoogle ScholarPubMed
Anderson, DJ, Chen, LF, Weber, DJ, et al. Enhanced terminal room disinfection and acquisition and infection caused by multidrug-resistant organisms and Clostridium difficile (the Benefits of Enhanced Terminal Room Disinfection study): a cluster-randomised, multicentre, crossover study. Lancet 2017;389:805814.CrossRefGoogle ScholarPubMed
Schaffzin, JK, Wilhite, AW, Li, Z, Finney, D, Ankrum, AL, Moore, R. Maximizing efficiency in a high-occupancy setting to utilize ultraviolet disinfection for isolation rooms. Am J Infect Control 2020;48:903909.CrossRefGoogle Scholar
Stevenson, LD, Banks, RE, Stryczek, KC, et al. A pilot study using telehealth to implement antimicrobial stewardship at two rural Veterans’ Affairs medical centers. Infect Control Hosp Epidemiol 2018;39:11631169.CrossRefGoogle ScholarPubMed
Wilson, BM, Banks, RE, Crnich, CJ, et al. Changes in antibiotic use following implementation of a telehealth stewardship pilot program. Infect Control Hosp Epidemiol 2019;40:810814.CrossRefGoogle ScholarPubMed
MacBrayne, CE, Williams, MC, Levek, C, et al. Sustainability of handshake stewardship: extending a hand is effective years later. Clin Infect Dis 2020;70:23252332.CrossRefGoogle Scholar
World Health Organization Guidelines on Hand Hygiene in Healthcare. Geneva: World Health Organization; 2009.Google Scholar
A Guide to the Implementation of the WHO Multimodal Hand Hygiene Improvement Strategy. World Health Organization website. https://www.who.int/publications/i/item/a-guide-to-the-implementation-of-the-who-multimodal-hand-hygiene-improvement-strategy. Published 2009. Accessed September 6, 2022.Google Scholar
Organization WH. Implementation guide for Vaccination of Health Workers. Geneva: World Health Organization; 2022.Google Scholar
Implementation manual: WHO surgical safety checklist. Implementation manual: WHO surgical safety checklist. World Health Organization website. https://apps.who.int/iris/handle/10665/70046. Published 2008. Accessed October 18, 2022.Google Scholar
Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: Institute of Medicine; 2001.Google Scholar
Pereira, VC, Silva, SN, Carvalho, VKS, Zanghelini, F, Barreto, JOM. Strategies for the implementation of clinical practice guidelines in public health: an overview of systematic reviews. Health Res Policy Syst 2022;20:13.CrossRefGoogle ScholarPubMed
Berenholtz, SM, Lubomski, LH, Weeks, K, et al. Eliminating central-line–associated bloodstream infections: a national patient safety imperative. Infect Control Hosp Epidemiol 2014;35:5662.CrossRefGoogle ScholarPubMed
Schaffzin, JK, Harte, L, Marquette, S, et al. Surgical site infection reduction by the solutions for patient safety hospital engagement network. Pediatrics 2015;136:e1353e1360.CrossRefGoogle ScholarPubMed
Schweizer, ML, Chiang, HY, Septimus, E, et al. Association of a bundled intervention with surgical site infections among patients undergoing cardiac, hip, or knee surgery. JAMA 2015;313:21622171.CrossRefGoogle ScholarPubMed
Mody, L, Greene, MT, Meddings, J, et al. A national implementation project to prevent catheter-associated urinary tract infection in nursing home residents. JAMA Intern Med 2017;177:11541162.CrossRefGoogle ScholarPubMed
Saint, S, Greene, MT, Krein, SL, et al. A program to prevent catheter-associated urinary tract infection in acute care. N Engl J Med 2016;374:21112119.CrossRefGoogle ScholarPubMed
Hartley, SE, Kuhn, L, Valley, S, et al. Evaluating a hospitalist-based intervention to decrease unnecessary antimicrobial use in patients with asymptomatic bacteriuria. Infect Control Hosp Epidemiol 2016;37:10441051.CrossRefGoogle ScholarPubMed
Guyatt, GH, Oxman, AD, Schunemann, HJ, Tugwell, P, Knottnerus, A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology . J Clin Epidemiol 2011;64:380382.CrossRefGoogle ScholarPubMed
Munoz-Price, LS, Bowdle, A, Johnston, BL, et al. Infection prevention in the operating room anesthesia work area. Infect Control Hosp Epidemiol 2019;40:117.CrossRefGoogle ScholarPubMed
Infection Prevention in the Anesthesia Work Area (online webinar series). Society for Healthcare Epidemiology of America website. https://learningce.shea-online.org/content/infection-prevention-anesthesia-work-area. Published 2018. Accessed June 1, 2022.Google Scholar
Schaffzin, JK, Murthy, ARK, Deloney, VM, et al. A guide to implementing COVID-19 vaccine as a condition of employment in healthcare facilities. Infect Control Hosp Epidemiol 2021. doi: 10.1017/ice.2021.405.CrossRefGoogle Scholar
Compendium of strategies 2022 updates. Infectious Diseases Society of America website. https://www.idsociety.org/practice-guideline/compendium-of-strategies-to-prevent-hais/Published 2022. Accessed June 1, 2022.Google Scholar
Yokoe, DS, Anderson, DJ, Berenholtz, SM, et al. A compendium of strategies to prevent healthcare-associated infections in acute-care hospitals: 2014 updates. Infect Control Hosp Epidemiol 2014;35:967977.CrossRefGoogle ScholarPubMed
Geerligs, L, Rankin, NM, Shepherd, HL, Butow, P. Hospital-based interventions: a systematic review of staff-reported barriers and facilitators to implementation processes. Implement Sci 2018;13:36.CrossRefGoogle Scholar
Kaplan, HC, Brady, PW, Dritz, MC, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q 2010;88:500559.CrossRefGoogle Scholar
Saint, S, Howell, JD, Krein, SL. Implementation science: how to jump-start infection prevention. Infect Control Hosp Epidemiol 2010;31 suppl 1:S14S17.CrossRefGoogle Scholar
Tomoaia-Cotisel, A, Scammon, DL, Waitzman, NJ, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med 2013;11 Suppl 1:S115S123.CrossRefGoogle Scholar
Smith, WR. Evidence for the effectiveness of techniques to change physician behavior. Chest 2000;118:8S17S.CrossRefGoogle ScholarPubMed
Bradt, J. Comparing the effects of behaviorally informed interventions on flood insurance demand: an experimental analysis of ‘boosts’ and ‘nudges.’ Behavioural Public Policy 2022;6:485515.CrossRefGoogle Scholar
Grüne-Yanoff, T, Marchionni, C, Feufel, MA. Toward a framework for selecting behavioural policies: how to choose between boosts and nudges. Econ Philosophy 2018;34:243266.CrossRefGoogle Scholar
van Roekel, H, Reinhard, J, Grimmelikhuijsen, S. Improving hand hygiene in hospitals: comparing the effect of a nudge and a boost on protocol compliance. Behav Public Policy 2022;6:5274.CrossRefGoogle Scholar