Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-24T07:46:51.610Z Has data issue: false hasContentIssue false

Implementation and outcomes of a clinician-directed intervention to improve antibiotic prescribing for acute respiratory tract infections within the Veterans’ Affairs Healthcare System

Published online by Cambridge University Press:  15 August 2022

Karl J. Madaras-Kelly*
Affiliation:
Boise Veterans’ Affairs (VA) Medical Center, Boise, Idaho College of Pharmacy, Idaho State University, Meridian, Idaho
Suzette A. Rovelsky
Affiliation:
Boise Veterans’ Affairs (VA) Medical Center, Boise, Idaho
Robert A. McKie
Affiliation:
Boise Veterans’ Affairs (VA) Medical Center, Boise, Idaho
McKenna R. Nevers
Affiliation:
Salt Lake City VA Health Care System, Salt Lake City, Utah University of Utah School of Medicine, Salt Lake City, Utah
Jian Ying
Affiliation:
Salt Lake City VA Health Care System, Salt Lake City, Utah University of Utah School of Medicine, Salt Lake City, Utah
Benjamin A. Haaland
Affiliation:
Salt Lake City VA Health Care System, Salt Lake City, Utah University of Utah School of Medicine, Salt Lake City, Utah
Chad L. Kay
Affiliation:
VA National Academic Detailing Service, St. Louis, Missouri
Melissa L. Christopher
Affiliation:
VA National Academic Detailing Service, San Diego, California
Lauri A. Hicks
Affiliation:
Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Mathew H. Samore
Affiliation:
Salt Lake City VA Health Care System, Salt Lake City, Utah University of Utah School of Medicine, Salt Lake City, Utah
*
Author for correspondence: Karl J. Madaras-Kelly, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

To determine whether a clinician-directed acute respiratory tract infection (ARI) intervention was associated with improved antibiotic prescribing and patient outcomes across a large US healthcare system.

Design:

Multicenter retrospective quasi-experimental analysis of outpatient visits with a diagnosis of uncomplicated ARI over a 7-year period.

Participants:

Outpatients with ARI diagnoses: sinusitis, pharyngitis, bronchitis, and unspecified upper respiratory tract infection (URI-NOS). Outpatients with concurrent infection or select comorbid conditions were excluded.

Intervention(s):

Audit and feedback with peer comparison of antibiotic prescribing rates and academic detailing of clinicians with frequent ARI visits. Antimicrobial stewards and academic detailing personnel delivered the intervention; facility and clinician participation were voluntary.

Measure(s):

We calculated the probability to receive antibiotics for an ARI before and after implementation. Secondary outcomes included probability for a return clinic visits or infection-related hospitalization, before and after implementation. Intervention effects were assessed with logistic generalized estimating equation models. Facility participation was tracked, and results were stratified by quartile of facility intervention intensity.

Results:

We reviewed 1,003,509 and 323,023 uncomplicated ARI visits before and after the implementation of the intervention, respectively. The probability to receive antibiotics for ARI decreased after implementation (odds ratio [OR], 0.82; 95% confidence interval [CI], 0.78–0.86). Facilities with the highest quartile of intervention intensity demonstrated larger reductions in antibiotic prescribing (OR, 0.69; 95% CI, 0.59–0.80) compared to nonparticipating facilities (OR, 0.89; 95% CI, 0.73–1.09). Return visits (OR, 1.00; 95% CI, 0.94–1.07) and infection-related hospitalizations (OR, 1.21; 95% CI, 0.92–1.59) were not different before and after implementation within facilities that performed intensive implementation.

Conclusions:

Implementation of a nationwide ARI management intervention (ie, audit and feedback with academic detailing) was associated with improved ARI management in an intervention intensity–dependent manner. No impact on ARI-related clinical outcomes was observed.

Type
Original Article
Creative Commons
This is a work of the US Government and is not subject to copyright protection within the United States. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America.
Copyright
© Department of Veterans Affairs, 2022

Outpatient acute respiratory tract infections (ARIs) are commonly treated with antibiotics.Reference Fleming-Dutra, Hersh and Shapiro1 Diagnostic and treatment recommendations to facilitate appropriate management of ARIs exist; however, opportunity to improve prescribing remains ample. Estimates suggest that ∼30% of antibiotic prescriptions are unnecessary, and ARI diagnoses constitute a major source of misuse.Reference Hersh, King and Shapiro2 In Veterans’ Healthcare Administration (VHA) analyses conducted between 2005 and 2012 and in 2016, most patients with ARI received antibiotics despite educational campaigns and guidelines recommending prudent prescribing.Reference Jones, Sauer and Jones3,Reference Bohan, Madaras-Kelly and Pontefract4

Interventional approaches including audit and feedback with peer comparison, academic detailing, clinician communication training, and clinician public commitments to use antibiotics appropriately have reduced antibiotic overprescribing for ARIs.Reference Meeker, Linder and Fox5Reference Yadav, Meeker and Mistry12 Behavioral interventions, such as audit and feedback with peer comparison, have demonstrated robust improvement in prescribing and are perceived by clinicians as an acceptable approach to improve practice.Reference Meeker, Linder and Fox5,Reference Madaras-Kelly, Hostler and Townsend7,Reference Meeker, Knight and Friedberg8,Reference Yadav, Meeker and Mistry12 Large systemwide audit-and-feedback interventions delivered in written or electronic format demonstrate modest results, suggesting that additional interaction with clinicians may be needed to facilitate behavior change.Reference Hemkens, Saccilotto and Reyes13,Reference Ratajczak, Gold and Hailstone14 Academic detailing or noncommercial interactive education that uses reinforcement techniques individually delivered to clinicians has demonstrated improvements in antibiotic prescribing.Reference Gjelstad, Høye and Straand6,Reference Solomon, Van Houten and Glynn15 Previously, we demonstrated that augmentation of audit and feedback of clinician ARI treatment patterns coupled with academic detailing improved prescribing for ARIs without negative clinical consequences in 10 VHA clinics.Reference Madaras-Kelly, Hostler and Townsend7 However, limited data describe the impact of health system–wide outpatient antibiotic stewardship interventions on patient outcomes.

The VHA is the largest healthcare system in the United States, providing integrated inpatient and ambulatory care to 9 million veterans through 130 VHA medical centers (VAMCs) (Appendix 1 online). VHA-wide antimicrobial stewardship activities are coordinated by the Antimicrobial Stewardship Taskforce (ASTF). Similar to the entire US healthcare system, the majority of antibiotics prescribed within the VHA are dispensed in outpatient settings.Reference Suda, Hicks and Roberts17 In 2016, ASTF and the VHA National Academic Detailing Service (ADS) developed an outpatient antimicrobial stewardship intervention to improve ARI prescribing (ie, the ARI Campaign). The ARI Campaign encourages local VAMCs to engage high-prescribing clinicians with 2 strategies: audit and feedback with peer comparison of ARI antibiotic prescribing rates, and individualized academic detailing of ARI management. The ARI Campaign was initiated in October 2017. Here, we describe the ARI Campaign and its association with antibiotic treatment and patient outcomes across the VHA.

Methods

Patients

A multicenter, retrospective cohort of outpatients with visits for uncomplicated ARI between October 2012 and April 2019 was developed. Uncomplicated ARI visits were identified by International Classification of Diseases, Tenth Revision (ICD-10) procedure coding system (PCS) or ICD-9 PCS equivalent for visits with diagnosis of acute rhinosinusitis, pharyngitis, bronchitis, or unspecified upper respiratory tract infection (URI-NOS) (Appendix 2 online).Reference Madaras-Kelly, Hostler and Townsend7 Visits for patients with ARIs who had ICD-10 PCS codes for immunosuppression, dialysis, advanced malignancy, and/or chronic pulmonary disease within the past 2 years were excluded (Appendix 2 online). To enhance complicated case identification, patients with prescriptions for inhaled anticholinergics, monoclonal antibody or anti–tumor necrosis factor agents, or recent chemotherapy, with a concurrent ICD-10 PCS codes for infectious disease requiring antibiotics, or an ARI diagnosed in the prior 30 days were excluded.Reference Jones, Sauer and Jones3,Reference Bohan, Madaras-Kelly and Pontefract4,Reference Madaras-Kelly, Hostler and Townsend7

Intervention

ASTF and VHA ADS initially defined ARI Campaign Key Messages (Table 1), created an inventory of resources, and developed an implementation guide (ie, step-by-step protocol) as a resource for local facility personnel (Appendix 3 online).

Table 1. Key Messages for the VHA ARI Campaign

Note. VHA, Veterans’ Health Administration.

The campaign was developed to align with the Centers for Disease Control and Prevention (CDC) Core Elements of Outpatient Antimicrobial Stewardship: Leadership Commitment, Action, Tracking and Reporting, and Education and Expertise.Reference Sanchez, Fleming-Dutra and Roberts18 A VHA-wide ASTF webinar to kick off the ARI Campaign was broadcast in October 2017. Local antimicrobial stewards were encouraged to engage stakeholders prior to campaign initiation and to obtain commitment from local leaders (ie, emergency department (ED) and ambulatory care directors) key to implementation. Along with local antimicrobial stewards, VHA ADS personnel are embedded within a VAMC or a VHA regional geographical network of facilities (ie, Veterans’ Integrated Service Network or VISN). VHA ADS personnel are trained to provide academic detailing to clinicians on a variety of clinical topics. Local intervention personnel (facility antimicrobial stewards plus ADS personnel) were encouraged to coordinate intervention activities within each VAMC. Actions included clinician audit and feedback with peer-group comparison and individualized academic detailing of clinicians who frequently diagnosed ARIs.

Clinicians practicing in the ED, urgent or primary-care settings were identified through a facility-level report obtained through an electronic medical record interface (ie, ARI dashboard) that tracked clinician ARI visit totals and antibiotic prescribing. The ARI dashboard allowed personnel delivering the intervention to filter aggregated ARI visits by date, clinician, and peer group (ie, ED or primary care). Peer comparison of measures on audit-and-feedback reports were compared to average values of the peer group. Intervention personnel could print the audit-and-feedback reports for in-person distribution or e-mail the report to clinicians. Stewards were encouraged to disseminate baseline audit-and-feedback reports to clinicians with ≥15 uncomplicated ARI visits during the prior year to coincide with the beginning of the ARI season, then at least quarterly through spring and as needed until the following ARI season. Intervention personnel were encouraged to reinitiate the campaign each ARI season. Additional campaign components included enablers to support the CDC Core Elements including sample commitment letters for administrative and clinic champions, sample electronic medical record ARI disease management menus, training for antimicrobial stewards on how to perform academic detailing, printed ARI-specific academic detailing materials, clinician-focused video clips on patient communication strategies for ARIs, patient educational materials, and an ARI Campaign kickoff slide set. These materials could be accessed (or ordered) online through the ADS SharePoint site free of charge.

Local antibiotic stewards were encouraged to track facility performance on ARI-related metrics as part of their stewardship program and to report performance to appropriate local facility governing committees. In addition to audit-and-feedback reports for individual clinicians, other ARI dashboards provided local stewardship personnel with clinic-, facility-, or VISN-level performance on 5 ARI–related antibiotic metrics (Appendix 4 online). The metrics were based on professional guideline recommendations for diagnosis and treatment of ARI.Reference Harris, Hicks and Qaseem19Reference Shulman, Bisno and Clegg22

Data and outcomes

Antibiotic prescriptions filled between 2 days before and 3 days after the index visit were attributed to the ARI visit.Reference Jones, Sauer and Jones3,Reference Madaras-Kelly, Hostler and Townsend7 Because some medications prescribed within the VHA are filled by non-VHA pharmacies, dispensing data were supplemented with natural language processing (NLP) algorithm-generated data that identified additional antibiotic prescriptions documented in clinician progress notes.Reference Jones, Sauer and Jones3,Reference Madaras-Kelly, Hostler and Townsend7

Additional data obtained for analysis included patient variables (ie, sex, age, diagnosis, maximal temperature recorded on visit date), clinician variables (ie, age, sex, degree), and facility-related variables (ie, clinic type and VISN) in addition to calendar month of study.

As VAMC participation in the ARI Campaign was voluntary, the number of times local intervention personnel accessed the ARI dashboard per month for audit-and-feedback reports and identifying high-prescribing clinicians was tracked as a measure of facility intervention intensity.

The primary outcome was the probability to receive an antibiotic for an uncomplicated ARI visit before and after campaign initiation. Secondary outcomes included the probability to receive an antibiotic for acute bronchitis or URI-NOS, to receive appropriate therapy for pharyngitis or sinusitis, or to be diagnosed with sinusitis relative to other uncomplicated ARI diagnoses. Patient outcome measures included the probability of a return visit with an ARI diagnosis coded (ie, return visit) and hospitalization with an infectious-related diagnosis 2–30 days after ARI index visit before and after campaign initiation (Appendix 2 online).

Analysis

Intervention effects were assessed with logistic generalized estimating equation (GEE) models for binary outcomes (antibiotic prescribing or outcomes) with clustering by facility. The preintervention period was from October 2012 to September 2017 and the postintervention period was from October 2017 to March 2019. The logistic GEE models pre- and postintervention effects adjusted for time trend, month, patient age, patient temperature, and provider type. Assessment of intervention intensity was conducted utilizing similar logistic GEE models, except the intervention was represented in 5 strata based on the number of times the ARI dashboard was accessed. The lowest stratum comprised facilities that never accessed the ARI dashboard, indicating nonparticipation in the campaign. The remaining facilities were stratified into quartiles of ARI dashboard access intensity. Results were expressed as odds ratios (ORs) with 95% confidence intervals (CIs) for all pre- and postimplementation effects. To aid in interpretation, antibiotic and patient outcomes were also expressed as events per 1,000 uncomplicated ARI visits before and after implementation.

The ARI campaign was conducted as an operational activity; however, the analysis activities constitute research (VHA Policy Handbook guideline 1058.05). The research activities were granted IRB approval and comply with all federal guidelines and policies relative to human-subjects research.

Results

In total, 2,554,472 visits with ARI diagnoses occurred during the 7-year study period. Among them, 1,227,940 (48.1%) were excluded due to complicated conditions (Fig. 1). The final cohort included 1,003,509 visits before implementation and 323,023 visits after implementation. Most patients were male, middle-aged, and afebrile upon presentation. Most visits occurred in primary care, and most care was provided by physicians (Table 2).

Fig. 1. Study flow diagram for the VHA ARI Campaign. Note. VHA, Veterans’ Healthcare Administration; ARI, acute respiratory tract infection; COPD, chronic obstructive pulmonary disease; SSTI, skin and soft-tissue infection. AVisits may have met >1 exclusion criteria.

Table 2. Characteristics of Patients With Uncomplicated Acute Respiratory Tract Infection (ARI) Before and After ARI Campaign Implementation

Note. URI-NOS, unspecified upper respiratory tract infection; IQR, interquartile range; PA, physician assistant; NP, nurse practitioner; ED, emergency department; UC, urgent care.

a Missing values: temperature (n = 73,865), systolic blood pressure (n = 55,522), provider type (n = 3).

Antibiotic prescription for uncomplicated ARI decreased after implementation (OR, 0.82; 95% CI, 0.78–0.86) (Fig. 2 and Table 3). Facilities in the upper third and fourth quartiles of intervention intensity exhibited significant reduction in antibiotic prescribing, with mean facility absolute decreases of 34 and 78 prescriptions per 1,000 ARI visits, respectively. Reductions (OR, 0.84; 95% CI, 0.80–0.88) in antibiotic prescribing for acute bronchitis and UTI-NOS paralleled those of the primary endpoint with significant reductions of antibiotic prescribing for the third quartile (−51 per 1,000) and fourth quartile (−92 per 1,000) of intervention intensity, respectively. Appropriate management of acute pharyngitis increased after implementation (OR, 1.20; 95% CI, 1.13–1.27). Improvement was driven by facilities in the fourth quartile (OR, 1.45; 95% CI, 1.24–1.70) of intervention intensity, where appropriate therapy increased by 43 per 1,000 after implementation. The proportion of sinusitis visits with preferred antibiotic therapy prescribed remained unchanged (OR, 0.97; 95% CI, 0.91–1.03). High absolute rates of prescribing preferred antibiotic therapy for sinusitis before implementation (731 per 1,000) and after implementation (756 per 1,000). The proportion of uncomplicated ARI visits diagnosed as sinusitis decreased after implementation (OR, 0.79; 95% CI, 0.75–0.82). The reductions in sinusitis diagnoses were similar across all levels of intervention intensity.

Fig. 2. Observed (2a) and predicted (2b) antibiotic prescription (%) for uncomplicated acute respiratory tract infection (ARI) diagnoses. (a) Observed monthly percentage of antibiotic prescribing was calculated for the whole cohort (overall) for the whole study period and by facility dashboard access quartiles (no access, Q1–Q4) for the 18-month postimplementation period. The probability of antibiotics prescribed for each individual was predicted using the generalized estimating equation (GEE) model as described in the Methods. (b) Predicted monthly percentage of antibiotics prescribing was estimated as the mean of the predicted probabilities for the whole cohort (overall) for the whole study period and by the facility dashboard access quartiles (no access, Q1–Q4) for the 18-month postimplementation period.

Table 3. Changes in Campaign Metrics Before and After ARI Campaign Implementation Across the VHA System and Based on Intensity of ARI Dashboard Utilization

Note. ARI, acute respiratory infection; VHA, Veterans’ Health Administration; CI, confidence interval.

a The percentage (%) of patient visits with antibiotics prescribed for individual ARI diagnoses pre/post implementation were bronchitis (83.0 vs 78.4), sinusitis (86.6 vs 86.5), pharyngitis (68.4 vs 63.4), URI-NOS (48.8 vs 42.3).

b ARI Dashboard hits was stratified into facilities that never accessed the dashboard indicated by 0 and for facilities that did access the dashboard into quartiles based on the number of times they accessed the dashboard over the 18-mo postimplementation period, reported as a range: first quartile (1–14), second quartile (≥14–49), third quartile (≥49–173), fourth quartile (≥173–1,300).

c Appropriate prescribing for acute pharyngitis was defined as no antibiotic for cases with a negative group A rapid antigen detection test or throat culture (or test not performed), penicillin or amoxicillin for cases with a positive test, or cephalexin, or clindamycin for cases with a positive test and penicillin allergy.

d Appropriate antibiotic selection was defined as defined as prescription for an aminopenicillin (±clavulanate) or, in case of penicillin allergy, doxycycline or a respiratory fluoroquinolone in patients visits with an antibiotic prescribed.

Across the VHA, the probability of a return ARI visit increased (OR, 1.04; 95% CI, 1.00–1.08) (Table 4). This effect was most pronounced for the first quartile in facilities that minimally participated in the campaign (OR, 1.15; 95% CI, 1.01–1.31). Infection-related hospitalization within 30 days (OR, 1.16; 95% CI, 0.99–1.35) was not significantly different; however, point estimates for infection-related hospitalization in the third quartile (OR, 1.30; 95% CI, 0.98–1.74) and fourth quartile (OR, 1.21; 95% CI, 0.92–1.59) of intervention intensity were observed (Table 4). The overall rate of infection-related hospitalization was low (0.22%), and the most common admitting diagnosis for infection-related hospitalization was pneumonia (22.0%) (Appendix 5 online).

Table 4. Patient Outcomes Before and After ARI Campaign Implementation Across the VHA System and Based on Intensity of ARI Dashboard Utilization

Note. ARI, acute respiratory infection; VHA, Veterans’ Health Administration; CI, confidence interval; ICD-10, International Classification of Diseases, Tenth Revision; PCS, procedure coding system.

a ARI dashboard hits was stratified into facilities that never accessed the dashboard indicated by 0 and for facilities that did access the dashboard into quartiles based on the number of times they accessed the dashboard over the 18- mo postimplementation period reported as a range: first quartile (1–14), second quartile (≥14–49), third quartile (≥49–173), fourth quartile (≥173–1,300).

b ARI-related visits were defined as any physical visit to the VHA with an ARI diagnostic code assigned to the visit that occurred 2–30 d after the index ARI visit.

c Infection-related hospitalization was defined as an admission to a Medical-Surgical ward in which a primary discharge diagnosis that included an infection-related ICD-10 PCS or ICD-9 PCS equivalent code (Appendix 2) that occurred within 2–30 d after the index visit.

Discussion

This large health-system intervention was associated with improved ARI management and reduction in outpatient antibiotic prescribing for uncomplicated ARIs after implementation. Participation was voluntary, and the frequency that local personnel conducting the intervention utilized the ARI dashboards served as measure of intervention intensity. Reduction in antibiotic prescribing was related to the intensity of intervention uptake. Facilities above the median of ARI dashboard access exhibited significant reduction in antibiotic prescription. Reduction in antibiotic prescription for acute bronchitis and URI-NOS, and improvements in pharyngitis management, were also observed within intensive-intervention facilities. The proportion of ARI visits diagnosed as acute sinusitis over the 7-year period decreased across the VHA irrespective of intervention intensity. The findings suggest that implementation of the clinician-directed intervention was associated with improvements in guideline-concordant ARI management.

Outpatient return visits for ARIs increased slightly after implementation. However, the increase was limited to facilities within the lowest intensity of ARI dashboard utilization. This finding is unlikely to be related to intervention implementation because utilization of the ARI dashboard in this quartile was exceptionally limited after implementation. Infection-related hospitalization after an ARI visit was not significantly different after implementation. Point estimates for the highest intervention intensity quartiles were higher, but not significantly different than facilities that did not participate in the intervention. The absolute differences in the postimplementation infection-related admission rate between facilities that never participated and those in the third and fourth quartiles of intervention intensity were 0.05% and 0.03%, respectively. This finding indicates that intervention implementation was not associated with harm at the health-system level.

A study strength was the real-world application of the intervention across a large healthcare system through voluntary participation, which may contribute to sustainability beyond the research setting. The VHA infrastructure allowed for intervention development and facilitation by the ASTF and ADS across the healthcare system. The centralized VHA Corporate Date Warehouse was utilized to generate both the ARI dashboard data used to deliver the intervention and to conduct an integrated analyses of outpatient ARI management and patient outcomes.23 Although many US healthcare systems do not possess data repositories or utilize academic detailing, the utilization of dashboards to track healthcare performance and academic detailing programs to improve medication prescribing is increasing among other large healthcare systems (ie, Kaiser Permanente and state health departments).Reference Avorn24 Analysis strengths include the large sample size, which provided statistical power to examine clinical outcomes with a high degree of precision and evaluation over multiple ARI seasons after implementation. Although the use of NLP to supplement antibiotic prescribing data for the analysis was a strength, it was not feasible to include these data in real time within the ARI dashboards. This finding may have resulted in underreporting of antibiotic use for audit and feedback in VHA practice settings (community-based outpatient clinics) where outsourcing of prescriptions is common. As a result, some VAMCs chose to exclude these clinics from intervention and reporting, whereas others performed academic detailing and included them.

This study had several limitations. As facility participation was voluntary, a quasi-experimental design was utilized. Facilities with higher-intensity intervention may have been more broadly engaged in quality improvement or may have employed additional or alternative interventions during the study period that we were unable to identify.Reference Livorsi, Nair and Dysangco25,Reference Buehrle, Shively and Wagener26 Facilities could have opted to deliver audit and feedback or academic detailing to clinicians without combining both interventions, and we were unable to track which interventions individual clinicians received. The VHA population is predominantly male and older than the overall US population, and approximately half of the ARI visits were excluded as potentially complicated due to chronic pulmonary disease and immunosuppression, which may have limited the potential reduction of overall antibiotic prescribing.Reference Livorsi, Nair and Dysangco25,27 Furthermore, ARI cases were identified based on administrative coding, and the analysis did not adjust for patient-level comorbidity. Finally, the analysis did not consider potential benefits of reduced antibiotic prescribing on adverse events, antibiotic resistance, or cost.

Antibiotic prescriptions in US outpatient settings decreased during the approximate time frame of the study; however, inappropriate antibiotic prescription for adults decreased minimally.Reference Hersh, King and Shapiro2 Most inappropriate antibiotic prescribing is for ARI-related conditions and visits for ARIs have declined since 2010–2011.Reference Hersh, King and Shapiro2 Reasons for the decline in ARI visits is unclear.

In a pilot study conducted in 10 VHA clinics that utilized a similar protocol to the ARI Campaign under more controlled conditions, we observed a reduction in antibiotic prescribing for uncomplicated ARIs that was comparable to the highest intervention quartile in the ARI Campaign. We also observed no increase in ARI return visits as well as a small decrease in all-cause hospitalization.Reference Madaras-Kelly, Hostler and Townsend7 Based on the pilot-study findings and other similar studies, the interventional approach appears to be cost-effective.Reference Yoo, Madaras-Kelly and Nevers28,Reference Gong, Zangwill and Hay29 To date, the VHA ARI Campaign is one of the largest US outpatient stewardship interventions using a clinician-directed approach. Prescription feedback interventions of similar focus and scale have been conducted in Europe with mixed results.Reference Hemkens, Saccilotto and Reyes13,Reference Ratajczak, Gold and Hailstone14 Many of these interventions focused on electronic or written dissemination of feedback coupled with dissemination or reference to prescribing guidelines. In a randomized trial of 2,900 high-prescribing primary-care clinicians in Switzerland in which feedback was provided by mail or electronically and was supplemented with national guidelines, minimal reduction in antibiotic prescription to adults was observed (between-group difference, −4.6%).Reference Hemkens, Saccilotto and Reyes13 In a cluster-randomized trial of 79 general practices in the United Kingdom where electronic prescription feedback was facilitated by recruitment of a local champion, a similar reduction (adjusted rate ratio, 0.84) in antibiotic prescription for treatment of respiratory tract infections without increase in secondary infection was observed.Reference Ratajczak, Gold and Hailstone14 A large study of academic detailing to improve antibiotic prescribing of general practitioners in Norway indicated a 13% reduction in potentially inappropriate antibiotic prescribing.Reference Rognstad, Brekke and Gjelstad30 To our knowledge, the ARI campaign is the only large-scale intervention to combine an audit-and-feedback approach with academic detailing targeting reduction in inappropriate antibiotic prescribing.

Future work should consider the impact of coronavirus disease 2019 (COVID-19) on outpatient antibiotic prescribing, the increasing use of telehealth for mild-to-moderate illness, the impact of diagnostic shifting, and approaches to optimizing clinician-directed intervention delivery. Although our study concluded prior to the arrival of COVID-19, large reductions in outpatient antibiotic prescription have been observed since the pandemic began.Reference King, Lovegrove and Shehab31 Reasons for the reductions include reduced transmission of non–COVID-19 viral illnesses such as influenza, a reduced volume of office visits, and a change in treatment modalities with large increases in telehealth.Reference King, Lovegrove and Shehab31Reference Rubin33 Many VHA facilities placed the ARI campaign on hold during the pandemic; however, the ARI Campaign was recently revised with anticipation of a return to historical practice patterns once COVID-19 subsides. The increased use of telehealth to diagnose and treat ARIs will require further study, especially the role of physical assessment and diagnostic test ordering in ARI management. Altering diagnosis or coding practices in response to diagnosis-based interventions (ie, diagnostic shifting) has been observed in audit-and-feedback interventions.Reference Madaras-Kelly, Hostler and Townsend7,Reference Roth, Gonzales and Harding-Anderer34 Additional work is needed to develop metrics to assess a broader array of conditions for which antibiotics are inappropriately prescribed and to address diagnostic shifting. In 2022, the National Committee for Quality Assurance released the Antibiotic Utilization for Respiratory Conditions HEDIS measure, which was designed to assess a broader array of respiratory diagnoses for which antibiotics are inappropriately prescribed.35 Despite the requirement that all VAMCs have a stewardship program, a number of facilities did not participate or participated minimally, and reasons for the lack of engagement requires study. Finally, further work is needed to optimize the behavioral approaches utilized in delivering audit-and-feedback and academic-detailing interventions.

In conclusion, implementation of a voluntary systemwide clinician-focused intervention involving audit and feedback of antibiotic prescribing rates coupled with academic detailing was associated a meaningful reduction in antibiotic prescribing for ARIs within facilities that intensively participated. Minimal impact on ARI-related clinical outcomes was observed. Healthcare systems implementing similar interventions should follow the CDC Core Elements in intervention design. Further work is needed to maximize reduction of unnecessary antibiotics while identifying patients for whom antibiotic therapy is appropriate.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/ice.2022.182

Acknowledgments

We recognize the dedication of clinicians, antibiotic stewards, and academic detailers for their commitment to providing quality care for US veterans. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Department of Veterans’ Affairs or the Centers for Disease Control and Prevention.

Financial support

This work was supported in part with resources and use of the Department of Veterans’ Affairs and was funded by the Centers for Disease Control and Prevention (grant no. 14FED1412883), and Safety and Healthcare Epidemiology Prevention Research Development (contract no. 200-2011-47039).

Conflicts of interest

All authors report no conflicts of interest related to this article.

References

Fleming-Dutra, KE, Hersh, AL, Shapiro, DJ, et al. Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010–2011. JAMA 2016;315:18641873.CrossRefGoogle ScholarPubMed
Hersh, AL, King, LM, Shapiro, DJ, et al. Unnecessary antibiotic prescribing in US ambulatory care settings, 2010–2015. Clin Infect Dis 2021;72:133137.Google ScholarPubMed
Jones, BE, Sauer, B, Jones, MM, et al. Variation in outpatient antibiotic prescribing for acute respiratory infections in the veteran population: a cross-sectional study. Ann Intern Med 2015;163:7380.CrossRefGoogle ScholarPubMed
Bohan, JG, Madaras-Kelly, K, Pontefract, B, et al. ARI Management Improvement Group. Evaluation of uncomplicated acute respiratory tract infection management in veterans: a national utilization review. Infect Control Hosp Epidemiol 2019;40:438446.CrossRefGoogle ScholarPubMed
Meeker, D, Linder, JA, Fox, CR, et al. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA 2016;315:562570.CrossRefGoogle ScholarPubMed
Gjelstad, S, Høye, S, Straand, J, et al. Improving antibiotic prescribing in acute respiratory tract infections: cluster randomised trial from Norwegian general practice (prescription peer academic detailing (Rx-PAD) study). BMJ 2013;347:f4403.CrossRefGoogle ScholarPubMed
Madaras-Kelly, K, Hostler, C, Townsend, M, et al. Impact of implementation of the core elements of outpatient antibiotic stewardship within Veterans’ Health Administration emergency departments and primary care clinics on antibiotic prescribing and patient outcomes. Clin Infect Dis 2021;73:e1126e1134.CrossRefGoogle ScholarPubMed
Meeker, D, Knight, TK, Friedberg, MW, et al. Nudging guideline-concordant antibiotic prescribing: a randomized clinical trial. JAMA Intern Med 2014;174:425431.CrossRefGoogle ScholarPubMed
Mangione-Smith, R, Zhou, C, Robinson, JD, et al. Communication practices and antibiotic use for acute respiratory tract infections in children. Ann Fam Med 2015;13:221227.CrossRefGoogle ScholarPubMed
Little, P, Stuart, B, Francis, N, et al. Effects of Internet-based training on antibiotic prescribing rates for acute respiratory-tract infections: a multinational, cluster, randomised, factorial, controlled trial. Lancet 2013;382:11751182.CrossRefGoogle ScholarPubMed
Van der Velden, AW, Pijpers, EJ, Kuyvenhoven, MM, et al. Effectiveness of physician-targeted interventions to improve antibiotic use for respiratory tract infections. Br J Gen Pract 2012;62:e801e807.CrossRefGoogle ScholarPubMed
Yadav, K, Meeker, D, Mistry, RD, et al. A multifaceted intervention improves prescribing for acute respiratory infection for adults and children in emergency department and urgent care settings. Acad Emerg Med 2019;26:719731.CrossRefGoogle ScholarPubMed
Hemkens, LG, Saccilotto, R, Reyes, SL, et al. Personalized prescription feedback using routinely collected data to reduce antibiotic use in primary care: a randomized clinical trial. JAMA Intern Med 2017;177:176183.CrossRefGoogle ScholarPubMed
Ratajczak, M, Gold, N, Hailstone, S, et al. The effectiveness of repeating a social norm feedback intervention to high prescribers of antibiotics in general practice: a national regression discontinuity design. J Antimicrob Chemother 2019;74:36033610.CrossRefGoogle ScholarPubMed
Solomon, DH, Van Houten, L, Glynn, RJ, et al. Academic detailing to improve use of broad-spectrum antibiotics at an academic medical center. Arch Intern Med 2001;161:18971902.CrossRefGoogle ScholarPubMed
Kelly, AA, Jones, MM, Echevarria, KL, et al. A report of the efforts of the Veterans’ Health Administration National Antimicrobial Stewardship Initiative. Infect Control Hosp Epidemiol 2017;38:513520.CrossRefGoogle ScholarPubMed
Suda, KJ, Hicks, LA, Roberts, RM, et al. Antibiotic expenditures by medication, class, and healthcare setting in the United States, 2010–2015. Clin Infect Dis 2018;66:185190.CrossRefGoogle ScholarPubMed
Sanchez, GV, Fleming-Dutra, KE, Roberts, RM, et al. Core elements of outpatient antibiotic stewardship. MMWR Recomm Rep 2016;65(6):112.CrossRefGoogle ScholarPubMed
Harris, AM, Hicks, LA, Qaseem, A. Appropriate antibiotic use for acute respiratory tract infection in adults: advice for high-value care from the American College of Physicians and the Centers for Disease Control and Prevention. Ann Intern Med 2016;164:425434.CrossRefGoogle ScholarPubMed
Chow, A, Benninger, M, Brook, I, et al. IDSA clinical practice guideline for acute bacterial rhinosinusitis in children and adults. Clin Infect Dis 2012;54:e72e112.CrossRefGoogle ScholarPubMed
Rosenfeld, RM, Piccirillo, JF, Chandrasekhar, SS, et al. Clinical practice guideline (update): adult sinusitis. Otolaryngol Head Neck Surg 2015;152 suppl 2:S1S39.Google Scholar
Shulman, ST, Bisno, AL, Clegg, HW, et al. Clinical practice guideline for the diagnosis and management of group A streptococcal pharyngitis: 2012 update by the Infectious Diseases Society of America. Clin Infect Dis 2012;55:e86e102.CrossRefGoogle Scholar
Corporate Data Warehouse (CDW). US Department of Veterans’ Affairs Health Services Research & Development website. https://www.hsrd.research.va.gov/for_researchers/vinci/cdw.cfm. Accessed November 19, 2021.Google Scholar
Avorn, J. Academic detailing: “marketing” the best evidence to clinicians. JAMA 2017;317:361362.CrossRefGoogle ScholarPubMed
Livorsi, DJ, Nair, R, Dysangco, A, et al. Using audit and feedback to improve antimicrobial prescribing in emergency departments: a multicenter quasi-experimental study in the Veterans’ Health Administration. Open Forum Infect Dis 2021;8:ofab186.CrossRefGoogle ScholarPubMed
Buehrle, DJ, Shively, NR, Wagener, MM, et al. Sustained reductions in overall and unnecessary antibiotic prescribing at primary care clinics in a Veterans’ Affairs Healthcare System following a multifaceted stewardship intervention. Clin Infect Dis 2020;71:e316e322.CrossRefGoogle Scholar
National Center for Healthcare Statistics. Veterans’ health statistics. Centers for Diseases Control and Prevention website. https://www.cdc.gov/nchs/nhis/veterans_health_statistics/veterans-health-statistics.htm. Accessed November 19, 2021.Google Scholar
Yoo, M, Madaras-Kelly, K, Nevers, M, et al. A Veterans’ Healthcare Administration (VHA) antibiotic stewardship intervention to improve outpatient antibiotic use for acute respiratory infections: a cost-effectiveness analysis. Infect Control Hosp Epidemiol 2021. doi: 10.1017/ice.2021.393.CrossRefGoogle Scholar
Gong, CL, Zangwill, KM, Hay, JW, et al. Behavioral economics interventions to improve outpatient antibiotic prescribing for acute respiratory infections: a cost-effectiveness analysis. J Gen Intern Med 2019;34:846854.CrossRefGoogle ScholarPubMed
Rognstad, S, Brekke, M, Gjelstad, S, et al. Potentially inappropriate prescribing to older patients: criteria, prevalence and an intervention to reduce it: the prescription peer academic detailing (Rx-PAD) study—a cluster-randomized, educational intervention in Norwegian general practice. Basic Clin Pharmacol Toxicol 2018;123:380391.CrossRefGoogle Scholar
King, LM, Lovegrove, MC, Shehab, N, et al. Trends in US outpatient antibiotic prescriptions during the coronavirus disease 2019 pandemic. Clin Infect Dis 2021;73:e652e660.CrossRefGoogle ScholarPubMed
Weiner, JP, Bandeian, S, Hatef, E, et al. In-person and telehealth ambulatory contacts and costs in a large US insured cohort before and during the COVID-19 pandemic. JAMA Netw Open 2021;4:e212618.CrossRefGoogle Scholar
Rubin, R. Influenza’s unprecedented low profile during COVID-19 pandemic leaves experts wondering what this flu season has in store. JAMA 2021;326:899900.CrossRefGoogle ScholarPubMed
Roth, S, Gonzales, R, Harding-Anderer, T, et al. Unintended consequences of a quality measure for acute bronchitis. Am J Manag Care 2012;18:e217e224.Google ScholarPubMed
HEDIS measures, antibiotic utilization for respiratory conditions. National Committee on Quality Assurance website. https://www.ncqa.org/hedis/measures/. Published 2022. Accessed February 15, 2022.Google Scholar
Figure 0

Table 1. Key Messages for the VHA ARI Campaign

Figure 1

Fig. 1. Study flow diagram for the VHA ARI Campaign. Note. VHA, Veterans’ Healthcare Administration; ARI, acute respiratory tract infection; COPD, chronic obstructive pulmonary disease; SSTI, skin and soft-tissue infection. AVisits may have met >1 exclusion criteria.

Figure 2

Table 2. Characteristics of Patients With Uncomplicated Acute Respiratory Tract Infection (ARI) Before and After ARI Campaign Implementation

Figure 3

Fig. 2. Observed (2a) and predicted (2b) antibiotic prescription (%) for uncomplicated acute respiratory tract infection (ARI) diagnoses. (a) Observed monthly percentage of antibiotic prescribing was calculated for the whole cohort (overall) for the whole study period and by facility dashboard access quartiles (no access, Q1–Q4) for the 18-month postimplementation period. The probability of antibiotics prescribed for each individual was predicted using the generalized estimating equation (GEE) model as described in the Methods. (b) Predicted monthly percentage of antibiotics prescribing was estimated as the mean of the predicted probabilities for the whole cohort (overall) for the whole study period and by the facility dashboard access quartiles (no access, Q1–Q4) for the 18-month postimplementation period.

Figure 4

Table 3. Changes in Campaign Metrics Before and After ARI Campaign Implementation Across the VHA System and Based on Intensity of ARI Dashboard Utilization

Figure 5

Table 4. Patient Outcomes Before and After ARI Campaign Implementation Across the VHA System and Based on Intensity of ARI Dashboard Utilization

Supplementary material: File

Madaras-Kelly et al. supplementary material

Appendices

Download Madaras-Kelly et al. supplementary material(File)
File 53.3 KB