Hostname: page-component-7b9c58cd5d-hxdxx Total loading time: 0 Render date: 2025-03-16T00:31:13.310Z Has data issue: false hasContentIssue false

Computer-Assisted Antimicrobial Recommendations for Optimal Therapy: Analysis of Prescribing Errors in an Antimicrobial Stewardship Trial

Published online by Cambridge University Press:  02 June 2017

David N. Schwartz*
Affiliation:
Division of Infectious Diseases, Stroger Hospital of Cook County, Chicago, Illinois Rush Medical College, Chicago, Illinois
Kevin W. McConeghy
Affiliation:
Providence VA Medical Center, Providence, Rhode Island
Rosie D. Lyles
Affiliation:
Stroger Hospital of Cook County, Chicago, Illinois
Ulysses Wu
Affiliation:
St Francis Hospital and Medical Center, Hartford, Connecticut
Robert C. Glowacki
Affiliation:
Pharmacy Department, Stroger Hospital of Cook County, Chicago, Illinois College of Pharmacy, University of Illinois at Chicago, Chicago, Illinois.
Gail S. Itokazu
Affiliation:
Pharmacy Department, Stroger Hospital of Cook County, Chicago, Illinois College of Pharmacy, University of Illinois at Chicago, Chicago, Illinois.
Piotr Kieszkowski
Affiliation:
Providence VA Medical Center, Providence, Rhode Island
Yingxu Xiang
Affiliation:
Providence VA Medical Center, Providence, Rhode Island
Bala Hota
Affiliation:
College of Pharmacy, University of Illinois at Chicago, Chicago, Illinois.
Robert A. Weinstein
Affiliation:
Division of Infectious Diseases, Stroger Hospital of Cook County, Chicago, Illinois Rush Medical College, Chicago, Illinois
*
Address correspondence to David N. Schwartz, MD, Chair, Division of Infectious Diseases, John H. Stroger, Jr Hospital of Cook County, 1900 W. Polk St, Room 1236, Chicago, IL 60612 (david.schwartz@hektoen.org).
Rights & Permissions [Opens in a new window]

Abstract

Clinician education and prospective audit and feedback interventions, deployed separately and concurrently, did not reduce antimicrobial use errors or rates compared to a control group of general medicine inpatients at our public hospital. Additional research is needed to define the optimal scope and intensity of hospital antimicrobial stewardship interventions.

Infect Control Hosp Epidemiol 2017;38:857–859

Type
Concise Communications
Copyright
© 2017 by The Society for Healthcare Epidemiology of America. All rights reserved 

The relative impact of different antimicrobial stewardship interventions on acute-care hospital rates of antimicrobial use and errors is largely unknown.Reference Barlam, Cosgrove and Abbo 1 After improving antimicrobial use at a long-term and acute-care hospital through clinician education and institutional infection management guideline implementation,Reference Schwartz, Abiad, DeMarais, Armeanu, Trick, Wang and Weinstein 2 we sought to determine the effectiveness of this approach by deploying a clinician education intervention concurrently with computer-assisted prospective audit and feedback by infectious disease (ID) pharmacists and with no intervention on the 3 inpatient internal medicine firms of our urban teaching hospital.

METHODS

All adult patients admitted over a 24-week period beginning in February 2005 to inpatient medicine services in our publicly funded Chicago teaching hospital were assigned sequentially to 3 inpatient medicine firms, each staffed for 4-week rotations by 4 physician teams. These patients were cared for across 9 general medical-surgical wards with shared facilities and services. Interventions were assigned to firms by coin flips. Interventions were developed as quality improvement initiatives under the auspices of the hospital’s Anti-Infective Committee, and the study was approved by the hospital’s institutional review board.

An investigator (D.N.S.) presented teaching sessions to physicians in the clinician education firm twice during each 4-week rotation. Case vignettes using the Audience Response SystemReference Schackow, Chavez and Loya 3 were used to explore the diagnosis and treatment of common infection syndromes, reinforcing recommendations from our hospital-wide infection management guidelines (see below) and emphasizing changing susceptibility patterns and syndromes associated with antimicrobial overuse.

A second firm was assigned to prospective audit and feedback by an ID pharmacist. Infectious disease pharmacists (R.C.G., G.S.I.) reviewed the charts of each inpatient antimicrobial recipient (excluding discharged patients or those whose antimicrobials had been discontinued) on each nonholiday weekday, using a computer program that reported patient demographic characteristics, test results, and antimicrobial therapy. Institutional guidelines provided a reference standard. Clinical pharmacist case review was not otherwise routinely available at our hospital.

The control firm was not subjected to active interventions but had access to hospital-wide antimicrobial stewardship programs, including institutional infection management guidelines implemented in 2004 to support the diagnosis and treatment of common infection syndromes, and restrictions for 7 antimicrobials necessitating ID pharmacist or physician approval before dispensing. The primary outcomes were the proportion of initial antimicrobial regimens with error, antimicrobial courses, and antimicrobial treatment days in which 1 or more antimicrobial use errors could be identified during retrospective review of a random sample of antimicrobial recipients hospitalized on the inpatient medicine firms during the study period. Methods for conducting case reviews were published previously.Reference Schwartz, Wu, Lyles, Xiang, Kieszkowski, Hota and Weinstein 4 Secondary outcomes included the mean number of days of therapy with any error and the overall antimicrobial utilization (expressed as days of therapy (DOT) per 1,000 patient days).Reference Schwartz, Abiad, DeMarais, Armeanu, Trick, Wang and Weinstein 2 Weekly aggregate antimicrobial use rates for each firm during the study period were programmed from hospital pharmacy and administrative data stored in a data warehouse.Reference Wisniewski, Kieszkowski, Zagorski, Trick, Sommers and Weinstein 5

A χ2 analysis or ANOVA test was used for comparisons of proportions or means when appropriate. For the secondary outcome, error days were modeled as counted data with an overdispersion variable (negative binomial regression) offset for total days of antimicrobial therapy (exposure). Analyses were performed using STATA SE 12 software (StataCorp, College Station, TX).

RESULTS

During the intervention period, 2,682 antimicrobial courses were administered among 5,804 admissions. Patients admitted to the control firm had shorter median lengths of stay than those in the other firms (4, 5, and 5 days, respectively; P<.001; Table 1). Among antimicrobial recipients randomly selected for antimicrobial error review, nearly 80% of antimicrobial courses were initiated in the emergency department (ED) (Table 1).

TABLE 1 Inpatient Medicine Firms and Reviewed Antimicrobial Cases

NOTE. SD, standard deviation; ED, emergency department.

a All patients admitted to that firm during the intervention period (February to July, 2005).

b Each case can have more than one indication so the sum percentages may exceed 100%.

Attendance at each of the 12 teaching sessions presented to the clinician education firm exceeded 80% of resident physicians and 50% of attending physicians. Infectious disease pharmacists reviewed 567 of 901 antimicrobial courses (62.9%) given in their firm, generating 202 (35.6%) recommendations for improvement, of which 129 (63.9% of the recommendations conveyed; 14.9% of total antimicrobial courses) were accepted. Recommendations that would reduce overall antimicrobial use (ie, to discontinue therapy or simplify redundant regimens) were made 94 times and were accepted 43 times.

Moreover, 1 or more antimicrobial use errors were identified in 420 of the 498 case vignettes reviewed (84.3%), including errors in the initial antimicrobial regimen in 354 (71.1%), and errors were identified during 1,237 (52.4%) of the 2,389 days of therapy reviewed (Table 2). The proportions of antimicrobial courses, course initiations, and treatment days with 1 or more errors at any time and the mean number of days per antimicrobial course during which specific error types were identified were higher in the education firm and in the pharmacist intervention firm than in the control firm. However, these differences held variable statistical significance (Table 2).

TABLE 2 Antimicrobial Regimen Error Rates

NOTE. DOT, antimicrobial days of therapy.

a χ2 analysis of proportions relative to control.

b The mean DOT per antimicrobial course, regimens could have >1 error type.

c Negative binomial regression, test of intervention error days vs control, offset for total days of therapy.

Weekly antimicrobial use rates for each of the 3 firms during the 24-week intervention period were highly variable and frequently overlapped, with no suggestion of reduced antimicrobial use in either intervention firm compared with the control firm (data not shown).

DISCUSSION

When concurrently deployed over 24 weeks in operationally equivalent inpatient medicine firms, neither clinician education nor prospective audit and feedback was associated with reductions in antimicrobial use errors or rates compared with the control. The limited reliability of our computer-assisted case vignette for error adjudicationReference Schwartz, Wu, Lyles, Xiang, Kieszkowski, Hota and Weinstein 4 is a potential explanation for this finding. In addition, nearly 80% of cases in which antimicrobial regimens were initiated in the emergency department (ED) where the interventions used in this study were not implemented. However, the proportions of antimicrobial courses begun in the ED were similar among the 3 firms (Table 2), and study outcomes were similar between courses begun in the ED and in the hospital (data not shown).

Our clinician education intervention had been effective in a public, long-term, acute-care hospital staffed by a small cadre of dedicated attending physicians and no residents.Reference Schwartz, Abiad, DeMarais, Armeanu, Trick, Wang and Weinstein 2 In comparison, the current intervention presented a broader range of topics to much larger groups of attending and resident physicians who regularly rotated to other duties. Also, our ID pharmacists’ recommendations for improvement were accepted for only 129 of the 901 antimicrobial regimens administered during the study period (14.9%), with only 43 (4.8%) of these leading to discontinuation of 1 or all drugs. This factor limited that intervention’s impact on antimicrobial errors and use.

The median length of stay was significantly shorter in the control firm than in either of the intervention firms (4, 5 and 5 days, respectively; P<.001; Table 1), and the prevalence of lower respiratory tract infection was lower in control firm cases randomly selected for error adjudication than for cases selected from the intervention firms. Because shorter lengths of stay have been associated with improved quality of care, reduced medical complexity, and greater physician experience among cardiacReference Tickoo, Bhardwaj, Gonarow, Liang, Bhatt and Cannon 6 and general medical inpatients,Reference Parekh, Saint, Furney, Kaufman and McMahon 7 unmeasured differences in patient or physician characteristics could plausibly have confounded our findings. If true, a different randomization of the 3 firms could have led to a type 1 error.

Both informational interventions intended to improve antimicrobial prescribing generally (eg, clinician education and infection management guidelines), and interventions providing patient-level decision support such as audit and feedback and drug restrictions are essential to hospital antimicrobial stewardship.Reference Barlam, Cosgrove and Abbo 1 , Reference Pollack, van Santen, Weiner, Dudeck, Edwards and Srinivasan 8 However, our findings reinforce our hypothesis that the optimal scopeReference Popovski, Mercuri and Main 10 and intensity of these interventions remain poorly defined and difficult to measure. Clarification of this dynamic through additional research is needed to guide better integrated and better resourced antimicrobial stewardship.Reference Pollack, van Santen, Weiner, Dudeck, Edwards and Srinivasan 8 , Reference Schwartz 9

ACKNOWLEDGMENTS

Financial support. This project was funded by the Centers for Disease Control and Prevention (cooperative agreement #U01-CI000303 to R.A.W. and P.I.).

Potential conflicts of interest. All authors report no conflicts of interest relevant to this article.

SUPPLEMENTARY MATERIAL

To view supplementary material for this article, please visit https://doi.org/10.1017/ice.2017.74

Footnotes

PREVIOUS PRESENTATION. These data were presented in part at the 16th Annual Meeting of the Society for Healthcare Epidemiology of America, Chicago, Illinois, March 16–21, 2006, (abstracts 27 and 317), and at the 17th Annual Meeting of the Society for Healthcare Epidemiology of America, Baltimore, MD, April 14–17, 2007 (abstracts 27 and 298).

References

REFERENCES

1. Barlam, TF, Cosgrove, SE, Abbo, LM, et al. Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. Clin Infect Dis 2016;62:e51e77.Google Scholar
2. Schwartz, DN, Abiad, H, DeMarais, PL, Armeanu, E, Trick, WE, Wang, Y, Weinstein, RA. An educational intervention to improve antimicrobial use in a hospital-based long-term care facility. J Am Geriatr Soc 2007;55:12361242.Google Scholar
3. Schackow, TE, Chavez, M, Loya, L, et al. Audience response system: effect on learning in family medicine residents. Fam Med 2004;36:496504.Google Scholar
4. Schwartz, DN, Wu, US, Lyles, RD, Xiang, Y, Kieszkowski, P, Hota, B, Weinstein, RA. Lost in translation? Reliability of assessing inpatient antimicrobial appropriateness using computerized case vignettes. Infect Control Hosp Epidemiol 2009;30:163171.Google Scholar
5. Wisniewski, MF, Kieszkowski, P, Zagorski, BM, Trick, WE, Sommers, M, Weinstein, RA. Development of a clinical data warehouse for hospital infection control. J Am Med Inform Assoc 2003;10:454462.Google Scholar
6. Tickoo, S, Bhardwaj, A, Gonarow, GC, Liang, L, Bhatt, DL, Cannon, CP. Relation between hospital length of stay and quality of care in patients with acute coronary syndromes (from the American Heart Association’s Get with the Guidelines—coronary artery disease data set). Am J Cardiol 2016;117:201205.Google Scholar
7. Parekh, V, Saint, S, Furney, S, Kaufman, S, McMahon, L. What effect does inpatient physician specialty and experience have on clinical outcomes and resource utilization on a general medical service? J Gen Intern Med 2004;19:395401.Google Scholar
8. Pollack, LA, van Santen, KL, Weiner, LM, Dudeck, MA, Edwards, JR, Srinivasan, A. Antibiotic stewardship programs in US acute-care hospitals: findings from the 2014 National Healthcare Safety Network annual hospital survey. Clin Infect Dis 2016;63:443449.Google Scholar
9. Schwartz, DN. Antimicrobial stewardship in US hospitals: Is the cup half-full yet? Clin Infect Dis 2016;63:450453.Google Scholar
10. Popovski, Z, Mercuri, M, Main, C, et al. Multifaceted intervention to optimize antibiotic use for intra-abdominal infections. J Antimicrob Chemother 2015;70:12261229.Google Scholar
Figure 0

TABLE 1 Inpatient Medicine Firms and Reviewed Antimicrobial Cases

Figure 1

TABLE 2 Antimicrobial Regimen Error Rates

Supplementary material: File

Schwartz supplementary material

Table S1

Download Schwartz supplementary material(File)
File 14.8 KB