Hostname: page-component-745bb68f8f-l4dxg Total loading time: 0 Render date: 2025-02-11T07:37:55.383Z Has data issue: false hasContentIssue false

A Simple Microsoft Excel Method to Predict Antibiotic Outbreaks and Underutilization

Published online by Cambridge University Press:  03 May 2017

Cristina Miglis
Affiliation:
Department of Pharmacy Practice, Midwestern University Chicago College of Pharmacy, Downers Grove, Illinois Department of Pharmacy, Northwestern Memorial Hospital, Chicago, Illinois
Nathaniel J. Rhodes
Affiliation:
Department of Pharmacy Practice, Midwestern University Chicago College of Pharmacy, Downers Grove, Illinois Department of Pharmacy, Northwestern Memorial Hospital, Chicago, Illinois
Sean N. Avedissian
Affiliation:
Department of Pharmacy Practice, Midwestern University Chicago College of Pharmacy, Downers Grove, Illinois Department of Pharmacy, Northwestern Memorial Hospital, Chicago, Illinois
Teresa R. Zembower
Affiliation:
Division of Infectious Diseases, Northwestern University Feinberg School of Medicine, Chicago, Illinois
Michael Postelnick
Affiliation:
Department of Pharmacy, Northwestern Memorial Hospital, Chicago, Illinois
Richard G. Wunderink
Affiliation:
Division of Pulmonary Critical Care, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
Sarah H. Sutton
Affiliation:
Division of Infectious Diseases, Northwestern University Feinberg School of Medicine, Chicago, Illinois
Marc H. Scheetz*
Affiliation:
Department of Pharmacy Practice, Midwestern University Chicago College of Pharmacy, Downers Grove, Illinois Department of Pharmacy, Northwestern Memorial Hospital, Chicago, Illinois
*
Address correspondence to Marc H. Scheetz, PharmD, MSc, Associate Professor of Pharmacy Practice, Midwestern University Chicago College of Pharmacy; 555 31st St, Downers Grove, IL 60515 (mschee@midwestern.edu).
Rights & Permissions [Opens in a new window]

Abstract

Benchmarking strategies are needed to promote the appropriate use of antibiotics. We have adapted a simple regressive method in Microsoft Excel that is easily implementable and creates predictive indices. This method trends consumption over time and can identify periods of over- and underuse at the hospital level.

Infect Control Hosp Epidemiol 2017;38:860–862

Type
Concise Communications
Copyright
© 2017 by The Society for Healthcare Epidemiology of America. All rights reserved 

The emergence of antibiotic-resistant bacteria is an increasingly serious threat to global public health.Reference Llor and Bjerrum 1 Infections caused by these organisms are associated with a significant clinical and financial burden worldwide and are responsible for at least 2 million illnesses and 23,000 attributable deaths annually in the United States alone. 2 Moreover, the Centers for Diseases Control and Prevention (CDC) estimates that up to 50% of antibiotic prescriptions in the United States are unnecessary. 2

As a result of inappropriate overuse, various calls to action for antimicrobial stewardship have been sounded. While a need to curtail inappropriate use through stewardship exists, defining this in the hospital setting can be difficult and requires standardization.Reference Spellberg and Gilbert 3 , Reference Spellberg, Srinivasan and Chambers 4 One mechanism aimed at benchmarking consumption and evaluating national trends is the CDC Antibiotic Use and Resistance (AUR) module for reporting data to the National Healthcare Safety Network (NHSN). We recently described a methodology to identify potential “antibiotic outbreaks” and periods of underutilization using data compiled by the NHSN AU method. Antibiotic use (ie, consumption) was measured in days of therapy (DOT), which was standardized to days present (DP) in the hospital (ie, DOT/1,000 DP). Over- and under-utilization was defined as a monthly rate of use outside the trend-adjusted prediction window.Reference Scheetz, Crew and Miglis 5 One barrier to implementing our previous methodology is the requirement for users to have technical statistical software (eg, Stata, StataCorp LP, College Station, TX) and statistical expertise. In this manuscript, we translate our methodology into a “plug and play strategy” using Microsoft Excel. By using well-known and readily available software, most hospital users should be able to employ these strategies. This method is easy to implement in any hospital that generates longitudinal antimicrobial utilization data, including those who participate in the NHSN AUR module.

For method illustration, data were obtained from Northwestern Memorial Hospital, an 897-bed, tertiary-care, academic medical center in Chicago, Illinois. Data regarding intravenous administration of piperacillin-tazobactam were extracted from our medical intensive care unit (MICU) monthly from January 1, 2012, to December 31, 2015. Antibiotic consumption was calculated as antimicrobial days (AD) per 1,000 DP in the ICU and compiled according to the NHSN AU methodology. 6 Antimicrobial days and DP facility wide were extracted from the electronic medication record (eMAR) and tallied. Microsoft Excel (2016) standard formulae were used for all calculations, and priority for formulae/code was based on compatibility with older Microsoft Excel versions. A database is supplied as Supplementary Material with formulae for each calculated text box. Interested readers can transfer their own data and generate similar graphics and predictions.

Our data were extracted from the NHSN portal as follows. The “Analysis” portal within the Patient Safety component was accessed, and the “Output options” section was selected. From this portal, the Antimicrobial Use and Resistance module was chosen and directed to Antimicrobial Use data. Using the “CDC defined output,” “Line Listing-All Submitted AU Data by Location” was downloaded (although whole-hospital [FACWIDEIN] is also an option). By modifying the output to comma-separated-value format (*.csv), the data were immediately available in Microsoft Excel. Date data (ie, month of use) are defined in the NHSN data as “summaryYM.” Numerator data (ie, consumption) were obtained from “IV_Count.” Denominator data (ie, days present) were obtained from “numDaysPresent.” After sorting for location and antibiotic of choice, sequential months were enumerated. Consumption data were then standardized as DOT/1,000 DP in the adjacent column for each corresponding month using the formula (=cell defining “IV_Count”/cell defining “numDaysPresent” *1,000; see Supplementary Material).

Because NHSN data are not universally available to all institutions, any antibiotic consumption data following a similar format (eg, DOT/1,000 DP) can be modeled using the file available in the Supplementary Material. That is, this document only requires that users insert institution-specific consumption data standardized to 1,000 DP. Formulae are included in the Supplementary Material, and derivations are detailed in Table 1.

FIGURE 1 Linear regression of piperacillin-tazobactam consumption (DOT/1000 PD) in the medical intensive care unit as the y-axis from the period from January 2012 to December 2015 as sequential months from 1 to 48 (x-axis). Dashed lines represent upper and lower bounds of the 95% confidence interval. Solid lines represent upper and lower bounds of the 80% prediction interval. The latter is suggested to predict periods of potential under- and overuse.

To investigate antibiotic outbreak thresholds and periods of underutilization, prediction intervals were defined for each individual time period.Reference Scheetz, Crew and Miglis 5 In this case, an 80% prediction interval was arbitrarily chosen to define potential antibiotic outbreaks; however, percentages can be set to any threshold at the discretion of each institution. We propose that this value has greater utility than the more generally reported 95% confidence interval for the mean, which predicts the confidence interval for the mean (rather than any individual single prediction). 7 Values above or below the prediction interval serve as a decision support tool for the investigation of antibiotic over- or underuse. Upper and lower bounds of these predictive intervals were calculated using standard errors of predictions (see Table 1, equation set 2).Reference Altman and Bland 8 , 9

TABLE 1 Derivations of Equation From the Supplemental MaterialFootnote a

NOTE. DOT, days of therapy; PD, patient days; T, time; SEM, standard error of the mean; SQRT, square root; DEVSQ, squared deviation of the sample mean; TINV, inverse of the two-tailed Student t distribution; PI_UB; upper bound 80% prediction interval PI_LB, lower bound 80% prediction interval; SE, standard error.

a Equation set 1 includes the formulae needed to construct a simple linear regression model using the FORECAST function with DOT/1,000 DP as the dependent variable and time as the independent variable. This calculates mean linear predictions for consumption data across ordered time months, with variability quantified as standard error of the mean (SEM) and attendant 95% confidence intervals at each time point. Equation set 2 includes the formulae needed to calculate standard errors of predictions and attendant 80% prediction intervals at each time point.

b Month is a single numeric value when months are numbered sequentially.

c Analysis_period is the total time of analysis.

d TINV is the 2-tailed inverse of the Student t distribution: the first number following TINV is the probability associated with the 2-tailed Student t distribution and the second number following it is the degrees of freedom.

e The COUNT -2 function is used to determine the needed degrees of freedom.

One application of this method may be to identify a hospital’s or unit’s adherence to antimicrobial stewardship policies over time and to provide trigger points for further ASP review. Trigger points would be those that were above (ie, potential overutilization due to inappropriate use) or below (ie, potential underutilization due to overly aggressive policy application) the prediction interval. In Figure 1, these trigger points are circled (ie, 3 below and 3 above the prediction interval). The stewardship team can conduct a drug utilization review for the antibiotic in question, focusing on the period surrounding the trigger point and determining whether use during the identified period was appropriate or inappropriate. Another application would be to test whether newly implemented stewardship strategies resulted in a departure from the previous linear trend (ie, Does consumption decrease beyond a certain prediction interval post implementation of stewardship strategy?). To measure impact, using the supplemental file, one would input the previous data that defined the past trend and would then omit data for the period that defined the intervention. The supplementary file is set up to automatically predict future trends. The investigator can utilize these calculations to determine whether the intervention resulted in a departure from the predicted trend.

We have adapted a methodology to identify potential antibiotic outbreaks using a widely available program, Microsoft Excel. This method can be easily implemented in individual institutions using NHSN or other similarly collected antibiotic consumption data. Variation of site-specific antimicrobial consumption and internal trends in antimicrobial use can then be identified. Determining such trends is highly relevant for individual institutions and may provide antimicrobial stewardship programs a stable method for comparing antimicrobial consumption over time for conserved patient mixes (eg, their own hospital). We believe this method has a variety of applications including quality assessment of stewardship protocols, formulary changes, or drug shortages.

It is important to understand several caveats when applying this methodology. As with most mathematic models, predictions have inherent uncertainty. Thus, we advise caution when interpreting these data to avoid any overconfidence or confirmation bias. In addition, this method assumes linearity of predicted consumption values and homoscedasticity of errors. These assumptions can be easily confirmed or refuted through visual inspection, where predictions around the line at zero should have roughly equal numbers of residuals above and below zero. Once these assumptions are verified, this model can be applied as a practical screening tool to identify institution-specific utilization trends and consumption triggers for further investigation.

SUPPLEMENTARY MATERIAL

To view supplementary material for this article, please visit https://doi.org/10.1017/ice.2017.72

ACKNOWLEDGMENTS

Financial support: No financial support was provided relevant to this article.

Potential conflicts of interest: All authors report no conflicts of interest relevant to this article.

References

REFERENCES

1. Llor, C, Bjerrum, L. Antimicrobial resistance: risk associated with antibiotic overuse and initiatives to reduce the problem. Ther Adv Drug Saf 2014;5:229241.CrossRefGoogle ScholarPubMed
2. Antibiotic resistance threats in the United States. Centers for Disease Control and Prevention website. http://www.cdc.gov/drugresistance/pdf/ar-threats-2013-508.pdf. Published 2013. Accessed September 1, 2016.Google Scholar
3. Spellberg, B, Gilbert, DN. The future of antibiotics and resistance: a tribute to a career of leadership by John Bartlett. Clin Infect Dis 2014;59(Suppl 2):S71S75.CrossRefGoogle ScholarPubMed
4. Spellberg, B, Srinivasan, A, Chambers, HF. New societal approaches to empowering antibiotic stewardship. JAMA 2016;315:12291230.CrossRefGoogle ScholarPubMed
5. Scheetz, MH, Crew, PE, Miglis, C, et al. Investigating the extremes of antibiotic use with an epidemiologic framework. Antimicrob Agents Ch 2016;60:32653269.CrossRefGoogle ScholarPubMed
6. Antimicrobial use and resistance (AUR) module. Centers for Disease Control and Prevention website. http://www.cdc.gov/nhsn/PDFs/pscManual/11pscAURcurrent.pdf. Published 2016. Accessed August 29, 2016.Google Scholar
7. Confidence and prediction intervals for forcasted values. Real Statistics University Excel website. http://www.real-statistics.com/regression/confidence-and-prediction-intervals/. Published 2016. Accessed March 27, 2017.Google Scholar
8. Altman, DG, Bland, JM. Statistics notes—standard deviations and standard errors. Brit Med J 2005;331:903903.CrossRefGoogle ScholarPubMed
9. Using Excel to compute a confidence interval. Graphpad software website. http://www.graphpad.com/support/faqid/1432/. Published 2016. Accessed March 27, 2017.Google Scholar
Figure 0

FIGURE 1 Linear regression of piperacillin-tazobactam consumption (DOT/1000 PD) in the medical intensive care unit as the y-axis from the period from January 2012 to December 2015 as sequential months from 1 to 48 (x-axis). Dashed lines represent upper and lower bounds of the 95% confidence interval. Solid lines represent upper and lower bounds of the 80% prediction interval. The latter is suggested to predict periods of potential under- and overuse.

Figure 1

TABLE 1 Derivations of Equation From the Supplemental Materiala

Supplementary material: File

Miglis supplementary material

Miglis supplementary material 1

Download Miglis supplementary material(File)
File 51 KB