Clostridium difficile infection (CDI) is a major cause of antibiotic-associated diarrhea and colitis, and it is among the most common healthcare-associated infections (HAIs). 1 , Reference Miller, Chen, Sexton and Anderson 2 The CDI incidence rate doubled between 2000 and 2009, and recent National Healthcare Safety Network (NHSN) data suggest a modest 8% decrease in CDI between 2011 and 2014, which represents far less progress in prevention than has been made against other serious HAIs such as central-line–associated bloodstream infection (CLABSI) and surgical site infection (SSI). 3 The NHSN measure used to track C. difficile disease is the laboratory-identified (LabID) CDI event, which was introduced in March 2009. 4 LabID CDI events represent new positive C. difficile lab test results for Toxin A and/or B and are further divided into community onset (CO; sample collected within the first 3 days of admission) or hospital onset (HO; sample collected on day 4 or later). HO Lab-ID CDI events (reported as standardized infection ratios [SIRs]) are reported publicly and are incorporated into the Centers for Medicare and Medicaid Services (CMS) value-based purchasing program. 5 , 6
At the same time that CDI has become the most common HAI in many US hospitals,Reference Miller, Chen, Sexton and Anderson 2 advances in diagnostic technology have improved our ability to detect toxigenic C. difficile in stool samples.Reference Bartsch, Umscheid, Nachamkin, Hamilton and Lee 7 – Reference Polage, Gyorke and Kennedy 9 Widely adopted nucleic acid amplification tests (NAATs) are far more sensitive than toxin enzyme immunoassays (EIAs), and they have increased the rate of C. difficile detection by more than 50%.Reference Moehring, Lofgren and Anderson 10 In addition, because such assays detect the toxin gene rather than the toxin itself, there is increasing recognition that some positive tests indicate the presence of a toxigenic strain in the absence of clinically significant disease.Reference Koo, Van and Zhao 8 , Reference Polage, Gyorke and Kennedy 9 Many centers have begun using testing algorithms that include toxin EIA testing in combination with more sensitive tests (glutamate dehydrogenase [GDH], NAAT, or both) in an effort to reduce costs, to obtain additional information about toxin production (to support clinical management), and to maintain the sensitivity of NAAT testing (to help guide infection control efforts).Reference Bartsch, Umscheid, Nachamkin, Hamilton and Lee 7
To improve interfacility comparison and bring fairness to pay-for-performance programs that incorporate LabID-CDI events, the NHSN utilizes a risk adjustment formula that includes several variables, including the diagnostic method used.Reference Dudeck, Weiner and Malpiedi 11 The diagnostic method variable is divided into 3 categories: NAAT, EIA for toxin, and all other tests. Because our hospital utilizes an algorithm that incorporates both toxin EIA and NAAT testing, we can calculate our LabID-CDI event SIR under the assumption that we use only EIA or only NAAT to evaluate the performance of the current NHSN risk-adjustment formula.
METHODS
The University of Iowa Hospitals and Clinics (UIHC) is a 732-bed hospital tertiary-care teaching hospital. The UIHC clinical microbiology laboratory uses an algorithmic approach to C. difficile detection: all submitted unformed stools (defined as those that take the shape of their container) are first tested using the combined GDH and toxin A/B lateral flow immunoassay (C. Diff Quik Chek Complete, Alere, Waltham, MA). Samples that are ‘positive–positive’ or ‘negative–negative’ by GDH and toxin are reported as such and are tested no further. Samples discordant by GDH and toxin are tested further using NAAT (GeneXpert C. difficile/Epi PCR, Cepheid, Sunnyvale, CA), which detects the genes for tcdB and binary toxin (cdt) and the single-nucleotide deletion at tcdC gene that is a marker for ribotype 027.Reference Bartsch, Umscheid, Nachamkin, Hamilton and Lee 7 During validation of this algorithm, we confirmed that all samples positive by GDH and toxin were also NAAT positive, while none of the GDH-negative samples were NAAT positive (data not shown). Thus, for the following analysis, we assumed all positive results by GDH/toxin EIA would have been positive using NAAT.
We calculated our LabID-CDI SIR for a 13-month period under the assumption that we performed only EIA (excluding GDH, which, while more sensitive than toxin EIA for C. difficile, does not trigger a LabID event if detected) and again under the assumption that we performed NAAT (and that toxin EIA positive samples would have been NAAT positive). We then compared the resulting SIR values.
RESULTS
From February 1, 2015, to February 29, 2016, UIHC had 213,404 patient days and 13,788 hospital admissions. During this time period, 374 patients had toxigenic C. difficile detected in stool samples by either EIA or NAAT, and 127 of these incidents were detected within the first 3 days of hospital admission (ie, were classified as community onset [CO]). Table 1 presents the differences in number of observed and expected cases of HO LabID-CDI under the EIA and NAAT assumptions, and HO SIR values.
TABLE 1 Hospital-Onset (HO) LabID-CDI Event Standardized Infection Ratio (SIR) when Using Enzyme Immunoassay (EIA) Versus Nucleic Acid Amplification Test (NAAT)

NOTE. No. of predicted LabID events=exp (β0+β1X1+β2X2+…)× patient days. No. of predicted (expected) HO CDI LabID events=exp [(−7.8983+0.385 NAATa+0.0160 EIAa)+0.3338×(CO CDI prevalence rate)+0.2164 bedsb+0.0935 bedsc+0.187 majord+0.0918 graduated]×CDI patient days, where a indicates CDI test types and b indicates bed size >245 beds, c indicates bed size=101–245 beds, and d indicates medical school affiliation. EIA model: No. of predicted LabID events=exp [−7.8983+0.385×0+0.1606×1+0.3338×0.43+0.2164×1+0.0935×0+0.187×1+0.0918×1]×213,404, where bold values have been substituted into the first equation as follows: NAAT=0; EIA=1; CO CDI prevalence rate=0.43; >245 beds=1; 101–245 beds=0; medical school majors=1; medical school graduates=1; and CDI patient days=213,404. NAAT model (assumes EIA positive samples are all NAAT positive): No. of predicted LabID events=exp [−7.8983+0.385×1+0.1606×0+0.3338×0.92+0.2164×1+0.0935×0+0.187×1+0.0918×1]×213,404, where bold values have been substituted into the first equation as follows: NAAT=1; EIA=0; CO CDI prevalence rate=0.92; >245 beds=1; 101–245 beds=0; medical school majors=1; medical school graduates=1; and CDI patient days=213,404.
a The CDI LabID SIR is calculated by dividing the no. of observed HO CDI LabID events by the no. of expected events.
The SIR for HO-LabID-CDI was almost double for NAAT (0.95) compared with EIA alone (0.50).
DISCUSSION
Public reporting of HAIs, combined with inclusion of HAI measures in pay-for-performance (PFP) programs, was instituted to increase prevention efforts that improve patient care and outcomes. However, the metrics adopted for public reporting and PFP must be appropriately risk adjusted so that a “level playing field” exists.Reference Talbot, Bratzler and Carrico 12
Our findings suggest that the risk adjustment formula currently used by NHSN for the LabID-CDI metric does not adequately control for the test method. The reasons that the model developed by NHSN, which used baseline surveillance data from 2010 to 2011, underestimates the increased number of cases identified by NAAT is unclear.Reference Dudeck, Weiner and Malpiedi 11 Early adoption of NAAT testing may be a marker for another hospital characteristic associated with fewer HO LabID-CDI events, or regional differences in strain type could affect the proportion of toxigenic C. difficile for which toxin is detected by EIA. In addition, the difference in detection rate between NAAT and EIA varies across populations.Reference Moehring, Lofgren and Anderson 10 Even within our single-center study, the ratio of events detected (NAAT:EIA) differed between the CO population (2.1:1) and the HO (2.8:1) population. This variation suggests that it will be difficult to improve statistical adjustment for the test method. Updating the coefficient that accounts for the “average” increased detection rate for NAAT is unlikely to perform equally well across populations and centers. Further study is needed to determine the variables associated with a higher “step up” in detection by NAAT versus EIA, which might allow risk adjustment to improve substantially.
In any case, to achieve a more level playing field, the adjustment formula must be changed. If the adjustment method is not improved, hospital laboratories may come under pressure to drop the more sensitive NAAT testing to improve their publicly reported rates, which could be impede case finding and prevention.Reference Bartsch, Umscheid, Nachamkin, Hamilton and Lee 7 Indeed, some hospitals have already reported this trend (personal communication).
In the United Kingdom, only cases identified by toxin EIA are publically reported, regardless of whether a center also performs NAAT for clinical or local infection prevention purposes. However, this reporting system assumes that all laboratories include the toxin EIA in their algorithm. 13 Indeed, one approach to improve reporting for the increasing number of centers that perform “2-step” algorithms is to allow those centers to report only cases positive by toxin EIA. However, such an approach would require a change in the formula to better adjust for centers using NAAT alone.
In summary, we found that our LabID event-CDI rate nearly doubled based solely on lab testing strategy; thus, the current NHSN risk adjustment formula must be revisited.
ACKNOWLEDGMENTS
Financial support: No financial support was provided relevant to this article.
Potential conflicts of interest: All authors report no conflicts of interest relevant to this article.