Previous Article | Next Article ![]()
Antimicrobial Agents and Chemotherapy, September 2008, p. 3188-3194, Vol. 52, No. 9
0066-4804/08/$08.00+0 doi:10.1128/AAC.01553-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Section of Infectious Diseases, Rush University Medical Center, Chicago, Illinois,1 Division of Infectious Diseases, John H. Stroger, Jr. (Cook County) Hospital, Chicago, Illinois2
Received 3 December 2007/ Returned for modification 26 March 2008/ Accepted 4 July 2008
|
|
|---|
|
|
|---|
While inadequate antimicrobial treatment of bloodstream infections has been associated with worse outcomes in specific populations of patients, such as those in the intensive care unit (ICU) (11, 15, 19), those with septic shock (22), and those infected with Staphylococcus aureus (25), Pseudomonas aeruginosa (24, 27), extended-spectrum β-lactamase-producing organisms (1, 18), or Candida spp. (28), not all studies have shown these associations (5, 21, 29, 32).
The heterogeneity of the results can be explained partly by methodological challenges inherent in studying the impact of inadequate antimicrobial therapy. First, the definitions of inadequate therapy are inherently arbitrary and vary among studies. Second, local antimicrobial resistance patterns and cultures of prescribing empirical antimicrobial therapy differ between institutions and over time, thus creating differences in the types and virulences of organisms that are likely to be inadequately treated. Third, because such studies are observational, removing confounding factors is a challenge.
In observational studies, significant differences that exist between treatment groups (in this study, nondelayed active antimicrobial therapy versus delayed active antimicrobial therapy) may not be adjusted sufficiently using commonly used multivariable techniques (16, 31, 35). In particular, multivariable models that include confounders based only on statistical significance with respect to the outcome (which is often encountered with automated variable selection methods) may inappropriately exclude important confounders that adjust for differences between treatment groups (14).
In this study, we used a manual model-building approach that evaluated potential confounders based on their impact on the point estimate and confidence interval (CI) of the main exposure-mortality relationship. Second, we assessed whether further inclusion of a propensity score in the multivariable model had an impact on residual confounding. The propensity score is a composite variable defined as the subject's probability, between 0 and 1, of receiving a particular treatment, derived from a separate logistic regression model incorporating variables that are associated with treatment. Two patients with the same propensity score have equal estimated probabilities of receiving treatment; if one receives treatment while another does not, then the treatment allocation can be considered random, conditional on the observed confounders. Such an approach has been proposed as a useful adjunct to traditional multivariable logistic regression models for observational studies of antimicrobial therapy (16, 30).
We report a retrospective study of a large cohort of patients with monomicrobial bloodstream infections over a 5-year period at our institution. We hypothesized that patients with a delay of active antimicrobial therapy for bloodstream infections would have a higher mortality risk than patients who did not have a delay.
|
|
|---|
The following patients were excluded: those with blood isolates of common skin commensals (coagulase-negative Staphylococcus spp., Micrococcus spp., Bacillus spp., or Corynebacterium spp.), to avoid misclassification of blood culture contaminants as true infections; those with anaerobes, because susceptibility testing was not routinely performed; those already receiving active antimicrobial therapy prior to index blood culture; those who were discharged within one hospital day after the index blood culture; those who died within one hospital day of index blood culture, as differences in antimicrobial therapy likely would not have changed their outcome (2, 7, 16); and those with bacteremia due to a second organism within 30 days of index bacteremia. Patients could be entered more than once in the study if episodes of monomicrobial bloodstream infections were separated by more than 30 days.
All clinical, microbiological, and pharmacy records were obtained using an electronic research database, developed as a part of the Chicago Antimicrobial Resistance Project (37). Data are prospectively collected in an event-driven fashion and systematically validated against the main hospital electronic record in an ongoing basis. Antimicrobial administration times were derived from electronic pharmacy records, based on the time of prescribed administration. Manual comparisons of electronic pharmacy dispensing records with a sample of bedside medication administration records showed excellent concordance (>95%) with respect to timing.
The study was reviewed by the hospital's institutional review board, and the need for informed consent was waived.
Data collection and variables of interest. (i) Outcome. Mortality was defined as in-hospital death due to any cause within 30 days of index blood culture.
(ii) Adequate antimicrobial therapy. To be categorized as adequate, initial antimicrobial therapy had to meet three criteria: (i) administration by intravenous route was initiated within 24 h of index blood draw, (ii) the bacterial blood isolate should be susceptible to the antimicrobial by subsequent in vitro testing, and (iii) the antimicrobial should be considered clinically effective or moderately effective against the isolate, as determined by the Sanford Guide to Antimicrobial Therapy (12). Patients who did not meet these criteria were considered to have delay of active antimicrobial therapy.
(iii) Covariates.
For all patients in the cohort, the following covariates were considered: age, number of hospital days prior to index blood culture, gender, human immunodeficiency virus (HIV) status, absolute neutrophil count (ANC; the lowest value measured 0 to 2 days prior to index blood culture, categorized as nonneutropenic [ANC, >500 cells/µl], moderately neutropenic [ANC, 100 to 500 cells/µl], or severely neutropenic [ANC, <100 cells/µl]), receipt of any inpatient antibacterial in the prior 30 days, blood culture time and date, location of patient at midnight prior to the time of blood culture draw (dichotomized as ICU versus non-ICU), and all medications, including antimicrobials, administered to the patient up to 14 days after index blood culture draw. Vasopressor use (defined as receipt of epinephrine, norepinephrine, phenylephrine, or vasopressin) was ascertained 0 to 2 days prior to index blood culture; for sensitivity analysis, vasopressor use ascertained 1 to 2 days prior to index blood culture was used. A modified Charlson comorbidity index was calculated using International Classification of Diseases (ICD-9) diagnosis codes (9); because we found the variable to be nonlinear with respect to mortality, we dichotomized the Charlson score (
1 versus
2). Specific bacterial groups considered covariates of interest included gram-positive and gram-negative organisms, Enterobacteriaceae, S. aureus (categorized as methicillin sensitive or resistant), Enterococcus spp. (categorized as vancomycin sensitive or resistant), E. coli and Klebsiella spp. (categorized as ceftazidime sensitive or resistant), Pseudomonas aeruginosa (categorized as imipenem sensitive or resistant), and Acinetobacter spp. (categorized as imipenem sensitive or resistant).
To allow adjustment for the level of antimicrobial resistance across different organisms as a factor for delayed antimicrobial therapy, we constructed a continuous variable called the pathogen resistance index (PRI). Using the in vitro susceptibility data for each bacterial isolate, a PRI was calculated by the formula (number of classes of resistant antimicrobials/number of total classes of antimicrobials tested) x 100 to create a score between 0 and 100. A completely resistant organism would have a score of 100, while a completely susceptible organism would have a score of 0.
Similarly, to allow adjustment for the spectrum of empirical antimicrobial therapy received as a factor for delayed antimicrobial therapy, we constructed a continuous variable called the antimicrobial spectrum index (ASI). Using the Sanford Guide to Antimicrobial Therapy, ASI was defined by the formula (number of susceptible bacteria/number of total bacteria listed) x 100 to create a score between 0 and 100 (see Table 4 in reference 12). Broad-spectrum antimicrobials had higher ASI scores than narrow-spectrum antimicrobials did. When patients were given multiple active drugs as empirical therapy, the antimicrobial with the highest ASI score was used for analysis.
|
View this table: [in a new window] |
TABLE 4. Adjusted effects of delay of active antimicrobial therapy on mortality, stratified by ICU stay and level of neutropeniaa
|
Bivariable analyses were performed using Fisher's exact and chi-square tests to compare categorical variables, and Student's t tests were performed to compare continuous variables.
To calculate a propensity score for the probability of delay in active antimicrobial therapy, we constructed a multivariable logistic regression model with treatment delay dichotomized as the dependent variable. For propensity score calculation, we evaluated baseline patient and organism covariates by using backward selection at a prespecified significance level (P < 0.05) for retaining terms.
Multivariable logistic regression was used to obtain an adjusted estimate of the association between delay of active antimicrobial therapy and mortality. First, all two-way interaction terms with antimicrobial therapy delay were analyzed in a model saturated with all covariates considered in this study. Significant interaction terms (P value, below or near 0.05) were retained in the model, along with their lower-order covariates. Next, covariates were manually assessed as confounders by determining whether their removal substantially changed the effect estimates of delayed antimicrobial therapy stratified by interaction terms. We assessed the fit of the logistic regression model to observed data by using the Hosmer-Lemeshow goodness-of-fit test (17). For sensitivity analysis, the propensity score was added as an additional covariate to determine whether measured differences between the delay and nondelay groups contributed to residual confounding. For interpretation of final model results, tests of significance were two tailed, and P values of <0.05 were considered significant. All data were analyzed using SAS software, version 9.1 (SAS Institute, Cary, NC).
|
|
|---|
In the overall cohort, 938 (61.6%) episodes were caused by gram-positive organisms. Four hundred eighty episodes were caused by Staphylococcus aureus, of which 169 were methicillin resistant. One hundred thirty-six episodes were caused by Enterococcus spp., of which 46 were vancomycin resistant. Of the 535 (38.4%) episodes caused by gram-negative organisms, highly resistant gram-negative organisms were rare (ceftazidime-resistant E. coli or Klebsiella spp., n = 8; imipenem-resistant Pseudomonas aeruginosa, n = 11; and imipenem-resistant Acinetobacter spp., n = 1).
Antimicrobial therapy delay. Overall, there were 540 (35.5%) episodes of delay of active antimicrobial therapy, while 983 (64.5%) had nondelayed therapy. The mortality rate in the delay group was 9.3%, while the mortality rate in the nondelay group was 8.0%. A total of 89 (5.8%) episodes of bacteremia were treated only with inactive antimicrobials; 15 of these were associated with death (mortality rate, 17%). Compared to the nondelay group, bacteremias leading to delay of active antimicrobial therapy were more likely to be caused by methicillin-resistant Staphylococcus aureus, vancomycin-resistant Enterococcus spp., or Acinetobacter spp. (all P values, <0.05). The mean PRI of organisms in the delay group was significantly higher than that of the nondelay group (35 versus 17; P < 0.01). Table 1 compares baseline and outcome characteristics of the nondelay group with those of the delay group.
|
View this table: [in a new window] |
TABLE 1. Characteristics of patients with nondelay or delay of active antimicrobial therapy
|
|
View this table: [in a new window] |
TABLE 2. Independent predictors of delay of active antimicrobial therapy in a multivariable logistic regression model (used to derive a propensity score for delay)
|
|
View this table: [in a new window] |
TABLE 3. Bivariate analysis of covariates with mortality as the outcome
|
In the final model (Table 4), among non-ICU patients, delay was not associated with significantly increased mortality among patients with ANCs of >500 cells/µl (OR, 1.78; 95% CI, 0.91 to 3.45; P = 0.09) or patients with ANCs of 100 to 500 cells/µl (OR, 1.92; 95% CI, 0.17 to 21.6; P = 0.60). However, non-ICU patients who were severely neutropenic with ANCs of <100 cells/µl had significantly higher odds of mortality when comparing delay versus nondelay of active antimicrobial therapy (OR, 18.0; 95% CI, 2.84 to 114.5; P < 0.01).
Among ICU patients, delay of active antimicrobial therapy was not associated with increased mortality for patients with ANCs of >500 cells/µl (OR, 0.55; 95% CI, 0.29 to 1.02; P = 0.06) or for patients with ANCs of 100 to 500 cells/µl (OR 0.59, 95% CI 0.06 to 6.22, P = 0.66). There was a trend toward higher odds of mortality for severely neutropenic patients in the ICU experiencing delays of active antimicrobial therapy, although the estimate was not statistically significant (OR, 5.56; 95% CI, 0.85 to 36.3; P = 0.07).
In the final model, methicillin-resistant S. aureus bacteremia conferred a twofold-increased odd of mortality, even after adjusting for antimicrobial therapy delay and other confounders (OR, 2.04; 95% CI, 1.17 to 3.53; P = 0.02). In contrast, methicillin-sensitive S. aureus bacteremia trended toward increased mortality but was not statistically significant (OR, 1.57; 95% CI, 0.90 to 2.75; P = 0.11). The final model also suggested that among bacteremic patients, HIV infection conferred a nearly twofold increase in odds of death (OR, 1.87; 95% CI, 1.03 to 3.38; P = 0.04), even after adjusting for patient and treatment characteristics.
Sensitivity analysis. To adjust for residual confounding due to measured differences between the delay and nondelay groups, the propensity score was added to the final regression model. Addition of the propensity score did not substantially change the effect estimates or CIs of the final model (Table 4). Furthermore, removal of the covariate controlling for sepsis (vasopressor use) or redefining the timing of sepsis determination (measuring vasopressor use 1 and 2 days prior to the index blood culture) did not substantially change the final-model results (data not shown). Finally, changing the definition of delay to a more restrictive time cutoff (12 h) in the final model did not substantially change the results of the final model.
The Hosmer-Lemeshow goodness-of-fit test did not reject the null hypothesis of good fit (P = 0.75), indicating that the final logistic regression model fit the observed data well.
|
|
|---|
Neutrophils are the predominant leukocytes in the blood and are the first line of defense in controlling bacteria invading the bloodstream (6). The risk for developing infection increases significantly as the ANC falls below 500 cells/µl and is the highest when the ANC falls below 100 cells/µl (4). Among neutropenic patients who develop bacteremia, studies have been inconclusive about the effect of the ANC level on mortality. González-Barca et al. studied 438 consecutive neutropenic cancer patients with bacteremia and found that patients with ANCs of <100 cells/µl at the onset of bacteremia had approximately 40%-increased unadjusted odds of death relative to those with ANCs of 100 to 500 cells/µl (13). In contrast, Elting et al. analyzed 909 episodes of neutropenic bacteremia and found that there was no substantial difference in mortality between patients with ANCs of <100 cells/µl and those with ANCs of 100 to 1,000 cells/µl, particularly for uncomplicated bacteremia (10). In both studies, neither ANC level nor inadequate empirical antimicrobial therapy predicted increased mortality in adjusted analyses; rather, other factors, such as shock at the time of bacteremia, appeared to be the most important predictors. Nevertheless, there is biological plausibility that severe neutropenia at the onset of bacteremia could impair the ability of the patient to survive the infection in the face of inadequate antimicrobial therapy. Our study suggests that there is a threshold ANC level (100 cells/µl) below which delay of active antimicrobial therapy has an important effect on mortality.
For bacteremic patients without severe neutropenia, delay of active antimicrobial therapy did not appear to significantly impact mortality. Although it is reasonable to expect inadequate antimicrobial therapy to worsen mortality, this relationship is complex and not consistently supported in the literature. While several studies have shown an association between inappropriate antimicrobial therapy and mortality (1, 19, 23, 25, 27, 33, 36), other studies have not found a significant association (3, 5, 8, 20, 21, 29, 32, 38).
Much of the conflicting findings may be due to differences in methodology, making generalizations difficult (26). Our study was unique in the following ways. First, we focused on monomicrobial bacterial infections, and we excluded common skin commensals and nonbacterial pathogens, such as fungi. Second, the majority of our subjects (73%) had community-acquired bacteremia; in this population, the true duration of bacteremia is unclear, and initial inappropriate antimicrobial therapy may not have significant impact. Third, because our electronic database lacked the necessary data to calculate common severity-of-illness variables, such as the APACHE score, we relied on other markers of acuity, such as vasopressor use and ICU stay. While we controlled for measured differences between the treatment groups by using multivariable regression models and testing the inclusion of a propensity score, there likely remained residual confounding by indication, as demonstrated by the nearly protective effect that delay had on mortality among nonneutropenic ICU patients.
Several studies have highlighted specific populations with bacteremia that may be vulnerable to inappropriate antimicrobial therapy. Ibrahim et al. found a relationship between inappropriate antimicrobial therapy and mortality among bacteremic patients in the ICU setting (19). Kumar et al. further identified inappropriate antimicrobial therapy as an important risk factor for death among bacteremic patients with septic shock. In contrast, other studies that included more heterogeneous patient populations have found a lack of association (5, 32). Our study focused on a heterogeneous patient population as well, but our experience suggests that including interaction terms and stratifying specific subgroups of bacteremic patients may reveal important associations between antimicrobial therapy and mortality.
Several publications have highlighted the importance of proper assessment of time-dependent covariates, such as severity of illness (26, 34). At issue is whether a covariate such as septic shock might be considered an intermediate variable in studies of bacteremia treatment and death. In our study, the main exposure of interest was whether a bacteremic patient received active antimicrobial therapy in the first 24 h after index blood culture draw. The main outcome, mortality, was assessed at a time point beyond the initial 24-hour window. Any patient characteristic known to physicians during the initial 24 h could influence choice of antimicrobials (e.g., septic shock developing in the first 24 h may influence physicians to broaden antimicrobial coverage) and would thus represent a potential confounder. We did not measure vasopressor use or other covariates beyond 24 h of the index blood culture, as those measurements clearly would be in the intermediate pathway to death.
Several limitations remain in this study. First, we did not examine primary versus secondary sources of bacteremia. It is possible that certain sources of bacteremia, such as the lung or abdomen, might be more susceptible to delayed antimicrobial therapy. Second, the study was retrospective, with data gathered through an electronic hospital database. Our medication administration data, like that of many retrospective studies of antimicrobial use, was based on the electronic pharmacy dispensing record rather than information at the point of care. Nondifferential misclassification may exist in categorizing patients as delayed versus nondelayed, which may bias results toward the null. Third, mortality was assessed only in the hospital setting; we did not assess for deaths occurring outside the hospital. It is possible that informative censoring could lead to bias in effect estimation. Finally, although we assessed for level of neutropenia at the time of index blood culture, we did not measure duration of neutropenia, which may be an important consideration in identifying patients who are the most immunocompromised and therefore vulnerable to inappropriate antimicrobial therapy.
In summary, our study found that patients with severe neutropenia, particularly in the non-ICU setting, were at increased risk of death when exposed to delay of active antimicrobial therapy. The mortality risk of inappropriate antimicrobial therapy was not significant for patients who were nonneutropenic or moderately neutropenic. In light of the evolution of the types of bloodstream pathogens and of available antimicrobials over the last 10 years, an updated assessment of appropriate empirical antimicrobial therapy focused on neutropenic patients may be warranted.
There are no conflicts of interest to report for any author.
Published ahead of print on 14 July 2008. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2010 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»