Hostname: page-component-745bb68f8f-d8cs5 Total loading time: 0 Render date: 2025-02-06T15:04:05.186Z Has data issue: false hasContentIssue false

Does Antiretroviral Therapy Improve HIV-Associated Cognitive Impairment? A Quantitative Review of the Literature

Published online by Cambridge University Press:  04 August 2011

Timour Al-Khindi
Affiliation:
Department of Psychology, University of Toronto Scarborough, Toronto, Ontario
Konstantine K. Zakzanis*
Affiliation:
Department of Psychology, University of Toronto Scarborough, Toronto, Ontario
Wilfred G. van Gorp
Affiliation:
Department of Psychiatry, Columbia University College of Physicians and Surgeons, New York, New York
*
Correspondence and reprint requests to: Konstantine K. Zakzanis, Department of Psychology, University of Toronto Scarborough, 1265 Military Trail, Toronto, Ontario, M1C 1A4, Canada. E-mail: zakzanis@utsc.utoronto.ca
Rights & Permissions [Opens in a new window]

Abstract

The development of antiretroviral therapy (ART) has dramatically improved survival for those living with human immunodeficiency virus (HIV), but whether ART improves cognitive functioning remains unclear. The aim of the present review was to examine systematically the extent to which ART improves cognition among individuals with HIV using meta-analytic methods. Twenty-three studies were included in the quantitative review. ART was associated with modest improvements in attention (mean d = .17; p < .001; 95% confidence interval [CI], .09/.25), executive function (mean d = .18; p < .001; 95% CI, .10/.26), and motor function (mean d = .24; p < .001; 95% CI, .16/.32). ART did not improve language, verbal memory, visual memory or visuospatial function. The extent to which cognition improved was correlated with the change in CD4 cell count following ART, suggesting a link between cognitive outcome and immune system integrity. Together, the present findings indicate that the neuropsychological test performance of most HIV patients taking ART is comparable to those not taking ART. Development of pharmaceutical treatments and rehabilitation strategies that target the cognitive effects of HIV infection is needed. (JINS, 2011, 17, 956–969)

Type
Critical Review
Copyright
Copyright © The International Neuropsychological Society 2011

Introduction

Acquired immune deficiency syndrome (AIDS) is a progressive disorder of the immune system characterized by selective destruction of CD4 T cells by the human immunodeficiency virus (HIV). The lack of a functional immune system results in greater risk of opportunistic infection (Orenstein, Fox, & Wahl, Reference Orenstein, Fox and Wahl1997). HIV infection is known to have profound effects on both brain and behavior. Neuroimaging studies have observed reduced cortical thickness among patients with HIV, particularly in premotor cortex, primary sensory and motor cortices, and visual cortex (Thompson et al., Reference Thompson, Dutton, Hayashi, Toga, Lopez, Aizenstein and Becker2005). HIV-associated brain changes are not restricted to cortical areas, however. Aylward et al. (Reference Aylward, Henderer, McArthur, Brettschneider, Harris, Barta and Pearlson1993) found that HIV patients show basal ganglia atrophy, whereas Chen et al. (Reference Chen, An, Zhu, Stone, Smith, Hall and Lin2009), using diffusion tensor imaging, found that HIV infection is associated with global reductions in white matter integrity. These brain changes have profound effects on cognition. Up to 52% of individuals with HIV experience some form of cognitive impairment (Heaton et al., Reference Heaton, Clifford, Franklin, Woods, Ake, Vaida and Grant2010; McArthur, Steiner, Sacktor, & Nath, Reference McArthur, Steiner, Sacktor and Nath2010). Commonly affected domains include motor function, executive function, attention, visual memory, and visuospatial function (Reger, Welsh, Razani, Martin, & Boone, Reference Reger, Welsh, Razani, Martin and Boone2002). Given its prevalence, treating cognitive dysfunction has become a central goal for therapies aiming to improve outcome among individuals with HIV.

The development of antiretroviral therapy (ART) was a major landmark in HIV treatment. Antiretroviral medications act by inhibiting HIV proteins such as reverse transcriptase and viral protease (for a detailed review, see Adamson & Freed, Reference Adamson and Freed2008). Early studies observed robust increases in CD4 cell count and life expectancy following ART (Fischl et al., Reference Fischl, Richman, Grieco, Gottlieb, Volberding, Laskin and King1987). The beneficial effects of antiretroviral medications are amplified when several drugs are given in combination. This approach, known as highly active antiretroviral therapy (HAART), reduces disease progression and mortality substantially more than monotherapy (Hammer et al., Reference Hammer, Squires, Hughes, Grimes, Demeter, Currier and Fischl1997). The efficacy of ART in reducing HIV-related cognitive impairment, however, remains unclear. Most studies have observed beneficial effects of ART on cognitive functioning (Baldeweg et al., Reference *Baldeweg, Catalan, Lovett, Gruzelier, Riccio and Hawkins1995; Cohen et al., Reference *Cohen, Boland, Paul, Tashima, Schoenbaum, Celentano and Carpenter2001; Robertson et al., Reference *Robertson, Robertson, Ford, Watson, Fiscus, Harp and Hall2004; Suarez et al., Reference Suarez, Baril, Stankoff, Khellaf, Dubois, Lubetzki and Hauw2001), but some have documented no effect (Tozzi et al., Reference *Tozzi, Balestra, Bellagamba, Corpolongo, Salvatori, Visco-Comandini and Narciso2007). The benefits of ART must also be weighed against the costs. A growing body of literature suggests that ART has numerous toxic side-effects, including mitochondrial toxicity, liver dysfunction, cardiovascular dysfunction, and, most pertinent to cognition, central nervous system hyperstimulation (Carr, Reference Carr2003; Marzolini et al., Reference Marzolini, Telenti, Decosterd, Greub, Biollaz and Buclin2001).

The question of whether ART improves HIV-related cognitive impairment has been explored in several narrative reviews (Cysique & Brew, Reference Cysique and Brew2009; Joska, Gouse, Paul, Stein, & Flisher, Reference Joska, Gouse, Paul, Stein and Flisher2010; Liner, Hall, & Robertson, Reference Liner, Hall and Robertson2008; Liner, Ro, & Robertson, Reference Liner, Ro and Robertson2010). These narrative reviews do not, however, reveal the magnitude of efficacy across studies. Moreover, traditional narrative reviews typically champion only statistically significant findings using vote count strategies as evidence of efficacy. By doing so, conclusions drawn using this method of research synthesis fail to give due consideration to the magnitude of effect beyond its statistical significance. Hence, the present quantitative review used meta-analytic methods so as to examine the efficacy of ART in reducing HIV-related cognitive dysfunction. Given that deficits in motor function, executive function, attention, visual memory, and visuospatial function are particularly pronounced among individuals with HIV (Reger et al., Reference Reger, Welsh, Razani, Martin and Boone2002), ART is hypothesized to have the most beneficial effects in these cognitive domains. Analyses were guided by three questions: (1) To what extent does ART reduce HIV-associated cognitive dysfunction? (2) Does HAART reduce HIV-associated cognitive dysfunction more than monotherapy? (3) To what extent do changes in immunological markers of HIV infection, such as CD4 cell count, predict changes in cognitive functioning?

Methods

Meta-analysis

We used standard meta-analytic techniques to perform our review of the literature (Cooper & Hedges, Reference Cooper and Hedges1994; Hedges & Olken, Reference Hedges and Olkin1985; Rosenthal, Reference Rosenthal1991, Reference Rosenthal1995). In addition to solving problems with traditional narrative reviews, meta-analysis provides tools for the analysis of magnitude. Magnitude can be indexed with the effect size estimate d that is meant to reflect the degree to which the dependent variable is present in the sample group or the degree to which the null hypothesis is false (Cohen, Reference Cohen1988). In mathematical terms, d is the difference between two group means calibrated in pooled standard deviation units. Individual study results (typically means and standard deviations from each group) and relevant moderator variables can be abstracted, quantified, and assembled into a database that is statistically analyzed (Lipsey & Wilson, Reference Lipsey and Wilson1993). The main statistic presented in a meta-analysis is the mean effect size, which reflects the average individual effect across the sample of studies included in the synthesis. Moderator variables are then correlated with the effect size to tease out relationships that may influence the magnitude of the effect.

Heterogeneity of effect sizes across studies was examined using the Q statistic and T, an estimate of the standard deviation of effect size across studies. The effect sizes were also transformed into a non-overlap percentage using Cohen's (1988) idealized distributions, which can be further transformed into an overlap percentage (OL%) to articulate the meaningfulness of an effect size (Zakzanis, Reference Zakzanis1998, Reference Zakzanis2001). The OL% statistic represents the degree of overlap by subtracting the non-overlap from 100. In the present context, the OL% statistic represents the degree of overlap between participants in the treatment group (i.e., individuals with HIV receiving ART) and participants in the control group (i.e., individuals with HIV patients not receiving ART).

To assess publication bias, funnel plot analyses were conducted. In this technique, asymmetry in the funnel plot signifies publication bias (Borenstein, Hedges, Higgins, & Rothstein, Reference Borenstein, Hedges, Higgins and Rothstein2009). The trim and fill method described by Duval and Tweedie (Reference Duval and Tweedie2000a, Reference Duval and Tweedie2000b) was used to correct for any publication bias detected by funnel plot analyses. To ascertain how robust our findings were, Orwin's (Reference Orwin1983) fail-safe N formula was used to provide an index of how many studies would be theoretically needed to overturn the obtained effect size and yield a non-significant effect (i.e., d = 0.1).

Finally, it should be noted that statistical analysis of meta-analytic studies is not entirely uncontroversial (see Hunter & Schmidt, Reference Hunter and Schmidt1990). Since studies with large sample sizes have more statistical power than studies with smaller sample sizes, computations of mean effect size must be weighted accordingly. In the present meta-analysis, the weight given to the effect size of an individual study was inversely proportional to the variance of each study and directly proportional to the sample size of each study. This method has previously been validated by Hedges and Olkin (Reference Hedges and Olkin1985).

Literature Search

The literature review was restricted to peer-reviewed research articles and dissertations on the effects of ART on cognitive functioning in individuals with HIV or AIDS. Studies were identified using PubMed, PsycINFO, and Medline with the following search terms: (“human immunodeficiency virus” OR “HIV” OR “acquired immune deficiency syndrome” OR “AIDS”) AND (“antiretrov*” OR “ART” OR “HAART”) AND (“neuropsychol*” OR “cognit*” OR “neurocog*). A secondary search involved checking the reference sections of relevant review papers for articles that may have been missed in the computerized search. Only articles in English were reviewed. Case studies were excluded.

Inclusion and Exclusion Criteria

Studies were included if they met the following criteria: studies that compare cognitive functioning between HIV-positive patients receiving ART and those not receiving ART; studies that compare cognitive functioning before and after the initiation of ART; studies that use at least one commercially available neuropsychological test to evaluate cognitive functioning; study statistics must be convertible to effect size (e.g., means, standard deviations, F, t). Exclusion criteria were as follows: studies using HIV-positive patients who are comorbid with major neurological or psychiatric conditions (e.g., schizophrenia, Parkinson's disease); studies that measure cognitive functioning using self-report or experimental cognitive tasks.

Recorded Variables

Recorded variables included the full study reference and any moderator variables reported (e.g., age, duration of illness, and so on). Effect sizes were calculated for each neuropsychological test that measured some aspect of cognitive functioning. Organizing the myriad of cognitive test variables reported in the literature into a coherent classification was a major challenge. Several strategies exist in the literature for organizing diverse tests into categories of cognitive function, and each of these strategies has advantages and disadvantages. To this end, there exist a priori approaches such as Lezak, Howieson, and Loring's (Reference Lezak, Howieson and Loring2004) classification, which are influenced by theoretical and practice-related considerations about the test measures and their putative underlying processes. For example, Lezak et al. (Reference Lezak, Howieson and Loring2004) include motor and executive ability tasks in the same chapter, presumably on the basis of a common substrate in the frontal brain or some other assumed link. Such classifications have no quantitative statistical underpinning, and even advocates of this approach admit to an element of arbitrariness in test organization (see Lezak et al., Reference Lezak, Howieson and Loring2004). A second approach is based on factor analytic studies of neuropsychological test batteries (see Goldstein, Reference Goldstein1984). Factor analysis provides a quantitative description that relates different tests to a smaller number of underlying abilities. The validity of this approach as a general strategy for organizing tests in a meta-analysis, however, depends in part on the availability of factor analyses that include all of the tests in the literature on cognitive function in the treatment of HIV/AIDS. In the present case, we were unable to find factor analytic studies of ART in HIV/AIDS patient samples that included all, or even most, of the cognitive test variables reported in the literature. Finally, it is possible to avoid constructs altogether and simply compile effects for individual tests. This approach incorporates the fewest assumptions about the data, although it is unwieldy in view of the dozens of tests in common use and the inconsistency with which different scores from the same test are reported in the literature (e.g., categories vs. perseverative errors on the Wisconsin Card Sorting Test; see Heaton, Chelune, Talley, Kay, & Curtiss, Reference Heaton, Chelune, Talley, Kay and Curtiss1993).

A further consideration is that regardless of classification method, several component processes probably influence many cognitive tests. Thus, scores on the Vocabulary subtest of the Wechsler Adult Intelligence Test (WAIS), for example, may reflect both language abilities and general intelligence while scores on the Trail Making Test may reflect visual scanning and perception but also motor speed, hand eye coordination, and attention (Lezak et al., Reference Lezak, Howieson and Loring2004). Hence, it may be misleading to categorize tests on the basis of a faulty assumption that test performance is determined by only one process. Accordingly, we tried to avoid aggregating different tests and their effect sizes into our own hypothetical categories and adopted those defined by Lezak et al. (Reference Lezak, Howieson and Loring2004), and Strauss, Sherman, and Spreen (Reference Strauss, Sherman and Spreen2006) as follows: attention, executive function, language, motor function, visuospatial function, immediate verbal memory, delayed verbal memory, immediate visual memory, and delayed visual memory. Table A1 (see Appendix) illustrates the specific neuropsychological tests that were aggregated into each generated category. Finally, to meet the assumption of independence, when multiple test variables in a study contributed to any one neuropsychological domain, the effect sizes were pooled together into a mean effect size (Borenstein et al., Reference Borenstein, Hedges, Higgins and Rothstein2009). For each neuropsychological domain, these mean effect sizes were aggregated and analyzed further.

The following moderator variables were extracted from each study: age, education, HIV status (asymptomatic HIV, symptomatic HIV, or AIDS), length of time since HIV diagnosis, duration of ART treatment, type of ART (monotherapy vs. HAART), magnitude of change in CD4 cell count (measured by Cohen's d), magnitude of change in plasma viral RNA concentration (measured by Cohen's d), and year of publication.

Statistical Analyses

The Student's t test was used to compare the efficacy of HAART and monotherapy. Bonferroni correction was used to correct for multiple comparisons. For the moderator variable analyses, the relationship between individual effect sizes and moderator variables was initially explored using Pearson correlations. Significant univariate predictors of effect size were subsequently entered into a multiple linear regression model weighted by sample size. Significance was defined as p < .05. Analyses were performed using Comprehensive Meta Analysis 2.0 (Englewood, NJ) and SPSS 17.0 (Chicago, IL).

Results

Study Characteristics

The literature search yielded 1014 articles. Of these, 23 articles met inclusion criteria. In total, cognitive functioning was assessed in 1598 HIV patients taking ART and in 996 HIV patients not taking ART. Mean age and education of HIV patients was 37.8 years (SD = 4.0 years) and 13.6 years (SD = 4.9 years), respectively. Mean duration of ART was 16.7 months (SD = 15.7 months). Five studies examined the effects of monotherapy on cognitive outcome, 16 studies examined the effects of HAART on cognitive outcome, and 2 studies did not specify the type of ART regimen used. Nine studies used a between-subjects design, 11 studies used a within-subjects design, and 3 studies used a mixed design. Eight studies used patients who were naive to ART, 11 studies used patients who had prior exposure to ART, and 4 did not state whether their patients were treatment naïve. Only 1 study used a blind design. Three studies reported the mean time since AIDS diagnosis, whereas only three studies stratified their results according to stage of HIV illness (i.e., asymptomatic HIV, symptomatic HIV, or AIDS).

Mean Effect Sizes

Table 1 displays the mean effect sizes stratified by cognitive domain. Tables A2 and A3 (see Appendix) display the mean effect sizes stratified by neuropsychological test and study, respectively. The number of effect sizes in several domains exceeds the number of studies because some studies contributed more than one effect size (e.g., a study may have examined the effects of ART in several independent patient samples). The data indicate that, following ART, improvements in cognitive functioning were only observed in attention (mean d = .17; p < .001; 95% CI, .09/.25), executive function (mean d = .18; p < .001, 95% CI, .10/.26), motor function (mean d = .24; p < .001; 95% CI, .16/.32), and delayed verbal memory (mean d = .11; p = .04; 95% CI, .00/.21). Improvements in these domains were modest at best; examination of overlap percentages reveals that, with respect to attention, executive function, motor function, and delayed verbal memory, 85% to 92% of HIV patients taking ART performed at levels comparable to HIV patients not taking ART.

Table 1 Effect size results stratified by cognitive domain

Note. N = number of studies; SD = standard deviation; CI = confidence interval; OL% = overlap percentage.

Examination of the Q statistic and T values (Table 1) indicates significant variation of effect size estimates for attention, executive function, motor function, and delayed verbal memory across studies. Funnel plot analyses for attention, executive function, motor function, and delayed verbal memory revealed asymmetry toward positive effect sizes, suggesting moderate publication bias (Figure 1). The high fail-safe N values for attention, executive function, and motor function (values ranging from 17 to 29; see Table 2), however, indicate that the improvements in these domains are robust and are unlikely to be artifacts of publication bias. Nevertheless, when effect sizes were corrected for publication bias using Duval and Tweedie's (2000a, 2000b) trim and fill method (Table 2), estimates of effect size for attention, executive function, and motor function were reduced from .17, .18, and .24 to .07, .12, and .15, respectively. Unlike attention, executive function, and motor function, the slight improvement in delayed verbal memory may be an artifact of publication bias, for it was driven by a small number of studies showing large effect sizes rather than a moderate number of studies showing moderate effect sizes. Indeed, examination of fail-safe N reveals that only one published study is needed to overturn the observed improvement in delayed verbal memory. The enhancement in delayed verbal memory performance must thus be interpreted with caution.

Fig. 1 Funnel plots for the domains of (a) attention, (b) executive function, (c) language, (d) motor function, (e) visuospatial function, (f) immediate verbal memory, (g) delayed verbal memory, (h) immediate visual memory, and (i) delayed visual memory. Asymmetry in the funnel plot indicates publication bias. Moderate publication bias favoring positive effect sizes was present in all cognitive domains except language, immediate verbal memory, and immediate visual memory.

Table 2 Analysis of publication bias

Note. CI = confidence interval; N fs = fail-safe N; OL% = overlap percentage.

ART had no observable benefits for other domains such as immediate verbal memory, delayed visual memory, language, or visuospatial function. Patients taking ART showed slightly poorer performance on immediate visual memory tasks compared with patients not taking ART. This finding, however, must be interpreted with caution, for it is only based on three studies. The low fail-safe N value further suggests that the result is not robust and may be an artifact of publication bias.

Influence of Moderator Variables

Although the mean effect size was greater for HAART than for monotherapy in all domains, no significant differences were observed after correcting for multiple comparisons (Figure 2). None of the studies using monotherapy examined visual memory, so comparing HAART and monotherapy in this domain was not possible.

Fig. 2 Comparing the efficacy of highly active antiretroviral therapy (HAART) and monotherapy in different cognitive domains. After correcting for multiple comparisons, there were no statistical differences in effect size between monotherapy and HAART for any cognitive domain. Qualitatively, however, HAART showed a greater mean effect size than monotherapy across all cognitive domains. Values are mean ± SEM.

Table 3 displays univariate correlations between effect sizes in particular cognitive domains and moderator variables. Across cognitive domains, the degree of improvement in cognitive functioning strongly correlated with changes in CD4 cell count. In particular, greater improvements in attention, executive function, motor function, and visuospatial function were strongly associated with greater increases in CD4 cell count. Improvements in attention, executive function, visuospatial function, immediate verbal memory, and delayed verbal memory were negatively correlated with participant age. No correlations were observed between changes in cognitive performance and changes in viral load, as measured by plasma HIV RNA concentration, duration of ART, education, or year of publication. The negative correlation between delayed visual memory and year of publication can be attributed to a single study that reported an unusually large effect size rather than to several studies that reported moderate effect sizes; as a result, this correlation must be interpreted with caution.

Table 3 Univariate Predictors of Improved Cognitive Functioning After ART

Note. *p < .05; **p < .01. N/A = not applicable (sample size was too small to conduct meaningful analysis).

Age and change in CD4 cell count were subsequently entered as predictor variables into a multiple linear regression model weighted by sample size. Effect size for attention, executive function, motor function, visuospatial function, immediate verbal memory, and delayed verbal memory were the dependent variables. Table 4 presents the results from the multiple regression analyses. The regression models were significant for attention, visuospatial function, and delayed verbal memory (ps < .05), but not executive function (p = .20), motor function (p = .11), and immediate verbal memory (p = .32). Greater change in CD4 cell count was a marginal predictor of improved attention (β = .36; p = .13), motor function (β = .42; p = .11), and visuospatial function (β = .63; p = .05). Older age was a significant predictor of smaller improvements in attention (β = −.55; p = .03) and delayed verbal memory (β = −.63; p = .02) and a marginal predictor of improved visuospatial function (β = −.52; p = .08). Together, age and change in CD4 cell count explained a substantial proportion of the variance in attention, visuospatial function, and delayed verbal memory, with adjusted R 2 ranging from .34 to .71.

Table 4 Multivariate analysis of moderator variables associated with improved cognitive functioning after ART

Note. N/A = not applicable (variable was not entered in regression analysis).

Discussion

The present findings indicate that the efficacy of ART in alleviating HIV-associated cognitive dysfunction is modest. Results from our quantitative review indicate that 85% to 92% of HIV patients taking ART performed at levels comparable to HIV patients not taking ART. The modest benefits of ART may explain why the prevalence of HIV-associated cognitive impairment has remained high despite the advent of HAART (Robertson et al., Reference Robertson, Smurzynski, Parsons, Wu, Bosch, Wu and Ellis2007; Sacktor, Reference Sacktor2002). Individual patients may exhibit dramatic improvement in cognitive functioning after taking ART, but the present data suggest that these patients are the exception rather than the rule.

Additionally, the benefits of ART are restricted to particular cognitive domains. Robust improvements were observed only in attention, motor function, and executive function. Enhanced performance in these domains was expected; a meta-analysis by Reger and colleagues (2002) found that attention, motor function, and executive function were particularly compromised among individuals with HIV. The observed improvement in motor function is consistent with recent data from the national CHARTER study showing a reduction in the prevalence of motor impairments since the advent of HAART (Heaton et al., Reference Heaton, Franklin, Ellis, McCutchan, Letendre, Leblanc and Grant2011). Of interest, patients taking ART showed poorer immediate visual memory than patients not taking ART, suggesting that ART may have detrimental effects on certain aspects of cognition. This finding is consistent with prior studies showing persistent inflammation in the hippocampus, a brain region involved in memory (Squire, Stark, & Clark, Reference Squire, Stark and Clark2004), among HIV patients taking HAART (Anthony, Ramage, Carnie, Simmonds, & Bell, Reference Anthony, Ramage, Carnie, Simmonds and Bell2005). Mechanistically, ART may exert its detrimental effects by facilitating central nervous system hyperstimulation (Marzolini et al., Reference Marzolini, Telenti, Decosterd, Greub, Biollaz and Buclin2001). The finding that HIV patients show poorer immediate visual memory after ART, however, must be interpreted with caution. The result was only based on three studies and the low fail-safe N value suggests that the finding is not robust and may be an artifact of publication bias.

There were no observed benefits of ART on delayed visual memory or visuospatial function, two other domains commonly impaired in HIV patients (Reger et al., Reference Reger, Welsh, Razani, Martin and Boone2002). Despite the importance of these two domains, only four and seven studies examined the effects of ART on delayed visual memory and visuospatial function, respectively. The paucity of research on visual memory and visuospatial function after ART is surprising given that atrophy of the visual cortex is commonly observed among patients with HIV (Thompson et al., Reference Thompson, Dutton, Hayashi, Toga, Lopez, Aizenstein and Becker2005). Additional studies are needed to further explore the integrity of visual memory and visuospatial function after ART.

Despite no statistical differences in effect size between studies using HAART and those using monotherapy, a qualitative examination of the data indicates that, across cognitive domains, the mean effect size for HAART is greater than the mean effect size for monotherapy (Figure 2). The failure to find statistical differences between monotherapy and HAART may be attributed to the small number of studies using monotherapy. The superior benefits of HAART may be partially attributed to its ability to normalize CD4 cell count (Hammer et al., Reference Hammer, Squires, Hughes, Grimes, Demeter, Currier and Fischl1997; Mocroft et al., Reference Mocroft, Phillips, Gatell, Ledergerber, Fisher, Clumeck and Lundgren2007). Indeed, univariate and multivariate analyses revealed that, in the case of attention, executive function, motor function, and visuospatial function, the extent to which ART improved cognitive outcome was correlated with its ability to enhance CD4 cell count. The integrity of the immune system thus appears to be linked to cognitive outcome among individuals with HIV. This finding supplements recent data from the national CHARTER study in which nadir CD4 cell count was found to correlate with neurocognitive functioning (Heaton et al., Reference Heaton, Franklin, Ellis, McCutchan, Letendre, Leblanc and Grant2011). Since only 3 of the 23 included studies reported nadir CD4 cell count, the predictive strength of this variable could not be assessed in the current meta-analysis.

The observed relationship between CD4 cell count and cognitive functioning stands in stark contrast to several studies observing no correlation between CD4 cell count and neuropsychological test performance (Ferrando et al., Reference *Ferrando, van Gorp, McElhiney, Goggin, Sewell and Rabkin1998; Sun et al., Reference Sun, Abadjian, Rempel, Calosing, Rothlind and Pulliam2010). By virtue of their small sample size, these individual studies may have had insufficient statistical power to detect correlations between CD4 cell count and cognitive functioning. By contrast, meta-analytic techniques, by synthesizing data across multiple studies, may possess sufficient power to detect such correlations (Borenstein et al., Reference Borenstein, Hedges, Higgins and Rothstein2009).

As well as CD4 cell count, patient characteristics also mediate the ability of ART to improve cognitive functioning. Older patients showed smaller improvements in attention, visuospatial function, immediate verbal memory, and delayed verbal memory after taking ART. Why older individuals experienced smaller improvements in cognitive functioning after ART is unknown. Older individuals may have been infected with HIV for a longer time period. As a result, brain injury in older patients may have progressed to a stage where ART could no longer improve cognitive functioning. Prior studies suggest that time since AIDS diagnosis and stage of HIV illness are important determinants of the extent of cognitive impairment (Cysique & Brew, Reference Cysique and Brew2009; Heaton et al., Reference Heaton, Franklin, Ellis, McCutchan, Letendre, Leblanc and Grant2011; Reger et al., Reference Reger, Welsh, Razani, Martin and Boone2002). Unfortunately, only 3 studies reported the time since AIDS diagnosis and the stage of HIV illness, so analyzing the contributions of these variables was not possible. Future studies should investigate how the efficacy of ART changes depending on the duration and stage of HIV illness.

The development of antiretroviral medications has transformed HIV infection from an inevitably fatal disease into a treatable condition. Despite the positive effects of ART on survival and immunological functioning (Fischl et al., Reference Fischl, Richman, Grieco, Gottlieb, Volberding, Laskin and King1987), the present results indicate that ART has only modest benefits in reducing HIV-associated cognitive impairment. Our findings may, therefore, be of interest to the practicing clinical neuropsychologist when interpreting change scores in the context of serial neuropsychological examinations of patients with HIV/AIDS before and after ART. Development of novel pharmaceutical treatments and rehabilitation strategies is needed to address the pressing issue of HIV-associated cognitive dysfunction.

Acknowledgments

No financial support was provided for the present research. The authors note that they have no financial or other relationships that could be interpreted as a conflict of interest affecting this manuscript.

Appendix

Table A1 Neuropsychological tests categorized by cognitive domain

Notes. N = number of studies that included the test; WAIS-R = Wechsler Adult Intelligence Scale – Revised.

Note. N = number of studies that included the test; WAIS-R = Wechsler Adult Intelligence Scale – Revised; WMS-R = Wechsler Memory Scale – Revised.

Note. N = number of studies that included the test; WMS-R = Wechsler Memory Scale – Revised.

Table A2 Effect size results stratified by test measure

Note. SD = standard deviation; OL% = overlap percentage; WAIS-R = Wechsler Adult Intelligence Scale – Revised; WMS-R = Wechsler Memory Scale – Revised.

Table A3 Effect size results stratified by study

Note. SD = standard deviation; OL% = overlap percentage.

References

References preceded by an asterisk were included in the meta-analysis.Google Scholar
Adamson, C.S., Freed, E.O. (2008). Recent progress in antiretrovirals – Lessons from resistance. Drug Discovery Today, 13, 424432.CrossRefGoogle ScholarPubMed
Anthony, I.C., Ramage, S.N., Carnie, F.W., Simmonds, P., Bell, J.E. (2005). Influence of HAART on HIV-related CNS disease and neuroinflammation. Journal of Neuropathology and Experimental Neurology, 64, 529536.CrossRefGoogle ScholarPubMed
Aylward, E.H., Henderer, J.D., McArthur, J.C., Brettschneider, P.D., Harris, G.J., Barta, P.E., Pearlson, G.D. (1993). Reduced basal ganglia volume in HIV-1-associated dementia: Results from quantitative neuroimaging. Neurology, 43, 20992104.CrossRefGoogle ScholarPubMed
*Baldeweg, T., Catalan, J., Lovett, E., Gruzelier, J., Riccio, M., Hawkins, D. (1995). Long-term zidovudine reduces neurocognitive deficits in HIV-1 infection. AIDS, 9, 589596.CrossRefGoogle ScholarPubMed
Borenstein, M., Hedges, L.V., Higgins, J.P.T., Rothstein, H.R. (2009). Introduction to meta-analysis. West Sussex, UK: John Wiley & Sons, Ltd.CrossRefGoogle Scholar
*Brouwers, P., Hendricks, M., Lietzau, J.A., Pluda, J.M., Mitsuya, H., Broder, S., Yarchoan, R. (1997). Effect of combination therapy with zidovudine and didanosine on neuropsychological functioning in patients with symptomatic HIV disease: A comparison of simultaneous and alternating regimens. AIDS, 11, 5966.CrossRefGoogle ScholarPubMed
Carr, A. (2003). Toxicity of antiretroviral therapy and implications for drug development. Nature Reviews Drug Discovery, 2, 624634.CrossRefGoogle ScholarPubMed
*Carvalhal, A.S., Rourke, S.B., Belmonte-Abreu, P., Correa, J., Goldani, L.Z. (2006). Evaluation of neuropsychological performance of HIV-infected patients with minor motor cognitive dysfunction treated with highly active antiretroviral therapy. Infection, 24, 357360.CrossRefGoogle Scholar
*Chang, L., Ernst, T., Witt, M.D., Ames, N., Walot, I., Jovicich, J., Miller, E.N. (2003). Persistent brain abnormalities in antiretroviral-naïve HIV patients 3 months after HAART. Antiviral Therapy, 8, 1726.CrossRefGoogle ScholarPubMed
Chen, Y., An, H., Zhu, H., Stone, T., Smith, J.K., Hall, C., Lin, W. (2009). White matter abnormalities revealed by diffusion tensor imaging in non-demented and demented HIV+ patients. Neuroimage, 47, 11541162.CrossRefGoogle ScholarPubMed
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
*Cohen, R.A., Boland, R., Paul, R., Tashima, K.T., Schoenbaum, E.E., Celentano, D.D., Carpenter, C.C. (2001). Neurocognitive performance enhanced by highly active antiretroviral therapy in HIV-infected women. AIDS, 15, 341345.Google ScholarPubMed
Cooper, H., Hedges, L.V. (1994). The handbook of research synthesis. New York: Russell Sage Foundation.Google Scholar
Cysique, L.A., Brew, B.J. (2009). Neuropsychological functioning and antiretroviral treatment in HIV/AIDS: A review. Neuropsychology Review, 19, 169185.CrossRefGoogle ScholarPubMed
Duval, S., Tweedie, R. (2000a). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 8998.Google Scholar
Duval, S., Tweedie, R. (2000b). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta analysis. Biometrics, 56, 455463.CrossRefGoogle ScholarPubMed
*Ferrando, S., van Gorp, W., McElhiney, M., Goggin, K., Sewell, M., Rabkin, J. (1998). Highly active antiretroviral treatment in HIV infection: Benefits for neuropsychological function. AIDS, 12, F65F70.CrossRefGoogle ScholarPubMed
Fischl, M.A., Richman, D.D., Grieco, M.H., Gottlieb, M.S., Volberding, P.A., Laskin, O.L., King, D. (1987). The efficacy of azidothymidine (AZT) in the treatment of patients with AIDS and AIDS-related complex. New England Journal of Medicine, 317, 185191.CrossRefGoogle ScholarPubMed
Goldstein, G. (1984). Comprehensive neuropsychological assessment batteries. In G. Goldstein & M. Herson (Eds.), Handbook of psychological assessment (pp. 181210). New York, NY: Pergamon Press.Google Scholar
Hammer, S.M., Squires, K.E., Hughes, M.D., Grimes, J.M., Demeter, L.M., Currier, J.S., Fischl, M.A. (1997). A controlled trial of two nucleoside analogues plus indinavir in persons with human immunodeficiency virus infection and CD4 cell counts of 200 per cubic millimeter or less. AIDS clinical trials group 320 study team. New England Journal of Medicine, 337, 725733.CrossRefGoogle ScholarPubMed
*Hayman-Abello, S.E. (2006). The effects of highly active antiretroviral therapy (HAART) on neuropsychological status in HIV-infection: A prospective study. Dissertation Abstracts International: Section B: The Sciences and Engineering, 67, 4106.Google Scholar
Heaton, R.K., Chelune, G.J., Talley, J., Kay, G.G., Curtiss, G. (1993). Wisconsin Card Sorting Test manual-revised and expanded. Odessa, FL: Psychological Assessment Resources.Google Scholar
Heaton, R.K., Clifford, D.B., Franklin, D.R. Jr., Woods, S.P., Ake, C., Vaida, F., Grant, I. (2010). HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER Study. Neurology, 75, 20872096.CrossRefGoogle ScholarPubMed
Heaton, R.K., Franklin, D.R., Ellis, R.J., McCutchan, J.A., Letendre, S.L., Leblanc, S., Grant, I. (2011). HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: Differences in rates, nature, and predictors. Journal of Neurovirology, 17, 316.CrossRefGoogle ScholarPubMed
Hedges, L.V., Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.Google Scholar
Hunter, J.E., Schmidt, F.L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage Publications.Google Scholar
Joska, J.A., Gouse, H., Paul, R.H., Stein, D.J., Flisher, A.J. (2010). Does highly active antiretroviral therapy improve neurocognitive function? A systematic review. Journal of Neurovirology, 16, 101114.CrossRefGoogle ScholarPubMed
Lezak, M.D., Howieson, D.B., Loring, D.W. (2004). Neuropsychological assessment (4th ed.). New York, NY: Oxford University Press.Google Scholar
*Lindsey, J.C., Malee, K.M., Brouwers, P., Hughes, M.D. (2007). Neurodevelopmental functioning in HIV-infected infants and young children before and after the introduction of protease inhibitor-based highly active antiretroviral therapy. Pediatrics, 119, e681e693.CrossRefGoogle ScholarPubMed
Liner, K.J. Jr., Hall, C.D., Robertson, K.R. (2008). Effects of antiretroviral therapy on cognitive impairment. Current HIV/AIDS Reports, 5, 6471.CrossRefGoogle Scholar
Liner, K.J. Jr., Ro, M.J., Robertson, K.R. (2010). HIV, antiretroviral therapies, and the brain. Current HIV/AIDS Reports, 7, 8591.CrossRefGoogle ScholarPubMed
Lipsey, M.W., Wilson, D.B. (1993). The efficacy of psychological, educational, and behavioral treatment. American Psychologist, 12, 11811209.CrossRefGoogle Scholar
*Llorente, A.M., van Gorp, W.G., Stern, M.J., George, L., Satz, P., Marcotte, T.D., Hinkin, C.H. (2001). Long-term effects of high-dose zidovudine on neuropsychological performance in mildly symptomatic HIV-positive patients: Results of a randomized, double-blind, placebo-controlled investigation. Journal of the International Neuropsychological Society, 7, 2732.CrossRefGoogle ScholarPubMed
*Martin, E.M., Pitrak, D.L., Novak, R.M., Pursell, K.J., Mullane, K.M. (1999). Reaction times are faster in HIV-seropositive patients on antiretroviral therapy: A preliminary report. Journal of Clinical and Experimental Neuropsychology, 21, 730735.CrossRefGoogle ScholarPubMed
Marzolini, C., Telenti, A., Decosterd, L.A., Greub, G., Biollaz, J., Buclin, T. (2001). Efavirenz plasma levels can predict treatment failure and central nervous system side effects in HIV-1-infected patients. AIDS, 15, 7175.CrossRefGoogle ScholarPubMed
McArthur, J.C., Steiner, J., Sacktor, N., Nath, A. (2010). Human immunodeficiency virus-associated neurocognitive disorders: Mind the gap. Annals of Neurology, 67, 699714.CrossRefGoogle ScholarPubMed
*Millikin, C.P., Trépanier, L.L., Rourke, S.B. (2005). Verbal fluency component analysis in adults with HIV/AIDS. Journal of Clinical and Experimental Neuropsychology, 26, 933942.CrossRefGoogle Scholar
Mocroft, A., Phillips, A.N., Gatell, J., Ledergerber, B., Fisher, M., Clumeck, N., Lundgren, J.D. (2007). Normalization of CD4 counts in patients with HIV-1 infection and maximum virological suppression who are taking combination antiretroviral therapy: An observational cohort study. Lancet, 370, 407413.CrossRefGoogle ScholarPubMed
Orenstein, J.M., Fox, C., Wahl, S.M. (1997). Macrophages as a source of HIV during opportunistic infections. Science, 276, 18571861.CrossRefGoogle ScholarPubMed
Orwin, R.G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8, 157159.Google Scholar
Reger, M., Welsh, R., Razani, J., Martin, D.J., Boone, K.B. (2002). A meta-analysis of the neuropsychological sequelae of HIV infection. Journal of the International Neuropsychological Society, 8, 410424.CrossRefGoogle ScholarPubMed
*Richardson, J.L., Martin, E.M., Jiminez, N., Danley, K., Cohen, M., Carson, V.L., Levine, A.M. (2002). Neuropsychological functioning in a cohort of HIV infected women: Importance of antiretroviral therapy. Journal of the International Neuropsychological Society, 8, 781793.CrossRefGoogle Scholar
*Robertson, K.R., Robertson, W.T., Ford, S., Watson, D., Fiscus, S., Harp, A.G., Hall, C.D. (2004). Highly active antiretroviral therapy improves neurocognitive functioning. Journal of Acquired Immune Deficiency Syndromes, 36, 562566.CrossRefGoogle ScholarPubMed
Robertson, K.R., Smurzynski, M., Parsons, T.D., Wu, K., Bosch, R.J., Wu, J., Ellis, R.J. (2007). The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS, 21, 19151921.CrossRefGoogle ScholarPubMed
Rosenthal, R. (1991). Meta-analytic procedures for social research. Beverly Hills, CA: Sage Publications.CrossRefGoogle Scholar
Rosenthal, R. (1995). Writing meta-analytic reviews. Psychological Bulletin, 118, 183192.CrossRefGoogle Scholar
Sacktor, N. (2002). The epidemiology of human immunodeficiency virus-associated neurological disease in the era of highly active antiretroviral therapy. Journal of Neurovirology, 8, 115121.CrossRefGoogle ScholarPubMed
*Sacktor, N.C., Lyles, R.H., Skolasky, R.L., Anderson, D.E., McArthur, J.C., McFarlane, G., Miller, E.N. (1999). Combination antiretroviral therapy improves psychomotor speed performance in HIV-seropositive homosexual men. Multicenter AIDS cohort study (MACS). Neurology, 52, 16401647.Google ScholarPubMed
*Sacktor, N., McDermott, M.P., Marder, K., Schitto, G., Selnes, O.A., McArthur, J.C., Epstein, L. (2002). HIV-associated cognitive impairment before and after the advent of combination therapy. Journal of Neurovirology, 8, 136142.CrossRefGoogle ScholarPubMed
*Sacktor, N., Nakasujja, N., Skolasky, R., Robertson, K., Wong, M., Musisi, S., Clifford, D.B. (2009). Benefits and risks of stavudine therapy for HIV-associated neurologic complications in Uganda. Neurology, 72, 165170.CrossRefGoogle ScholarPubMed
*Sacktor, N., Nakasujja, N., Skolasky, R., Robertson, K., Wong, M., Musisi, S., Katabira, E. (2006). Antiretroviral therapy improves cognitive impairment in HIV+ individuals in sub-Saharan Africa. Neurology, 67, 311314.CrossRefGoogle ScholarPubMed
Squire, L.R., Stark, C.E., Clark, R.E. (2004). The medial temporal lobe. Annual Review of Neuroscience, 27, 279306.CrossRefGoogle ScholarPubMed
Strauss, E., Sherman, E.M.S., Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms and commentary (3rd ed.). New York, NY: Oxford University Press.Google Scholar
Suarez, S., Baril, L., Stankoff, B., Khellaf, M., Dubois, B., Lubetzki, C., Hauw, J. (2001). Outcome of patients with HIV-1-related cognitive impairment on highly active antiretroviral therapy. AIDS, 15, 195200.CrossRefGoogle ScholarPubMed
Sun, B., Abadjian, L., Rempel, H., Calosing, C., Rothlind, J., Pulliam, L. (2010). Peripheral biomarkers do not correlate with cognitive impairment in highly active antiretroviral therapy-treated subjects with human immunodeficiency virus type 1 infection. Journal of Neurovirology, 16, 115124.CrossRefGoogle Scholar
Thompson, P.M., Dutton, R.A., Hayashi, K.M., Toga, A.W., Lopez, O.L., Aizenstein, H.J., Becker, J.T. (2005). Thinning of the cerebral cortex visualized in HIV/AIDS reflects CD4+ T lymphocyte decline. Proceedings of the National Academy of Sciences of the United States of America, 102, 1564715652.CrossRefGoogle ScholarPubMed
*Tozzi, V., Balestra, P., Bellagamba, R., Corpolongo, A., Salvatori, M.F., Visco-Comandini, U., Narciso, P. (2007). Persistence of neuropsychologic deficits despite long-term highly active antiretroviral therapy in patients with HIV-related neurocognitive impairment: Prevalence and risk factors. Journal of Acquired Immune Deficiency Syndromes, 45, 174182.Google ScholarPubMed
*Tozzi, V., Balestra, P., Galgani, S., Narciso, P., Ferri, F., Sebastiani, G., Benedetto, A. (1999). Positive and sustained effects of highly active antiretroviral therapy on HIV-1-associated neurocognitive impairment. AIDS, 13, 18891897.Google ScholarPubMed
*Tozzi, V., Balestra, P., Galgani, S., Pasquale, N., Sampaolesi, A., Antinori, A., Ippolito, G. (2001). Changes in neurocognitive performance in a cohort of patients treated with HAART for 3 years. Journal of Acquired Immune Deficiency Syndromes, 28, 1927.Google Scholar
*Tozzi, V., Balestra, P., Salvatori, M.F., Vlassi, C., Liuzzi, G., Giancola, M.L., Antinori, A. (2009). Changes in cognition during antiretroviral therapy: Comparison of 2 different ranking systems to measure antiretroviral drug efficacy on HIV-associated neurocognitive disorders. Journal of Acquired Immune Deficiency Syndromes, 52, 5663.Google ScholarPubMed
*Tozzi, V., Narciso, P., Galgani, S., Sette, P., Balestra, P., Gerace, C., Visco, G. (1993). Effects of zidovudine in 30 patients with mild to end-stage AIDS dementia complex. AIDS, 7, 683692.Google ScholarPubMed
*Winston, A., Duncombe, C., Li, P.C., Gill, J.M., Kerr, S.J., Puls, R., Cooper, D.A. (2010). Does choice of combination antiretroviral therapy (cART) alter changes in cerebral function testing after 48 weeks in treatment-naive, HIV-1-infected individuals commencing cART? A randomized controlled study. Clinical Infectious Diseases, 50, 920929.CrossRefGoogle ScholarPubMed
Zakzanis, K.K. (1998). Brain is related to behavior (p < .05). Journal of Clinical and Experimental Neuropsychology, 20, 419427.CrossRefGoogle ScholarPubMed
Zakzanis, K.K. (2001). Statistics to tell the truth, the whole truth, and nothing but the truth: Formulae, illustrative numerical examples, and heuristic interpretation of effect size analyses for neuropsychological researchers. Archives of Clinical Neuropsychology, 16, 653667.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Effect size results stratified by cognitive domain

Figure 1

Fig. 1 Funnel plots for the domains of (a) attention, (b) executive function, (c) language, (d) motor function, (e) visuospatial function, (f) immediate verbal memory, (g) delayed verbal memory, (h) immediate visual memory, and (i) delayed visual memory. Asymmetry in the funnel plot indicates publication bias. Moderate publication bias favoring positive effect sizes was present in all cognitive domains except language, immediate verbal memory, and immediate visual memory.

Figure 2

Table 2 Analysis of publication bias

Figure 3

Fig. 2 Comparing the efficacy of highly active antiretroviral therapy (HAART) and monotherapy in different cognitive domains. After correcting for multiple comparisons, there were no statistical differences in effect size between monotherapy and HAART for any cognitive domain. Qualitatively, however, HAART showed a greater mean effect size than monotherapy across all cognitive domains. Values are mean ± SEM.

Figure 4

Table 3 Univariate Predictors of Improved Cognitive Functioning After ART

Figure 5

Table 4 Multivariate analysis of moderator variables associated with improved cognitive functioning after ART

Figure 6

Table A1 Neuropsychological tests categorized by cognitive domain

Figure 7

Table A2 Effect size results stratified by test measure

Figure 8

Table A3 Effect size results stratified by study