Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-02-06T07:48:31.947Z Has data issue: false hasContentIssue false

Working memory in schizophrenia: a meta-analysis

Published online by Cambridge University Press:  23 October 2008

N. F. Forbes
Affiliation:
University of Edinburgh, Department of Psychiatry, Royal Edinburgh Hospital, Edinburgh, UK
L. A. Carrick
Affiliation:
University of Edinburgh, Department of Psychiatry, Royal Edinburgh Hospital, Edinburgh, UK
A. M. McIntosh
Affiliation:
University of Edinburgh, Department of Psychiatry, Royal Edinburgh Hospital, Edinburgh, UK
S. M. Lawrie*
Affiliation:
University of Edinburgh, Department of Psychiatry, Royal Edinburgh Hospital, Edinburgh, UK
*
*Address for correspondence: Dr S. M. Lawrie, University of Edinburgh, Department of Psychiatry, Royal Edinburgh Hospital, Morningside Park, Edinburgh EH10 5HF, UK. (Email: s.lawrie@ed.ac.uk)
Rights & Permissions [Opens in a new window]

Abstract

Background

Memory impairment is being recognized increasingly as an important feature of the neuropsychology of schizophrenia. Dysfunction of working memory, a system for the short-term storage and manipulation of information, may relate to a number of core symptoms of schizophrenia. Many studies have examined working memory function in schizophrenia but a clear understanding of the nature and extent of any deficit has been elusive.

Method

A systematic review and meta-analysis of studies comparing working memory function in subjects with schizophrenia and healthy controls was performed. Following a comprehensive literature search, meta-analyses were conducted on 36 measures of phonological, visuospatial and central executive working memory functioning, encompassing 441 separate results from 187 different studies.

Results

Statistically significant effect sizes were found for all working memory measures, indicating deficits in schizophrenia groups. Some of these were robust findings in the absence of evidence of significant heterogeneity or publication bias. Meta-regression analyses showed that the working memory deficit was not simply explained by discrepancies in current IQ between schizophrenia and control groups.

Conclusions

Large deficits in working memory were demonstrated in schizophrenia groups across all three working memory domains. There were, however, no clear differences across subdomains or between particular working memory tasks. There was substantial heterogeneity across results that could only be partly explained.

Type
Editorial Review
Copyright
Copyright © Cambridge University Press 2008

Introduction

Schizophrenia is a heterogeneous disorder, probably encompassing several disease processes that disturb a range of human characteristics including thought, perception, emotion, drive and behaviour. Although neurocognitive dysfunction in schizophrenia is sometimes overshadowed by more obvious symptoms such as hallucinations, delusions and thought disorder, it is a major contributor to the disability experienced by people with schizophrenia (Green & Nuechterlein, Reference Green and Nuechterlein1999) and may in fact represent a core feature of the disease from which the others arise.

There has been much debate as to whether the putative neuropsychological impairment in schizophrenia is a generalized one (Blanchard & Neale, Reference Blanchard and Neale1994), or whether certain functions are differentially impaired. For example, increased distractibility (Oltmanns, Reference Oltmanns1978), memory impairment (comparable to classical amnesic syndrome; McKenna et al. Reference McKenna, Tamlyn, Lund, Mortimer, Hammond and Baddeley1990), attentional disturbance (Nuechterlein & Dawson, Reference Nuechterlein and Dawson1984; cf. Kenny & Meltzer, Reference Kenny and Meltzer1991) and executive dysfunction (Weinberger et al. Reference Weinberger, Berman and Zec1986) have all been suggested as core features. Resolution of this question is complicated because different tests vary in their degree of difficulty and their sensitivity to the effects of impaired functioning (Chapman & Chapman, Reference Chapman and Chapman1973; Calev, Reference Calev1984). In addition, the variation in intellectual difficulties, sometimes on top of an apparent decline from pre-morbid or general levels, may range from a gross impairment in some patients with schizophrenia to complete preservation of function in a minority, rendering a precise formulation difficult.

A meta-analysis by Heinrichs & Zakzanis (Reference Heinrichs and Zakzanis1998) examined a comprehensive range of studies looking at selected neurocognitive variables in schizophrenia. They demonstrated that neurocognitive deficit was a reliable finding in schizophrenia and that deficits were present on most of the tasks examined, although no task could discriminate completely between schizophrenia patients and controls. Impaired verbal memory was a reliable finding in patients with schizophrenia compared to healthy controls. They found far fewer studies reporting performance on non-verbal memory tasks; the magnitude of performance deficits among schizophrenia patients on these tasks was comparable overall to their deficits on verbal memory tasks but much more variable across studies and therefore less reliable. Different measures of global intellectual functioning produced different results, with the Wechsler Adult Intelligence Scale – Revised (WAIS-R) IQ test being the most reliable at demonstrating a deficit in schizophrenia groups.

A meta-analysis by Aleman et al. (Reference Aleman, Hijman, de Haan and Kahn1999), looking specifically at memory impairment in schizophrenia, also found evidence of a significant association between schizophrenia and memory dysfunction. According to Cohen's (Reference Cohen1988) effect size nomenclature, there was a large impairment on tests of recall and a moderate impairment on tests of recognition, suggesting the possibility of a particular deficit in retrieval. There was significant impairment on measures of short-term memory but no difference between measures of verbal and non-verbal memory.

Lee & Park's (Reference Lee and Park2005) meta-analysis looked specifically at working memory in schizophrenia. They demonstrated significant deficits in working memory across all 124 studies included, but suggested that these deficits were more consistent for visuospatial than for verbal working memory tasks. They also showed that the extent of the working memory deficit in schizophrenia groups was unrelated to the length of delay involved in the task, implicating a deficit in encoding rather than storage or retrieval.

Working memory is a concept of short-term memory that is a flexible and dynamic memory resource, where sensory information can be held briefly and manipulated. Baddeley (Reference Baddeley1986) described working memory as ‘a system for the temporary holding and manipulation of information during the performance of a range of neurocognitive tasks such as comprehension, learning and reasoning’, implying an active process rather than simply a static, temporary store. Goldman-Rakic (Reference Goldman-Rakic1994) postulated a neuropsychological model of schizophrenia with working memory dysfunction as the core feature. Specifically, she related working memory dysfunction to formal thought disorder, which she argued was characterized by a failure to adequately retain recent ideas or utterances in working memory.

Baddeley's (Reference Baddeley1986) model of working memory comprised three subsystems: a supervisory, executive system, and two ‘slave systems’, the phonological loop and the visuospatial sketchpad. The phonological loop consists of a short-term phonological store, supported by an articulatory rehearsal process. Material enters the phonological store either as auditory inputs, such as speech, or through non-auditory modalities, for example printed words or pictures representing specific words. The visuospatial sketchpad acts as a short-term store for spatial information and visual characteristics such as shape, colour, brightness and pattern. The central executive has a supervisory attentional role, coordinating the activities of the other working memory subsystems. Specifically, its role is conceived as regulating memory and action by integrating information and selecting strategies for processing it, rather than as attending to perception in a more general sense. Baddeley's (Reference Baddeley1986) model was refined recently to include a fourth component, the episodic buffer (Repovs & Baddeley, Reference Repovs and Baddeley2006). Together with the central executive, the episodic buffer integrates information from working memory and other systems, including semantic and long-term memory.

Many studies have examined working memory function in people with schizophrenia, and robust, reliable deficits across a range of measures have been demonstrated (Lee & Park, Reference Lee and Park2005). We set out to replicate these findings by conducting a thorough and wide-ranging systematic review and meta-analysis of working memory in schizophrenia, comparing performance on tests of working memory in people with schizophrenia versus healthy control subjects. We aimed to determine whether the working memory deficit in schizophrenia, if it exists, is a global impairment, or whether there are specific domains of working memory, measured by specific neuropsychological tests or subtests, that are differentially impaired. By adopting broader inclusion criteria and incorporating data on more working memory tasks than Lee & Park (Reference Lee and Park2005), we hoped to extend their findings by including measures of executive working memory functioning, and calculating overall, pooled effect sizes for many specific tests of working memory.

We hypothesized that any working memory deficit in schizophrenia would represent a specific neurocognitive deficit, rather than simply a correlate of general intellectual ability (IQ). We also set out to explore the relationship between working memory in schizophrenia and illness duration, antipsychotic medication, and positive and negative symptoms, as well as comparing first-episode and chronic patient groups. These variables have not previously been examined so comprehensively and specifically with respect to working memory function in schizophrenia.

Method

Literature search

A comprehensive search for studies was conducted in Medline, EMBASE, Cinahl and PsycINFO, with all articles published after 1966 and before the end of 2005 considered. The terms ‘schizophrenia’ and ‘memory’ and related terms were searched, both as free text and as exploded subject headings. The specific search terms were adapted to the specific headings and thesauri of the databases searched. The full search strategy as conducted in Medline is detailed in the Appendix.

This search produced 6094 results, 5470 of which were English language publications. Titles, abstracts and, where necessary, the full text of the articles identified were examined for possible inclusion in the analysis. In addition, references in the bibliographies of included studies and relevant review articles were examined.

Inclusion criteria

Studies were included if they met the following criteria:

  1. (1) They measured the performance of people with schizophrenia (however diagnosed) and that of healthy control subjects on a test of working memory under comparable conditions. Studies that used other psychiatric or medical patients, prisoners, or relatives of people with schizophrenia as controls were excluded because of the possibility of subtle neurocognitive impairment existing in these groups. Only studies where the mean age in both schizophrenia and control groups was under 65 years were included to reduce possible contamination by age-related neurocognitive decline.

  2. (2) They included a valid test of working memory. For tests of phonological or visuospatial working memory, the delay period between presentation of material and recall or recognition testing had to be 2 minutes or less. For visual information, the stimulus had to be presented for at least 1 second to ensure adequate registration. When in doubt, the appropriateness of including tests as measures of working memory was determined by consulting Lezak (Reference Lezak1995) or Baddeley et al. (Reference Baddeley, Wilson and Watts1995).

  3. (3) They reported sufficient data to enable calculation of an effect size for each test; that is, clear reporting of the number of subjects undertaking each test, mean scores and standard deviation or standard error for each group.

  4. (4) They were published in English language journals.

Data extraction

For each working memory test reported in each study, the following data, where provided, were recorded for both schizophrenia and control groups:

  1. (1) Number of subjects completing the test.

  2. (2) Current IQ, as measured by the WAIS (Wechsler, Reference Wechsler1955), WAIS-R (Wechsler, Reference Wechsler1981) or Quick Test (Ammons & Ammons, Reference Ammons and Ammons1962); where full-scale IQ was extrapolated from WAIS or WAIS-R subtests, only estimates based on four or more subtest scores were included.

  3. (3) Mean test score and standard deviation or standard error.

In addition, the following data were recorded for the schizophrenia group:

  1. (1) Duration of illness in years.

  2. (2) Whether or not experiencing first episode of illness.

  3. (3) Symptom ratings by the Positive and Negative Syndrome Scale (PANSS; Kay et al. Reference Kay, Fiszbein and Opler1987) positive scale score (PANSS-P) and negative scale score (PANSS-N).

  4. (4) Number of subjects on antipsychotic medication and mean dose in chlorpromazine equivalents for both first- and second-generation antipsychotics (Woods, Reference Woods2003).

Where descriptive data were unclear, for example where all of the group to whom the demographic data applied did not complete the memory test, then data were extrapolated to describe the subgroup that participated in memory testing. Some papers subdivided the schizophrenia group (e.g. by symptom profile, chronicity of illness or medication status) and gave results for two or more subgroups. Where first-episode and chronic schizophrenia patients were differentiated, data for both schizophrenia groups were recorded. Otherwise, means and standard deviations were pooled and entered for the schizophrenic group as a whole, to avoid multiple entries for the same control sample.

Several multiple publications were located, where data from the same subjects were reported by more than one study. To avoid multiple entries for the same sample, only the data from the study with the largest number of subjects were entered.

Data analysis

Meta-analyses were performed on tests of working memory for which three or more different studies reported results. Statistical calculations were performed using Stata version 8.2 (Stata Corp., College Station, TX, USA).

From the data reported for each working memory test in each study, a random effects model (allowing for heterogeneity between studies) was used to calculate effect size for the difference in test performance between schizophrenia and control groups. Effect sizes were estimated using the unbiased estimator, d (Hedges & Olkin, Reference Hedges and Olkin1985), and are presented with 95% confidence intervals (CIs). The d statistic is calculated as the difference between the two group means divided by the pooled standard deviation. The d statistic was corrected for small sample bias using a multiplier that corrects for the tendency of small studies to overestimate the effect size.

The summary effect size (d+), its significance and CI were calculated for each working memory measure using a random effects meta-analysis. The DerSimonian & Laird (Reference DerSimonian and Laird1986) method was used to calculate all summary estimates, and includes an estimate of the variance in effect size between study populations (i.e. heterogeneity). The significance and magnitude of any heterogeneity were calculated using the Q and I 2 statistics respectively. I 2 provides a measure of the proportion of inconsistency between studies attributable to heterogeneity, and is described by Higgins et al. (Reference Higgins, Thompson, Deeks and Altman2003). Galbraith plots were constructed to look for outliers in analyses with significant heterogeneity.

To further investigate causes for hetereogeneity, meta-regression analyses were performed for the following variables: duration of illness in years, difference in current IQ between schizophrenia and control groups, PANSS-P score, PANSS-N score, and current antipsychotic medication dose in chlorpromazine equivalents. The Stata program metareg.ado was used throughout and the Restricted Maximum Likelihood (REML) method was used to estimate the model parameters. Subgroup analysis was also performed to explore possible heterogeneity between first-episode and non-first-episode groups.

Publication bias was investigated in two ways. First, funnel plots of effect sizes from individual studies against each study's sample size were constructed. Second, a statistical analogue of the funnel plot was used, the linear regression approach described by Egger et al. (Reference Egger, Davey, Schneider and Minder1997). This approach examines the association between effect size and standard error for each study, and therefore takes into account both the sample size and the statistical power of each study in relation to effect size.

Results

The literature search and review of bibliographies identified 200 references that met criteria for inclusion. Results for specific working memory tests were categorized together, and a random effects meta-analysis was conducted for those tests of working memory where results had been reported by three or more different studies. In total, meta-analyses were conducted for 36 different tests of working memory derived from 187 different studies. These yielded 441 sets of data incorporating a total of 17 152 working memory test scores from subjects with schizophrenia and 14 605 from healthy controls.

Phonological working memory

Table 1 displays the results of meta-analyses of schizophrenia and control subjects in performance on tests of phonological working memory. Twenty-one tests or subtests with at least three contributing studies (range up to 38 studies) were identified. For all of these tests, scores were worse in schizophrenia than control groups at a statistically significant level, with absolute effect sizes ranging from 0.55 to 1.41. It is notable, however, that the 95% CIs for all of these tests overlap, that is this meta-analysis provides no evidence for differential impairment on one particular phonological working memory task.

Table 1. Results of meta-analyses of tests of phonological working memory

DSDT, Digit Span Distraction Test; CI, confidence interval.

Fourteen of these tests were associated with significant heterogeneity between studies with I 2>50% and p values <0.05. Seven tests showed significant differences between schizophrenia and control groups that were not potentially attributable to heterogeneity or publication bias: the long Digit Span Distraction Test (DSDT) (non-distraction condition), long DSDT (distraction condition), short DSDT (non-distraction condition), digit span backwards, verbal learning tests list A trial 1, verbal learning tests list B, and verbal span tasks not involving manipulation of information. Representative Forest plots from the phonological working memory meta-analyses are shown for digit span backwards (Fig. 1) and letter number span (Fig. 2).

Fig. 1. Forest plot of digit span backwards meta-analysis.

Fig. 2. Forest plot of letter number span meta-analysis.

Fig. 2 demonstrates one potential explanation of this high level of heterogeneity, in that Antonova et al. (Reference Antonova, Kumari, Morris, Halari, Anilkumar, Mehrotra and Sharma2005) appears to be an outlier. We also considered the possibility that some of this heterogeneity may relate to the tasks we combined in individual meta-analyses, as less heterogeneity is generally evident in the analyses of the better circumscribed tests or subtests, such as digit span. However, subgroup analyses comparing those verbal learning tests where the items belong to clear semantic categories (as in the California Verbal Learning Test; Delis et al. Reference Delis, Kramer, Kaplan and Ober1987) against those where the items are not categorized (as in the Rey Auditory Verbal Learning Test, described by Lezak, Reference Lezak1995) identified no significant differences between the two.

Visuospatial working memory

We found 11 tests or subtests of visuospatial working memory with at least three studies contributing usable data (range up to 33 studies), all of which found statistically significantly impairments in schizophrenia versus control groups, with absolute effect sizes ranging between 0.51 and 1.29 (Table 2). Again, the CIs of these effect sizes overlapped and there was a suggestion that those tests with higher effect sizes were also associated with greater heterogeneity. Seven tests were not associated with significant heterogeneity or publication bias. These were: complex figure reproduction tests, spatial delayed response tasks, tests of spatial recognition, tests of pattern recognition, spatial span backwards, spatial span forwards and backwards combined, and visual paired associate learning tests. However, the single visuospatial working memory test for which there were most data, spatial span forwards, showed evidence of significant heterogeneity and publication bias. Figs 3 and 4 show representative Forest plots from the spatial span forwards and spatial span backwards meta-analyses.

Fig. 3. Forest plot of spatial span forwards meta-analysis.

Fig. 4. Forest plot of spatial span backwards meta-analysis.

Table 2. Results of meta-analyses of tests of visuospatial working memory

CI, Confidence interval.

a Tests where lower scores indicate better performance.

Executive working memory

Four tests of executive working memory were found with at least three studies contributing usable data (range up to six studies). All found statistically significant effect sizes ranging between 0.73 and 0.92, and none were associated with statistically significant heterogeneity or publication bias. These are shown in Table 3. Fig. 5 shows the Forest plot for the Cambridge Neuropsychological Test Automated Battery (CANTAB) spatial working memory strategy task.

Fig. 5. Forest plot of the Cambridge Neuropsychological Test Automated Battery (CANTAB) spatial working memory strategy task.

Table 3. Results of meta-analyses of tests of executive working memory

CI, Confidence interval; CANTAB, Cambridge Neuropsychological Test Automated Battery; SWM, spatial working memory.

a Tests where lower scores indicate better performance.

Meta-regression analysis

We were interested a priori in determining whether some of the working memory deficits in schizophrenia could be related to key clinical features of the illness. We also sought, post hoc, to see whether some of the heterogeneity we found by calculation of the I 2 statistic could be explained using meta-regression analyses.

We conducted meta-regression analyses for duration of illness in years against all tests where there were sufficient data. We found significant associations for the following five tests: spatial working memory strategy task (b=0.027, Z=2.31, p=0.021), verbal learning tests cued recall post-distraction (b=−0.037, Z=−3.27, p=0.001), verbal learning tests free recall post-distraction (b=−0.0339, Z=−2.44, p=0.015), visual paired associate learning tests (b=−0.15, Z=−2.39, p=0.017) and immediate visual recall tests (b=−0.062, Z=−2.81, p=0.005) (note that the sign of these beta coefficients reflects the scoring of the tests). These associations suggest that studies including patients with longer illness durations generally find greater deficits on these tasks.

We also looked at the difference in current IQ between schizophrenia and control groups, and conducted meta-regression analyses for these values against all tests where there were sufficient data. There was only one statistically significant association, between passage recall and IQ difference (b=−0.074, Z=−3.42, p=0.001). Therefore, in general, the pattern of working memory deficits was not explained by any discrepancies in current IQ between schizophrenia and control groups.

We looked at positive and negative symptoms scores, measured by the PANSS (Kay et al. Reference Kay, Fiszbein and Opler1987). For verbal list learning list 1, significant heterogeneity was associated with greater symptom severity on both PANSS-P (b=0.09, Z=2.11, p=0.035) and PANSS-N (b=0.13, Z=2.34, p=0.019). For digit span forwards and backwards combined, significant heterogeneity was also associated with greater symptom severity on both PANSS-P (b=0.154, Z=3.65, p<0.001) and PANSS-N (b=0.139, Z=3.75, p<0.001).

Finally, we looked at current antipsychotic dose in chlorpromazine equivalents, which was also associated with heterogeneity in verbal list learning list 1 (b=−0.0026, Z=−4.29, p<0.001), verbal list learning list 5 (b=−0.0027, Z=−3.98, p<0.001), total recall on verbal learning tests recall trials (b=−0.0013, Z=−3.98, p=0.008) and verbal leaning tests, short delay, free recall (b=−0.002, Z=−2.56, p=0.01).

Subgroup analysis

We then examined whether there were greater deficits in multiple-episode versus first-episode schizophrenia groups, for working memory tests with data from at least two first-episode and two multiple-episode groups. For 11 of the 13 working memory tests analysed, performance in the sample was worse in the multiple-episode than first-episode patients. We found five tests or subtests where performance was worse, to a statistically significant degree, in those with multiple episodes compared to first episodes: verbal learning tests list 5, verbal learning tests list 6 (free recall), tests of pattern recognition, spatial span forwards and tests of immediate visual recall. It is, however, striking that none of these test were also found to be associated with duration of illness.

Discussion

The number of studies included in the present meta-analysis makes it larger than any published meta-analysis of working memory in schizophrenia to date. In the majority of the present analyses, funnel plots and statistical tests of publication bias demonstrated little evidence of reporting bias, suggesting that studies of working memory in schizophrenia are equally likely to be published regardless of the direction, magnitude or statistical significance of their results. Most of the analyses in the present study demonstrated relatively large and statistically robust overall effect sizes. The likelihood that these would be altered in a meaningful way by the inclusion of a small number of unpublished or unidentified studies is therefore low.

Statistically significant overall effect sizes, indicating impaired performance among subjects with schizophrenia, were found for all 36 analyses. These were present and comparable across all three domains of working memory examined, and across the different tests or subtests within each domain. There were also some consistent deficits in analyses where there was no evidence of significant heterogeneity or publication bias. These 18 tasks, which include simple tests such as digit span backwards and spatial span backwards, can therefore be regarded as relatively robust and reliable methods of identifying deficits in patients with schizophrenia.

However, one of the most striking results of this meta-analysis is the amount of heterogeneity between studies and the difficulty in finding consistent associations with this. Some of this inhomogeneity may of course reflect the way that we grouped tests, but we did this with reference to standard texts. Furthermore, it is clear that some single tests, such as forwards digit span, are associated with substantial heterogeneity, whereas some collections of, for example, verbal span tasks are not. Some of this inhomogeneity may of course reflect differences in the way tests are administered and scored but this detail is rarely provided in original papers. Overall, we were left with the impression that the bulk of heterogeneity in these results is potentially attributable to differences in the populations studied, and in particular the possibility that larger effect sizes in some studies could reflect the inclusion of particularly impaired patients.

Subgroup (first-episode versus chronic) and meta-regression (for duration of illness) analyses nonetheless produced some interesting findings in keeping with the possibility of a progressive decline in working memory performance in people with schizophrenia. This would be in accordance with Mohs' (Reference Mohs1999) suggestion that age-related neurocognitive changes may follow an accelerated trajectory in people with schizophrenia compared to healthy individuals. However, we conducted numerous analyses and there is no agreement between the specific tests identified on the subgroup and meta-regression analyses. We cannot therefore say that we have found evidence for progression of cognitive impairment in schizophrenia. Rather, we would use these findings to suggest that future studies should address these possibilities.

The lack of association with deficit in current IQ suggests that the robust finding of working memory deficit in schizophrenia groups across all 36 tasks examined is not simply attributable to IQ deficits. This supports the hypothesis that people with schizophrenia have a specific working memory deficit, rather than a generalized cognitive impairment. Indeed, many of the studies contributing data to the meta-analyses had matched schizophrenia and control subjects for pre-morbid IQ and/or educational attainment. This, however, may have led to the selection of unrepresentative samples from both groups, as suggested by Buckley et al. (Reference Buckley, O'Callaghan, Larkin and Waddington1992). Thus, our findings may be more representative of relatively high functioning patients, or indeed of patients with more than average decline from pre-morbid levels of function.

The severity of positive or negative psychotic symptoms did not seem to affect the magnitude of performance deficit across the range of working memory tests, suggesting that the deficits relate to an aspect of the schizophrenic trait, rather than, for example, distractibility and disorganization in the acute psychotic state. There was, however, a trend towards association between performance on verbal learning tests and both positive and negative symptom scores and antipsychotic dose, suggesting that researchers interested in verbal learning should take careful account of both the symptom and treatment status of their subjects.

The validity of comparing results between different types of working memory test has, however, been called into question. Chapman & Chapman (Reference Chapman and Chapman1973, Reference Chapman and Chapman1978) observed that subjects with schizophrenia scored less well than healthy controls on most tasks, and that for a deficit to be of particular importance it should be of greater magnitude than would be expected on the basis of the generalized deficit. They pointed out that such differential deficits in ability may not be reflected accurately by differential deficits in test performance because of varying psychometric properties between different tests. For example, tests may differ in the extent to which they discriminate between high and low performers, or in their reliability. Chapman & Chapman (Reference Chapman and Chapman1978) suggested that, to overcome these problems with comparability of results between different tests, tests should be matched for level of difficulty and variance in scores among normal control subjects.

In the present analysis, only the digit span distraction tests had all been developed according to this principle, so that comparisons of the distraction and non-distraction component of each are valid. The other tests of working memory included in the present study were, however, unmatched. This must be considered when comparing effect sizes, both between analyses and within those analyses incorporating different working memory tasks. These measures may be influenced by the psychometric properties of the tests themselves, and their relationship to each other will not necessarily equate to underlying differences in ability between schizophrenia and control groups. Any conclusions drawn from relative magnitudes of overall effect size between analyses must therefore be guarded.

Conclusions

Statistically significant deficits in task performance were found in schizophrenia groups in all 36 working memory tasks examined, across the domains of phonological, visuospatial and central executive working memory. For many tasks, these findings could not be explained by publication bias or significant heterogeneity. Meta-regression analyses showed that the working memory deficits were not explained by discrepancies in current IQ between schizophrenia and control groups. No consistent associations were found between duration of illness, antipsychotic medication or symptom profile and the working memory deficit in schizophrenia groups. Our conclusions are, however, limited by the significant heterogeneity across studies included in the meta-analyses.

Appendix

Literature search conducted in Medline

  1. 1. explode SCHIZOPHRENIA or explode SCHIZOPHRENIA, CATATONIC or explode SCHIZOPHRENIA, DISORGANIZED or explode SCHIZOPHRENIA, PARANOID

  2. 2. schizophren$ [title, abstract, MeSH]

  3. 3. #1 or #2

  4. 4. explode MEMORY or explode MEMORY, SHORT-TERM or explode MEMORY DISORDERS or explode ATTENTION

  5. 5. ‘memory’ or ‘attention’ or ‘learning’ [title, abstract, MeSH]

  6. 6. ‘central executive’ or ‘supervisory attentional system’ [title, abstract, MeSH]

  7. 7. ‘phonological loop’ or ‘articulatory loop’ [title, abstract, MeSH]

  8. 8. ‘visuo-spatial scratch-pad’ or ‘visuospatial scratch-pad’ or ‘visuo-spatial scratchpad’ or ‘visuospatial scratchpad’ or ‘visuo-spatial sketch-pad’ or ‘visuospatial sketch-pad’ or ‘visuo-spatial sketchpad’ or ‘visuospatial sketchpad’ [title, abstract, MeSH]

  9. 9. ‘digit sequence’ [title, abstract, MeSH]

  10. 10. ‘span’ or ‘supra-span’ [title, abstract, MeSH]

  11. 11. ‘immediate recall’ [title, abstract, MeSH]

  12. 12. ‘paired associate’ [title, abstract, MeSH]

  13. 13. ‘consonant trigrams’ or ‘consonant trigram’ [title, abstract, MeSH]

  14. 14. (‘Peterson’ and ‘task’) [title, abstract, MeSH]

  15. 15. ‘proactive inhibition’ [title, abstract, MeSH]

  16. 16. ‘Corsi’ [title, abstract, MeSH]

  17. 17. (‘match’ and ‘sample’) [title, abstract, MeSH]

  18. 18. ‘visual distraction’ or ‘visual reproduction’ or ‘visual retention’ or ‘visual learning’ or ‘visual recall’ [title, abstract, MeSH]

  19. 19. ‘spatial recall’ or ‘spatial learning’ [title, abstract, MeSH]

  20. 20. ‘pattern recognition’ or ‘spatial recognition’ or ‘facial recognition’ [title, abstract, MeSH]

  21. 21. (‘Rey’ and ‘Osterreith’) or (‘Rey’ and ‘Osterrieth’) or (‘Rey’ and ‘Oesterreith’) or (‘Rey’ and ‘Oesterrieth’) [title, abstract, MeSH]

  22. 22. ‘complex figure’ [title, abstract, MeSH]

  23. 23. (‘dual’ and ‘task’) [title, abstract, MeSH]

  24. 24. ‘sentence verification’ [title, abstract, MeSH](‘random’ and ‘generation’) [title, abstract, MeSH]

  25. 25. (‘source’ and ‘monitoring’) [title, abstract, MeSH]

  26. 26. ‘Wechsler Adult Intelligence Scale’ or ‘WAIS’ [title, abstract, MeSH]

  27. 27. ‘Wechsler Memory Scale’ or ‘WMS’ [title, abstract, MeSH]

  28. 28. #4 or #5 or #6 or #7 or #8 or #9 or #10 or #11 or #12 or #13 or #14 or #15 or #16 or #17 or #18 or #19 or #20 or #21 or #22 or #23 or #24 or #25 or #26 or #27 or #28

  29. 29. #3 and #29

  30. 30. ‘case’ or ‘affected’ or ‘patient’ or ‘proband’ or ‘subject’ or ‘control’ or ‘normal’ or ‘healthy’ or ‘unaffected’ or ‘cohort’ or ‘follow-up’ or ‘case-control’ or ‘comparative study’ or ‘risk’ or ‘odds ratio’ [title, abstract, MeSH]

  31. 31. explode CASE-CONTROL STUDIES or explode COHORT STUDIES or explode RISK or explode RISK FACTORS

  32. 32. #31 or #32

  33. 33. #30 and #33

  34. 34. limit #34 to human

Acknowledgements

We thank Wendy Mill for assistance in obtaining articles. A.M.M. is supported by the Health Foundation and S.M.L. is supported by the Sackler Foundation.

Declaration of Interest

None.

Footnotes

* Asterisked references indicate studies included in meta-analyses.

References

*Albus, M, Hubman, W, Ehrenberg, C, Forcht, U, Mohr, F, Sobizack, N, Wahlheim, C, Hecht, S (1996). Neuropsychological impairment in first episode and chronic schizophrenia. European Archives of Psychiatry and Clinical Neuroscience 246, 249255.CrossRefGoogle Scholar
*Albus, M, Hubmann, W, Scherer, J, Dreikorn, B, Hecht, S, Sobizack, N, Mohr, F (2002). A prospective 2-year follow-up study of neurocognitive functioning in patients with first-episode schizophrenia. European Archives of Psychiatry and Clinical Neuroscience 252, 262267.CrossRefGoogle ScholarPubMed
Aleman, A, Hijman, R, de Haan, EH, Kahn, RS (1999). Memory impairment in schizophrenia: a meta-analysis. American Journal of Psychiatry 156, 13581366.CrossRefGoogle ScholarPubMed
*Altshuler, LL, Ventura, J, van Gorp, WG, Green, MF, Theberge, DC, Mintz, J (2004). Neurocognitive function in clinically stable men with bipolar I disorder or schizophrenia and normal control subjects. Biological Psychiatry 56, 560569.CrossRefGoogle ScholarPubMed
Ammons, R, Ammons, C (1962). Quick Test. Psychological Tests Specialists: Missoula, MT.Google Scholar
*Andreasen, NC, O'Leary, DS, Cizadlo, T, Arndt, S, Rezai, K, Ponto, LL, Watkins, GL, Hichwa, RD (1996). Schizophrenia and cognitive dysmetria: a positron-emission tomography study of dysfunctional prefrontal-thalamic-cerebellar circuitry. Proceedings of the National Academy of Sciences USA 93, 99859990.CrossRefGoogle ScholarPubMed
*Anselmetti, S, Bechi, M, Cocchi, F, Ermoli, E, Smeraldi, E, Cavallaro, R (2005). Source monitoring in schizophrenia: a signal detection analysis study. Clinical Neuropsychiatry 2, 229236.Google Scholar
*Antonova, E, Kumari, V, Morris, R, Halari, R, Anilkumar, A, Mehrotra, R, Sharma, T (2005). The relationship of structural alterations to cognitive deficits in schizophrenia: a voxel-based morphometry study. Biological Psychiatry 58, 457467.CrossRefGoogle ScholarPubMed
*Baare, WFC, Pol, HEH, Hijman, R, Mali, WPT, Viergever, MA, Kahn, RS (1999). Volumetric analysis of frontal lobe regions in schizophrenia: relation to cognitive function and symptomatology. Biological Psychiatry 45, 15971605.CrossRefGoogle ScholarPubMed
*Badcock, JC, Michie, PT, Rock, D (2005). Spatial working memory and planning ability: contrasts between schizophrenia and bipolar I disorder. Cortex 41, 753763.CrossRefGoogle ScholarPubMed
Baddeley, A (1986). Working Memory. Clarendon Press: Oxford.Google ScholarPubMed
Baddeley, A, Wilson, B, Watts, FE (1995). Handbook of Memory Disorders. John Wiley and Sons: New York.Google Scholar
*Bagner, DM, Melinder, MRD, Barch, DM (2003). Language comprehension and working memory language comprehension and working memory deficits in patients with schizophrenia. Schizophrenia Research 60, 299309.CrossRefGoogle ScholarPubMed
*Baldeweg, T, Klugman, A, Gruzelier, J, Hirsch, SR (2004). Mismatch negativity potentials and cognitive impairment in schizophrenia. Schizophrenia Research 69, 203217.CrossRefGoogle ScholarPubMed
*Ball, S, Busatto, GF, David, AS, Jones, SH, Hemsley, DR, Pilowsky, LS, Costa, DC, Ell, PJ, Kerwin, RW (1998). Cognitive functioning and GABAA/benzodiazepine receptor binding in schizophrenia: a 123I-iomazenil SPET study. Biological Psychiatry 43, 107117.CrossRefGoogle ScholarPubMed
*Barkataki, I, Kumari, V, Das, M, Hill, M, Morris, R, O'Connell, P, Taylor, P, Sharma, T (2005). A neuropsychological investigation into violence and mental illness. Schizophrenia Research 74, 113.CrossRefGoogle ScholarPubMed
*Beatty, WW, Jocic, Z, Monson, N, Staton, RD (1993). Memory and frontal lobe dysfunction in schizophrenia and schizoaffective disorder. Journal of Nervous and Mental Disease 181, 448453.CrossRefGoogle ScholarPubMed
*Bilder, RM, Goldman, RS, Robinson, D, Reiter, G, Bell, L, Bates, JA, Pappadopulos, E, Willson, DF, Alvir, JMJ, Woerner, MG, Geisler, S, Kane, JM, Lieberman, JA (2000). Neuropsychology of first-episode schizophrenia: initial characterization and clinical correlates. American Journal of Psychiatry 157, 549559.CrossRefGoogle ScholarPubMed
*Blanchard, JJ, Neale, JM (1994). The neuropsychological signature of schizophrenia: generalized or differential deficit? American Journal of Psychiatry 151, 4048.Google ScholarPubMed
*Bollini, AM, Arnold, MC, Keefe, RS (2000). Test–retest reliability of the dot test of visuospatial working memory in patients with schizophrenia and controls. Schizophrenia Research 45, 169173.CrossRefGoogle ScholarPubMed
*Brazo, P, Marié, RM, Halbecq, I, Benali, K, Segard, L, Delamillieure, P, Langlois-Théry, S, van der Elst, A, Thibaut, F, Petit, M, Dollfus, S (2002). Cognitive patterns in subtypes of schizophrenia. European Psychiatry 17, 155162.CrossRefGoogle ScholarPubMed
*Brebion, G, Amador, X, Smith, MJ, Gorman, JM (1997). Mechanisms underlying memory impairment in schizophrenia. Psychological Medicine 27, 383393.CrossRefGoogle ScholarPubMed
*Brebion, G, David, AS, Bressan, RA, Pilowsky, LS (2005). Word frequency effects on free recall and recognition in patients with schizophrenia. Journal of Psychiatric Research 39, 215222.CrossRefGoogle ScholarPubMed
*Brebion, G, David, AS, Jones, H, Pilowsky, LS (2004). Semantic organization and verbal memory efficiency in patients with schizophrenia. Neuropsychology 18, 378383.CrossRefGoogle ScholarPubMed
*Brebion, G, Gorman, JM, Malaspina, D, Sharif, Z, Amador, X (2001). Clinical and cognitive factors associated with verbal memory task performance in patients with schizophrenia. American Journal of Psychiatry 158, 758764.CrossRefGoogle ScholarPubMed
*Brewer, WJ, Edwards, J, Anderson, V, Robinson, T, Pantelis, C (1996). Neuropsychological, olfactory, and hygiene deficits in men with negative symptom schizophrenia. Biological Psychiatry 40, 10211031.CrossRefGoogle ScholarPubMed
*Broerse, A, Holthausen, EAE, van den Bosch, RJ, den Boer, JA (2001). Does frontal normality exist in schizophrenia? A saccadic eye movement study. Psychiatry Research 103, 167178.Google ScholarPubMed
Buckley, P, O'Callaghan, E, Larkin, C, Waddington, JL (1992). Schizophrenia research: the problem of controls. Biological Psychiatry 32, 215217.Google ScholarPubMed
*Buckley, PF, Moore, C, Long, H, Larkin, C, Thompson, P, Mulvany, F, Redmond, O, Stack, JP, Ennis, JT, Waddington, JL (1994). 1H-magnetic resonance spectroscopy of the left temporal and frontal lobes in schizophrenia: clinical, neurodevelopmental, and cognitive correlates. Biological Psychiatry 36, 792800.CrossRefGoogle ScholarPubMed
*Butler, RW, Jenkins, MA, Sprock, J, Braff, DL (1992). Wisconsin Card Sorting Test deficits in chronic paranoid schizophrenia: evidence for a relatively discrete subgroup? Schizophrenia Research 7, 169176.CrossRefGoogle ScholarPubMed
*Cadenhead, KS, Perry, W, Shafer, K, Braff, DL (1999). Cognitive functions in schizotypal personality disorder. Schizophrenia Research 37, 123132.CrossRefGoogle ScholarPubMed
Calev, A (1984). Recall and recognition in mildly disturbed schizophrenics: the use of matched tasks. Psychological Medicine 14, 425429.CrossRefGoogle ScholarPubMed
*Calev, A, Edelist, S (1993). Affect and memory in schizophrenia: negative emotion words are forgotten less rapidly than other words by long-hospitalized schizophrenics. Psychopathology 26, 229235.CrossRefGoogle ScholarPubMed
*Calev, A, Nigal, D, Kugelmass, S, Weller, MPI, Lerer, B (1991). Performance of long-stay schizophrenics after drug withdrawal on matched immediate and delayed recall tasks. British Journal of Clinical Psychology 30, 241245.CrossRefGoogle ScholarPubMed
*Cantor-Graae, E, Warkentin, S, Nilsson, A (1995). Neuropsychological assessment of schizophrenic patients during a psychotic episode: persistent cognitive deficit? Acta Psychiatrica Scandinavica 91, 283288.CrossRefGoogle ScholarPubMed
*Carstairs, K, Okocha, CI, Hemsley, D, Toone, B, Sivakumar, K (1995). An application of Shallice's response selection model to the symptoms of schizophrenia. Neurology Psychiatry and Brain Research 3, 211218.Google Scholar
*Cermak, SA, Eimon, M, Eimon, P, Hartwell, A (1991). Constructional abilities in persons with chronic schizophrenia. Occupational Therapy in Mental Health 11, 2139.CrossRefGoogle Scholar
Chapman, LJ, Chapman, JP (1973). Problems in the measurement of cognitive deficits. Psychological Bulletin 79, 380385.CrossRefGoogle Scholar
Chapman, LJ, Chapman, JP (1978). The measurement of differential deficit. Journal of Psychiatric Research 14, 303311.CrossRefGoogle ScholarPubMed
*Chazan, S, Calev, A, Gil, T, Tubi, N, Amiri, Z, Lerer, B (1987). A study of the discriminating power of the Wechsler Memory Scale using schizophrenic and normal subjects in Israel. Israel Journal of Psychiatry and Related Sciences 24, 179190.Google ScholarPubMed
*Chen, YL, Chen, YHE, Lieh-Mak, F (2000). Semantic verbal fluency deficit as a familial trait marker in schizophrenia. Psychiatry Research 95, 133148.CrossRefGoogle ScholarPubMed
*Chey, J, Lee, J, Kim, YS, Kwon, SM, Shin, YM (2002). Spatial working memory span, delayed response and executive function in schizophrenia. Psychiatry Research 110, 259271.CrossRefGoogle ScholarPubMed
*Clare, L, McKenna, PJ, Mortimer, AM, Baddeley, AD (1993). Memory in schizophrenia: what is impaired and what is preserved? Neuropsychologia 31, 12251241.CrossRefGoogle ScholarPubMed
*Cleghorn, JM, Kaplan, RD, Szechtman, B, Szechtman, H, Brown, GM (1990). Neuroleptic drug effects on cognitive function in schizophrenia. Schizophrenia Research 3, 211219.CrossRefGoogle ScholarPubMed
Cohen, J (1988). Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates: Hillsdale, NJ.Google Scholar
*Cohen, JD, Barch, DM, Carter, C, Servan-Schreiber, D (1999). Context-processing deficits in schizophrenia: converging evidence from three theoretically motivated cognitive tasks. Journal of Abnormal Psychology 108, 120133.CrossRefGoogle ScholarPubMed
*Condray, R, Steinhauer, SR, van Kammen, DP, Kasparek, A (1996). Working memory capacity predicts language comprehension in schizophrenic patients. Schizophrenia Research 20, 113.CrossRefGoogle ScholarPubMed
*Conklin, HM, Calkins, ME, Anderson, CW, Dinzeo, TJ, Iacono, WG (2002). Recognition memory for faces in schizophrenia patients and their first-degree relatives. Neuropsychologia 40, 23142324.CrossRefGoogle ScholarPubMed
*Conklin, HM, Curtis, CE, Calkins, ME, Iacono, WG (2005). Working memory functioning in schizophrenia patients and their first-degree relatives: cognitive functioning shedding light on etiology. Neuropsychologia 43, 930942.CrossRefGoogle ScholarPubMed
*Corcoran, R, Frith, CD (2003). Autobiographical memory and theory of mind: evidence of a relationship in schizophrenia. Psychological Medicine 33, 897905.CrossRefGoogle ScholarPubMed
*Corrigan, PW, Green, MF (1991). Signal detection analysis of short-term recall in schizophrenia. Journal of Nervous and Mental Disease 179, 495498.CrossRefGoogle ScholarPubMed
*Crespo-Facorro, B, Paradiso, S, Andreasen, NC, O'Leary, DS, Watkins, GL, Boles Ponto, LL, Hichwa, RD (1999). Recalling word lists reveals ‘cognitive dysmetria’ in schizophrenia: a positron emission tomography study. American Journal of Psychiatry 156, 386392.CrossRefGoogle ScholarPubMed
*Danion, JM, Meulemans, T, Kauffmann-Muller, F, Vermaat, H (2001). Intact implicit learning in schizophrenia. American Journal of Psychiatry 158, 944948.CrossRefGoogle ScholarPubMed
*Danion, JM, Rizzo, L, Bruant, A (1999). Functional mechanisms underlying impaired recognition memory and conscious awareness in patients with schizophrenia. Archives of General Psychiatry 56, 639644.CrossRefGoogle ScholarPubMed
Delis, DC, Kramer, JH, Kaplan, E, Ober, BA (1987). The California Verbal Learning Test. Psychological Corporation: San Antonio, TX.Google Scholar
DerSimonian, R, Laird, N (1986). Meta-analysis in clinical trials. Controlled Clinical Trials 7, 177188.CrossRefGoogle ScholarPubMed
*Dickinson, D, Iannone, VN, Wilk, CM, Gold, JM (2004). General and specific cognitive deficits in schizophrenia. Biological Psychiatry 55, 826833.CrossRefGoogle ScholarPubMed
*Docherty, NM, Gordinier, SW (1999). Immediate memory, attention and communication disturbances in schizophrenia patients and their relatives. Psychological Medicine 29, 189197.CrossRefGoogle ScholarPubMed
*Donohoe, G, Corvin, A, Robertson, IH (2005). Are the cognitive deficits associated with impaired insight in schizophrenia specific to executive task performance? Journal of Nervous and Mental Disease 193, 803808.CrossRefGoogle ScholarPubMed
*Egeland, J, Sundet, K, Rund, BR, Asbjørnsen, A, Hugdahl, K, Landrø, NI, Lund, A, Roness, A, Stordal, KI (2003). Sensitivity and specificity of memory dysfunction in schizophrenia: a comparison with major depression. Journal of Clinical and Experimental Neuropsychology 25, 7993.CrossRefGoogle ScholarPubMed
Egger, M, Davey, SG, Schneider, M, Minder, C (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 315, 629634.CrossRefGoogle ScholarPubMed
*Elliott, R, McKenna, PJ, Robbins, TW, Sahakian, BI (1998). Specific neuropsychological deficits in schizophrenic patients with preserved intellectual function. Cognitive Neuropsychiatry 3, 4570.CrossRefGoogle Scholar
*Elvevåg, B, Fisher, JE, Weickert, TW, Weinberger, DR, Goldberg, TE (2004). Lack of false recognition in schizophrenia: a consequence of poor memory? Neuropsychologia 42, 546554.CrossRefGoogle ScholarPubMed
*Elvevåg, B, Maylor, EA, Gilbert, AL (2003). Habitual prospective memory in schizophrenia. BMC Psychiatry 3, 9.CrossRefGoogle ScholarPubMed
*Ermoli, E, Anselmetti, S, Bechi, M, Cocchi, F, Smeraldi, E, Cavallaro, R (2005). Assessment of psychosis in schizophrenia: neuropsychological profile of chronic schizophrenia. Clinical Neuropsychiatry 2, 243249.Google Scholar
*Ertuğrul, A, Uluğ, B (2002). The influence of neurocognitive deficits and symptoms on disability in schizophrenia. Acta Psychiatrica Scandinavica 105, 196201.CrossRefGoogle ScholarPubMed
*Evangeli, M, Broks, P (2000). Face processing in schizophrenia: parallels with the effects of amygdala damage. Cognitive Neuropsychiatry 5, 81104.CrossRefGoogle ScholarPubMed
*Exner, C, Boucsein, K, Degner, D, Irle, E, Weniger, G (2004). Impaired emotional learning and reduced amygdala size in schizophrenia: a 3-month follow-up. Schizophrenia Research 71, 493503.CrossRefGoogle ScholarPubMed
*Exner, JE, Murillo, LG (1977). A long-term follow-up of schizophrenics treated with regressive ECT. Diseases of the Nervous System 38, 162168.Google ScholarPubMed
*Fennig, S, Mottes, A, Ricter-Levin, G, Treves, I, Levkovitz, Y (2002). Everyday memory and laboratory memory tests: general function predictors in schizophrenia and remitted depression. Journal of Nervous and Mental Disease 190, 677682.CrossRefGoogle ScholarPubMed
*Finkelstein, RJ (1983). Distractibility among paranoid and non-paranoid schizophrenics using subtests matched for discriminating power. British Journal of Clinical Psychology 22, 237244.CrossRefGoogle ScholarPubMed
*Fleming, K, Goldberg, TE, Binks, S, Randolph, C, Gold, JM, Weinberger, D.R (1997). Visuospatial working memory in patients with schizophrenia. Biological Psychiatry 41, 4349.CrossRefGoogle ScholarPubMed
*Fossati, P, Amar, G, Raoux, N, Ergis, AM, Allilaire, JF (1999). Executive functioning and verbal memory in young patients with unipolar depression and schizophrenia. Psychiatry Research 89, 171187.CrossRefGoogle ScholarPubMed
*Franke, P, Gänsicke, M, Schmitz, S, Falkai, P, Maier, W (1999). Differential memory span – abnormal lateralization pattern in schizophrenic patients and their siblings? International Journal of Psychophysiology 34, 303311.CrossRefGoogle ScholarPubMed
*Franke, P, Maier, W, Hardt, J, Frieboes, R, Lichtermann, D, Hain, C (1993). Assessment of frontal lobe functioning in schizophrenia and unipolar major depression. Psychopathology 26, 7684.CrossRefGoogle ScholarPubMed
*Friedman, L, Kenny, JT, Jesberger, JA, Choy, MM, Meltzer, HY (1995). Relationship between smooth pursuit eye-tracking and cognitive performance in schizophrenia. Biological Psychiatry 37, 265272.CrossRefGoogle ScholarPubMed
*Fucetola, R, Seidman, LJ, Kremen, WS, Faraone, SV, Goldstein, JM, Tsuang, MT (2000). Age and neuropsychologic function in schizophrenia: a decline in executive abilities beyond that observed in healthy volunteers. Biological Psychiatry 48, 137146.CrossRefGoogle ScholarPubMed
*Ganguli, R, Carter, C, Mintun, M, Brar, J, Becker, J, Sarma, R, Nichols, T, Bennington, E (1997). PET brain mapping study of auditory verbal supraspan memory versus visual fixation in schizophrenia. Biological Psychiatry 41, 3342.CrossRefGoogle ScholarPubMed
*Glahn, DC, Cannon, TD, Gur, RE, Ragland, JD, Gur, RC (2000). Working memory constrains abstraction in schizophrenia. Biological Psychiatry 47, 3442.CrossRefGoogle ScholarPubMed
*Gold, JM, Carpenter, C, Randolph, C, Goldberg, TE, Weinberger, DR (1997). Auditory working memory and Wisconsin Card Sorting Test performance in schizophrenia. Archives of General Psychiatry 54, 159165.CrossRefGoogle ScholarPubMed
*Gold, JM, Rehkemper, G, Binks, SW 3rd, Carpenter, CJ, Fleming, K, Goldberg, TE, Weinberger, DR (2000). Learning and forgetting in schizophrenia. Journal of Abnormal Psychology 109, 534538.CrossRefGoogle ScholarPubMed
*Goldberg, TE, Aloia, MS, Gourovitch, ML, Missar, D, Pickar, D, Weinberger, DR (1998). Cognitive substrates of thought disorder. I. The semantic system. American Journal of Psychiatry 155, 16711676.CrossRefGoogle ScholarPubMed
*Goldberg, TE, Torrey, EF, Gold, JM, Bigelow, LB, Ragland, RD, Taylor, E, Weinberger, DR (1995). Genetic risk of neuropsychological impairment in schizophrenia: a study of monozygotic twins discordant and concordant for the disorder. Schizophrenia Research 17, 7784.CrossRefGoogle ScholarPubMed
Goldman-Rakic, PS (1994). Working memory dysfunction in schizophrenia. Journal of Neuropsychiatry and Clinical Neurosciences 6, 348357.Google ScholarPubMed
*Gorissen, M, Sanz, JC, Schmand, B (2005). Effort and cognition in schizophrenia patients. Schizophrenia Research 78, 199208.CrossRefGoogle ScholarPubMed
*Granholm, E, Morris, SK, Sarkin, AJ, Asarnaow, RF, Jeste, DV (1997). Pupillary responses index overload of working memory resources in schizophrenia. Journal of Abnormal Psychology 106, 458467.CrossRefGoogle ScholarPubMed
*Gras-Vincendon, A, Danion, JM, Grange, D, Bilik, M, Willard-Schroeder, D, Sichel, JP, Singer, L (1994). Explicit memory, repetition priming and cognitive skill learning in schizophrenia. Schizophrenia Research 13, 117126.CrossRefGoogle ScholarPubMed
*Green, M, Walker, E (1985). Neuropsychological performance and positive and negative symptoms in schizophrenia. Journal of Abnormal Psychology 94, 460469.CrossRefGoogle ScholarPubMed
*Green, M, Walker, E (1986). Attentional performance in positive- and negative-symptom schizophrenia. Journal of Nervous and Mental Disease 174, 208213.CrossRefGoogle ScholarPubMed
Green, MF, Nuechterlein, KH (1999). Should schizophrenia be treated as a neurocognitive disorder? Schizophrenia Bulletin 25, 309319.CrossRefGoogle ScholarPubMed
*Gruzelier, J, Seymour, K, Wilson, L, Jolley, A, Hirsch, S (1988). Impairments on neuropsychologic tests of temporohippocampal and frontohippocampal functions and word fluency in remitting schizophrenia and affective disorders. Archives of General Psychiatry 45, 623629.CrossRefGoogle ScholarPubMed
*Gruzelier, JH, Wilson, L, Liddiard, D, Peters, E, Pusavat, L (1999). Cognitive asymmetry patterns in schizophrenia: active and withdrawn syndromes and sex differences as moderators. Schizophrenia Bulletin 25, 349362.CrossRefGoogle ScholarPubMed
*Gur, RE, Jaggi, JL, Shtasel, DL, Ragland, JD, Gur, RC (1994). Cerebral blood flow in schizophrenia: effects of memory processing on regional activation. Biological Psychiatry 35, 315.CrossRefGoogle ScholarPubMed
*Hagger, C, Buckley, P, Kenny, JT, Friedman, L, Ubogy, D, Meltzer, HY (1993). Improvement in cognitive functions and psychiatric symptoms in treatment-refractory schizophrenic patients receiving clozapine. Biological Psychiatry 34, 702712.CrossRefGoogle ScholarPubMed
*Harvey, PD, Earle-Boyer, EA, Levinson, JC (1988). Cognitive deficits and thought disorder: a retest study. Schizophrenia Bulletin 14, 5766.CrossRefGoogle ScholarPubMed
*Harvey, PD, Earle-Boyer, EA, Wielgus, MS, Levinson, JC (1986). Encoding, memory, and thought disorder in schizophrenia and mania. Schizophrenia Bulletin 12, 252261.CrossRefGoogle ScholarPubMed
*Harvey, PD, Pedley, M (1989). Auditory and visual distractibility in schizophrenia: clinical and medication status correlations. Schizophrenia Research 2, 295300.CrossRefGoogle ScholarPubMed
*Harvey, PD, Serper, MR (1990). Linguistic and cognitive failures in schizophrenia: a multivariate analysis. Journal of Nervous and Mental Disease 178, 487494.CrossRefGoogle ScholarPubMed
Hedges, L, Olkin, I (1985). Statistical Methods for Meta-Analysis. Academic Press: London.Google Scholar
Heinrichs, RW, Zakzanis, KK (1998). Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. Neuropsychology 12, 426445.CrossRefGoogle ScholarPubMed
Higgins, JP, Thompson, SG, Deeks, JJ, Altman, DG (2003). Measuring inconsistency in meta-analyses. British Medical Journal 327, 557560.CrossRefGoogle ScholarPubMed
*Hill, SK, Beers, SR, Kmiec, JA, Keshavan, MS, Sweeney, JA (2004). Impairment of verbal memory and learning in antipsychotic-naive patients with first-episode schizophrenia. Schizophrenia Research 68, 127136.CrossRefGoogle ScholarPubMed
*Hill, SK, Schuepbach, D, Herbener, ES, Keshavan, MS, Sweeney, JA (2004). Pretreatment and longitudinal studies of neuropsychological deficits in antipsychotic-naive patients with schizophrenia. Schizophrenia Research 68, 4963.CrossRefGoogle ScholarPubMed
*Ho, BC, Wassink, TH, O'Leary, DS, Sheffield, VC, Andreasen, NC (2005). Catechol-O-methyl transferase Val158Met gene polymorphism in schizophrenia: working memory, frontal lobe MRI morphology and frontal cerebral blood flow. Molecular Psychiatry 10, 287298.CrossRefGoogle ScholarPubMed
*Hoff, AL, Riordan, H, O'Donnell, DW, Morris, L, DeLisi, LE (1992). Neuropsychological functioning of first-episode schizophreniform patients. American Journal of Psychiatry 149, 898903.Google ScholarPubMed
*Hoff, AL, Wieneke, M, Faustman, WO, Horon, R, Sakuma, M, Blankfeld, H, Espinoza, S, DeLisi, LE (1998). Sex differences in neuropsychological functioning of first-episode and chronically ill schizophrenic patients. American Journal of Psychiatry 155, 14371439.CrossRefGoogle ScholarPubMed
*Hoffman, RE, Rapaport, J, Mazure, CM, Quinlan, DM (1999). Selective speech perception alterations in schizophrenia patients reporting hallucinated ‘voices’. American Journal of Psychiatry 156, 393399.CrossRefGoogle ScholarPubMed
*Holthausen, EA, Wiersma, D, Sitskoorn, MM, Dingemans, PM, Schene, AH, van den Bosch, RJ (2003). Long-term memory deficits in schizophrenia: primary or secondary dysfunction? Neuropsychology 17, 539547.CrossRefGoogle ScholarPubMed
*Hsieh, MH, Liu, K, Liu, SK, Chiu, MJ, Hwu, HG, Chen, ACN (2004). Memory impairment and auditory evoked potential gating deficit in schizophrenia. Psychiatry Research: Neuroimaging 130, 161169.CrossRefGoogle ScholarPubMed
*Hughes, C, Kumari, V, Das, M, Zachariah, E, Ettinger, U, Sumich, A, Sharma, T (2005). Cognitive functioning in siblings discordant for schizophrenia. Acta Psychiatrica Scandinavica 111, 185192.CrossRefGoogle ScholarPubMed
*Hughes, C, Kumari, V, Soni, W, Das, M, Binneman, B, Drozd, S, O'Neil, S, Mathew, V, Sharma, T (2003). Longitudinal study of symptoms and cognitive function in chronic schizophrenia. Schizophrenia Research 59, 137146.CrossRefGoogle ScholarPubMed
*Hutton, SB, Huddy, V, Barnes, TR, Robbins, TW, Crawford, TJ, Kennard, C, Joyce, EM (2004). The relationship between antisaccades, smooth pursuit, and executive dysfunction in first-episode schizophrenia. Biological Psychiatry 56, 553559.CrossRefGoogle ScholarPubMed
*Ismail, B, Cantor-Graae, E, McNeil, TF (2000). Minor physical anomalies in schizophrenia: cognitive, neurological and other clinical correlates. Journal of Psychiatric Research 34, 4556.CrossRefGoogle ScholarPubMed
*Johnstone, EC, Crow, TJ, Frith, CD, Stevens, M, Kreel, L, Husband, J (1978). The dementia of dementia praecox. Acta Psychiatrica Scandinavica 57, 305324.CrossRefGoogle ScholarPubMed
*Joyce, E, Hutton, S, Mutsatsa, S, Gibbins, H, Webb, E, Paul, S, Robbins, T, Barnes, T (2002). Executive dysfunction in first-episode schizophrenia and relationship to duration of untreated psychosis: the West London Study. British Journal of Psychiatry 181 (Suppl. 43), s38s44.CrossRefGoogle Scholar
*Joyce, EM, Hutton, SB, Mutsatsa, SH, Barnes, TRE (2005). Cognitive heterogeneity in first-episode schizophrenia. British Journal of Psychiatry 187, 516522.CrossRefGoogle ScholarPubMed
Kay, SR, Fiszbein, A, Opler, LA (1987). The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophrenia Bulletin 13, 261276.CrossRefGoogle ScholarPubMed
*Kemali, D, Maj, M, Galderisi, S, Ariano, MG, Cesarelli, M, Milici, N, Salvati, A, Valente, A, Volpe, M (1985). Clinical and neuropsychological correlates of cerebral ventricular enlargement in schizophrenia. Journal of Psychiatric Research 19, 587596.CrossRefGoogle ScholarPubMed
*Kemali, D, Maj, M, Galderisi, S, Monteleone, P, Mucci, A (1987). Conditional associative learning in drug-free schizophrenic patients. Neuropsychobiology 17, 3034.CrossRefGoogle ScholarPubMed
*Kenny, JT, Meltzer, HY (1991). Attention and higher cortical functions in schizophrenia. Journal of Neuropsychiatry and Clinical Neurosciences 3, 269275.Google ScholarPubMed
*Keri, S, Nagy, O, Kelemen, O, Myers, CE, Gluck, MA (2005). Dissociation between medial temporal lobe and basal ganglia memory systems in schizophrenia. Schizophrenia Research 77, 321328.CrossRefGoogle ScholarPubMed
*Kiefer, M, Apel, A, Weisbrod, M (2002). Arithmetic fact retrieval and working memory in schizophrenia. Schizophrenia Research 53, 219227.CrossRefGoogle ScholarPubMed
*Killian, GA, Holzman, PS, Davis, JM, Gibbons, R (1984). Effects of psychotropic medication on selected cognitive and perceptual measures. Journal of Abnormal Psychology 93, 5870.CrossRefGoogle ScholarPubMed
*Kim, J, Glahn, DC, Nuechterlein, KH, Cannon, TD (2004). Maintenance and manipulation of information in schizophrenia: further evidence for impairment in the central executive component of working memory. Schizophrenia Research 68, 173187.CrossRefGoogle ScholarPubMed
*Knoblich, G, Stottmeister, F, Kircher, T (2004). Self-monitoring in patients with schizophrenia. Psychological Medicine 34, 15611569.CrossRefGoogle ScholarPubMed
*Kopelowicz, A, Liberman, RP, Ventura, J, Zarate, R, Mintz, J (2005). Neurocognitive correlates of recovery from schizophrenia. Psychological Medicine 35, 11651173.CrossRefGoogle ScholarPubMed
*Krabbendam, L, Honig, A, Wiersma, J, Vuurman, EFPM, Hofman, PAM, Derix, MMA, Nolen, WA, Jolles, J (2000). Cognitive dysfunctions and white matter lesions in patients with bipolar disorder in remission. Acta Psychiatrica Scandinavica 101, 274280.CrossRefGoogle ScholarPubMed
*Kravariti, E, Morris, RG, Rabe-Hesketh, S, Murray, RM, Frangou, S (2003). The Maudsley Early-Onset Schizophrenia Study: cognitive function in adolescent-onset schizophrenia. Schizophrenia Research 65, 95103.CrossRefGoogle ScholarPubMed
*Kwapil, TR, Chapman, LJ, Chapman, JP (1992). Monaural and binaural story recall by schizophrenic subjects. Journal of Abnormal Psychology 101, 709716.CrossRefGoogle ScholarPubMed
*Landrø, NI, Ørbeck, AL, Rund, BR (1993). Memory functioning in chronic and non-chronic schizophrenics, affectively disturbed patients and normal controls. Schizophrenia Research 10, 8592.CrossRefGoogle ScholarPubMed
*Landrø, NI, Pape-Ellefsen, E, Hagland, KO, Odland, T (2001). Memory deficits in young schizophrenics with normal general intellectual function. Scandinavian Journal of Psychology 42, 459466.CrossRefGoogle ScholarPubMed
Lee, J, Park, S (2005). Working memory impairments in schizophrenia: a meta-analysis. Journal of Abnormal Psychology 114, 599611.CrossRefGoogle ScholarPubMed
Lezak, MD (1995). Neuropsychological Assessment, 3rd edn. Oxford University Press: New York.Google Scholar
*Mahurin, RK, Velligan, DI, Miller, AL (1998). Executive-frontal lobe cognitive dysfunction in schizophrenia: a symptom subtype analysis. Psychiatry Research 79, 139149.CrossRefGoogle ScholarPubMed
*McCreadie, RG, Latha, S, Thara, R, Padmavathi, R, Ayankaran, JR (1997). Poor memory, negative symptoms and abnormal movements in never-treated Indian patients with schizophrenia. British Journal of Psychiatry 171, 360363.CrossRefGoogle ScholarPubMed
McKenna, PJ, Tamlyn, D, Lund, CE, Mortimer, AM, Hammond, S, Baddeley, AD (1990). Amnesic syndrome in schizophrenia. Psychological Medicine 20, 967972.CrossRefGoogle ScholarPubMed
*Mellers, JDC, Toone, BK, Lishman, WA (2000). A neuropsychological comparison of schizophrenia and schizophrenia-like psychosis of epilepsy. Psychological Medicine 30, 325335.CrossRefGoogle ScholarPubMed
*Menon, R, Sen-Mazumdar, DP, Menon, DK (1976). A study of retroactive inhibition in short-term memory. Indian Journal of Clinical Psychology 3, 7378.Google Scholar
Mohs, RC (1999). Cognition in schizophrenia: natural history, assessment, and clinical importance. Neuropsychopharmacology 21 (Suppl. 2), s203s210.CrossRefGoogle Scholar
*Morice, R (1990). Cognitive inflexibility and pre-frontal dysfunction in schizophrenia and mania. British Journal of Psychiatry 157, 5054.CrossRefGoogle ScholarPubMed
*Morice, R, Delahunty, A (1996). Frontal/executive impairments in schizophrenia. Schizophrenia Bulletin 22, 125137.CrossRefGoogle ScholarPubMed
*Moritz, S, Andresen, B, Perro, C, Schickel, M, Krausz, M, Naber, D, Aderholt, V, Basdekis, R, Briken, P, Gottwalz, E, Haasen, C, Karow, A, Lambert, M, Nika, L, Schafer, I, Yagdiran, O (2002). Neurocognitive performance in first-episode and chronic schizophrenic patients. European Archives of Psychiatry and Clinical Neuroscience 252, 3337.CrossRefGoogle ScholarPubMed
*Moritz, S, Birkner, C, Kloss, M, Jahn, H, Hand, I, Haasen, C, Krausz, M (2002). Executive functioning in obsessive-compulsive disorder, unipolar depression, and schizophrenia. Archives of Clinical Neuropsychology 17, 477483.Google ScholarPubMed
*Moritz, S, Heeren, D, Andresen, B, Krausz, M (2001). An analysis of the specificity and the syndromal correlates of verbal memory impairments in schizophrenia. Psychiatry Research 101, 2331.CrossRefGoogle ScholarPubMed
*Morris, SK, Granholm, E, Sarkin, AJ, Jeste, DV (1997). Effects of schizophrenia and aging on pupillographic measures of working memory. Schizophrenia Research 27, 119128.CrossRefGoogle ScholarPubMed
*Morrison-Stewart, SL, Williamson, PC, Corning, WC, Kutcher, SP, Snow, WG, Merskey, H (1992). Frontal and non-frontal lobe neuropsychological test performance and clinical symptomatology in schizophrenia. Psychological Medicine 22, 353359.CrossRefGoogle ScholarPubMed
*Müller, U, Werheid, K, Hammerstein, E, Jungmann, S, Becker, T (2005). Prefrontal cognitive deficits in patients with schizophrenia treated with atypical or conventional antipsychotics. European Psychiatry 20, 7073.CrossRefGoogle ScholarPubMed
*Nathaniel-James, DA, Brown, R, Ron, MA (1996). Memory impairment in schizophrenia: its relationship to executive function. Schizophrenia Research 21, 8596.CrossRefGoogle ScholarPubMed
*Nathaniel-James, DA, Brown, RG, Maier, M, Mellers, J, Toone, B, Ron, MA (2004). Cognitive abnormalities in schizophrenia and schizophrenia-like psychosis of epilepsy. Journal of Neuropsychiatry and Clinical Neurosciences 16, 472479.CrossRefGoogle ScholarPubMed
*Nestor, PG, Akdag, SJ, O'Donnell, BF, Niznikiewicz, M, Law, S, Shenton, ME, McCarley, RW (1998). Word recall in schizophrenia: a connectionist model. American Journal of Psychiatry 155, 16851690.CrossRefGoogle ScholarPubMed
*Newcomer, JW, Craft, S, Fucetola, R, Moldin, SO, Selke, G, Paras, L, Miller, R (1999). Glucose-induced increase in memory performance in patients with schizophrenia. Schizophrenia Bulletin 25, 321335.CrossRefGoogle ScholarPubMed
*Nienow, TM, Docherty, NM (1992). Internal source monitoring and thought disorder in schizophrenia. Journal of Nervous and Mental Disease 192, 696700.CrossRefGoogle Scholar
Nuechterlein, KH, Dawson, ME (1984). Information processing and attentional functioning in the developmental course of schizophrenic disorders. Schizophrenia Bulletin 10, 160203.CrossRefGoogle ScholarPubMed
*Nuyen, J, Sitskoorn, MM, Cahn, W, Kahn, RS (2005). Verbal memory in first-episode schizophrenia: heterogeneity in performance? Journal of the International Neuropsychological Society 11, 152162.CrossRefGoogle ScholarPubMed
*O'Carroll, RE, Murray, C, Austin, MP, Ebmeier, KP, Goodwin, GM, Dunan, J (1993). Proactive interference and the neuropsychology of schizophrenia. British Journal of Clinical Psychology 32, 353356.CrossRefGoogle ScholarPubMed
Oltmanns, TF (1978). Selective attention in schizophrenic and manic psychoses: the effect of distraction on information processing. Journal of Abnormal Psychology 87, 212225.CrossRefGoogle ScholarPubMed
*Onitsuka, T, Shenton, ME, Kasai, K, Nestor, PG, Toner, SK, Kikinis, R, Jolesz, FA, McCarley, RW (2003). Fusiform gyrus volume reduction and facial recognition in chronic schizophrenia. Archives of General Psychiatry 60, 349355.CrossRefGoogle ScholarPubMed
*Otteson, JP, Holzman, PS (1976). Cognitive controls and psychopathology. Journal of Abnormal Psychology 85, 125139.CrossRefGoogle ScholarPubMed
*Pantelis, C, Barnes, TRE, Nelson, HE, Tanner, S, Weatherley, L, Owen, AM, Robbins, TW (1997). Frontal-striatal cognitive deficits in patients with chronic schizophrenia. Brain 120, 18231843.CrossRefGoogle ScholarPubMed
*Papageorgiou, C, Lykouras, L, Alevizos, B, Ventouras, E, Mourtzouchou, P, Uzunoglu, N, Christodoulou, GN, Rabavilas, A (2005). Psychophysiological differences in schizophrenics with and without delusional misidentification syndromes: a P300 study. Progress in Neuro-Psychopharmacology and Biological Psychiatry 29, 593601.CrossRefGoogle ScholarPubMed
*Papageorgiou, C, Oulis, P, Vasios, C, Matsopoulos, GK, Uzunoglu, N, Rabavilas, A, Christodoulou, GN (2003). Do atypical antipsychotics fail to exert cognitive sparing effects? Neuroreport 14, 505509.CrossRefGoogle ScholarPubMed
*Park, S, Holzman, PS (1992). Schizophrenics show spatial working memory deficits. Archives of General Psychiatry 49, 975982.CrossRefGoogle ScholarPubMed
*Perry, W, Heaton, RK, Potterat, E, Roebuck, T, Minassian, A, Braff, DL (2001). Working memory in schizophrenia: transient ‘online’ storage versus executive functioning. Schizophrenia Bulletin 27, 157176.CrossRefGoogle ScholarPubMed
*Pirkola, T, Tuulio-Henriksson, A, Glahn, D, Kieseppä, T, Haukka, J, Kaprio, J, Lönnqvist, J, Cannon, TD (2005). Spatial working memory function in twins with schizophrenia and bipolar disorder. Biological Psychiatry 58, 930936.CrossRefGoogle ScholarPubMed
*Pukrop, R, Matuschek, E, Ruhrmann, S, Brockhaus-Dumke, A, Tendolkar, I, Bertsch, A, Klosterkötter, J (2003). Dimensions of working memory dysfunction in schizophrenia. Schizophrenia Research 62, 259268.CrossRefGoogle ScholarPubMed
*Radant, AD, Claypoole, K, Wingerson, DK, Cowley, DS, Roy-Byrne, PP (1997). Relationships between neuropsychological and oculomotor measures in schizophrenia patients and normal controls. Biological Psychiatry 42, 797805.CrossRefGoogle ScholarPubMed
*Ragland, JD, Gur, RC, Glahn, DC, Censits, DM, Smith, RJ, Lazarev, MG, Alavi, A, Gur, RE (1998). Frontotemporal cerebral blood flow change during executive and declarative memory tasks in schizophrenia: a positron emission tomography study. Neuropsychology 12, 399413.CrossRefGoogle ScholarPubMed
Repovs, G, Baddeley, A (2006). The multi-component model of working memory: explorations in experimental cognitive psychology. Neuroscience 139, 521.CrossRefGoogle ScholarPubMed
*Riley, EM, McGovern, D, Mockler, D, Doku, VCK, O'Ceallaigh, S, Fannon, DG, Tennakoon, L, Santamaria, M, Soni, W, Morris, RG, Sharma, T (2000). Neuropsychological functioning in first-episode psychosis: evidence of specific deficits. Schizophrenia Research 43, 4755.CrossRefGoogle ScholarPubMed
*Rizzo, L, Danion, JM, van der Linden, M, Grangé, D, Rohmer, JG (1996). Impairment of memory for spatial context in schizophrenia. Neuropsychology 10, 376384.CrossRefGoogle Scholar
*Robert, PH, Migneco, V, Chaix, I, Berthet, L, Kazes, M, Danion, JM, Baudu, C, Darcourt, G (1997). Use of a sequencing task designed to stress the supervisory system in schizophrenic subjects. Psychological Medicine 27, 12871294.CrossRefGoogle ScholarPubMed
*Rodríguez-Sánchez, JM, Crespo-Facorro, B, Iglesias, RP, Bosch, CG, Álvarez, M, Llorca, J, Vázquez-Barquero, JL (2005). Prefrontal cognitive functions in stabilized first-episode patients with schizophrenia spectrum disorders: a dissociation between dorsolateral and orbitofrontal functioning. Schizophrenia Research 77, 279288.CrossRefGoogle ScholarPubMed
*Rollnik, JD, Borsutzky, M, Huber, TJ, Mogk, H, Seifert, J, Emrich, HM, Schneider, U (2002). Short-term cognitive improvement in schizophrenics treated with typical and atypical neuroleptics. Neuropsychobiology 45, 7480.CrossRefGoogle ScholarPubMed
*Rosenberg, S, Weber, N, Crocq, MA, Duval, F, Macher, JP (1990). Random number generation by normal, alcoholic and schizophrenic subjects. Psychological Medicine 20, 953960.CrossRefGoogle ScholarPubMed
*Rossell, SL, Coakes, J, Shapleske, J, Woodruff, PWR, David, AS (2003). Insight: its relationship with cognitive function, brain volume and symptoms in schizophrenia. Psychological Medicine 33, 111119.CrossRefGoogle ScholarPubMed
*Roxborough, H, Muir, WJ, Blackwood, DHR, Walker, MT, Blackburn, IM (1993). Neuropsychological and P300 abnormalities in schizophrenics and their relatives. Psychological Medicine 23, 305314.CrossRefGoogle ScholarPubMed
*Rund, BR (1983). The effect of distraction on focal attention in paranoid and non-paranoid schizophrenic patients compared to normals and non-psychotic psychiatric patients. Journal of Psychiatric Research 17, 241250.CrossRefGoogle Scholar
*Rund, BR, Landrø, NI, Ørbeck, AL (1997). Stability in cognitive dysfunctions in schizophrenic patients. Psychiatry Research 69, 131141.CrossRefGoogle ScholarPubMed
*Russell, PN, Bannatyne, PA, Smith, JF (1975). Associative strength as a mode of organization in recall and recognition: a comparison of schizophrenics and normals. Journal of Abnormal Psychology 84, 122128.CrossRefGoogle ScholarPubMed
*Russell, PN, Beekhuis, ME (1976). Organization in memory: a comparison of psychotics and normals. Journal of Abnormal Psychology 85, 527534.CrossRefGoogle ScholarPubMed
*Sacco, KA, Termine, A, Seyal, A, Dudas, MM, Vessicchio, JC, Krishnan-Sarin, S, Jatlow, PI, Wexler, BE, George, TP (2005). Effects of cigarette smoking on spatial working memory and attentional deficits in schizophrenia: involvement of nicotinic receptor mechanisms. Archives of General Psychiatry 62, 649659.CrossRefGoogle ScholarPubMed
*Salamé, P, Danion, JM, Peretti, S, Cuervo, C (1998). The state of functioning of working memory in schizophrenia. Schizophrenia Research 30, 1129.CrossRefGoogle ScholarPubMed
*Scarone, S, Abbruzzese, M, Gambini, O (1993). Monaural and binaural recall of stories in schizophrenia: neurofunctional hypotheses. Neuropsychiatry, Neuropsychology and Behavioral Neurology 6, 154158.Google Scholar
*Seidman, LJ, Kremen, WS, Koren, D, Faraone, SV, Goldstein, JM, Tsuang, MT (2002). A comparative profile analysis of neuropsychological functioning in patients with schizophrenia and bipolar psychoses. Schizophrenia Research 53, 3144.CrossRefGoogle ScholarPubMed
*Seidman, LJ, Lanca, M, Kremen, WS, Faraone, SV, Tsuang, MT (2003). Organizational and visual memory deficits in schizophrenia and bipolar psychoses using the Rey-Osterrieth complex figure: effects of duration of illness. Journal of Clinical and Experimental Neuropsychology 25, 949964.CrossRefGoogle ScholarPubMed
*Seidman, LJ, Stone, WS, Jones, R, Harrison, RH, Mirsky, AF (1998). Comparative effects of schizophrenia and temporal lobe epilepsy on memory. Journal of the International Neuropsychological Society 4, 342352.CrossRefGoogle ScholarPubMed
*Semkovska, M, Bédard, MA, Godbout, L, Limoge, F, Stip, E (2004). Assessment of executive dysfunction during activities of daily living in schizophrenia. Schizophrenia Research 69, 289300.CrossRefGoogle ScholarPubMed
*Semkovska, M, Stip, E, Godbout, L, Paquet, F, Bédard, MA (2002). Behavioral disorganization in schizophrenia during a daily activity: the kitchen behavioral scoring scale. Brain and Cognition 48, 546553.Google ScholarPubMed
*Shedlack, K, Lee, G, Sakuma, M, Xie, SH, Kushner, M, Pepple, J, Finer, DL, Hoff, AL, DeLisi, LE (1997). Language processing and memory in ill and well siblings from multiplex families affected with schizophrenia. Schizophrenia Research 25, 4352.CrossRefGoogle ScholarPubMed
*Shinba, T, Shinozaki, T, Kariya, N, Ebata, K (2000). Random number generation deficit in schizophrenia characterized by oral vs written response modes. Perceptual and Motor Skills 91, 10911105.CrossRefGoogle ScholarPubMed
*Shoqeirat, MA, Mayes, AR (1988). Spatiotemporal memory and rate of forgetting in acute schizophrenics. Psychological Medicine 18, 843853.CrossRefGoogle ScholarPubMed
*Sitskoorn, MM, Nuyen, J, Appels, MCM, van der Wee, NJA, Kahn, RS (2002). Release from proactive inhibition in schizophrenia and its potential as a genotypic marker. Journal of Clinical and Experimental Neuropsychology 24, 6781.CrossRefGoogle ScholarPubMed
*Sonobe, N (1993). Eye movements, verbal material recall and negative symptoms in chronic schizophrenia. International Journal of Psychophysiology 15, 7378.CrossRefGoogle ScholarPubMed
*Stefánsson, SB, Jónsdóttir, TJ (1996). Auditory event-related potentials, auditory digit span, and clinical symptoms in chronic schizophrenic men on neuroleptic medication. Biological Psychiatry 40, 1927.CrossRefGoogle ScholarPubMed
*Stirling, JD, Hellewell, JS, Hewitt, J (1997). Verbal memory impairment in schizophrenia: no sparing of short-term recall. Schizophrenia Research 25, 8595.CrossRefGoogle ScholarPubMed
*Stirling, JD, Hellewell, JS, Quraishi, N (1998). Self-monitoring dysfunction and the schizophrenic symptoms of alien control. Psychological Medicine 28, 675683.CrossRefGoogle ScholarPubMed
*Stone, M, Gabrieli, JDE, Stebbins, GT, Sullivan, EV (1998). Working and strategic memory deficits in schizophrenia. Neuropsychology 12, 278288.CrossRefGoogle ScholarPubMed
*Torres, IJ, Flashman, LA, O'Leary, DS, Andreasen, NC (2001). Effects of retroactive and proactive interference on word list recall in schizophrenia. Journal of the International Neuropsychological Society 7, 481490.CrossRefGoogle ScholarPubMed
*Toulopoulou, T, Morris, RG, Rabe-Hesketh, S, Murray, RM (2003). Selectivity of verbal memory deficit in schizophrenic patients and their relatives. American Journal of Medical Genetics, Part B (Neuropsychiatric Genetics) 116, 17.CrossRefGoogle Scholar
*Traupmann, KL (1975). Effects of categorization and imagery on recognition and recall by process and reactive schizophrenics. Journal of Abnormal Psychology 84, 307314.CrossRefGoogle ScholarPubMed
*van Beilen, M, Pijnenborg, M, van Zomeren, EH, van den Bosch, RJ, Withaar, FK, Bouma, A (2004). What is measured by verbal fluency tests in schizophrenia? Schizophrenia Research 69, 267276.CrossRefGoogle ScholarPubMed
*van Beilen, M, van Zomeren, EH, van den Bosch, RJ, Withaar, FK, Bouma, A (2005). Measuring the executive functions in schizophrenia: the voluntary allocation of effort. Journal of Psychiatric Research 39, 585593.CrossRefGoogle ScholarPubMed
*van Oostrom, I, Dollfus, S, Brazo, P, Abadie, P, Halbecq, I, Théry, S, Marié, RM (2003). Verbal learning and memory in schizophrenic and Parkinson's disease patients. Psychiatry Research 117, 2534.CrossRefGoogle ScholarPubMed
*Wagman, AMI, Heinrichs, DW, Carpenter, WT (1987). Deficit and nondeficit forms of schizophrenia: neuropsychological evaluation. Psychiatry Research 22, 319330.CrossRefGoogle ScholarPubMed
*Watanabe, A, Kato, T (2004). Cerebrovascular response to cognitive tasks in patients with schizophrenia measured by near-infrared spectroscopy. Schizophrenia Bulletin 30, 435444.CrossRefGoogle ScholarPubMed
*Watson, CG, Plemel, D (1981). A test of the interference and normal associate bias theories of schizophrenic cognitive deficit. Journal of Nervous and Mental Disease 169, 185190.CrossRefGoogle ScholarPubMed
Wechsler, D (1955). Wechsler Adult Intelligence Scale. The Psychological Corporation: New York.Google Scholar
Wechsler, D (1981). Wechsler Adult Intelligence Scale – Revised. The Psychological Corporation: New York.Google Scholar
Weinberger, DR, Berman, KF, Zec, RF (1986). Physiological dysfunction of dorsolateral prefrontal cortex in schizophrenia. 1. Regional cerebral blood flow evidence. Archives of General Psychiatry 43, 114125.CrossRefGoogle Scholar
*Weiss, AP, Dodson, CS, Goff, DC, Schacter, DL, Heckers, S (2002). Intact suppression of increased false recognition in schizophrenia. American Journal of Psychiatry 159, 15061513.CrossRefGoogle ScholarPubMed
*Whittaker, JF, Deakin, JF, Tomenson, B (2001). Face processing in schizophrenia: defining the deficit. Psychological Medicine 31, 499507.CrossRefGoogle ScholarPubMed
*Wittorf, A, Klingberg, S, Wiedemann, G (2004). Secondary verbal memory: a potential endophenotype of schizophrenia. Journal of Psychiatric Research 38, 601612.CrossRefGoogle ScholarPubMed
*Wood, FB, Flowers, DL (1990). Hypofrontal vs. hypo-Sylvian blood flow in schizophrenia. Schizophrenia Bulletin 16, 413424.CrossRefGoogle ScholarPubMed
Woods, SW (2003). Chlorpromazine equivalent doses for the newer atypical antipsychotics. Journal of Clinical Psychiatry 64, 663667.CrossRefGoogle ScholarPubMed
*Woonings, FMJ, Appelo, MT, Kluiter, H, Slooff, CJ, van den Bosch, RJ (2003). Learning (potential) and social functioning in schizophrenia. Schizophrenia Research 59, 287296.CrossRefGoogle ScholarPubMed
*Zuffante, P, Leonard, CM, Kuldau, JM, Bauer, RM, Doty, EG, Bilder, RM (2001). Working memory deficits in schizophrenia are not necessarily specific or associated with MRI-based estimates of area 46 volumes. Psychiatry Research: Neuroimaging 108, 187209.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Results of meta-analyses of tests of phonological working memory

Figure 1

Fig. 1. Forest plot of digit span backwards meta-analysis.

Figure 2

Fig. 2. Forest plot of letter number span meta-analysis.

Figure 3

Fig. 3. Forest plot of spatial span forwards meta-analysis.

Figure 4

Fig. 4. Forest plot of spatial span backwards meta-analysis.

Figure 5

Table 2. Results of meta-analyses of tests of visuospatial working memory

Figure 6

Fig. 5. Forest plot of the Cambridge Neuropsychological Test Automated Battery (CANTAB) spatial working memory strategy task.

Figure 7

Table 3. Results of meta-analyses of tests of executive working memory