Hostname: page-component-745bb68f8f-d8cs5 Total loading time: 0 Render date: 2025-02-11T08:45:29.879Z Has data issue: false hasContentIssue false

Cognitive rehabilitation in the elderly: A randomized trial to evaluate a new protocol

Published online by Cambridge University Press:  13 December 2006

DONALD T. STUSS
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Psychology, University of Toronto, Ontario, Canada Department of Medicine (Neurology), University of Toronto, Ontario, Canada Department of Medicine (Rehabilitation Sciences), University of Toronto, Ontario, Canada
IAN H. ROBERTSON
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Psychology and Institute of Neuroscience, Trinity College, Dublin, Ireland
FERGUS I.M. CRAIK
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Psychology, University of Toronto, Ontario, Canada
BRIAN LEVINE
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Psychology, University of Toronto, Ontario, Canada Department of Medicine (Neurology), University of Toronto, Ontario, Canada
MICHAEL P. ALEXANDER
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Neurology, Beth Israel Deaconess Medical Center, Boston, Massachusetts
SANDRA BLACK
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Medicine (Neurology), University of Toronto, Ontario, Canada Sunnybrook and Women's College Health Sciences Centre, Toronto, Ontario, Canada
DEIRDRE DAWSON
Affiliation:
Department of Medicine (Rehabilitation Sciences), University of Toronto, Ontario, Canada Kunin-Lunenfeld Applied Research Unit, Baycrest, Toronto, Ontario, Canada Department of Medicine (Occupational Science & Occupational Therapy), University of Toronto, Ontario, Canada
MALCOLM A. BINNS
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada
HEATHER PALMER
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada
MAUREEN DOWNEY-LAMB
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada
GORDON WINOCUR
Affiliation:
Rotman Research Institute, Baycrest, Toronto, Ontario, Canada Department of Psychology, University of Toronto, Ontario, Canada Department of Medicine (Psychiatry), University of Toronto, Ontario, Canada Department of Psychology, Trent University, Peterborough, Canada
Rights & Permissions [Opens in a new window]

Abstract

This study provides an introduction to, and overview of, several papers that resulted from a randomized control trial that evaluated a new cognitive rehabilitation protocol. The program was designed to improve general strategic abilities in ways that would be expressed in a broad range of functional domains. The trial, which was conducted on a sample of older adults who had experienced normal age-related cognitive decline, assessed performance in the following domains: memory, goal management, and psychosocial status. The general rationale for the trial, the overall experimental design, and the approach to statistical analyses that are relevant to each paper are described here. The results for each functional domain are reported in separate papers in this series (JINS, 2007, 13, 120–131.)

Type
REHAB SERIES—INTRODUCTORY PAPER
Copyright
© 2007 The International Neuropsychological Society

INTRODUCTION

With support from the JSF McDonnell Foundation, a team of scientists at the Rotman Research Institute of Baycrest undertook to develop an approach to cognitive rehabilitation that could be effectively applied to individuals who, for various reasons, suffer from memory and memory-related problems. Our objective was to devise a comprehensive program that incorporates scientifically based principles of cognitive function and current thinking about rehabilitation practice. In the series of papers that comprise this special section, we report the first phase of the project—an experimental trial that was conducted on a population of older adults who were experiencing normal cognitive decline.

Many studies have assessed the efficacy of different cognitive interventions in the elderly. A focus has been on training memory and related functions, the typical result suggesting beneficial effects in older adults (e.g., Anschutz et al., 1985; Glisky & Glisky, 1999; Greenberg & Powers, 1987; Kliegl et al., 1989; Stigsdotter Neely & Bäckman, 1993a, 1993b; Yesavage, 1985; Yesavage & Rose, 1983; Zarit et al., 1981). Moreover, there is evidence that benefits from training can be maintained for a considerable period of time beyond training (Stigsdotter Neely & Bäckman, 1993a, 1993b). As an example, Ball and colleagues (2002) completed a large scale study in older adults comparing three different cognitive training interventions (memory, reasoning, and speed of processing) to a no-contact control group. There was content-specific improvement for each training group. As well, with the aid of booster training 11 months after initial training, improved performance was maintained at 2-year follow-up.

Our study extends these efforts in several ways. Our primary emphasis was on improving the use of general strategic abilities, because (as noted below) strategic functioning is particularly vulnerable to the aging process. As well, in some research, there is the suggestion that such abilities are amenable to rehabilitation training (Levine et al., 2000). Because of the variability of the aging process and because of our concern that a narrowly based rehabilitation program would not be effective for everyone (Glisky & Glisky, 1999; Hertzog et al., 1992; Shammi et al., 1998; West et al., 2002), we decided to take a comprehensive and multidimensional approach (see, e.g., Stigsdotter Neely & Bäckman, 1993a, 1993b, 1995). We developed an integrated modular program that provided training in three distinct domains: memory, goal management, and psychosocial function. Finally, because of the progressive nature of cognitive decline in the elderly, and because of the need for shorter interventions in brain-damaged populations, our program was designed to be administered over a relatively short training period.

As part of the overview, we summarize the general rationale for the study, our thinking about cognitive aging, and our approach to promoting recovery of cognitive function. As well, we outline the experimental design used in the trial, general principles and methodology that are common to all papers, and the consistent approach to statistical analysis of data. Details of each module and results of testing in each domain are provided in the respective papers.

The Approach

In developing our program, we adopted scientifically based principles of strategic processing. This theoretical approach was chosen for several reasons (see below), but mainly because of our commitment to the importance of basic research in contributing to evidence-based rehabilitation practice (Levine et al., 2000). Accordingly, we incorporated current thinking about rehabilitation practice, borrowed from various approaches to rehabilitation and drew heavily on previous research (e.g., Flynn & Storandt, 1990; Kramer & Willis, 2002; Verhaeghen et al., 1992). Having reviewed the various approaches, we decided on a small group format in which individuals as a group met weekly in relatively short (3-hr), highly interactive sessions. In addition to providing formal training and encouraging group discussion, a certain amount of time in each session was devoted to informing participants about specific objectives, the underlying rationale, and even scientific evidence that supported our particular approach. To complement our group-oriented approach and, in recognition of the importance of personalizing the rehabilitation process, several one-on-one meetings were held between the group leader and each participant (see below for details). The purpose of these meetings was to set personal goals, discuss progress, and deal with any individual issues that arose over the course of training.

In the rehabilitation literature, there are several reports of improved memory and other cognitive abilities following training (see Cicerone et al., 1996, for a review; Rasmusson et al., 1999; Stigsdotter Neely & Bäckman, 1993a; Storandt, 1992; Yesavage & Rose, 1983). However, because of methodological and design limitations, it is often difficult to attribute benefits solely to the treatment effect (Cicerone et al., 2000, 2005; Levine & Downey-Lamb, 2002; Turner & Levine, 2004). We extended the studies that did use a control group (e.g., Ball et al., 2002; Jobe et al., 2001; Stigsdotter Neely & Bäckman, 1993a, 1993b) by combining a randomized control experimental design with interventions that draw upon the relevant research and theory in the cognitive neuroscience of strategic processes, and rehabilitation practice.

The program, administered over 12 weeks, consisted of three distinct 4-week modules, two developed specifically for the program, and one (Goal Management Training) adapted for inclusion in the program: (1) Memory Skills Training, where participants were shown how to use external and internal strategies for learning, retaining, and recovering information; (2) modified Goal Management Training (GMT; Levine et al., 2000), where the emphasis was on managing goal-directed behavior in “real-life” situations; (3) Psychosocial Training, which was designed to enhance psychological well-being and build participants' confidence in their cognitive abilities.

These three modules were selected for specific reasons. Memory loss is the most common symptom in individuals experiencing cognitive decline, suggesting the need to emphasize memory rehabilitation. Our approach to memory was based on theoretical work that has delineated different types of memory (Craik & Lockhart, 1972; Moscovitch, 1992; Schacter, 1994; Tulving, 1983), and the knowledge that both strategic and more automatic processes required for successful memory performance can be differentiated (Craik & Grady, 2002; Moscovitch & Winocur, 1992). Lesion and imaging research have documented the role of frontal (strategic) and limbic (more automatic) circuits in memory (Alexander et al., 2003; Stuss et al., 1994; Tulving et al., 1996). As well, research involving elderly individuals also provided evidence for the importance of both strategic and more automatic processes in successful memory functioning (Craik & Grady, 2002; Stuss et al., 1996; Winocur et al., 1996). Contrary to other approaches, we did not believe that there was much to be gained by trying to enlarge memory capacity, which is less under conscious control. Rather, our focus was on improving the strategic component of memory functioning, and, overall, providing a more adaptable set of strategic processing tools.

A basic assumption underlying the development of our protocol was that reduced cognitive function in normal old adults and people with brain damage is the combined effect of biological and nonbiological factors, and that environmental/psychosocial factors are critical to maximizing cognitive rehabilitation efforts (Antonucci & Akiyama, 1997; Ben-Yishay & Prigatano, 1990; Prigatano, 1999; Regnier, 1997). There is growing evidence that psychological and social factors, as well as lifestyle-related activities, can interact in important ways to reduce adverse effects of brain dysfunction on cognition (e.g., Dawson et al., 1999; Hultsch et al., 1999; Wilson et al., 2002). This can result in a combination of benefits that include, for example, enhanced brain function (e.g., improved cerebral blood flow, neurogenesis), an improved sense of psychological well-being that is manifested in higher motivation and increased confidence, and an improved ability to attend to and engage cognitive challenges. Accordingly, we adopted a multidimensional approach that, in addition to emphasizing cognitive strategic processes, took into account the importance of optimal psychosocial function for the realization of full cognitive potential.

Our approach to rehabilitation has the additional benefit of addressing a serious limitation of many cognitive rehabilitation programs—the well-established fact that benefits observed on specific tasks in the clinic do not necessarily generalize to other tasks or situations (Turner & Levine, 2004). Assessments in cognitively oriented programs often do not include outcome measures that relate meaningfully to “real-world” performance. This important issue was addressed in part by including the modified version of Goal Management Training (Levine et al., 2000; Robertson, 1996), an approach that emphasizes the enhancement of attentional control to reduce everyday slips, to monitor goal attainment, and to simplify cognitively demanding real-life tasks. As well, our outcome assessment battery included tests specifically designed to assess changes in participants' ability to perform such tasks (see also Cahn-Weiner et al., 2000, 2002). Another measure of the generalizability of training-induced benefits was the inclusion of two tests of verbal fluency in our outcome measures. These tests assessed language function that was not directly targeted for rehabilitation and the results, while not formally reported in the papers in this series, are described in the Overview paper (Winocur et al., 2007a).

Rationale

Theoretical perspectives about cognitive changes with aging provided a framework to test our hypotheses about the importance of strategic processes. One prevalent view is that age-related cognitive changes in different functional areas occur at similar rates, as a result of decreased speed of information processing (Salthouse, 1993) or reduced attentional capacity (Craik & Byrd, 1982) following nonlocalized brain deterioration. The effect is to produce progressive linear deterioration in most human abilities after approximately age 25 (Doppelt & Wallace, 1955; Park & Hedden, 2002; Salthouse, 1988, 1991, 1992; Verhaeghen & Salthouse, 1997). There is considerable evidence for this linear effect of aging—in various cognitive and neuropsychological tests (Park & Hedden, 2002; Salthouse, 1988, 1991); in neurophysiological measures (Picton et al., 1984); in the pattern of recovery after traumatic brain injury (Stuss et al., 2000a); and biologically in reductions in brain weight, brain volume, and blood flow (Colcombe et al., 2003; Jernigan et al., 2001; Raz, 2000). If the changes are related to nonspecific, progressive atrophy, one might indeed hypothesize that cognitive deterioration in old age follows a linear pattern that affects most cognitive processes at the same rate. This might lead to the assumption that interventions could be successful only if they directly targeted the full range of affected cognitive processes, an approach that would have serious practical limitations.

An alternate view is that different abilities decline at different rates (Bäckman et al., 1997; Balota et al., 2000; Moscovitch & Winocur, 1992; Rabbitt et al., 2001; Rypma et al., 2001; Stuss et al., 1996) and that the cognitive abilities most vulnerable in aging, and earliest affected, are those with a substantial strategic (frontal lobe) component (Haug & Eggers, 1991; Moscovitch & Winocur, 1992; Raz, 2000; Stuss et al., 1996; West, 1996). Thus our training emphasized “frontal lobe” strategic processes rather than a general cognitive approach to training. Importantly, from the perspective of cognitive rehabilitation, there is growing evidence that strategic processes in the areas of attention, information processing, and planning, are amenable to retraining (Levine et al., 2000). Moreover, training-induced benefits in these areas are reflected indirectly in improved performance in other areas where a high level of function depends on strategic support. It is also possible, however, that in early stages general atrophy would selectively affect strategic processes. Because we were not certain which strategic processes were important, we did not emphasize any particular strategic mechanism.

Our program is based on the fundamental premise that individuals experiencing cognitive loss need assistance in learning appropriate strategies (regardless of the reasons for deterioration), and also in making the necessary effort to select and implement strategies for the task at hand. We decided to teach multiple strategies to maximize the likelihood of success, despite evidence for fractionation of these abilities (Shallice, 2002; Stuss & Levine, 2002). Our approach focuses on the development of basic and practically oriented strategies for learning, remembering, and problem solving, combined with an explicit emphasis on enhancing psychosocial well-being. With respect to the elderly, a basic assumption is that the capacity for strategic organization and planning, while compromised, is underutilized. On this view, with proper direction and support, older adults are potentially capable of making the necessary efforts directed at selecting and implementing strategies that are appropriate for a great variety of tasks.

Our expectation was that, with insights gained from our multidimensional protocol and the necessary commitment on their part, elderly participants' use of strategies would increase and their general cognitive performance would improve. Importantly, as they become increasingly familiar with the use of various strategies on a day-to-day basis, we anticipated that this essential cognitive operation would be accomplished with reduced effort and incorporated into their daily lives.

The following is a summary of the protocol, along with its essential design and operational features.

METHODS

Participants

A total of 49 older adults (27 women and 22 men; age = 71 to 87 years; M = 78.7; SD = 3.9) participated in the research. Participants' responses on a self-report questionnaire (form available from the corresponding author) determined their eligibility for inclusion in the study.

All selected participants were retired middle class healthy community-dwellers who lived independently and functioned successfully. All had been successful in their professions, or positions in the household. At the time of the study, participants expressed subjective complaints of memory or cognitive dysfunction. However, neither they nor their treating family physicians had considered referral for assessment of dementia. Their subjective problems did not affect their daily functioning.

Their level of normal functioning was confirmed at preassessment by their Mini-Mental State Examination (MMSE) score. Despite their subjective complaints, the participants did not fit the criteria for mild cognitive impairment (Petersen et al., 1999). When an estimate of general intelligence (NART-R) was assessed in relation to memory (Logical Memory), only 2 participants had memory scores that were greater that 1.5 SD different from their IQ scores, and the memory scores of these 2 persons were less than 1.5 SD different from normative data. An additional criterion was fluency in written and spoken English. Our formal assessments confirmed the participants' self-reports of general good health commensurate for their age. There was no history of significant medical, psychiatric, or neurological problems; excessive alcohol use or use of nonprescription drugs; and current use of central nervous system–altering medications.

All participants were competent, were presented with an approved information form, and gave their signature consent for participation. Participants were volunteers from the community at large who were recruited through advertising and word of mouth. Recruitment took place over time due to the practical necessity of administering the protocol to several groups. The volunteers who met inclusion criteria were divided into an Early Training Group (ETG; N = 29) and a Late Training Group (LTG; N = 20). Random assignment to the two groups was qualified by the need to equalize the groups with respect to MMSE (all 25 or higher, groups matched ± 2 points), education (approximately equal numbers within the following grade ranges: grade 8 or lower; 9–10; 11–12; college or higher), sex, and age (all were within the age range of 72–87 years, groups matched ± 3 years). Thus a blocked randomized procedure was used to maintain an equal balance in both groups on these factors. The ETG entered the rehabilitation program shortly after screening; the LTG first acted as a control group for 3 months, and then underwent the protocol (hence “Late” Training Group). In the control procedure, contact was maintained with participants through an individual meeting with the group leader and by telephone. In addition, participants underwent regular testing according to the prescribed schedule. Missed attendance was negligible. On the few occasions that it did occur, participants were able to make up the session by attending another group or through individual contact with the group leader, with the result that they received the full training protocol, including the one-on-one sessions, with exceptions outlined in Figure 1.

CONSORT-type figure illustrating the maximum number of participants at each assessment. The loss of subjects in the Late Training Group (LTG) for Assessments C and D was secondary to a province-wide pandemic (SARS) which closed hospitals and associated buildings for all nonessential personnel (such as research participants), as indicated in the text. ETG = Early Training Group.

Before admission to the program, volunteers were administered the following neuropsychological tests (average time of administration = 1.5 to 2.0 hr) to characterize various aspects of the groups' cognitive function (baseline testing) and provide a screen for cognitive impairment and general psychological status:

  1. Mini-Mental State Examination (MMSE; Folstein et al., 1975): a brief assessment of general functioning that screens for dementia. A score greater than or equal to 24 was required for inclusion;
  2. National Adult Reading Test–Revised (NART-R; Nelson & Willison, 1991): a reading test that provides an estimate of intellectual status. A minimal score of 90 was required for inclusion;
  3. Digit Span (forward and backward; Wechsler, 1987), forward span measures simple attention, with backward span providing a general index of working memory;
  4. Logical Memory (Wechsler, 1987), immediate recall of two short stories;
  5. Judgment of Line Orientation (JLO; Benton et al., 1978), a measure of visual spatial judgment considered primarily sensitive to right parietal lobe functioning;
  6. Wisconsin Card Sorting Test (WCST; Heaton, 1981; administration following the procedure of Stuss et al., 2000b), a measure of concept learning and switching of concepts following feedback. This test is widely held to be sensitive to frontal lobe functioning if comprehension and visual attention are normal (Stuss et al., 2000b). Our version, derived from the original instructions as described by Grant and Berg (1948; see also Milner, 1963) is similar to the standard version as implemented by Heaton (1981), with the exception that all 128 cards are administered, providing a more sensitive measure of loss of set;
  7. Boston Naming Test (BNT; Kaplan et al., 1983), a visual confrontation task of naming of objects;
  8. Beck Anxiety Index (BAI; Beck & Steer, 1990), a self-report index of anxiety symptomatology;
  9. Geriatric Depression Scale (GDS; Brink et al., 1982), a test of depression commonly used in the elderly population.

Means and standard deviations for ETG and LTG for age, years of education, NART-R, and MMSE are listed in Table 1. The general neuropsychological measures served several purposes as an additional screening beyond the self-report of the participants: comparison of equality of groups; comparison of participants to normative data; and additional verification of normal level of functioning (data were examined by a board certified neuropsychologist if there was question of impaired functioning; no subject was rejected on the basis of the general neuropsychological measures). The two groups were comparable in virtually every aspect. There were no differences in age, education, sex, intelligence, or scores on the MMSE. The groups were also comparable in general functioning (no significant group differences between the ETG and LTG on the general neuropsychological battery), with the exception of a solitary significant difference in immediate (but not delayed) recall on Logical Memory Stories in favor of the ETG. This general group equivalence is an important prerequisite for interpreting any group differences secondary to the interventions. In addition, on none of the measures did either group differ more than 1.5 SD from the mean score of the published normative data (see Table 1). The lowest scores were in logical memory, but this finding was considered to reflect their memory complaints. In other words, this was a very representative sample of normal older adults living independently and functioning well in the community, who had noticed changes in their cognitive abilities and who wanted to do something to recover apparently diminished function.

Demographic, neuropsychological screening and normative data summary

The project was approved by the University of Toronto/Baycrest Research Ethics Committee, and followed the Canadian Tri-Council Ethics Guidelines as well as the Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects.

Experimental Design

A within-subject, crossover design was used (see Figure 2). To measure the efficacy of our rehabilitation program, after pre-admission testing, there were four major assessment sessions (each lasting approximately 2.5 to 3.0 hr) identified as Assessments A to D. The group leaders were not involved in the assessment sessions. The complete battery, consisting of experimental neuropsychological, practical task planning, and psychosocial tests, was administered before (Assessment A) and after (Assessment B) the ETG underwent the training protocol. Assessment A indicated whether the two groups were equivalent before training; Assessment B provided a test of the effects of rehabilitation training of the ETG, relative to the LTG whose members performed the control procedure.

Within-subject crossover experimental design with the timeline for the early and late training groups.

After Assessment B, there was a crossover in which the LTG switched from the control condition to rehabilitation training, and the ETG from training to the control condition. Following the completion of training for the LTG, the test battery was administered to both groups again (Assessment C).

Both groups received follow-up testing 6 months after completion of training (Assessment D) to assess long-term benefits of rehabilitation (see Baltes & Willis, 1982). The difference in delay (see Figure 1) between Assessments C and D for the ETG and LTG was necessary to ensure the same delay between the end of training and the long-term follow-up test.

The tests used in Assessments A through D were as follows: Cognitive/Memory: Alpha Span, Brown-Peterson, Hopkins Verbal Learning Test, Logical Stories Memory, Verbal and Semantic Fluency; Goal Management: simulated real-life tasks (organizing car pools, swimming lesson); Psychosocial: Dysexecutive Function Test, Everyday Activities, Locus of Control, Life Orientation Test, and the Memorial University of Newfoundland Scale of Happiness. The descriptions and references for these tests are provided in the corresponding papers. As explained in the specific papers, alternate forms were used, where feasible and appropriate, We decided in favor of understanding the effects of test order rather than counterbalancing because of the relatively limited sample size, common in studies of this type.

In addition, we administered a self-assessment questionnaire (SAQ) at the end of the training program querying how well participants had responded to rehabilitation training. The SAQ consisted of statements, of which 15 were related to the Psychosocial component (e.g., “I am leading a more active lifestyle”): 8 statements to the goal management component (e.g., “I am better at setting goals for myself”), and 7 to the Memory component (e.g., “My memory seems better because I am concentrating more”). Participants were asked to respond to each statement based on how they felt “today as compared to last month,” according to a 4-point scale. The maximum total score was 120, distributed across the three components as follows: Psychosocial, maximum = 60; modified GMT, maximum = 32; Memory, maximum = 28. The SAQ results are summarized in the Overview paper (Winocur et al., 2007a)

The Training Protocol

The program was administered to groups of 5–6 participants, with each group run by an experienced leader who had been trained specifically to lead the sessions. Before the start of the program, individual goals were identified for each participant to establish personal motivation and to ascertain reasons for his/her involvement (Prigatano, 1999). In addition, to ensure engagement and active participation, the group leader met for approximately 1 hr each time with each participant individually over the course of the program (ETG, five times: one before start of program to identify goals, one after the third session of each module, and one at the end of the program to evaluate progress related to goals; LTG, 6 times: because of the delay in starting training, an additional session was held before the start of their training program to see if they made progress on their goals on their own during the control wait period, and to reestablish goals for the actual program).

The entire rehabilitation program spanned 14 weeks and included an introductory seminar, 12 weekly training sessions, and a wrap-up seminar. Test sessions and individual meetings with participants were conducted during this period, as scheduled (see Figure 1). The training program consisted of three distinct modules, each consisting of 4 consecutive weeks. The groups met once per week in 3-hr sessions. The modules were presented in fixed order: Memory Training, modified GMT, and Psychosocial Training. The contents of each module are presented in the papers related to the respective modules. Each training session adhered to a prescribed format and was highly interactive, with the group leader assuming the roles of instructor and facilitator. Most sessions included practical projects related to the theme of the module.

To maximize learning and to generalize the training to home environments, participants were given home assignments of approximately 1 hr in duration, to complete during the week. These assignments were designed to encourage participants to apply strategies and techniques learned in that week's training session to their day-to-day lives. To ensure completion, the home assignments were monitored for each participant in the weekly sessions.

Statistical Analyses

We compared baseline performance between the two groups using analysis of variance to test for possible differences on each of the measures at Assessment A. Because volunteers were assigned to the two groups using a block randomization procedure, we predicted that there would be no differences between the groups on any of the measures at baseline.

At each of the two subsequent assessments (B and C), we investigated differential change between the two groups on each measure relative to performance at the preceding assessment using analysis of covariance. Effect sizes (η2) are reported alongside these significance tests of differential change between groups. To indicate the size of the effect, following the definitions of Cohen (1988): small, η2 = .01; medium, η2 = .06; large, η2 = .14. Hypothesis tests were set at an α-level of 5%. To avoid unacceptable loss of power in this exploratory study, adjustments for multiple comparisons were not made. Accordingly, however, appropriate caution was taken in interpreting the results. Where informative, we also present results of repeated measures analysis of variance within groups to provide a further index of the effect of rehabilitation on performance over consecutive paired assessments.

At Assessment B, we predicted a rehabilitation training effect in the ETG relative to the LTG, which acted as the control group at that point. Analysis of covariance performed on the dependent measures at Assessment B included Assessment A performance as a covariate to increase precision by accommodating natural heterogeneity between subjects within a group. It was predicted that within-group analyses would show improvement in the ETG but not the LTG.

At Assessment C, we expected a rehabilitation training effect in the LTG relative to the ETG. No change was expected in the ETG because they were anticipated to be in “maintenance” mode. Because Assessment C scores were adjusted to compensate for differences in Assessment B scores in this analysis of covariance, we predicted a significant difference between groups in favor of the LTG that had just received rehabilitation training.

Assessment D provided an examination of the long-term benefits of rehabilitation training for each group. To evaluate improvement between Assessments A and D, we performed either repeated measures analysis of variance on the two scores or linear regression of adjusted Assessment D score on adjusted Assessment A score. For the latter, with both measures adjusted by subtracting mean Assessment A score, the intercept for this regression model was interpreted as a relative change between assessments.

Some inability to obtain data at Assessments C and D was encountered for the last subset of LTG participants. This loss of data was the result of logistical problems and was not due to motivation of the volunteers. After the last LTG subgroup had received Assessment B, and after their training sessions but before Assessment C, severe acute respiratory syndrome (SARS) broke out in Toronto and, as a result, essentially all hospitals in Toronto were closed for several months. Research subjects were not permitted to enter the hospital or research buildings. Because this development precluded data collection for Assessments C and D for one of the LTG subgroups, we did not consider it to be related to the efficacy of the rehabilitation program. Nevertheless, the reduction in the number of participants does raise the issue of power, and the long-term follow-up data should be interpreted with caution. For these reasons, our analytic approach should be considered an observed cases approach, and not intent-to-treat. A degree of data reduction was achieved using composite scores where multiple measures were correlated and were hypothesized to be nonhierarchical (e.g., G7 composite score in the Psychosocial paper; Winocur et al., 2007b).

Predictions

The following general predictions guided the trial:

  1. At Assessment A, there would be no differences between the groups on the defined measures.
  2. At Assessment B, group differences favoring the ETG were expected. This finding would indicate that there was a specific effect of rehabilitation for the ETG because, at this point, the LTG would be acting as a control group.
  3. At Assessment C, after the LTG had received training, there would be no difference in the two groups' overall performance. Statistically controlling for performance at the prior assessment, however, would allow analyses to show training-related group differences. It was expected that a within-group analysis from Assessment B to C would reveal improvement in the LTG, confirming the effect of training.
  4. At Assessment D, there would be no group differences. While some decrease in scores was expected at Assessment D, relative to those recorded immediately after rehabilitation training, it was predicted that both groups would perform better at Assessment D, as compared to Assessment A, thereby reflecting long-term benefits of training.
  5. Training would have direct benefits on frontal lobe-mediated strategic processes with derivative benefits to cognitive functions associated with other brain regions (e.g., episodic memory).

CONCLUDING REMARKS

In this study, we outline the rationale and advantages of our approach to cognitive rehabilitation, as well as the design and methods followed in our experimental trial. The design allowed us to conclude that changes in strategic processing can be trained in the elderly, and that in this case any changes observed were the direct result of rehabilitation. Studies that involve repeated testing are always prone to potential practice effects. Our design took this factor into consideration in that both groups received equal practice on the tests for which there were multiple versions. As well, some of our most significant results were obtained on measures of strategic processing that are relatively insensitive to practice effects. Our data point to long-term benefits of rehabilitation. However, this must be qualified by the unavoidable subject attrition in the LTG, which may have affected the power of statistical analysis.

It is uncertain if any single module, or combination of modules, provided the most benefit, and how efficient our approach is compared with other therapies (see Winocur et al., 2007a). Our multidimensional approach, which focused on improving strategic processing, was designed to allow the flexibility that we believed was needed to accommodate the considerable variability that characterizes a relatively healthy, functional elderly population with real and perceived concerns about cognitive decline.

ACKNOWLEDGMENTS

Above all, we want to acknowledge the participants who volunteered for the trial, as well as their supportive families and significant others. Clearly, without their enthusiastic cooperation, a study of this magnitude would not have been possible. In the early stages of our pilot work, we benefited from helpful discussions with Drs. R. Ruff and M. Ylvisaker. Our research assistants were key to the successful completion at different stages of the project: Kristen Bridges, Rayonne Chavannes, Melissa Edwards, Louise Fahy, Peter Glazer, Marina Mandic, and Tara McHugh. Their input is worthy of special mention. Marie-Ève Couture assisted in manuscript preparation. Funding for this research was provided by the JSF McDonnell Foundation. We are especially grateful to Dr. Susan Fitzpatrick, Vice President of the Foundation, for her encouragement and ongoing support throughout the project. D. Stuss was supported by the Reva James Leeds Chair in Neuroscience and Research Leadership. The information reported in this manuscript and the manuscript itself are new and original. The manuscript is not under review by any other journal and has never been published either electronically or in print. There are no financial or other relationships that could be interpreted as a conflict of interest affecting this manuscript.

References

REFERENCES

Alexander, M.P., Stuss, D.T., & Fansabedian, N. (2003). California verbal learning test: Performance by patients with focal frontal and non-frontal lesions. Brain, 126, 14931503.Google Scholar
Anschutz, L., Camp, C.L., Markley, R.P., & Kramer, J.J. (1985). Maintenance and generalization of mnemonics for grocery shopping by older adults. Experimental Aging Research, 11, 157160.Google Scholar
Antonucci, T.C. & Akiyama, H. (1997). Social support and the maintenance of competence. In S.L. Willis, K.W. Schaie, & M. Hayward (Eds.), Societal mechanisms for maintaining competence in old age (pp. 183206). New York: Springer Publishing Company.
Bäckman, L., Almkvist, O., Andersson, J., Nordberg, A., Winblad, B., Reineck, R., & Langstrom, B. (1997). Brain activation in young and older adults during implicit and explicit retrieval. Journal of Cognitive Neuroscience, 9, 378391.Google Scholar
Ball, K., Berch, D.B., Helmers, K.F., Jobe, J.B., Leveck, J.D., Marsiske, M., Morris, J.N., Rebok, G.W., Smith, D.M., Tennstedt, S.L., Unverzagt, F.W., & Willis, S.L. (2002). Effects of cognitive training interventions with older adults: A randomized controlled trial. Journal of the American Medical Association, 233, 22712281.Google Scholar
Balota, D.A., Law, M.B., & Zevin, J.D. (2000). The attentional control of lexical processing pathways: Reversing the word frequency effect. Memory and Cognition, 28, 10811089.Google Scholar
Baltes, P.B. & Willis, S.L. (1982). Plasticity and enhancement of intellectual functioning in old age: Penn State's Adult Development and Enrichment Project (ADEPT). In F.I.M. Craik & S. Trehub (Eds.), Aging and cognitive processes (pp. 353389). New York: Plenum Press.
Beck, A.T. & Steer, R.A. (1990). The Beck Anxiety Inventory. Austin, TX: The Psychological Corporation.
Benton, A.L., Varney, N.R., & Hamsher, K. (1978). Visuospatial judgment: A clinical test. Archives of Neurology, 35, 364367.Google Scholar
Ben-Yishay, Y. & Prigatano, G.P. (1990). Cognitive remediation. In M. Rosenthal, E.R. Griffith, M.R. Bond, & et al. (Eds.), Rehabilitation of the adult and child with traumatic brain injury (pp. 393409). Philadelphia: F.A. Davis.
Brink, T.L., Yesavage, J.A., Lum, O., Heersema, P.H., Adey, M., & Rose, T.S. (1982). Screening tests for geriatric depression. Clinical Gerontologist, 1, 3743.Google Scholar
Cahn-Weiner, D.A., Boyle, P.A., & Malloy, P.F. (2002). Tests of executive function predict instrumental activities of daily living in community-dwelling older individuals. Applied Neuropsychology, 9, 187191.Google Scholar
Cahn-Weiner, D.A., Malloy, P.F., Boyle, P.A., Marran, M., & Salloway, S. (2000). Prediction of functional status from neuropsychological tests in community-dwelling elderly individuals. The Clinical Neuropsychologist, 14, 187195.Google Scholar
Cicerone, K.D., Dahlberg, C., Kalmar, L., Langenbahn, D., Malec, J.F., Bergquist, T.F., Felicetti, T., Giacino, J.T., Harley, J.P., Harrington, D.E., Herzog, J., Kneipp, S., Laatsch, L., & Morse, P. (2000). Evidence-based cognitive rehabilitation: Recommendations for clinical practice. Archives of Physical Medicine and Rehabilitation, 81, 15961615.Google Scholar
Cicerone, K.D., Dahlberg, C., Malec, J.F., Langenbahn, D.M., Felicetti, T., Kneipp, S., Ellmo, W., Kalmar, K., Giacino, J.T., Harley, J.P., Laatsch, L., Morse, P.A., & Catanese, J. (2005). Evidence-based cognitive rehabilitation: Updated review of the literature from 1998 through 2002. Archives of Physical Medicine and Rehabilitation, 86, 16811692.Google Scholar
Cicerone, K.D., Smith, L.C., Ellmo, W., Mangel, H., Nelson, P., Chase, R.F., & Kalmar, K. (1996). Neuropsychological rehabilitation of mild traumatic brain injury. Brain Injury, 10, 277286.Google Scholar
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Colcombe, S.J., Erickson, K.I., Raz, N., Webb, A.G., Cohen, N.J., McAuley, E., & Kramer, A.F. (2003). Aerobic fitness reduces brain tissue loss in aging humans. Journal of Gerontology: Medical Sciences, 58A, 176180.Google Scholar
Craik, F.I.M. & Byrd, M. (1982). Aging and cognitive deficits: The role of attentional resources. In F.I.M. Craik & S.E. Trehub (Eds.), Aging and cognitive processes (pp. 191211). New York: Plenum Press.
Craik, F.I.M. & Grady, C.L. (2002). Aging, memory, and frontal lobe functioning. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 528540). New York: Oxford University Press.
Craik, F.I.M. & Lockhart, R.S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671684.Google Scholar
Dawson, D., Winocur, G., & Moscovitch, M. (1999). The psychological environment and cognitive rehabilitation in the elderly. In D.T. Stuss, G. Winocur, & I.H. Robertson (Eds.), Cognitive neurorehabilitation (pp. 94108). Cambridge, UK: Cambridge University Press.
Doppelt, J.E. & Wallace, W.L. (1955). Standardization of the Wechsler adult intelligence scale for older persons. Journal of Abnormal Psychology, 51, 312330.CrossRefGoogle Scholar
Flynn, T.M. & Storandt, M. (1990). Supplemental group discussions in memory training for older adults. Psychology and Aging, 5, 178181.CrossRefGoogle Scholar
Folstein, M.F., Folstein, S.E., & McHugh, P.R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189198.Google Scholar
Glisky, E.L. & Glisky, M.L. (1999). Memory rehabilitation in the elderly. In D.T. Stuss, G. Winocur, & I.H. Robertson (Eds.), Cognitive neurorehabilitation (pp. 347361). Cambridge: Cambridge University Press.
Grant, D.A. & Berg, E.A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38, 404411.Google Scholar
Greenberg, C. & Powers, S.M. (1987). Memory improvement among adult learners. Educational Gerontology, 12, 385394.Google Scholar
Haug, H. & Eggers, R. (1991). Morphometry of the human cortex cerebri and corpus striatum during aging. Neurobiology of Aging, 12, 352355.Google Scholar
Heaton, R.K. (1981). A manual for the Wisconsin Card Sorting Test. Odessa, FL: Psychological Assessment Resources.
Hertzog, C., Dixon, R.A., & Hultsch, D.F. (1992). Intraindividual change in text recall of the elderly. Brain and Language, 42, 248269.Google Scholar
Hultsch, D.F., Hertzog, C., Small, B.J., & Dixon, R.A. (1999). Use it or lose it: Engaged lifestyle as a buffer of cognitive decline in aging? Psychology of Aging, 14, 520527.Google Scholar
Jernigan, T.L., Archibald, S.L., Fennema-Notestine, C., Gamst, A.C., Stout, J.C., Bonner, J., & Hesselink, J.R. (2001). Effects of age on tissues and regions of the cerebrum and cerebellum. Neurobiology of Aging, 22, 581594.Google Scholar
Jobe, J.B., Smith, D.M., Ball, K., Tennstedt, S.L., Marsiske, M., Willis, S.L., Rebok, G.W., Morris, J.N., Helmers, K.F., Leveck, M.D., & Kleinman, K. (2001). ACTIVE: A cognitive intervention trial to promote independence in older adults. Controlled Clinical Trials, 22, 453479.Google Scholar
Kaplan, E., Goodglass, H., & Weintraub, S. (1983). The Boston Naming Test (2nd ed.). Philadelphia: Lea and Febiger.
Kliegl, R., Smith, J., & Baltes, P.B. (1989). Testing-the-limits and the study of adult age differences in cognitive plasticity of a mnemonic skill. Developmental Psychology, 25, 247256.Google Scholar
Kramer, A.R. & Willis, S.L. (2002). Enhancing the cognitive vitality of older adults. Current Directions in Psychological Science, 11, 173176.Google Scholar
Levine, B. & Downey-Lamb, M. (2002). Design and evaluation of intervention experiments. In P.J. Eslinger (Ed.), Neuropsychological interventions: Emerging treatment and management models for neuropsychological impairments (pp. 80104). New York: Guilford Publications.
Levine, B., Robertson, I.H., Clare, L., Carter, G., Hong, J., Wilson, B.A., Duncan, J., & Stuss, D.T. (2000). Rehabilitation of executive functioning: An experimental-clinical validation of Goal Management Training. Journal of the International Neuropsychological Society, 6, 299312.CrossRefGoogle Scholar
Mack, W.J., Freed, D.M., Williams, B.W., & Henderson, V.W. (1992). Boston Naming Test: Shortened versions for use in Alzheimer's Disease. Journal of Gerontology, 47, 154158.Google Scholar
Milner, B. (1963). Effects of different brain lesions on card sorting: The role of the frontal lobes. Archives of Neurology, 9, 100110.Google Scholar
Moscovitch, M. (1992). Memory and working-with-memory: A component process model based on modules and central systems. Journal of Cognitive Neuroscience, 4, 257267.Google Scholar
Moscovitch, M. & Winocur, G. (1992). The neuropsychology of memory and aging. In F.I.M. Craik & T. Salthouse (Eds.), The handbook of aging and cognition (pp. 315371). Hillsdale: Lawrence Erlbaum Associates.
Nelson, H. & Willison, J.R. (1991). National Adult Reading Test (NART): Test Manual (2nd ed.). Windsor: NFER-Nelson.
Park, D.C. & Hedden, T. (2002). Working memory and aging. In M. Naveh-Benjamin, M. Moscovitch, & H.L. Roediger III (Eds.), Perspectives on human memory and cognitive aging: Essays in honour of Fergus Craik (pp. 148160). East Sussex, UK: Psychology Press.
Petersen, R.C., Smith, G.E., Waring, S.C., Ivnik, R.J., Tangalos, E.G., & Kokmen, E. (1999). Mild cognitive impairment: Clinical characteristics and outcome. Archives of Neurology, 56, 303308.Google Scholar
Picton, T.W., Stuss, D.T., Champagne, S.C., & Nelson, R.F. (1984). The effects of age on human event-related potentials. Psychophysiology, 21, 312325.Google Scholar
Prigatano, G.P. (1999). Motivation and awareness in cognitive neurorehabilitation. In D.T. Stuss, G. Winocur, & I.H. Robertson (Eds.), Cognitive neurorehabilitation (pp. 240251). Cambridge, UK: Cambridge University Press.
Rabbitt, P., Lowe, C., & Shilling, V. (2001). Frontal tests and models for cognitive ageing. European Journal of Cognitive Psychology, 13, 528.CrossRefGoogle Scholar
Rasmusson, D.X., Rebok, G.W., Bylsma, F.W., & Brandt, J. (1999). Effects of three types of memory training in normal elderly. Aging, Neuropsychology, and Cognition, 6, 5666.CrossRefGoogle Scholar
Raz, N. (2000). Aging of the brain and its impact on cognitive performance: Integration of structural and functional findings. In F.I.M. Craik & T. Salthouse (Eds.), The handbook of aging and cognition (pp. 190). Mahwah, NJ: Lawrence Erlbaum Associates.
Regnier, V. (1997). The physical environment and maintenance of competence. In S.L. Willis, K.W. Schaie, & M. Hayward (Eds.), Societal mechanisms for maintaining competence in old age (pp. 233250). New York: Springer Publishing Company.
Robertson, I.H. (1996). Goal management training. Cambridge: MRC Cognition and Brain Sciences Unit.
Rypma, B., Prabhakaran, V., Desmond, J.E., & Gabrieli, J.D.E. (2001). Age differences in prefrontal cortical activity in working memory. Psychology and Aging, 16, 371384.Google Scholar
Salthouse, T.A. (1988). The role of processing resources in cognitive aging. In M.L. Howe & C. Brainerd (Eds.), Cognitive development in adulthood (pp. 185239). New York: Springer-Verlag.
Salthouse, T.A. (1991). Mediation of adult age differences in cognition by reductions in working memory and speed of processing. Psychological Science, 2, 179183.Google Scholar
Salthouse, T.A. (1992). What do adult age differences in the Digit Symbol Substitution Test reflect? Journal of Gerontology 47, 121128.Google Scholar
Salthouse, T.A. (1993). Attentional blocks are not responsible for age-related slowing. Journal of Gerontology, 48, 263270.Google Scholar
Schacter, D.L. (1994). Priming and multiple memory systems: Perceptual mechanisms of implicit memory. In D.L. Schacter & E. Tulving (Eds.), Memory systems (pp. 244256). Cambridge, MA: MIT Press.
Shallice, T. (2002). Fractionation of the supervisory system. In D.T. Stuss & R. Knight (Eds.), Principles of frontal lobe function (pp. 261277). New York: Oxford University Press.
Shammi, P., Bosman, E., & Stuss, D.T. (1998). Aging and variability in performance. Aging, Neuropsychology, and Cognition, 5, 113.Google Scholar
Spreen, O. & Strauss, E. (1998). A compendium of neuropsychological tests: Administration, norms & commentary (2nd ed.). New York: Oxford University Press.
Stigsdotter Neely, A. & Bäckman, L. (1993a). Long-term maintenance of gains from memory training in older adults: Two 3 1/2 year follow-up studies. Journal of Gerontology: Psychological Sciences, 48, 233237.Google Scholar
Stigsdotter Neely, A. & Bäckman, L. (1993b). Maintenance of gains following multifactorial and unifactorial memory training in late adulthood. Educational Gerontology, 19, 105117.Google Scholar
Stigsdotter Neely, A. & Bäckman, L. (1995). Effects of multifactorial memory training in old age: Generalizability across tasks and individuals. Journal of Gerontology: Psychological Sciences, 50, 134140.Google Scholar
Storandt, M. (1992). Memory-skills training for older adults. In T.B. Sonderigger (Ed.), Nebraska symposium on motivation, 1991: Vol. 39, Psychology and aging (pp. 3962). Lincoln, NE: University of Nebraska Press.
Stuss, D.T., Alexander, M.P., Palumbo, C.L., Buckle, L., Sayer, L., & Pogue, J. (1994). Organizational strategies of patients with unilateral or bilateral frontal lobe injury in word list learning tasks. Neuropsychology, 8, 355373.Google Scholar
Stuss, D.T., Binns, M.A., Carruth, F.G., Levine, B., Brandys, C.F., Moulton, R.J., Snow, W.G., & Schwartz, M.L. (2000a). Prediction of recovery of continuous memory after traumatic brain injury. Neurology, 54, 13371344.Google Scholar
Stuss, D.T., Craik, F.I.M., Sayer, L., Franchi, D., & Alexander, M.P. (1996). Comparison of older people and patients with frontal lesions: Evidence from word list learning. Psychology and Aging, 11, 387395.Google Scholar
Stuss, D.T. & Levine, B. (2002). Adult clinical neuropsychology: Lessons from studies of the frontal lobes. Annual Review of Psychology, 53, 401433.Google Scholar
Stuss, D.T., Levine, B., Alexander, M.P., Hong, J., Palumbo, C., Hamer, L., Murphy, K.J., & Izukawa, D. (2000b). Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: Effects of lesion location and test structure on separable cognitive processes. Neuropsychologia, 38, 388402.Google Scholar
Tulving, E. (1983). Elements of episodic memory. New York: Oxford University Press.
Tulving, E., Markowitsch, H.J., Craik, F.I.M., Habib, R., & Houle, S. (1996). Novelty and familiarity activations in PET studies of memory encoding and retrieval. Cerebral Cortex, 6, 7179.Google Scholar
Turner, G. & Levine, B. (2004). Disorders of executive function and self-awareness. In J. Ponsford (Ed.), Rehabilitation of neurobehavioral disorders. New York: Guilford Publications.
Verhaeghen, P., Marcoen, A., & Goosens, L. (1992). Improving memory performance in the aged through mnemonic training: A meta-analytic study. Psychology and Aging, 7, 242251.CrossRefGoogle Scholar
Verhaeghen, P. & Salthouse, T.A. (1997). Meta-analyses of age-cognition relations in adulthood: Estimates of linear and nonlinear age effects and structural models. Psychological Bulletin, 122, 231249.Google Scholar
Wechsler, D. (1987). WMS-R: Wechsler Memory Scale-Revised, Manual. San Diego: The Psychological Corporation.
West, R. (1996). An application of prefrontal cortex function theory to cognitive aging. Psychological Bulletin, 120, 272292.CrossRefGoogle Scholar
West, R., Murphy, K.J., Armilio, M.L., Craik, F.I.M., & Stuss, D.T. (2002). Lapses of intention and performance variability reveal age-related increases in fluctuations of executive control. Brain and Cognition, 49, 402419.Google Scholar
Wilson, R.S., Mendes de Leon, C.F., Barnes, L.L., Schneider, J.A., Bienias, J.L., Evans, D.A., & Bennett, D.A. (2002). Participation in cognitively stimulating activities and risk of incident Alzheimer disease. Journal of the American Medical Association, 287, 742748.Google Scholar
Winocur, G., Craik, F.I.M., Levine, B., Robertson, I.H., Binns, M.A., Alexander, M.P., Black, S., Dawson, D., Palmer, H., Downey-Lamb, M., & Stuss, D.T. (2007a, this issue). Cognitive rehabilitation in the elderly: Overview and future directions. Journal of the International Neuropsychological Society, 13, 166171.Google Scholar
Winocur, G., Palmer, H., Dawson, D., Binns, M.A., Bridges, K., & Stuss, D.T. (2007b, this issue). Cognitive rehabilitation in the elderly: An evaluation of psychosocial factors. Journal of the International Neuropsychological Society, 13, 153165.Google Scholar
Winocur, G., Moscovitch, M., & Stuss, D.T. (1996). Explicit and implicit memory in the elderly: Evidence for double dissociation involving medial temporal- and frontal-lobe functions. Neuropsychology, 10, 5765.Google Scholar
Yesavage, J.A. (1985). Nonpharmacologic treatments for memory losses with normal aging. American Journal of Psychiatry, 142, 600605.Google Scholar
Yesavage, J.A. & Rose, T.L. (1983). Concentration and mnemonic training in elderly with memory complaints: A study of combined therapy and order effects. Psychiatry Research, 9, 157167.CrossRefGoogle Scholar
Zarit, S.H., Cole, K.D., & Guider. R.L. (1981). Memory training strategies and subjective complaints of memory in the aged. The Gerontologist, 21, 158162.CrossRefGoogle Scholar
Figure 0

CONSORT-type figure illustrating the maximum number of participants at each assessment. The loss of subjects in the Late Training Group (LTG) for Assessments C and D was secondary to a province-wide pandemic (SARS) which closed hospitals and associated buildings for all nonessential personnel (such as research participants), as indicated in the text. ETG = Early Training Group.

Figure 1

Demographic, neuropsychological screening and normative data summary

Figure 2

Within-subject crossover experimental design with the timeline for the early and late training groups.