Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-02-06T06:49:51.706Z Has data issue: false hasContentIssue false

Merging Clinical Neuropsychology and Functional Neuroimaging to Evaluate the Construct Validity and Neural Network Engagement of the n-Back Task

Published online by Cambridge University Press:  25 June 2014

Tonisha E. Kearney-Ramos*
Affiliation:
Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas
Jennifer S. Fausett
Affiliation:
Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas
Jennifer L. Gess
Affiliation:
Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas
Ashley Reno
Affiliation:
University of Virginia School of Medicine, Charlottesville, Virginia
Jennifer Peraza
Affiliation:
New Mexico VA Health Care System, Albuquerque, New Mexico
Clint D. Kilts
Affiliation:
Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas
G. Andrew James
Affiliation:
Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas
*
Correspondence and reprint requests to: Tonisha E. Kearney-Ramos, University of Arkansas for Medical Sciences, Psychiatric Research Institute, 4301 W. Markham Street, #554, Little Rock, AR 72205-7199. E-mail: tekearneyramos@uams.edu
Rights & Permissions [Opens in a new window]

Abstract

The n-back task is a widely used neuroimaging paradigm for studying the neural basis of working memory (WM); however, its neuropsychometric properties have received little empirical investigation. The present study merged clinical neuropsychology and functional magnetic resonance imaging (fMRI) to explore the construct validity of the letter variant of the n-back task (LNB) and to further identify the task-evoked networks involved in WM. Construct validity of the LNB task was investigated using a bootstrapping approach to correlate LNB task performance across clinically validated neuropsychological measures of WM to establish convergent validity, as well as measures of related but distinct cognitive constructs (i.e., attention and short-term memory) to establish discriminant validity. Independent component analysis (ICA) identified brain networks active during the LNB task in 34 healthy control participants, and general linear modeling determined task-relatedness of these networks. Bootstrap correlation analyses revealed moderate to high correlations among measures expected to converge with LNB (|ρ|≥0.37) and weak correlations among measures expected to discriminate (|ρ|≤0.29), controlling for age and education. ICA identified 35 independent networks, 17 of which demonstrated engagement significantly related to task condition, controlling for reaction time variability. Of these, the bilateral frontoparietal networks, bilateral dorsolateral prefrontal cortices, bilateral superior parietal lobules including precuneus, and frontoinsular network were preferentially recruited by the 2-back condition compared to 0-back control condition, indicating WM involvement. These results support the use of the LNB as a measure of WM and confirm its use in probing the network-level neural correlates of WM processing. (JINS, 2014, 20, 1–15)

Type
Research Articles
Copyright
Copyright © The International Neuropsychological Society 2014 

Introduction

Working memory (WM) is the set of mental processes that enables manipulation of information stored within short-term memory, and provides an interface between sensory perception, long-term memory, and active interaction with one’s environment (Baddeley, Reference Baddeley2012; Conway, Jarrold, Kane, Miyake, & Towse, Reference Conway, Jarrold, Kane, Miyake and Towse2007; Miyake & Shah, Reference Miyake and Shah1999). This transient storage and active manipulation of goal-relevant information facilitates higher-order cognitive processes, such as reasoning, comprehension, planning and learning (Baddeley, Reference Baddeley1986; D’Esposito, Reference D’Esposito2007; Just & Carpenter, Reference Just and Carpenter1992; Was, Dunlosky, Bailey, & Rawson, Reference Was, Dunlosky, Bailey and Rawson2012). The prominent role of WM in diverse cognitive processes has motivated research investigating WM dysfunction across a range of psychiatric and neurologic disorders, including schizophrenia, attention deficit hyperactivity disorder, dementia, and traumatic brain injury (Gagnon & Belleville, Reference Gagnon and Belleville2011; Gorman, Barnes, Swank, Prasad, & Ewing-Cobbs, Reference Gorman, Barnes, Swank, Prasad and Ewing-Cobbs2012; Kim et al., Reference Kim, Manoach, Mathalon, Turner, Mannell, Brown and Calhoun2009; Schweitzer et al., Reference Schweitzer, Faber, Grafton, Tune, Hoffman and Kilts2000). However, disparate WM theories and approaches to its study have resulted in incongruities in our understanding of its components, functions and dynamics (Baddeley, Banse, Huang, & Page, Reference Baddeley, Banse, Huang and Page2012; Conway et al., Reference Conway, Jarrold, Kane, Miyake and Towse2007; Miyake & Shah, Reference Miyake and Shah1999). Thus, we must first improve our characterization of the neural encoding of normative population variance in WM to provide a framework by which we may define the neural processing variance associated with cognitive and behavioral dysfunction in clinical groups.

Functional neuroimaging has played a pivotal role in refining the cognitive construct and neural representation of WM (Champod & Petrides, Reference Champod and Petrides2010; Smith & Jonides, Reference Smith and Jonides1997). The n-back task is arguably the most widely used functional neuroimaging paradigm for investigating the neural basis of WM due to its ability to produce robust and consistent neuroactivations and to parametrically vary memory load demands (Braver et al., Reference Braver, Cohen, Nystrom, Jonides, Smith and Noll1997; Cohen et al., Reference Cohen, Perlstein, Braver, Nystrom, Noll, Jonides and Smith1997; Jonides et al., Reference Jonides, Schumacher, Smith, Lauber, Awh, Minoshima and Koeppe1997; Kane & Engle, Reference Kane and Engle2002). However, despite the n-back task’s strong face validity as a measure of WM, its construct validity as a WM measure has been inconsistently established. Some studies report strong convergent validity between n-back performance and WM-related processes such as WM capacity (Schmiedek, Hildebrandt, Lövdén, Wilhelm, & Lindenberger, Reference Schmiedek, Hildebrandt, Lövdén, Wilhelm and Lindenberger2009; Shamosh et al., Reference Shamosh, Deyoung, Green, Reis, Johnson, Conway and Gray2008; Shelton, Elliott, Hill, Calamia, & Gouvier, Reference Shelton, Elliott, Hill, Calamia and Gouvier2009; Shelton, Metzger, & Elliott, Reference Shelton, Metzger and Elliott2007), various executive functions (Ciesielski, Lesnik, Savoy, Grant, & Ahlfors, Reference Ciesielski, Lesnik, Savoy, Grant and Ahlfors2006), and/or general and fluid intelligence (Colom, Abad, Quiroga, Shih, & Flores-Mendoza, Reference Colom, Abad, Quiroga, Shih and Flores-Mendoza2008; Gevins & Smith, Reference Gevins and Smith2000; Gray, Chabris, & Braver, Reference Gray, Chabris and Braver2003; Jaeggi, Buschkuehl, Perrig, & Meier, Reference Jaeggi, Buschkuehl, Perrig and Meier2010). However, others have reported weak or negligible correlations between n-back performance and WM-related measures (Friedman et al., Reference Friedman, Miyake, Corley, Young, Defries and Hewitt2006; Jaeggi et al., Reference Jaeggi, Buschkuehl, Perrig and Meier2010; Kane, Conway, Miura, & Colflesh, Reference Kane, Conway, Miura and Colflesh2007), instead associating n-back with simple short-term memory (Oberauer, Reference Oberauer2005; Roberts & Gibson, Reference Roberts and Gibson2002), or concluding that the complexity of n-back tasks requires a combination of processes not easily disentangled or characterized through comparison of performance on existing cognitive tests (Jaeggi et al., Reference Jaeggi, Buschkuehl, Perrig and Meier2010).

The inconsistency of these findings limits the interpretability of the n-back as a reliable probe of WM (as mentioned by Conway et al., Reference Conway, Kane, Bunting, Hambrick, Wilhelm and Engle2005; Miller, Price, Okun, Montijo, & Bowers, Reference Miller, Price, Okun, Montijo and Bowers2009). Thus, the present study sought to validate the n-back as a reliable WM probe by demonstrating its cognitive-behavioral specificity for a domain-general WM construct. We use the letter variant of the n-back task (LNB), generally considered a measure of verbal WM (Cohen et al., Reference Cohen, Perlstein, Braver, Nystrom, Noll, Jonides and Smith1997; Owen, McMillan, Laird, & Bullmore, Reference Owen, McMillan, Laird and Bullmore2005). To establish LNB’s construct validity, we correlate LNB task performance with a diverse battery of (1) clinically validated neuropsychological (NP) measures of WM (i.e., auditory, verbal, and visuospatial), to establish convergent validity, and (2) measures related to but conceptually distinct from WM, to establish discriminant validity. We sought to control for the effects of paradigm design-specific variance on the validity relationships by administering NP instruments that included separate subtests which did and did not measure WM, thereby allowing within-instrument measures of convergent and discriminant validity with the n-back.

Furthermore, while several brain regions have been shown to be consistently recruited by the LNB task, it remains unclear how these regions are integrated into larger functional networks. In a 2005 quantitative meta-analysis, 24 normative functional neuroimaging studies of several n-back task variants differing in WM process (i.e., location vs. identity monitoring) and content (i.e., verbal vs. non-verbal material) were compiled to investigate the neuroanatomic representation of WM (Owen et al., Reference Owen, McMillan, Laird and Bullmore2005). Seven brain regions were identified as consistently activated across all studies, regardless of task variant, including six cortical regions: (1) bilateral and medial posterior parietal cortex; (2) bilateral premotor cortex; (3) dorsal cingulate/medial premotor cortex; (4) bilateral rostral prefrontal cortex; (5) bilateral dorsolateral prefrontal cortex; (6) bilateral mid-ventrolateral prefrontal cortex, and (7) the medial cerebellum. Owen et al. provided strong evidence for the consistent involvement of core frontal and parietal cortical regions across variants of the n-back task, as well as identifying differential subregional and lateralized activation patterns for process- and content-specific task differences.

We sought to expand upon Owen et al.’s findings by identifying the LNB’s network-level neural correlates of WM using independent component analysis (ICA), a data-driven statistical method for identifying functionally connected networks of brain regions (Calhoun, Adali, Pearlson, & Pekar, Reference Calhoun, Adali, Pearlson and Pekar2002; McKeown et al., Reference McKeown, Jung, Makeig, Brown, Kindermann, Lee and Sejnowski1998). While previous studies have sought to establish the neural correlates of this task using ICA-based approaches, all have either studied dysfunctional network organization in patients (Cousijn et al., Reference Cousijn, Wiers, Ridderinkhof, van den Brink, Veltman and Goudriaan2014; Nejad et al., Reference Nejad, Madsen, Ebdrup, Siebner, Rasmussen, Aggernæs and Baaré2013; Palacios et al., Reference Palacios, Sala-Llonch, Junque, Roig, Tormos, Bargallo and Vendrell2012; Penadés et al., Reference Penadés, Pujol, Catalán, Massana, Rametti, García-Rizo and Junqué2013), the organization of the default mode network (DMN) (Esposito et al., Reference Esposito, Aragri, Latorre, Popolizio, Scarabino, Cirillo and Di Salle2009, Reference Esposito, Bertolino, Scarabino, Latorre, Blasi, Popolizio and Di Salle2006; Sambataro et al., Reference Sambataro, Blasi, Fazio, Caforio, Taurisano, Romano and Bertolino2010), or focused on neuroimaging method development (Haller, Homola, Scheffler, Beckmann, & Bartsch, Reference Haller, Homola, Scheffler, Beckmann and Bartsch2009; Missonnier et al., Reference Missonnier, Leonards, Gold, Palix, Ibáñez and Giannakopoulos2003). The present study aims to characterize normative neural networks recruited by the LNB task and their relationships to task demand, thereby testing the hypothesis that the LNB and its neural processing networks fulfill convergent and discriminant validity as a WM demand.

METHODS

Subjects

Fifty-two participants [29 female; mean (SD) age=32 (10) years] were recruited via community advertisements in accordance with University of Arkansas for Medical Sciences (UAMS) Institutional Review Board approval and oversight. We strove to recruit a demographically diverse sample of participants by posting flyers and banners on city buses, at local eateries, and in community centers, in addition to posting at the university. Inclusion criteria for the study were native English-speaking adults ages 18–50 without history of psychiatric or neurologic illness. Exclusion criteria included the presence of any DSM-IV psychiatric disorders (except nicotine dependence) as determined by structured clinical interview (SCID-NP) (First, Spitzer, Gibbon, & Williams, Reference First, Spitzer, Gibbon and Williams2002), ferromagnetic implants and other contraindications to the high-field MRI environment (determined through medical history), and pregnancy (determined through urinalysis). Eighteen participants were excluded from analyses due to incomplete fMRI or NP data (n=11) or excessive head motion artifact (n=7; see the METHODS, Image Acquisition and Processing, for details). Analyses were conducted on the remaining 34 participants [22 female; mean (SD) age=32 (10) years; range 19–50 years; 31 right-handed; see Table 1 for full demographic information].

Table 1 Participant Demographics

Includes one participant self-reporting as both African-American and Caucasian

Procedures

The data included in the present study were collected as a subset of a larger, multifaceted initiative known as the “Cognitive Connectome (Cognectome)” which seeks to comprehensively map the brain’s functional and structural encoding of individual variation in cognitive and behavioral abilities across cognitive modalities. All procedures were conducted at the Brain Imaging Research Center (BIRC) in the Psychiatric Research Institute at UAMS. Participants first underwent a telephone interview to establish inclusion criteria. Eligible participants were invited to the BIRC for an intake session where they provided written informed consent and underwent SCID-NP assessment and medical evaluation to assess exclusion criteria. Eligible participants underwent two MRI sessions (1 hr each), a battery of computerized assessments (1 hr), and comprehensive NP assessment (3–4 hr). Intakes were conducted in the morning, fMRI sessions in the afternoon (between 1 p.m. and 5 p.m.), and NP assessment (due to length) in morning or afternoon at participants’ convenience. Participants were compensated $25 for completion of each of the four sessions (Intake, one NP, two fMRI), in addition to compensation for parking or bus fare.

Neuropsychological (NP) Assessments

NP instruments were administered per standardized instructions. Administrators were trained by a board-certified clinical neuropsychologist. The following tests were selected from the larger Cognectome test battery for having at least one subscale accepted as a measure of WM and at least one subscale that was not, thus permitting exploration of convergent and discriminant validity. Two additional tests, the Halstead-Reitan Finger Tapping Test and the Boston Naming Test, were included as stand-alone measures of discriminant validity.

Digit Span Test (WAIS-IV)

The Digit Span Test of the Wechsler Adult Intelligence Scales-Fourth Edition (WAIS-IV) was designed to measure span of auditory attention and verbal WM and was administered and scored per standardized instructions (Wechsler, Reference Wechsler2008). This version of the Digit Span Test includes: Digit Span Forward (DSF), Digit Span Backward (DSB), and Digit Span Sequencing (DSS) which requires oral repetition, reversal, and sequencing of number strings, respectively.

Spatial Span Test (WMS-III)

The Wechsler Memory Scale-Third Edition (WMS-III) Spatial Span Test was designed to measure span of visuospatial attention and visuospatial WM and was administered and scored per standardized instructions (Wechsler, Reference Wechsler1997). The Spatial Span Test includes: Spatial Span Forward (SSF) and Spatial Span Reverse (SSR), which requires manual repetition and reversal of visuospatial sequences, respectively.

Test of Everyday Attention (TEA)

The Test of Everyday Attention (TEA) consists of eight subtests designed to measure three major features of attention—selective attention, sustained attention and attentional switching—as well as auditory-verbal WM (Robertson, Ward, Ridgeway, & Nimmo-Smith, Reference Robertson, Ward, Ridgeway and Nimmo-Smith1994, Reference Robertson, Ward, Ridgeway and Nimmo-Smith1996). Five of the eight subtests were included in the Cognectome test battery and were administered and scored per standardized instructions (Robertson et al., Reference Robertson, Ward, Ridgeway and Nimmo-Smith1994). These included: [TEA 1] Map Search (selective visual attention), [TEA 2-3] Elevator Counting and Elevator Counting with Distraction (sustained attention and auditory-verbal WM, respectively) and [TEA 4-5] Elevator Counting with Reversal using visual or auditory stimuli (attentional switching and auditory-verbal WM, respectively).

D-KEFS Trail-Making Test (TMT)

The Delis-Kaplan Executive Function System (D-KEFS) Trail-Making Test (TMT) was administered and scored per standardized instructions and included five self-paced subtests designed to measure cognitive flexibility/set-shifting (an executive subprocess of WM) while also allowing for the disambiguation of constituent processes embedded in the higher-level task performances (i.e., visuomotor speed, selective visual attention, and temporal sequencing; Delis, Kaplan, & Kramer, Reference Delis, Kaplan and Kramer2001). The five self-paced TMT subtests included: [1] Visual Scanning (visuomotor speed, selective visual attention), [2-3] Number Sequencing and Letter Sequencing (visuomotor speed, selective visual attention, temporal sequencing of numerical or alphabetical stimuli, respectively), [4] Number-Letter Sequencing (visuomotor speed, selective visual attention, complex temporal sequencing, cognitive flexibility/set shifting), and [5] Motor Speed (visuomotor speed/agility).

Halstead-Reitan Finger Tapping Test (FTT)

The Halstead-Reitan Finger Tapping Test (FTT) was designed to provide a measure of simple motor speed and was administered and scored per standardized instructions (Reitan & Wolfson, Reference Reitan and Wolfson1985).

Boston Naming Test-2 (BNT)

The Boston Naming Test-2 (BNT) is a picture naming task designed to measure visual confrontational naming—which involves processes such as semantic fluency, lexical retrieval, and speech production—and was administered and scored per standardized instructions (Kaplan, Goodglass, & Weintraub, Reference Kaplan, Goodglass and Weintraub2001).

Letter n- back (LNB) fMRI Task

The LNB task was conducted as a block design using Presentation 14.4 (Neurobehavioral Systems, Inc.) and consisted of alternating blocks of 0-back (sensorimotor and sustained attention control) and 2-back (WM) conditions. Task blocks involved the random sequential presentation of uppercase letter stimuli (A-E), with each trial lasting a total of 1500 ms (letter presentation for 1200 ms or until participant made a response, followed by fixation cross presented for remainder of the trial). During 0-back blocks, participants were instructed to respond whenever the letter “A” was shown. For 2-back blocks, participants were instructed to respond if the currently presented letter matched the letter presented two letters prior. Twenty-five percent of trials from each condition were coded as target trials warranting a response. Before fMRI scanning, all participants practiced the task outside the MRI scanner to ensure task comprehension.

The first five participants underwent alternating 90s blocks of 0-back and 2-back conditions (three blocks each; six total). Each block was preceded by a 6 s Instruction block indicating task condition (“0-back” or “2-back”) and followed by a 20s Rest (baseline) block consisting of a static fixation cross, for total duration of 11.1 min. Interim analysis showed comparable neural responses when each task condition was reduced to blocks with shorter total durations, prompting a task redesign to reduce participant fatigue. Subsequent participants underwent alternating 40s blocks of 0-back and 2-back trials (four blocks each; eight total), which were now preceded by a 5 s Instruction block and followed by a 15 s Rest block for a total task time of 7.3 min.

Performance on the LNB was computed using the Critical Success Index (CSI), a modified estimate of percent accuracy given by: the number of hits (correct intentional responses) divided by the sum of hits, false alarms (incorrect intentional responses), and misses (incorrect intentional non-responses) (Wilks, Reference Wilks2011). CSI was preferred over standard percent accuracy due to the fact that correct intentional non-responses (“rejections”) cannot be discriminated from correct unintentional non-responses when using standard percent accuracy calculations, which results in overinflated accuracy estimates, especially for designs with a high percentage of non-response trials, such as the present study (~75% of trials). Thus, the CSI provided a performance measure less biased by the ambiguity of non-response trials (Wilks, Reference Wilks2011). However, for simplicity, we will still refer to the performance scores as “accuracy” or “percent accuracy” throughout the manuscript.

Construct Validity Analysis of the LNB Task

LNB construct validity was determined using bootstrapping to estimate correlations of LNB performance with each NP assessment. Considering our relatively small sample compared to other behavioral and/or construct validation studies, bootstrapping provided a statistical approach more robust against small sample size than simple correlations alone (Cumming, Reference Cumming2008; Efron & Tibshirani, Reference Efron and Tibshirani1993; Gardner & Altman, Reference Gardner and Altman1986; Young & Lewis, Reference Young and Lewis1997). This is because it involves the simulation of an empirical distribution of correlation estimates that represents the true (population) distribution, followed by the evaluation of the stability of these approximations using confidence intervals (CI), a more interpretable (i.e., generalizable) statistical measure of significance than p-values (Cumming, Reference Cumming2008; Efron & Tibshirani, Reference Efron and Tibshirani1993; Gardner & Altman, Reference Gardner and Altman1986; Young & Lewis, Reference Young and Lewis1997). Bootstrapping provided estimates of the means, standard deviations (SE) and 95% CI for correlations between LNB performance and each NP assessment, as follows. First, 34 subjects were randomly selected with replacement from the observed sample to form a bootstrap resample; this process was repeated 1000 times to form 1000 34-subject resamples. Partial correlations were calculated (controlling for age and education) between LNB accuracy and the raw scores on each NP subscale for each of the 1000 resamples, forming an empirical distribution of the correlation estimates, from which a mean, SE, and 95% CI were calculated. LNB was interpreted as having discriminant or convergent validity with a NP test if the 95% CI of its bootstrapped correlation did or did not include zero, respectively. All analyses of behavioral performance were conducted using Matlab 7.10 (The MathWorks, Inc.).

Image Acquisition and Processing

Participants were scanned using a Philips 3T Achieva X-series MRI scanner (Philips Healthcare, USA). Anatomic images were acquired with a magnetization prepared gradient echo (MPRAGE) sequence (matrix=256×256, 160 sagittal slices, repetition time/echo time/flip angle [TR/TE/FA]=2600 ms/3.05 ms/8°, final resolution=1×1×1 mm3). Functional images were acquired for 23 participants using an 8-channel head coil with an echo planar imaging sequence [TR/TE/FA= 2000 ms/30 ms/90°, field of view=240×240 mm, matrix=80×80, 37 oblique slices (parallel to orbitofrontal cortex to reduce sinus artifact), slice thickness=4 mm, interleaved slice acquisition, final resolution 3×3×4 mm3]. Following an equipment upgrade, functional data for the 11 remaining participants were acquired with a Phillips 32-channel head coil (Philips Healthcare, USA). The same image acquisition parameters were used, except with thinner slices (slice thickness=2.5 mm with 0.5 mm gap) and a sequential ascending slice acquisition. The thinner slices were selected to reduce orbitofrontal signal loss caused by sinus cavity artifact.

MRI data preprocessing was performed using AFNI version 2011_12_21_1014 (Cox, Reference Cox1996). Anatomic data underwent skull stripping, spatial normalization to the ICBM 452 brain atlas and segmentation into white matter, gray matter, and cerebrospinal fluid (CSF) using FSL v5.0.4 (Jenkinson, Beckmann, Behrens, Woolrich, & Smith, Reference Jenkinson, Beckmann, Behrens, Woolrich and Smith2012). The functional data underwent despiking; slice time correction; deobliquing (to 3×3×3 mm3 voxels); head motion correction; transformation to the spatially normalized anatomic image; regression of motion parameters, mean timecourse of white matter voxels, and mean timecourse of CSF voxels; spatial smoothing with a 6 mm FWHM Gaussian kernel; and scaling to percent signal change.

After preprocessing, ICA was conducted using the Group ICA of fMRI Toolbox (GIFT v1.3) for Matlab (Calhoun, Adali, Pearlson, & Pekar, Reference Calhoun, Adali, Pearlson and Pekar2001) to identify and remove sources of signal caused by head motion (Tohka et al., Reference Tohka, Foerde, Aron, Tom, Toga and Poldrack2008; see METHODS, Independent Component Analysis and General Linear Modeling for detailed ICA procedure). Head motion artifact manifests in the functional data as alternating “bands” or “stripes” of activity corresponding to the order of slice acquisition. For each subject, ICA solved for the optimal number of components as determined by GIFT’s MDL algorithm (typically 150–200 components). Because the pattern of slice acquisition (e.g., all even slices or all odd slices) does not represent biologically relevant brain activity, a liberal threshold (r>0.05) was used to identify components that correlated with slice acquisition. These components were removed from the preprocessed functional data using the “icatb_removeArtifact.m” command in Matlab. Motion artifact was assessed before and after ICA “stripe” removal using single voxel seed-based correlation analyses via AFNI’s “InstaCorr” function. Seven subjects still demonstrated “striping” after ICA removal and were thus excluded from further analysis. Two additional subjects were excluded because excessive signal loss in the orbitofrontal cortex resulted in poor normalization of the functional data to the ICBM 452 template.

Independent Component Analysis and General Linear Modeling

Independent Component Analysis (ICA)

ICA was performed on the LNB fMRI data using Matlab’s GIFT. GIFT uses a two-step data-reduction ICA approach. The first step of the GIFT ICA procedure performs a principal component analysis (PCA) on each individual participant to reduce the dimensionality of each fMRI dataset into subject-specific principal components. The second step performs ICA upon these subjects’ principal components by first concatenating the subject-specific components into a group and then identifying group-level independent components (i.e., components that are consistently represented across all subjects). For the first step, PCAs were performed using GIFT’s expectation maximization and stacked datasets options. For the second step, GIFT’s ICASSO3 toolbox was used to determine the reliability of the ICA components across iterations. ICASSO3 was repeated 20 times using the Infomax algorithm to calculate the stability index (iq) of each component, a measure of how reliably each component was reproduced in the sample across ICASSO iterations.

The GIFT ICA procedure defines components by their spatial independence, which requires that the spatial distributions of the components be independent of one another (Beckmann, Reference Beckmann2012; McKeown et al., Reference McKeown, Jung, Makeig, Brown, Kindermann, Lee and Sejnowski1998). Thus, any given brain region is capable of contributing to multiple components—for instance, when the same brain region is transiently recruited by several discrete neural processes throughout the course of the task—as long as the overall spatiotemporal maps are statistically spatially distinct (Calhoun et al., Reference Calhoun, Adali, Pearlson and Pekar2001; Xu, Potenza, & Calhoun, Reference Xu, Potenza and Calhoun2013). However, ICA model order selection (i.e., the number of components solved for) can greatly impact the extent of segregation and/or overlap of the components’ spatiotemporal maps by altering the stringency of their spatial independence (Calhoun et al., Reference Calhoun, Adali, Pearlson and Pekar2001; Ray et al., Reference Ray, McKay, Fox, Riedel, Uecker, Beckmann and Laird2013). Yet methods for determining the optimal number of components for a given sample are either still in debate or in active development (Li, Adali, & Calhoun, Reference Li, Adali and Calhoun2007; Ray et al., Reference Ray, McKay, Fox, Riedel, Uecker, Beckmann and Laird2013). Thus, the selection of the present study’s ICA model order was motivated by an empirical evaluation of the component quality across several different ICA procedures within our sample, as follows. Four separate ICAs were conducted (solving for the following combinations of PCA/ICA components: 40/20, 50/25, 60/30, and 70/35) to find the model with, both, the best component stability (given by the iq estimate) and the best replication of well-supported (“canonical”) functional networks (Ray et al., Reference Ray, McKay, Fox, Riedel, Uecker, Beckmann and Laird2013; Smith et al., Reference Smith, Fox, Miller, Glahn, Fox, Mackay and Beckmann2009). Of the four models, solving for 35 components produced the best balance between component stability (iq ≥.90) and the partitioning of components into well-validated canonical functional networks (Ray et al., Reference Ray, McKay, Fox, Riedel, Uecker, Beckmann and Laird2013; Smith et al., Reference Smith, Fox, Miller, Glahn, Fox, Mackay and Beckmann2009). Because the group ICA approach identifies components common to all individuals, this also ensured the generalizabilty (and interpretation) of the ICA results across subjects (Calhoun et al., Reference Calhoun, Adali, Pearlson and Pekar2001).

In the final step of the GIFT ICA procedure, a back-reconstruction was performed using the GICA3 algorithm to identify the subject-specific neuroanatomical and timecourse representations of every component, followed by the normalization of all data to Z-scores to enable the comparison of subject-specific component maps across subjects. (Note: additional software parameters included full storage of covariance matrix to double precision and usage of selective eigenvariate solvers, as detailed in the GIFT v1.3 User Manual).

General Linear Modeling (GLM)

The GLM analysis assessed task-dependent recruitment of each component. Each subject-specific ICA timecourse underwent GLM using AFNI’s 3dDeconvolve program (code available upon request). The GLM modeled nine parameters: three task conditions (Instructions, 0-back, and 2-back) as parameters of interest, and six head motion parameters (x, y, z, roll, pitch, yaw) included into the baseline model as parameters of no interest. Because trials were terminated by participant responses, we accounted for the effect of trial duration variability upon brain activity using amplitude modulation, which models participants’ brain activity for each task block as varying proportionally to the participants’ mean reaction time (RT) for that block. Beta values (β) were estimated describing the magnitude of component recruitment across each of the task conditions for the following general linear test (GLT) contrasts (controlling for age and education): 0-back vs. Rest, 2-back vs. Rest, and 2-back vs. 0-back. Group-level t tests then identified the components whose β contrasts significantly differed from zero across subjects within the sample [i.e., with p ≤.05 after false-discovery rate (FDR) correction for the 105 contrasts (35 components×3 GLT contrasts)].

A post hoc analysis was also conducted to determine if the mid-study equipment upgrade from the 8- to 32-channel head coil represented a confounding factor for the GLM analysis. For each ICA component, a one-way analysis of variance (ANOVA) tested whether subjects scanned on either head coil (8 vs. 32) had significantly different GLT βs for the 2-back vs. 0-back contrast. ANOVA results demonstrated no significant effect of head coil on GLT results for any of the components (all p>.05 after FDR correction), supporting the exclusion of head coil as a covariate.

RESULTS

Behavioral Results

Table 2 provides descriptive statistics for participants’ LNB and NP performances. Mean (SD) LNB accuracy was 0.97 (0.09) for 0-back trials and 0.61 (0.21) for 2-back trials. Accuracy was significantly lower for 2-back vs. 0-back trials [paired t test(33)=12.13, p<1×10-12], consistent with expected diminishes in performance resulting from 2-back’s greater task difficulty. Increased task difficulty was also conveyed by parallel increases in RT for 2-back relative to 0-back conditions, with a mean (SD) RT of 0.45 (0.06) and 0.63 (0.07) seconds for 0-back and 2-back trials, respectively (paired t test(33)=13.77; p<1×10-14).

Table 2 Descriptive statistics for group performance

As an initial step of the construct validity analysis, a Lilliefors’ test determined LNB 2-back accuracy to have a non-normal distribution (K=0.155; p <.05), warranting the use of Spearman’s correlations for the bootstrapping procedure. Table 3 and Figure 1 illustrate the 95% CIs calculated from the bootstrapped correlations between LNB and each NP assessment. The following assessments had 95% CIs that did not include zero, indicating convergent validity with the LNB: DSS, SSF, SSR, TEA 4 (accuracy and timing), TEA 5, and TMT 2-4. Conversely, the following tests’ 95% CIs did include zero, indicating discriminant validity with the LNB: DSF, DSB, TEA 1-3, TMT 1 and 5, FTT, and BNT. As described in Table 3, the NP assessments that significantly converged with LNB had mean bootstrapped |ρ| ranging from 0.37 to 0.60, while assessments that discriminated from LNB had mean bootstrapped |ρ| ranging from 0.007 to 0.29.

Fig. 1 Graph of 95% CIs for bootstrapped distributions of LNB performance correlations with NP test scores. The means and upper and lower confidence limits are depicted for each of the bootstrap distributions. LNB demonstrated discriminant or convergent validity with NP measures exhibiting 95% CIs that did (DSF, DSB, TEA 1-3, TMT 1, TMT 5, FTT, and BNT) or did not include zero (SSF, SSR, DSS, TEA 4 Acc and Time, TEA 5, and TMT 2-4), respectively. See Table 3 for detailed statistics.

Table 3 Bootstrap correlation statistics for LNB construct validity analysis

Abbreviations: SSF=Spatial Span Forward, SSR=Spatial Span Reverse, DSF=Digit Span Forward, DSB=Digit Span Backward, DSS=Digit Span Sequencing, TEA=Test of Everyday Attention, TMT=Trail Making Test, FTT=Finger Tapping Test, BNT=Boston Naming Test-2.

Neuroimaging Results

Of the 35 ICA components identified, 14 were classified as noise artifact components according to the criteria delineated in METHODS, Image Acquisition and Processing, and omitted from subsequent analysis (see Supplementary Table S1 for full descriptions of all 35 components, including noise components). Table 4 GLM statistics show that, of the 21 non-noise components, 17 demonstrated significant task-dependent activity. Eight components were significantly more active during 2-back than 0-back: cerebellum (IC10), superior parietal lobule (SPL)/precuneus (IC12), right frontoparietal (RFP; IC21), supplementary motor area/lateral premotor (SMA/LPM; IC22), left frontoparietal (LFP; IC23), dorsolateral prefrontal cortex (DLPFC; IC25), frontoinsular (IC29), and bilateral primary motor (M1; IC30) (all FDR p<.0005; see Figure 2 for images of these components). Nine components were significantly less active during 2-back than 0-back; bilateral anterior insulae (IC4), left primary motor (LM1; IC6), right primary motor (RM1; IC14), anterior DMN (IC17), bilateral amygdalae/hippocampi (IC18), posterior DMN (IC19), dorsomedial prefrontal cortex (DMPFC; IC20), auditory (IC28), and ventromedial prefrontal cortex (VMPFC; IC35) (all FDR p<.05; see Supplementary Figure S2 for images of these components).

Fig. 2 Eight ICA-derived networks demonstrated greater activity during 2-back vs. 0-back task conditions. Axial, sagittal, and coronal planes are shown (respectively) for each independent component (IC). Activations are depicted in neurological convention (left=left) with minimum cluster size=50 voxels (allowing voxels connected by edge to constitute a cluster). IC10=cerebellum, IC12=SPL/precuneus, IC21=RFP, IC22=SMA/LPM, IC23=LFP, IC25=DLPFC, IC29=frontoinsular, IC30=Bilateral Primary Motor. (See Supplementary Table S1 and Figure S1 for detailed IC subcluster composition).

Table 4 GLT and group-level t test statistics describing task-relatedness of ICA networks (n components=21)

Abbreviations: GLT=General Linear Test, IC=independent component, 2B=2-back, 0B=0-back, R=Rest, FDR p-val=False Discovery Rate corrected p-value, SPL=superior parietal lobule, DMN=default mode network, DMPFC=dorsomedial prefrontal cortex, SMA=supplementary motor area, LPM=lateral premotor, DLPFC=dorsolateral prefrontal cortex, VMPFC=ventromedial prefrontal cortex

DISCUSSION

The current study sought to empirically validate the LNB as a WM probe by assessing both its behavioral construct validity and characterizing its specificity for network-level recruitment of WM-related neural processing correlates.

LNB Demonstrates Strong Measurement Specificity for WM Constructs

LNB demonstrated broad convergence with NP tasks assessing auditory and verbal WM. LNB was most strongly convergent with TEA 5, which measures auditory-verbal WM and attentional switching, and was slightly less convergent with TEA 3, which measures auditory-verbal WM and inhibitory control. While LNB has been proposed to involve both attentional switching and inhibitory control processes (Bledowski, Kaiser, & Rahm, Reference Bledowski, Kaiser and Rahm2010; Owen et al., Reference Owen, McMillan, Laird and Bullmore2005; Wager & Smith, Reference Wager and Smith2003), LNB’s stronger correlation with TEA 5 than TEA 3 suggests a greater involvement of attentional switching during the LNB. LNB also exhibited strong convergence with DSS, which requires maintenance and manipulation of auditory-verbal stimuli within WM. Unexpectedly, LNB did not converge with DSB, despite DSB reportedly tapping much the same cognitive abilities as DSS. This finding may reflect the greater WM demands required of DSS’s more complex ordinal sequencing manipulation vs. DSB’s stimulus reversal (Sattler & Ryan, Reference Sattler and Ryan2009; Wechsler, Reference Wechsler2008). Furthermore, the 95% CIs for LNB’s correlation with TEA 5 and DSS (Figure 1) are distinctly different from zero (i.e., robust), suggesting a high probability of replicating this finding in an independent sample. Conversely, the 95% CIs for LNB’s correlation with DSB and TEA 3 are marginally distinct from zero, indicating that these findings are less statistically robust, that is, more likely to differ in an independent replication.

LNB also demonstrated convergence with tasks engaging visual and visuospatial WM processes. LNB was strongly convergent with both SSF and SSR. This finding corroborates previous reports that forward and reverse conditions of the Spatial Span (and the homologous Corsi Block Tapping Task) have comparable WM demands (Kessels, van den Berg, Ruis, & Brands, Reference Kessels, van den Berg, Ruis and Brands2008; Li & Lewandowsky, Reference Li and Lewandowsky1995; Smyth & Scholey, Reference Smyth and Scholey1992; Wilde & Strauss, Reference Wilde and Strauss2002). LNB performance also converged with TEA 4 timing and accuracy, measures of visual attentional switching. Lastly, LNB exhibited strong convergence with TMT 4 and weaker but significant convergence with TMT 2 and 3. We expected convergence with TMT 4 given its temporal sequencing and set shifting demands; however, LNB convergence with TMT 2 and 3 was unanticipated. Similarities in task design may explain this unexpected convergence, as LNB, TMT 2 and TMT 3 all require maintenance of a continuous alphabetical or numerical sequence.

In establishing discriminant validity, we expected LNB performance to be unrelated to both verbal and visual/visuospatial measures of short-term memory, simple sustained attention, vigilance, visuomotor speed, simple motor speed, and language processing. This was demonstrated in the lack of correlation between the LNB and DSF, TEA 2, TMT 1, TMT 5, FTT, and BNT, respectively.

In summary, we report moderate to high convergence of LNB performance with WM measures across sensory modality (i.e., auditory-verbal, visuospatial, visual) and discrimination from measures of short-term memory, attention, vigilance, visuomotor speed, and general language processing (Table 3). Although LNB is generally considered a verbal WM task, we report convergence with both verbal and visual/visuospatial WM measures. Thus, LNB’s assessment of the underlying domain-general WM construct transcended the modality-specific differences that exist across differing WM validity tests. These findings support the LNB as a processing load for the same core cognitive construct measured by canonical WM tasks despite task-specific differences, and demonstrate that their relationships are not mediated by general attentional or perceptual task demands alone. As such, these collective results corroborate the use of the LNB as a robust, domain-general cognitive-behavioral probe of WM.

LNB Demonstrates Specificity for WM-Related Recruitment of Neural Networks

Our combined ICA and GLM approach identified eight task-positive networks (Table 4; Figure 2), which included all seven task-related regions described by previous meta-analysis of n-back tasks (Owen et al., Reference Owen, McMillan, Laird and Bullmore2005). In addition to replicating these past univariate findings, ICA informs how these regions actively interact during task. Four of these previously reported regions (bilateral DLPFC, mid-VLPFC, rostral PFC, and posterior parietal/precuneus regions) were captured within our left and right frontoparietal networks [LFP (IC23) and RFP (IC21)]. These networks were more active during 2-back vs. Rest and 2-back vs. 0-back contrasts but not 0-back vs. Rest, indicating WM-related recruitment specificity. These networks have been implicated in a broad range of cognitive processes, including language, reasoning, attention, and explicit memory (Fox et al., Reference Fox, Laird, Fox, Fox, Uecker, Crank and Lancaster2005; Smith et al., Reference Smith, Fox, Miller, Glahn, Fox, Mackay and Beckmann2009). LFP is often portrayed as having greater domain-general task involvement than RFP (Smith et al., Reference Smith, Fox, Miller, Glahn, Fox, Mackay and Beckmann2009), but is particularly identified in tasks involving verbal WM (Owen et al., Reference Owen, McMillan, Laird and Bullmore2005; Wager & Smith, Reference Wager and Smith2003), as supported by our present findings. Of interest, ICA also identified bilateral DLPFC (IC25) and bilateral SPL/precuneus (IC12) components independent of the LFP and RFP networks, possibly reflecting the intrinsic interhemispheric connectivity of these regions.

ICA revealed Owen et al.’s bilateral premotor, dorsal cingulate/SMA, and medial cerebellar neuroactivations as three separate motor-related components: bilateral M1 (IC30), SMA/LPM (IC22), and cerebellum (IC10). These networks were positively activated across all three n-back GLT contrasts, suggesting a general role in executing motor responses independent of WM load. The premotor cortex has also been associated with updating and maintenance of the temporal order of stimuli encoded during n-back task performance (Wager & Smith, Reference Wager and Smith2003). Of note, the medial cerebellar cluster identified by Owen et al. was represented in both our cerebellar and LFP networks, indicating a possible role in cognitive aspects of LNB performance. Given the known role of the cerebellum in cognition, (Desmond & Fiez, Reference Desmond and Fiez1998; Koziol, Budding, & Chidekel, Reference Koziol, Budding and Chidekel2012; Leiner, Leiner, & Dow, Reference Leiner, Leiner and Dow1986; Marien, Engelborghs, & De Deyn, Reference Marien, Engelborghs and De Deyn2001; Strick, Dum, & Fiez, Reference Strick, Dum and Fiez2009), and, more specifically, in WM (Desmond, Gabrieli, Wagner, Ginier, & Glover, Reference Desmond, Gabrieli, Wagner, Ginier and Glover1997; Durisko & Fiez, Reference Durisko and Fiez2010; Hautzel, Mottaghy, Specht, Müller, & Krause, Reference Hautzel, Mottaghy, Specht, Müller and Krause2009) this is not completely unexpected, although additional research tracking cerebellar recruitment in WM may prove informative to better understanding the interplay of cerebellar and frontal networks. Our ICA also identified a frontoinsular network (IC29) that included Owen et al.’s WM-related precuneus, dorsal cingulate/SMA, and bilateral mid-VLPFC activations. Studies have implicated this network in domain-independent, externally directed task modes in opposition to the DMN that initiate transitions between engagement and disengagement of the frontoparietal and DMN across tasks and stimulus modalities (Dosenbach et al., Reference Dosenbach, Fair, Miezin, Cohen, Wenger, Dosenbach and Petersen2007; Sridharan, Levitin, & Menon, Reference Sridharan, Levitin and Menon2008; Tang, Rothbart, & Posner, Reference Tang, Rothbart and Posner2012). This dynamic switching function has been proposed to permit access to attentional and WM resources following a task-salient event to facilitate goal-directed behavior (Menon & Uddin, Reference Menon and Uddin2010).

Our task-active ICA-derived networks overlapped in their recruitment of the regions identified by Owen et al., suggesting that these common regions subserve multiple, differing functional roles (Xu, Zhang, et al., Reference Xu, Zhang, Calhoun, Monterosso, Li, Worhunsky and Potenza2013). Whereas, traditional univariate approaches identify which brain regions are involved in a task, ICA complements such findings by also informing how these regions are co-recruited to form distinct functional networks. The ability of ICA to map the functional organization of these regions into discrete neural processing networks underscores its power for exploring individual differences in the brain’s capacity to dynamically organize cognitive resources in response to task demands (Congdon et al., Reference Congdon, Mumford, Cohen, Galvan, Aron, Xue and Poldrack2010; Xu, Zhang, et al., Reference Xu, Zhang, Calhoun, Monterosso, Li, Worhunsky and Potenza2013).

The ICA and GLM analysis also identified nine “task-negative” networks, that is, networks less engaged during 2-back than 0-back conditions (Table 4 for GLM statistics; Supplementary Figure S2 for images of task-negative components). Because Owen et al. only included task-positive activations, it is unclear whether our “deactivations” are specific to this n-back task variant or generally applicable to n-back tasks. Also, although we identified many of the same networks as Esposito et al. (Reference Esposito, Bertolino, Scarabino, Latorre, Blasi, Popolizio and Di Salle2006), their reporting of only magnitude (not direction) of network activity prevents a comparison of task-negative networks between our studies. Consequently, we discuss these findings in brief.

Although we report activation of bilateral M1 (IC30) across task conditions, ICA also identified separate LM1 (IC6) and RM1 (IC14) components that were deactivated by task. LM1 showed less activity during 2-back vs. 0-back, but more activity for 0-back vs. Rest and no difference in activity between 2-back vs. Rest. RM1 exhibited less activity during 2-back vs. 0-back and 2-back vs. Rest but no significant differences in activity for 0-back vs. Rest. Since participants responded with only their right hand (corresponding to LM1), the lesser RM1 engagement during the 2-back conditions may reflect task-induced deactivation (TID), a relative decrease in neural activity within an uninvolved region in response to increased task demand elsewhere (Allison, Meader, Loring, Figueroa, & Wright, Reference Allison, Meader, Loring, Figueroa and Wright2000; Liu, Shen, Zhou, & Hu, Reference Liu, Shen, Zhou and Hu2011; Zeharia, Hertz, Flash, & Amedi, Reference Zeharia, Hertz, Flash and Amedi2012). The task-deactivation of LM1, however, is harder to interpret. Future work should explore the task-dependent interactions among these motor networks at varying levels of cognitive and psychomotor processing loads, for instance, using motor response-based paradigms with parametric and/or dual-task designs, as is the case in several variants of the n-back.

The bilateral anterior insulae (IC4), amygdalae/hippocampi (IC18), DMPFC (IC20), auditory (IC28), and VMPFC (IC35) networks also exhibited patterns of activity that seemed to reflect TID. However, the current task design was unable to determine whether these TID patterns represented a facilitatory process (i.e., processing resources were redistributed from task-irrelevant regions to support regions involved in task performance) (Arsalidou, Pascal-Leone, Johnson, Morris, & Taylor, Reference Arsalidou, Pascal-Leone, Johnson, Morris and Taylor2013; Jackson, Morgan, Shapiro, Mohr, & Linden, Reference Jackson, Morgan, Shapiro, Mohr and Linden2011; Leech, Kamourieh, Beckmann, & Sharp, Reference Leech, Kamourieh, Beckmann and Sharp2011), or reflected the attenuation of internally focused mentation (i.e., activity in self-referential regions was suspended during the externally focused, goal-directed task) (Gusnard & Raichle, Reference Gusnard and Raichle2001; McKiernan, Kaufman, Kucera-Thompson, & Binder, Reference McKiernan, Kaufman, Kucera-Thompson and Binder2003; Spreng & Grady, Reference Spreng and Grady2010). Future research should explore the involvement of differing cognitive strategies resulting in both task-induced activation and deactivation as it relates to performance of WM tasks, such as the n-back.

Finally, components representing anterior [VMPFC and PCC (IC17)] and posterior [PCC and bilateral inferior parietal (IC19)] elements of the DMN were identified as independent networks. These regions are typically represented as a single network consistently deactivated across demanding task conditions, indicating greater activity during Rest than during effortful cognition (Greicius, Krasnow, Reiss, & Menon, Reference Greicius, Krasnow, Reiss and Menon2003; Greicius, Srivastava, Reiss, & Menon, Reference Greicius, Srivastava, Reiss and Menon2004) as a result of their involvement in internally derived, self-referential thought processes, such as daydreaming, introspection, and theory of mind (Buckner, Andrews-Hanna, Schacter, Kingstone, & Miller, Reference Buckner, Andrews-Hanna, Schacter, Kingstone and Miller2008; Raichle et al., Reference Raichle, MacLeod, Snyder, Powers, Gusnard and Shulman2001; Spreng & Grady, Reference Spreng and Grady2010). We report task-dependent activity for both posterior DMN and anterior DMN. Of interest, however, only posterior DMN significantly differs across all 3 contrasts, whereas anterior DMN differs only for 2-back vs. 0-back. While the segregation of DMN into anterior and posterior networks may be attributed to network fragmentation when solving for a higher number of components (n=35), increasing evidence suggests the DMN to be inherently modular in its organization and represented by multiple interacting subsystems with differential functional specializations (Andrews-Hanna, Reidler, Huang, & Buckner, Reference Andrews-Hanna, Reidler, Huang and Buckner2010; Buckner et al., Reference Buckner, Andrews-Hanna, Schacter, Kingstone and Miller2008; Laird et al., Reference Laird, Eickhoff, Li, Robin, Glahn and Fox2009; Mayer, Roebroeck, Maurer, & Linden, Reference Mayer, Roebroeck, Maurer and Linden2010; Uddin, Kelly, Biswal, Castellanos, & Milham, Reference Uddin, Kelly, Biswal, Castellanos and Milham2009). Future studies should explore the functional relevance of these individual (sub)networks, especially in the context of WM tasks (Ray et al., Reference Ray, McKay, Fox, Riedel, Uecker, Beckmann and Laird2013). Given past studies’ usage of the LNB to characterize DMN function, the present study provides an important step toward characterizing both the engagement and disengagement of functional networks in service of LNB task performance by illustrating the emergence of WM function through the concerted efforts of functionally diverse networks.

Limitations

One limitation of ICA is that the number of components estimated defines the neuroanatomical representation of the identified networks (Abou-Elseoud et al., Reference Abou-Elseoud, Starck, Remes, Nikkinen, Tervonen and Kiviniemi2010; Pamilo et al., Reference Pamilo, Malinen, Hlushchuk, Seppä, Tikka and Hari2012). While our 35-component ICA produced predominantly stable and functionally relevant networks, some components (i.e., IC27 and IC31) appeared to merge noise artifact with the functional networks, while other networks (i.e., DMN) appeared fragmented across multiple components (IC17 and IC19). Solving for fewer components (i.e., 20, 25, 30), however, led to components with a greater merging of distinct functional networks, thus limiting their interpretability. We, thus, chose the 35-component ICA as a better representation of canonical functional networks and task-relevant cognitive processing.

The present study sought to determine the convergent/discriminant relationships of the n-back task with clinically validated NP assessments that have previously undergone construct validation. While our sample size is suitably large for a neuroimaging study, psychometric validation studies are typically conducted in much larger samples (Robertson et al., Reference Robertson, Ward, Ridgeway and Nimmo-Smith1996; Burton, Ryan, Axlerod, Schellenberger, & Richards, Reference Burton, Ryan, Axlerod, Schellenberger and Richards2003); thus, replication of our analyses in a larger sample is suggested to confirm the generalizability of these behavioral findings. Additionally, we could not feasibly control for time of NP administration in this study. While between-subject diurnal variance in performance has been reported for some measures of executive function (i.e., Wisconsin Card Sorting Task; Bennett, Petros, Johnson, & Ferraro, 2008), measures of WM (specifically, the Digit Span Test) appear resilient to such effects. To further explore diurnal variance in these measures, these effects should be assessed in a larger within-subject test–retest study design.

Finally, our LNB task was designed to quickly map brain regions subserving WM in healthy and clinical adult populations, and was thus not optimized to assess other factors of interest such as varying network recruitment with parametric load manipulation, error processing, or differential network involvement in WM subprocesses. Thus, our neuroimaging findings may be specific to the LNB task, and should be replicated using other n-back variants and neuroimaging tasks of WM. However, we present these neuroimaging and NP findings with hopes of laying the groundwork for future investigations into these areas.

CONCLUSIONS

To our knowledge, the present study is the first to comprehensively investigate the construct validity of the LNB task as a WM probe and to identify the task-related neural network representation of healthy WM function. Future work will characterize normative WM brain-behavior relationships by assessing how WM network functional organization reflects individual differences in WM ability. By modeling the neural encoding of cognitive and behavioral WM—in both healthy subjects (as described here) and in future clinical populations—we aim to differentiate normative neural processing variance from the specific disparities associated with disrupted brain function in individual patients, thereby extending this neuroimaging model into the personalized treatment of various disorders related to WM dysfunction.

As functional neuroimaging begins to play a larger role in clinical assessment, we need to better understand the relationships between neuroimaging and clinical neuropsychology, and remain receptive to questioning and modifying each in the face of evidence derived from studies such as this. As such, the present study exemplifies the value of merging functional neuroimaging and clinical neuropsychology so that these disparate fields may mutually inform one another, and thus provide a framework to further translate functional neuroimaging into clinical care.

Acknowledgments

This research was supported by the Translational Research Institute (TRI) at the University of Arkansas for Medical Sciences (UAMS) which is funded by the National Institutes of Health (NIH) Clinical and Translational Science Award (CTSA) program (UL1TR000039); the CTSA KL2 Scholars Program (KL2TR000063; to G.A.J.); NIH National Institute of General Medical Sciences Initiative for Maximizing Student Development Fellowship (IMSD; R25GM083247; to T.K.R.) and NIH National Institute of Drug Abuse T32 Addiction Training Grant (T32DA022981; to T.K.R.). CDK served as a member of a scientific advisory meeting for Allergan Pharmaceuticals, served as a member of the national advisory board for Skyland Trail, and is also a co-holder of U.S. Patent No. 6,373,990 (Method and device for the transdermal delivery of lithium). The authors declare no conflicts of interest. All authors contributed to the interpretation and writing of this manuscript. We thank Jonathan Young and Sonet Smitherman of UAMS for their roles in study coordination and MRI scanner operation, and Molly Robbins, Bradford Martins and Sarah Zimmerman of UAMS for their help with data entry.

References

Abou-Elseoud, A., Starck, T., Remes, J., Nikkinen, J., Tervonen, O., & Kiviniemi, V. (2010). The effect of model order selection in group PICA. Human Brain Mapping, 31(8), 12071216. doi:10.1002/hbm.20929 CrossRefGoogle ScholarPubMed
Allison, J., Meader, K., Loring, D., Figueroa, R., & Wright, J. (2000). Functional MRI cerebral activation and deactivation during finger movement. Neurology, 54(1), 135142.Google Scholar
Andrews-Hanna, J., Reidler, J., Huang, C., & Buckner, R. (2010). Evidence for the default network’s role in spontaneous cognition. Journal of Neurophysiology, 104(1), 322335. doi:10.1152/jn.00830.2009 Google Scholar
Arsalidou, M., Pascal-Leone, J., Johnson, J., Morris, D., & Taylor, M.J. (2013). A balancing act of the brain: Activations and deactivations driven by cognitive load. Brain and Behavior, 3, 273285.Google Scholar
Baddeley, A. (1986). Working memory. Oxford: Clarendon Press.Google ScholarPubMed
Baddeley, A. (2012). Working memory: Theories, models, and controversies. In S.T. Fiske, D.L. Schacter & S.E. Taylor (Eds.), Annual review of psychology, (Vol. 63, pp 129). Palo Alto: Annual Reviews.Google Scholar
Baddeley, A., Banse, R., Huang, Y.M., & Page, M. (2012). Working memory and emotion: Detecting the hedonic detector. Journal of Cognitive Psychology, 24(1), 616. doi:10.1080/20445911.2011.613820 CrossRefGoogle Scholar
Beckmann, C.F. (2012). Modelling with independent components. Neuroimage, 62(2), 891901.Google Scholar
Bennett, C.L., Petros, T.V., Johnson, M., & Ferraro, F.R. (2008). Individual differences in the influence of time of day on executive functions. Am J Psychol, 121(3), 349361. doi:10.2307/20445471.Google Scholar
Bledowski, C., Kaiser, J., & Rahm, B. (2010). Basic operations in working memory: Contributions from functional imaging studies. Behavioural Brain Research, 214(2), 172179.CrossRefGoogle ScholarPubMed
Braver, T.S., Cohen, J.D., Nystrom, L.E., Jonides, J., Smith, E.E., & Noll, D.C. (1997). A parametric study of prefrontal cortex involvement in human working memory. Neuroimage, 5(1), 4962. doi:10.1006/nimg.1996.0247 CrossRefGoogle ScholarPubMed
Buckner, R., Andrews-Hanna, J., Schacter, D., Kingstone, A., & Miller, M. (2008). The brain’s default network - Anatomy, function, and relevance to disease. Annals of the New York Academy of Sciences, 1124, 138. doi:10.1196/annals.1440.011 CrossRefGoogle ScholarPubMed
Burton, D.B., Ryan, J.J., Axlerod, B.N., Schellenberger, T., & Richards, H.M. (2003). A confirmatory factor analysis of the WMS-III in a clinical sample with crossvalidation in the standardization sample. Archives of Clinical Neuropsychology, 18(6), 629641.CrossRefGoogle Scholar
Calhoun, V.D., Adali, T., Pearlson, G.D., & Pekar, J.J. (2001). A method for making group inferences from functional MRI data using independent component analysis. Human Brain Mapping, 14(3), 140151. doi:10.1002/hbm.1048 Google Scholar
Calhoun, V.D., Adali, T., Pearlson, G.D., & Pekar, J.J. (2002). On complex infomax applied to functional MRI data. Paper presented at the International Conference on Acoustics, Speech, and Signal Processing, Orlando, Florida, May 13–17, 2002.Google Scholar
Champod, A.S., & Petrides, M. (2010). Dissociation within the frontoparietal network in verbal working memory: A parametric functional magnetic resonance imaging study. Journal of Neuroscience, 30(10), 38493856. doi:10.1523/jneurosci.0097-10.2010 CrossRefGoogle ScholarPubMed
Ciesielski, K.T., Lesnik, P.G., Savoy, R.L., Grant, E.P., & Ahlfors, S.P. (2006). Developmental neural networks in children performing a Categorical N-Back Task. Neuroimage, 33(3), 980990.Google Scholar
Cohen, J.D., Perlstein, W.M., Braver, T.S., Nystrom, L.E., Noll, D.C., Jonides, J., & Smith, E.E. (1997). Temporal dynamics of brain activation during a working memory task. Nature, 386(6625), 604608. doi:10.1038/386604a0 CrossRefGoogle ScholarPubMed
Colom, R., Abad, F.J., Quiroga, M.A., Shih, P.C., & Flores-Mendoza, C. (2008). Working memory and intelligence are highly related constructs, but why? Intelligence, 36, 584606.Google Scholar
Congdon, E., Mumford, J., Cohen, J., Galvan, A., Aron, A., Xue, G., Poldrack, R. (2010). Engagement of large-scale networks is related to individual differences in inhibitory control. Neuroimage, 53(2), 653663. doi:10.1016/j.neuroimage.2010.06.062 Google Scholar
Conway, A.R.A., Jarrold, C., Kane, M.J., Miyake, A., & Towse, J.N. (2007). Variation in working memory. New York, NY: Oxford University Press.Google Scholar
Conway, A.R.A., Kane, M., Bunting, M., Hambrick, D., Wilhelm, O., & Engle, R. (2005). Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin & Review, 12(5), 769786. doi:10.3758/BF03196772 Google Scholar
Cousijn, J., Wiers, R.W., Ridderinkhof, K.R., van den Brink, W., Veltman, D.J., & Goudriaan, A.E. (2014). Effect of baseline cannabis use and working-memory network function on changes in cannabis use in heavy cannabis users: A prospective fMRI study. Human Brain Mapping, 35, 24702482. doi:10.1002/hbm.22342 CrossRefGoogle ScholarPubMed
Cox, R.W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29(3), 162173.Google Scholar
Cumming, G. (2008). Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. Perspectives on Psychological Science, 3(4), 286300. doi:10.1111/j.1745-6924.2008.00079.x Google Scholar
D’Esposito, M. (2007). From cognitive to neural models of working memory. Philosophical Transactions of the Royal Society B-Biological Sciences, 362(1481), 761772. doi:10.1098/rstb.2007.2086 CrossRefGoogle ScholarPubMed
Delis, D.C., Kaplan, E., & Kramer, J.H. (2001). Delis-Kaplan Executive Function System. San Antonio, TX: The Psychological Corporation.Google Scholar
Desmond, J.E., & Fiez, J.A. (1998). Neuroimaging studies of the cerebellum: Language, learning and memory. Trends in Cognitive Sciences, 2(9), 355362.CrossRefGoogle ScholarPubMed
Desmond, J.E., Gabrieli, J.D., Wagner, A.D., Ginier, B.L., & Glover, G.H. (1997). Lobular patterns of cerebellar activation in verbal working-memory and finger-tapping tasks as revealed by functional MRI. Journal of Neuroscience, 17(24), 96759685.CrossRefGoogle ScholarPubMed
Dosenbach, N.U., Fair, D.A., Miezin, F.M., Cohen, A.L., Wenger, K.K., Dosenbach, R.A., Petersen, S.E. (2007). Distinct brain networks for adaptive and stable task control in humans. Proceedings of the National Academy of Sciences of the United States of America, 104(26), 1107311078. doi:10.1073/pnas.0704320104 Google Scholar
Durisko, C., & Fiez, J.A. (2010). Functional activation in the cerebellum during working memory and simple speech tasks. Cortex, 46(7), 896906. doi:10.1016/j.cortex.2009.09.009 Google Scholar
Efron, B., & Tibshirani, R. (1993). An introduction to the bootstrap. New York: Chapman and Hall.Google Scholar
Esposito, F., Aragri, A., Latorre, V., Popolizio, T., Scarabino, T., Cirillo, S., Di Salle, F. (2009). Does the default-mode functional connectivity of the brain correlate with working-memory performances? Archives Italiennes de Biologie, 147(1-2), 1120.Google ScholarPubMed
Esposito, F., Bertolino, A., Scarabino, T., Latorre, V., Blasi, G., Popolizio, T., Di Salle, F. (2006). Independent component model of the default-mode brain function: Assessing the impact of active thinking. Brain Research Bulletin, 70(4-6), 263269. doi:10.1016/j.brainresbull.2006.06.012 Google Scholar
First, M.B., Spitzer, R.L., Gibbon, M., & Williams, J.B.W. (2002). Structured clinical interview for DSM-IV-TR Axis I disorders, research version, non-patient edition (SCID-I/NP). New York: Biometrics Research, New York State Psychiatric Institute.Google Scholar
Fox, P.T., Laird, A.R., Fox, S.P., Fox, P.M., Uecker, A.M., Crank, M., Lancaster, J.L. (2005). BrainMap taxonomy of experimental design: Description and evaluation. Human Brain Mapping, 25(1), 185198. doi:10.1002/hbm.20141 Google Scholar
Friedman, N.P., Miyake, A., Corley, R.P., Young, S.E., Defries, J.C., & Hewitt, J.K. (2006). Not all executive functions are related to intelligence. Psychological Science, 17(2), 172179. doi:10.1111/j.1467-9280.2006.01681.x Google Scholar
Gagnon, L.G., & Belleville, S. (2011). Working memory in mild cognitive impairment and Alzheimer’s disease: Contribution of forgetting and predictive value of complex span tasks. Neuropsychology, 25(2), 226236. doi:10.1037/a0020919 Google Scholar
Gardner, M.J., & Altman, D.G. (1986). Confidence intervals rather than P values: Estimation rather than hypothesis testing. British Medical Journal (Clinical Research Ed), 292(6522), 746750.Google Scholar
Gevins, A., & Smith, M.E. (2000). Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. Cerebral Cortex, 10(9), 829839.CrossRefGoogle ScholarPubMed
Gorman, S., Barnes, M.A., Swank, P.R., Prasad, M., & Ewing-Cobbs, L. (2012). The effects of pediatric traumatic brain injury on verbal and visual-spatial working memory. Journal of the International Neuropsychological Society, 18(1), 2938. doi:10.1017/S1355617711001251 Google Scholar
Gray, J.R., Chabris, C.F., & Braver, T.S. (2003). Neural mechanisms of general fluid intelligence. Nature Neuroscience, 6(3), 316322. doi:10.1038/nn1014 Google Scholar
Greicius, M.D., Krasnow, B., Reiss, A.L., & Menon, V. (2003). Functional connectivity in the resting brain: A network analysis of the default mode hypothesis. Proceedings of the National Academy of Sciences of the United States of America, 100(1), 253258. doi:10.1073/pnas.0135058100 Google Scholar
Greicius, M.D., Srivastava, G., Reiss, A.L., & Menon, V. (2004). Default-mode network activity distinguishes Alzheimer's disease from healthy aging: Evidence from functional MRI. Proceedings of the National Academy of Sciences of the United States of America, 101(13), 46374642. doi:10.1073/pnas.0308627101 CrossRefGoogle ScholarPubMed
Gusnard, D.A., & Raichle, M.E. (2001). Searching for a baseline: Functional imaging and the resting human brain. Nature Reviews. Neuroscience, 2(10), 685694. doi:10.1038/35094500 CrossRefGoogle ScholarPubMed
Haller, S., Homola, G.A., Scheffler, K., Beckmann, C.F., & Bartsch, A.J. (2009). Background MR gradient noise and non-auditory BOLD activations: A data-driven perspective. Brain Research, 1282, 7483. doi:10.1016/j.brainres.2009.05.094 CrossRefGoogle ScholarPubMed
Hautzel, H., Mottaghy, F.M., Specht, K., Müller, H.W., & Krause, B.J. (2009). Evidence of a modality-dependent role of the cerebellum in working memory? An fMRI study comparing verbal and abstract n-back tasks. Neuroimage, 47(4), 20732082. doi:10.1016/j.neuroimage.2009.06.005 CrossRefGoogle ScholarPubMed
Jackson, M.C., Morgan, H.M., Shapiro, K.L., Mohr, H., & Linden, D.E. (2011). Strategic resource allocation in the human brain supports cognitive coordination of object and spatial working memory. Human Brain Mapping, 32(8), 13301348. doi:10.1002/hbm.21112 CrossRefGoogle ScholarPubMed
Jaeggi, S.M., Buschkuehl, M., Perrig, W.J., & Meier, B. (2010). The concurrent validity of the N-back task as a working memory measure. Memory, 18(4), 394412. doi:10.1080/09658211003702171 CrossRefGoogle ScholarPubMed
Jenkinson, M., Beckmann, C.F., Behrens, T.E., Woolrich, M.W., & Smith, S.M. (2012). FSL. Neuroimage, 62(2), 782790. doi:10.1016/j.neuroimage.2011.09.015 CrossRefGoogle ScholarPubMed
Jonides, J., Schumacher, E.H., Smith, E.E., Lauber, E.J., Awh, E., Minoshima, S., & Koeppe, R.A. (1997). Verbal working memory load affects regional brain activation as measured by PET. Journal of Cognitive Neuroscience, 9(4), 462475. doi:10.1162/jocn.1997.9.4.462 Google Scholar
Just, M.A., & Carpenter, P.A. (1992). A capacity theory of comprehension: Individual differences in working memory. Psychology Review, 99(1), 122149.CrossRefGoogle ScholarPubMed
Kane, M.J., Conway, A.R., Miura, T.K., & Colflesh, G.J. (2007). Working memory, attention control, and the N-back task: A question of construct validity. Journal of Expimental Psychology . Learning, Memory, and Cognition, 33(3), 615622. doi:10.1037/0278-7393.33.3.615 Google Scholar
Kane, M.J., & Engle, R.W. (2002). The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective. Psychonomic Bulletin & Review, 9(4), 637671.Google Scholar
Kaplan, E., Goodglass, H., & Weintraub, S. (2001). The Boston Naming Test (2nd ed.). Philadelphia: Lippincott Williams & Wilkins.Google Scholar
Kessels, R.P., van den Berg, E., Ruis, C., & Brands, A.M. (2008). The backward span of the Corsi Block-Tapping Task and its association with the WAIS-III Digit Span. Assessment, 15(4), 426434. doi:10.1177/1073191108315611 CrossRefGoogle ScholarPubMed
Kim, D.I., Manoach, D.S., Mathalon, D.H., Turner, J.A., Mannell, M., Brown, G.G., Calhoun, V.D. (2009). Dysregulation of working memory and default-mode networks in schizophrenia using independent component analysis, an fBIRN and MCIC study. Human Brain Mapping, 30(11), 37953811. doi:10.1002/hbm.20807 Google Scholar
Koziol, L.F., Budding, D.E., & Chidekel, D. (2012). From movement to thought: Executive function, embodied cognition, and the cerebellum. Cerebellum, 11(2), 505525. doi:10.1007/s12311-011-0321-y CrossRefGoogle ScholarPubMed
Laird, A.R., Eickhoff, S.B., Li, K., Robin, D.A., Glahn, D.C., & Fox, P.T. (2009). Investigating the functional heterogeneity of the default mode network using coordinate-based meta-analytic modeling. Journal of Neuroscience, 29(46), 1449614505. doi:10.1523/JNEUROSCI.4004-09.2009 Google Scholar
Leech, R., Kamourieh, S., Beckmann, C.F., & Sharp, D.J. (2011). Fractionating the default mode network: Distinct contributions of the ventral and dorsal posterior cingulate cortex to cognitive control. Journal of Neuroscience, 31(9), 32173224. doi:10.1523/JNEUROSCI.5626-10.2011 Google Scholar
Leiner, H.C., Leiner, A.L., & Dow, R.S. (1986). Does the cerebellum contribute to mental skills? Behavioral Neuroscience, 100(4), 443454.CrossRefGoogle ScholarPubMed
Li, S.C., & Lewandowsky, S. (1995). Forward and backward recall: Different retrieval processes. Journal of Experimental Psychology. Learning, Memory, and Cognition, 21(4), 837847.CrossRefGoogle Scholar
Li, Y.O., Adali, T., & Calhoun, V. (2007). Estimating the number of independent components for functional magnetic resonance imaging data. Human Brain Mapping, 28, 12511266.CrossRefGoogle ScholarPubMed
Liu, Y., Shen, H., Zhou, Z., & Hu, D. (2011). Sustained negative BOLD response in human fMRI finger tapping task. Plos One, 6(8), e23839. doi:10.1371/journal.pone.0023839 CrossRefGoogle ScholarPubMed
Marien, P., Engelborghs, S., & De Deyn, P.P. (2001). Cerebellar neurocognition: A new avenue. Acta Neurologica Belgica, 101(2), 96109.Google ScholarPubMed
Mayer, J.S., Roebroeck, A., Maurer, K., & Linden, D.E. (2010). Specialization in the default mode: Task-induced brain deactivations dissociate between visual working memory and attention. Human Brain Mapping, 31(1), 126139. doi:10.1002/hbm.20850 Google Scholar
McKeown, M.J., Jung, T.P., Makeig, S., Brown, G., Kindermann, S.S., Lee, T.W., & Sejnowski, T.J. (1998). Spatially independent activity patterns in functional MRI data during the stroop color-naming task. Proceedings of the National Academy of Sciences of the United States of America, 95(3), 803810.CrossRefGoogle ScholarPubMed
McKiernan, K.A., Kaufman, J.N., Kucera-Thompson, J., & Binder, J.R. (2003). A parametric manipulation of factors affecting task-induced deactivation in functional neuroimaging. Journal of Cognitive Neuroscience, 15(3), 394408. doi:10.1162/089892903321593117 Google Scholar
Menon, V., & Uddin, L.Q. (2010). Saliency, switching, attention and control: A network model of insula function. Brain Structure & Function, 214(5-6), 655667. doi:10.1007/s00429-010-0262-0 CrossRefGoogle ScholarPubMed
Miller, K.M., Price, C.C., Okun, M.S., Montijo, H., & Bowers, D. (2009). Is the n-back task a valid neuropsychological measure for assessing working memory? Archives of Clinical Neuropsychology, 24(7), 711717. doi:10.1093/arclin/acp063 CrossRefGoogle ScholarPubMed
Missonnier, P., Leonards, U., Gold, G., Palix, J., Ibáñez, V., & Giannakopoulos, P. (2003). A new electrophysiological index for working memory load in humans. Neuroreport, 14(11), 14511455. doi:10.1097/01.wnr.0000080101.90506.9b Google Scholar
Miyake, A., & Shah, P. (1999). Models of working memory: Mechanisms of active maintenance and executive control. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Nejad, A.B., Madsen, K.H., Ebdrup, B.H., Siebner, H.R., Rasmussen, H., Aggernæs, B., Baaré, W.F. (2013). Neural markers of negative symptom outcomes in distributed working memory brain activity of antipsychotic-naive schizophrenia patients. International Journal of Neuropsychopharmacology, 16(6), 11951204. doi:10.1017/S1461145712001253 CrossRefGoogle ScholarPubMed
Oberauer, K. (2005). Binding and inhibition in working memory: Individual and age differences in short-term recognition. Journal of Expimental Psychology . General, 134(3), 368387. doi:10.1037/0096-3445.134.3.368 Google Scholar
Owen, A.M., McMillan, K.M., Laird, A.R., & Bullmore, E. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25(1), 4659. doi:10.1002/hbm.20131 Google Scholar
Palacios, E.M., Sala-Llonch, R., Junque, C., Roig, T., Tormos, J.M., Bargallo, N., & Vendrell, P. (2012). White matter integrity related to functional working memory networks in traumatic brain injury. Neurology, 78(12), 852860. doi:10.1212/WNL.0b013e31824c465a Google Scholar
Pamilo, S., Malinen, S., Hlushchuk, Y., Seppä, M., Tikka, P., & Hari, R. (2012). Functional subdivision of group-ICA results of fMRI data collected during cinema viewing. Plos One, 7(7), e42000. doi:10.1371/journal.pone.0042000 CrossRefGoogle ScholarPubMed
Penadés, R., Pujol, N., Catalán, R., Massana, G., Rametti, G., García-Rizo, C., Junqué, C. (2013). Brain effects of cognitive remediation therapy in schizophrenia: A structural and functional neuroimaging study. Biological Psychiatry, 73(10), 10151023. doi:10.1016/j.biopsych.2013.01.017 CrossRefGoogle ScholarPubMed
Raichle, M.E., MacLeod, A.M., Snyder, A.Z., Powers, W.J., Gusnard, D.A., & Shulman, G.L. (2001). A default mode of brain function. Proceedings of the National Academy of Sciences of the United States of America, 98(2), 676682. doi:10.1073/pnas.98.2.676 CrossRefGoogle ScholarPubMed
Ray, K.L., McKay, D.R., Fox, P.M., Riedel, M.C., Uecker, A.M., Beckmann, C.F., Laird, A.R. (2013). ICA model order selection of task co-activation networks. Frontiers in Neuroscience, 7, 237. doi:10.3389/fnins.2013.00237 Google Scholar
Reitan, R.M., & Wolfson, D. (1985). The Halstead-Reitan Neuropsychological Test Battery: Theory and interpretation. Tucson, AZ: Neuropsychology Press.Google Scholar
Roberts, R., & Gibson, E. (2002). Individual differences in sentence memory. Journal of Psycholinguistic Research, 31(6), 573598.CrossRefGoogle ScholarPubMed
Robertson, I.H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1994). The test of everyday attention. Bury St. Edmunds: Thames Valley Test Company.Google Scholar
Robertson, I.H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1996). The structure of normal human attention: The test of everyday attention. Journal of the International Neuropsychological Society, 2(6), 525534.Google Scholar
Sambataro, F., Blasi, G., Fazio, L., Caforio, G., Taurisano, P., Romano, R., Bertolino, A. (2010). Treatment with olanzapine is associated with modulation of the default mode network in patients with Schizophrenia. Neuropsychopharmacology, 35(4), 904912. doi:10.1038/npp.2009.192 Google Scholar
Sattler, J.M., & Ryan, J.J. (2009). Assessment with the WAIS-IV. San Diego, CA: Jerome M. Sattler.Google Scholar
Schmiedek, F., Hildebrandt, A., Lövdén, M., Wilhelm, O., & Lindenberger, U. (2009). Complex span versus updating tasks of working memory: The gap is not that deep. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4), 10891096. doi:10.1037/a0015730 Google Scholar
Schweitzer, J.B., Faber, T.L., Grafton, S.T., Tune, L.E., Hoffman, J.M., & Kilts, C.D. (2000). Alterations in the functional anatomy of working memory in adult attention deficit hyperactivity disorder. American Journal of Psychiatry, 157(2), 278280.CrossRefGoogle ScholarPubMed
Shamosh, N.A., Deyoung, C.G., Green, A.E., Reis, D.L., Johnson, M.R., Conway, A.R., Gray, J.R. (2008). Individual differences in delay discounting: Relation to intelligence, working memory, and anterior prefrontal cortex. Psychological Science, 19(9), 904911. doi:10.1111/j.1467-9280.2008.02175.x Google Scholar
Shelton, J.T., Elliott, E.M., Hill, B.D., Calamia, M.R., & Gouvier, W.D. (2009). A comparison of laboratory and clinical working memory tests and their prediction of fluid intelligence. Intelligence, 37(3), 283. doi:10.1016/j.intell.2008.11.005 Google Scholar
Shelton, J.T., Elliott, E.M., Matthews, R.A., Hill, B.D., & Gouvier, W.D. (2010). The relationships of working memory, secondary memory, and general fluid intelligence: Working memory is special. Journal of Experimental Psychology . Learning, Memory, and Cognition, 36(3), 813820. doi:10.1037/a0019046 Google Scholar
Shelton, J.T., Metzger, R.L., & Elliott, E.M. (2007). A group-administered lag task as a measure of working memory. Behavior Research Methods, 39(3), 482493.Google Scholar
Smith, E.E., & Jonides, J. (1997). Working memory: A view from neuroimaging. Cognitive Psychology, 33(1), 542. doi:10.1006/cogp.1997.0658 Google Scholar
Smith, S., Fox, P., Miller, K., Glahn, D., Fox, P., Mackay, C., Beckmann, C. (2009). Correspondence of the brain's functional architecture during activation and rest. Proceedings of the National Academy of Sciences of the United States of America, 106(31), 1304013045. doi:10.1073/pnas.0905267106 Google Scholar
Smyth, M.M., & Scholey, K.A. (1992). Determining spatial span memory: The role of movement time and articulation rate. The Quarterly Journal of Experimental Psychology, 45A(3), 479501. doi:10.1080/02724989208250624 CrossRefGoogle Scholar
Spreng, R.N., & Grady, C.L. (2010). Patterns of brain activity supporting autobiographical memory, prospection, and theory of mind, and their relationship to the default mode network. Journal of Cognitive Neuroscience, 22(6), 11121123. doi:10.1162/jocn.2009.21282 CrossRefGoogle ScholarPubMed
Sridharan, D., Levitin, D.J., & Menon, V. (2008). A critical role for the right fronto-insular cortex in switching between central-executive and default-mode networks. Proceedings of the National Academy of Sciences of the United States of America, 105(34), 1256912574. doi:10.1073/pnas.0800005105 Google Scholar
Strick, P.L., Dum, R.P., & Fiez, J.A. (2009). Cerebellum and nonmotor function. Annual Review of Neuroscience, 32, 413434. doi:10.1146/annurev.neuro.31.060407.125606 CrossRefGoogle ScholarPubMed
Tang, Y.Y., Rothbart, M.K., & Posner, M.I. (2012). Neural correlates of establishing, maintaining, and switching brain states. Trends in Cognitive Sciences, 16(6), 330337. doi:10.1016/j.tics.2012.05.001 Google Scholar
Tohka, J., Foerde, K., Aron, A.R., Tom, S.M., Toga, A.W., & Poldrack, R.A. (2008). Automatic independent component labeling for artifact removal in fMRI. Neuroimage, 39(3), 12271245. doi:10.1016/j.neuroimage.2007.10.013 Google Scholar
Uddin, L.Q., Kelly, A.M., Biswal, B.B., Castellanos, F.X., & Milham, M.P. (2009). Functional connectivity of default mode network components: Correlation, anticorrelation, and causality. Human Brain Mapping, 30(2), 625637. doi:10.1002/hbm.20531 Google Scholar
Wager, T.D., & Smith, E.E. (2003). Neuroimaging studies of working memory: A meta-analysis. Cognitive Affective & Behavioral Neuroscience, 3(4), 255274.Google Scholar
Was, C.A., Dunlosky, J., Bailey, H., & Rawson, K.A. (2012). The unique contributions of the facilitation of procedural memory and working memory to individual differences in intelligence. Acta Psychologica (Amst), 139(3), 425433. doi:10.1016/j.actpsy.2011.12.016 CrossRefGoogle ScholarPubMed
Wechsler, D. (1997). Wechsler Memory Scale-Third Edition (3rd ed.). San Antonio, TX: The Psychological Corporation.Google Scholar
Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth Edition: Technical and interpretive manual. San Antonio, TX: Pearson.Google Scholar
Wilde, N., & Strauss, E. (2002). Functional equivalence of WAIS-III/WMS-III digit and spatial span under forward and backward recall conditions. The Clinical Neuropsychologist, 16(3), 322330. doi:10.1076/clin.16.3.322.13858 Google Scholar
Wilks, D.S. (2011). Forecast verification. In: Statistical methods in the atmospheric sciences (3rd ed., p 309). Oxford, UK: Academic Press.Google Scholar
Xu, J., Potenza, M.N., & Calhoun, V.D. (2013). Spatial ICA reveals functional activity hidden from traditional fMRI GLM-based analyses. Frontiers in Neuroscience, 7, 154. doi: 10.3389/fnins.2013.00154 Google Scholar
Xu, J., Zhang, S., Calhoun, V.D., Monterosso, J., Li, C.S., Worhunsky, P.D., Potenza, M.N. (2013). Task-related concurrent but opposite modulations of overlapping functional networks as revealed by spatial ICA. Neuroimage, 79, 6271. doi:10.1016/j.neuroimage.2013.04.038 Google Scholar
Young, K.D., & Lewis, R.J. (1997). What is confidence? Part 1: The use and interpretation of confidence intervals. Annals of Emergency Medicine, 30(3), 307310.Google Scholar
Zeharia, N., Hertz, U., Flash, T., & Amedi, A. (2012). Negative blood oxygenation level dependent homunculus and somatotopic information in primary motor cortex and supplementary motor area. Proceedings of the National Academy of Sciences of the United States of America, 109(45), 1856518570. doi:10.1073/pnas.1119125109 Google Scholar
Figure 0

Table 1 Participant Demographics

Figure 1

Table 2 Descriptive statistics for group performance

Figure 2

Fig. 1 Graph of 95% CIs for bootstrapped distributions of LNB performance correlations with NP test scores. The means and upper and lower confidence limits are depicted for each of the bootstrap distributions. LNB demonstrated discriminant or convergent validity with NP measures exhibiting 95% CIs that did (DSF, DSB, TEA 1-3, TMT 1, TMT 5, FTT, and BNT) or did not include zero (SSF, SSR, DSS, TEA 4 Acc and Time, TEA 5, and TMT 2-4), respectively. See Table 3 for detailed statistics.

Figure 3

Table 3 Bootstrap correlation statistics for LNB construct validity analysis

Figure 4

Fig. 2 Eight ICA-derived networks demonstrated greater activity during 2-back vs. 0-back task conditions. Axial, sagittal, and coronal planes are shown (respectively) for each independent component (IC). Activations are depicted in neurological convention (left=left) with minimum cluster size=50 voxels (allowing voxels connected by edge to constitute a cluster). IC10=cerebellum, IC12=SPL/precuneus, IC21=RFP, IC22=SMA/LPM, IC23=LFP, IC25=DLPFC, IC29=frontoinsular, IC30=Bilateral Primary Motor. (See Supplementary Table S1 and Figure S1 for detailed IC subcluster composition).

Figure 5

Table 4 GLT and group-level t test statistics describing task-relatedness of ICA networks (n components=21)

Supplementary material: File

Kearney-Ramos Supplementary Material

Table S1

Download Kearney-Ramos Supplementary Material(File)
File 92.9 KB