Discrimination on the basis of race, gender identity, and age, among others, has been associated with negative cognitive outcomes. However, the mechanisms by which perceived discrimination impacts cognition are not yet well understood. Discrimination can lead to chronic stress, which disrupts glucocorticoid pathways and induces susceptibility to metabolic dysregulation. On the basis of this prior work, and the known associations between metabolic syndrome and cognition, the current study examined the hypothesis that metabolic syndrome mediates the relationship between discrimination and cognition.

1,063 adults (Mean age = 54.92 years, SD = 11.68) who participated in the Midlife in the United States project were included. Confirmatory factor analysis was used to examine the acceptability of a bifactor model of metabolic syndrome using four subfactors (insulin resistance, adiposity, dyslipidemia, and blood pressure). The mediating effect of the metabolic syndrome latent factor on the association between discrimination and cognition was tested using PROCESS (Hayes, 2013). Exploratory analyses were conducted to examine which cognitive domains and which metabolic syndrome subfactors were driving these relationships. Mediation analyses adjusted for age, race, sex, and education.

The three most frequently reported reasons for discrimination were gender (n = 209), age (n = 174), and race (n = 129). The CFA of metabolic symptoms was deemed acceptable based on previously outlined goodness of fit criteria (CFI = 0.986, TLI = 0.976, RMSEA = 0.040, SRMR = 0.034). Results of the mediation analysis indicated a significant indirect effect of major events discrimination on the total cognition composite through the general metabolic syndrome factor (B = -0.0029, 95% CI [-0.0016, -0.0066]). Further examination revealed that this relationship was driven through an indirect path of metabolic syndrome on the relationship between discrimination and executive functioning (B = -0.0024, 95% CI -0.0059, -0.0001]). We examined which subfactors were driving these relationships and found that there were significant indirect effects of major events discrimination on total cognition through the insulin resistance (B = -0.0028, 95% CI -0.0065, -0.0003]) and dyslipidemia factors (B = -0.0026, 95% CI -0.0064, -0.0002]).

Our findings provide evidence that metabolic syndrome can help explain differences in cognitive functioning based on experiences of discrimination, even after adjusting for relevant demographic factors. Results from this study suggest that understanding the impact of perceived discrimination on metabolic syndrome and developing lifestyle interventions that can improve metabolic syndrome may be helpful in reducing stress-related cognitive disparities.

The Personality Assessment Inventory (PAI; Morey, 1991; 2007) is a 344 item self-report measure of personality, psychopathology, and factors affecting treatment. The PAI short form (PAI-SF) contains the first 160 items of the PAI and is often favoured as a screening tool or brief version to mitigate respondent burden and fatigue. The PAI has been psychometrically validated among numerous populations (Slavin-Mulford et al., 2012), while psychometric research on the PAI-SF is gradually emerging. The psychometric properties of the PAI-SF range from adequate to strong in psychiatric (Sinclair et al., 2009), forensic (Sinclair et al., 2010), outpatient and nonclinical (Ward et al., 2018), and stroke (Udala et al., 2020) samples. To advance research validating the PAI-SF among diverse populations, this project investigated the psychometric comparability between the PAI and the PAI-SF in a neuropsychiatric population. Based on previous literature, it was hypothesized that the PAI-SF would produce congruent results to the PAI in this sample.

For this study, participant files (N=214) were collected retrospectively from short- and long-term residential psychiatric and substance use treatment facilities in Minnesota for patients with neurological and cognitive concerns referred for neuropsychological evaluation. The PAI-SF was scored using the first 160 items from a patient’s long-form PAI protocol. To determine the psychometric comparability of long- and short-forms, paired-samples t-tests, intraclass correlations, and percent agreement in clinical classification between forms were analyzed.

Analyses of participant data found that intra-class correlations ranged from .87 to .98 for each subscale on the PAI when compared to the PAI-SF, demonstrating good to excellent reliability between forms. Symptoms are considered clinically elevated when they exceed the clinical significance threshold for a subscale (typically a T-score of 70+). Agreement between the PAI and PAI-SF subscales in the classification of clinically elevated scores ranged from 86% to 100%. When forms did not agree, the PAI-SF was more likely to be clinically significant relative to the PAI. A comparison of subscale means between forms was examined by independent samples T-tests with a Bonferroni correction. Results revealed significant differences between the PAI and PAI-SF on one validity scale (Negative Impression Management), three clinical scales (Anxiety; Depression; Antisocial Features), and one treatment scale (Treatment Rejection).

Results demonstrated that the PAI and PAI-SF have high reliability between forms in a neuropsychiatric population. Although mean scores differed on a small number of subscales between the PAI and PAI-SF, differences did not appear sufficiently large enough to shift clinical classifications, as the two forms performed similarly in their identification of clinically elevated scales. Findings align with previous literature and suggest that the PAI-SF may perform adequately in a neuropsychiatric population if brevity or participant burden is of concern. However, caution is warranted when making clinical decisions with the PAI-SF as more research is needed.

Face masks are required in many healthcare settings. Face masks have well documented health advantages, but they can negatively impact interpersonal communication, an essential element of neuropsychological assessment. The purpose of this study was to quantify the impact of face masks on neuropsychological assessment in a large clinical setting.

Participants included 755 pre-pandemic onset (51.3 % men, M = 59.54 years, SD = 17.23) and 838 (51.7% men, M = 60.63 years, SD = 16.71) post-pandemic onset outpatients from a large academic medical center in the Midwest. Performance was compared on selected assessments characterized by visual function (WAIS-IV Block Design, WAIS-IV Matrix Reasoning, and the Rey-Osterrieth Complex Figure Test - Copy trial) and assessments characterized by verbal function (WAIS-IV Digit Span (DS), Rey Auditory Verbal Learning Test (AVLT) total score, and Complex Ideational Material). Secondary analyses compared performance between the groups by age: in an older group (greater than 65 years old) and a younger group (less than 65 years old).

The pre-and-post pandemic onset groups did not differ with respect to age, gender, education, or clinical diagnosis. Independent Samples T-tests showed that the post-pandemic onset group performed significantly worse on two verbal tests, DS (p =.005, Cohen’s d = 0.131) and the AVLT (p <.001, Cohen’s d = 0.245). Within the older group, the frequency of patients with dementia (54.1 vs 54.8 percent), and all other diagnoses, was comparable pre-and-post pandemic onset. The younger group also had comparable rates of clinical diagnoses at each time point. Secondary analyses showed that the older group was the only group to perform significantly worse on the two verbal tests post-pandemic onset: DS (p =.004, Cohen’s d = 0.20) and AVLT (p <.001, Cohen’s d = 0.39). The younger group had no differences in their performance on any of the verbal tests. For both the primary and secondary analyses, none of the groups had a significant change in performance on the tests that were characterized by visual function.

These results suggest that mask use during neuropsychological assessment may hinder performance on tests that require close attention to verbal output in older patients. This finding is not otherwise explained by demographic or clinical differences. In fact, these patients had nearly identical rates of dementia before and after the onset of the pandemic. In contrast, performance on tests that rely mainly on visual function was not affected. Attending to masked speech may be more cognitively demanding for older individuals, thus influencing their performance during testing. This may be particularly relevant for neuropsychologists working in geriatric settings.

Neuropsychologists performing assessments inperson, with masks, should be aware that patient scores on certain tests may be artificially deflated for reasons unrelated to cognition or clinical condition.

With the emergence of the coronavirus 2019 pandemic, investigating the validity of tele-screenings for neuropsychological status has become increasingly necessary. While the telephone version of the Montreal Cognitive Assessment (MoCA-T) has been validated for use in patients with Parkinson’s and stroke/cerebrovascular disease, the clinical utility of this instrument in geriatric patients with other suspected cognitive disorders has yet to be determined. Thus, the present study aimed to examine the classification accuracy of the MoCA-T in a mixed clinical sample of patients with mild cognitive impairment (MCI) or dementia.

Ninety-one older adults were administered the MoCA-T via videoconferencing technology as part of a comprehensive neurocognitive evaluation performed by a multidisciplinary treatment team within a dementia specialty clinic. Based on this evaluation, 51 (56.0%) patients were diagnosed with dementia, 27 (29.7%) with MCI, and 13 (14.3%) with no neurocognitive diagnosis (i.e., subjective cognitive complaints). In addition to MoCA-T total and item scores, we also computed subscale scores for between-group comparisons as the sum of items assessing orientation, language, attention/executive function, and memory. ANOVA/ANCOVA and ROC curve analyses were used to examine between-group differences on the MoCA-T and its psychometric properties in discriminating patients with MCI or dementia, respectively.

Participants had a mean age of 74.3 ± 8.7 and education of 16 ± 2.9 years. Patients with dementia were significantly older than those with MCI and no diagnosis, but there were no other significant between-group differences in clinical characteristics. MoCA-T total [F(2,86)=28.5, p<0.001] and all subscale scores (p<0.01) differed significantly between groups and in the expected direction (dementia<MCI<no diagnosis) even after controlling for age. The only exception was language for which there was initially a statistical trend (p=0.06) that reached significance (p<0.05) after controlling for age. In terms of individual items, abstraction, fluency, orientation to place/city, and category cued recall were the only items that did not differ significantly between groups. ROC curve analyses revealed -5 points to be the optimum cut-off for distinguishing between cognitively normal individuals from patients with MCI (Sensitivity=0.67; Specificity=0.77; AUC=0.78), and a cut-off of -8 points optimally distinguished between patients with MCI and dementia (Sensitivity=0.77; Specificity=0.74; AUC=0.81).

The current study provides further evidence for the clinical utility of the MoCA-T as a screening instrument for neurocognitive disorders in older adults and extends prior work to include administration via videoconferencing technology. While previous studies have focused on the use of MoCA-T in specific patient populations, here, we demonstrate the validity of this screening tool in a mixed-clinical sample, which suggests its broader use in clinical settings for distinguishing between neurocognitive disorders, regardless of the underlying etiology.

Patients with Parkinson’s disease (PD) commonly show deficits on tests of visuospatial functioning. The Identi-Fi is a new measure of visual organization and recognition composed of two components. The Visual Recognition (VR) subtest asks persons to identify an object that has been broken its pieces and rearranged, akin to the Hooper Visual Organization Test, but using updated and colorful pictures. The Visual Matching (VM) subtest involves showing the same stimuli, but the examinee must select the correct response from among five choices (1 correct and 4 foils), placing greater demand on visuospatial discrimination. Together, the two subtests comprise the Visual Organization Index (VOI), reflecting overall visual processing and organization ability. The present study examined performance on the Identi-Fi in patients with PD and its association with other aspects of cognition.

Participants were 23 patients with PD (95% male; mean age = 69.7 years [SD = 7.8], range = 47-79) and 12 patients with cognitive concerns (CC) who were intact on neuropsychological testing (excluding consideration of Identi-Fi scores; 50% male, mean age = 71.08 [SD = 6.27], range = 60-78) seen for a neuropsychological evaluation at a large Northeastern medical center. As part of a larger battery, patients completed the Identi-Fi, Trail Making Test (TMT), Category Fluency, Test of Premorbid Functioning (TOPF), and Brief Visuospatial Memory Test, Revised (BVMT-R).

The PD group performed significantly worse than the CC group on VR and VM, as well as VOI, of the Identi-Fi (p < .001). Within the PD group, poorer VR, VM, and VOI performance was associated with lower scores on the TOPF (p < .05), BVMT-R learning (p < .05) and delayed recall (p < .05), as well as TMT Parts A and B (p < .05). VR was significantly correlated with Category Fluency (p < .05), while a trend was seen for the association between VOI and Category Fluency (p = .094).

Identi-Fi performance was worse in the PD group than the CC group, which is consistent with prior research indicating that visuospatial processing is often abnormal in patients with PD. Furthermore, findings indicate that poorer performance on the Identi-Fi in the PD group is associated with poorer cognitive functioning in other domains (i.e., visuospatial learning and memory, processing speed, cognitive flexibility, and semantic fluency), as well as lower premorbid intellectual functioning. While these findings suggest that the Identi-Fi is useful in identifying visuospatial dysfunction in PD, findings should be interpreted with caution given the small sample sizes and uneven gender distribution

Cognitive, motor and sensory deficits associated with aging, and with some neurological conditions such as acquired brain injury, may lead to severe driving performance impairment. While rehabilitation and driver assistance technologies may improve driving performance, the assessment of the actual fitness-to-drive of these people is challenging. Office-based neuropsychological/physical tests are considered insufficient to understand one’s ability to drive. The gold standard is the on-road assessment with dual control cars, superior in ecological validity, but expensive, stressful, and potentially unsafe. Valid, more cost-effective solutions for a safer, more accurate, standardized assessment of fitness-to-drive are currently needed. Modern and sensorized driving simulators offer key advantages, such as the possibility of exposing drivers to several relevant driving scenarios, including hazard situations, and of assessing their driving performance without being physically at risk. However, the extraction and direct interpretation of existing simulator-produced data may require specialized data processing skills or simulation expertise. To overcome this, we have developed an easy-to-use, pencil-and-paper observational instrument. The Sim-DOS is an adaptation of the widely used instrument to assess “natural driving”, the Driving Observation Schedule (DOS; Vlahodimitrakou et al., 2013).

Via expert consensus, DOS targeted behaviors were adapted to a simulated-based environment (signaling, observation of environment, speed regulation, slow or unsafe reaction, distance interpretation, vehicle/lane positioning), and the Sim-DOS scores calculation (based on errors while doing such behaviors) was adapted from DOS to include hazard situations (HS, 0-100) and free driving (FD, 0-°°) scores. The instrument was then piloted with a sample of 35 older adults, along with the collection of simulator-produced data on number of harsh events and driving speed. Participants drove two consecutive 20-minutes long scenarios, with low and high traffic density (LTD, HTD). In each scenario, there were periods with and without potentially hazard situations.

Assessments were performed by two independent trained observers, producing substantial inter-rater reliability (intra-class correlation coefficients above 0.94). Participants (70.7±4.1 years old, 60% male, 46.1±6.7 years of driving experience) were mostly regular drivers (74%). However, psychomotor skills of the majority were compromised, with only one participant being above the 80th percentile in the reaction times test of the national mandatory driving assessment. When exposed to hazard situations, most of the participants (94.1%) did not perform well, independently of traffic density, with average Sim-DOS-HS scores of 87.1±9.7 (out of 100, t-values>7.3, p-values<.05).

Compared to LTD scenarios, in HTD scenarios participants drove less smoothly (HTD:0.97±1.24 vs. LTD:0.33±0.58 of harsh events, Z=3.1, p<.05). However, they also drove slower (HTD:82.41±27.43 vs. LTD:103.55±14.61 km/h, t=5.2, p<.05), improving their ability to manage hazard situations, and therefore producing higher than expected Sim-DOS scores (HTD:87.05±10.28). During free driving, participants performed worse under LTD conditions (Sim-DOS-FD scores: HTD:11.68±6.20 vs. LTD:14.40±9.58, t=2.15, p<.05) as they drove at higher speed (HTD:85.01±24.28 vs. LTD:104.70±11.94 km/h, t=5.8, p<.05), although they did it more smoothly (HTD:1.94±3.74 vs. LTD:0.45±0.74 harsh events, Z=2.65, p<.05).

Our study provides a validated driving assessment tool for use in driving simulators that will allow a safer, more ecologic, holistic and informative evaluation of the fitness-to-drive of older adults and neurological patients.

The Montreal Cognitive Assessment (MOCA) is a brief cognitive screener, widely used by providers to detect mild cognitive impairment (MCI). It encompasses 30 questions, assessing executive functioning, visuospatial skills, language, memory, attention, and orientation. Although the MOCA has been shown to have high sensitivity (90%) and specificity (87%) for detecting MCI, existing studies have primarily included participants who were already diagnosed with amnestic MCI via neuropsychological testing. Since several factors beyond the presence of MCI can contribute to low performance on the MOCA (e.g., premorbid IQ, fatigue, mood symptoms), over-reliance on the MOCA runs the risk of falsely identifying individuals as having cognitive impairment. The MOCA’s memory subtest raises particular concern as there are several language-based tasks between the learning and delay trials, introducing the potential for interference effects. Thus, the MOCA’s ability to accurately identify those at risk for MCI in the community remains unclear. The objective of the present study was to evaluate: (1) the MOCA’s association with neuropsychological memory measures; and (2) its ability to distinguish between neurocognitive groups (intact vs. MCI vs. dementia).

This study involved a retrospective analysis of fifty-one patients (M age=72.58 [7.90]; M education= 16.37 [16.37]) who underwent neuropsychological evaluation. Standardized scores for total list-learning (HVLT; CVLT-bf) were used to capture memory encoding; retention % scores were used to capture memory storage. MOCA scores included Total MOCA, MOCA-Orientation, and the MOCA Memory Index (MOCA-MEM). MOCA-MEM was calculated based on Julayanont et al., 2014— (Free-Delayed Recall*3) + (Category-Cued Recall*2) + Multiple Choice-Cued Recall. Bivariate correlations were conducted for the MOCA and neuropsychological test scores. Participants were divided into three diagnostic groups, classified by the neuropsychologist: (1) Cognitive Intact (CI; n=13); (2) MCI (n=26); and (3) Major Neurocognitive Disorder/Dementia (MNCD; n=11). Analysis of covariance was used to analyze differences between the cognitive groups on Total MOCA, MOCA-Orientation, and MOCA-MEM.

Total MOCA correlated with word-list learning (r=.434, p=.004) and retention% (r=.306, p=.049). MOCA-MEM was correlated with word-list learning (r=.367, p=.042); it did not significantly correlate with retention%. MOCA-Orientation had the strongest correlation with retention0/) (r=.406, p=.009). Means of Total MOCA significantly differed between CI (25.31[2.56]), MCI (22.04[4.14]), and MNCD (15.44[4.13]). MOCA-MEM only differentiated CI (10[3.66]) and MNCD (5.71[2.14]); it did not differentiate MCI (6.94[3.13]) from either CI or MNCD.

Our findings suggest that the MOCA has limitations in accurately classifying memory deficits in older adults. First, our study suggests that the MOCA-MEM reflects encoding rather than memory storage. Given that deficiency in encoding may be secondary to other cognitive deficits, such as attention and executive dysfunction, performance on MOCA-MEM cannot readily delineate the presence of an amnestic process. Second, the findings show that MOCA-MEM does not differentiate between patient groups with intact cognition versus MCI, nor those with MCI versus MNCD. These findings argue the importance of neuropsychological evaluation in deciphering patterns of memory performance and the presence of an amnestic process.

The prevalence of ADHD diagnoses more than doubled in VA settings between 2009 and 2016 (Hale et al., 2020). However, attentional difficulties are not exclusive to ADHD and can also be seen in non-neurodevelopmental disorders, including depression, anxiety, substance use, and PTSD (Marshall et al., 2018, Suhr et al., 2008). Further, patients can easily feign symptoms of ADHD with few available instruments for accurate detection (Robinson & Rogers, 2018). Given the significant symptom overlap and rising rates of reported ADHD among Veterans, accurate detection of feigned ADHD is essential.

This study examined the utility of the experimental Dissimulation ADHD scale (Ds-ADHD; Robinson & Rogers, 2018) on the MMPI-2, in detecting feigned ADHD presentation within a mixed sample of Veterans.

In this retrospective study, 173 Veterans (Mage = 36.18, SDage = 11.10, Medu = 14.01, SDedu = 2.11, 88% male, 81% White, and 17% Black) were referred for neuropsychological evaluation of ADHD that included the MMPI-2 and up to 10 PVTs. Participants were assigned to a credible group (n=146) if they passed all PVTs or a non-credible group (n=27) if they failed two or more PVTs. Group assignment was also clinically confirmed. The Ds-ADHD was used to differentiate groups who either had credible or non-credible performance on cognitive measures. Consistent with Robinson and Rogers’ study, “true” answers (i.e., erroneous stereotypes) were coded as 1 and “false” answers were coded as 2, creating a 10- to 20-point scale. Lower scores were associated with a higher likelihood of a feigned ADHD presentation.

Preliminary analyses revealed no significant group differences in age, education, race, or gender (ps > .05). An ANOVA indicated a significant difference between groups (F[1, 171] = 10.44, p = .001; Cohen’s d = .68) for Ds-ADHD raw scores; Veterans in the non-credible group reported more “erroneous stereotypes” of ADHD (M raw score = 13.33, SD = 2.20) than those in the credible group (M = 14.82, SD = 2.20). A ROC analysis indicated AUC of .691 (95% CI = .58 to .80). In addition, a cut score of <12 resulted in specificity of 91.8% and sensitivity of 18.5%, whereas a cut score of <13 resulted in specificity of 83.6% and sensitivity of 44.4%.

The Ds-ADHD scale demonstrated significant differences between credible and non-credible respondents in a real-world setting. Previously, this scale has primarily been studied within laboratory settings. Further, results indicate a cut score of <12 could be used in order to achieve adequate specificity (i.e., >90%), which were similar findings to a study examining SVT-based groups (Winiarski et al., 2023). These results differ slightly from prior research by Robinson and Rogers (2018), who indicated a cut score of <13 based on the initial simulation-based study. In similar clinical settings, where there are high rates of psychiatric comorbidity, a cut score of <12 may prove clinically useful. However, this cut-score was associated with low sensitivity within this mixed Veteran sample. Further research should focus on replicating findings within other clinical settings, including ones with larger non-credible samples.

The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is one of the most widely used measures in neuropsychological assessment. Studies of practice effects on the RBANS have largely been limited to studies assessing one or two repeated assessments. The aim of the current study is to examine practice effects across four years after baseline in a longitudinal study of cognitively healthy older adults. Practice effects were estimated using a pseudo-replacement participants approach which has been previously applied in other aging studies.

453 Participants from the Louisiana Aging Brain Study (LABrainS) completed the RBANS Form A on up to four annual assessments after a baseline evaluation. Practice effects were calculated using a modified participants-replacement method where scores of individuals who were administered RBANS Form A multiple times are compared to the baseline scores of matched participants with additional adjustment for attrition effects.

Practice effects were observed primarily in the immediate memory, delayed memory, and total score indices. For example, an increase of nearly half a standard deviation was observed for delayed memory.

These findings extend past work on the RBANS and other neuropsychological batteries more broadly in showing the susceptibility of memory measures to practice effects. Given that memory and total score indices of the RBANS have the most robust relationships with diagnostic status and biomarkers for pathological cognitive decline, these findings raise concerns about the ability to recruit those at risk for decline from longitudinal studies using the same form of the RBANS for multiple years.

Inconsistent relationships between subjective and objective performance have been found across various clinical groups. Discrepancies in these relationships across studies have been attributed to various factors such as patient characteristics (e.g., level of insight associated with cognitive impairment) and test characteristics (e.g., using too few measures to assess different cognitive domains). Although performance and symptom invalidity are common in clinical and research settings and have the potential to impact responding on testing, previous studies have not explored the role of performance and symptom invalidity on relationships between objective and subjective performance. Therefore, the current study examined the impact of invalidity on performance and symptom validity tests (PVTs and SVTs, respectively) on the relationship between subjective and objective cognitive functioning.

Data were obtained from 299 Veterans (77.6% male, mean age of 48.8 years (SD = 13.5)) assessed in a VA medical center epilepsy monitoring unit from 2008-2018. Participants completed a measure of subjective functioning (i.e., the Patient Competency Rating Scale), PVTs (i.e., Word Memory Test, Test of Memory Malingering, Reliable Digit Span), SVTs (i.e., Minnesota Multiphasic Personality Inventory-2-Restructured Form Response Bias Scale, Structured Inventory of Malingered Symptomatology), and neuropsychological measures assessing objective cognitive performance (e.g., Trail Making Test parts A and B). Pearson correlations were conducted between subjective functioning and objective cognitive performance in the following groups: 1.) PVT and SVT valid, 2.) PVT and SVT invalid, 3.) PVT-only invalid, 4.) SVT-only invalid. Using Fisher’s r-to-z transformation, tests for the differences between correlation coefficients were then conducted between the PVT and SVT valid vs. PVT and SVT invalid groups, and the PVT-only invalid vs. SVT-only invalid groups.

Participants with fully valid PVT and SVT performances demonstrated generally stronger relationships between subjective and objective scores (r’s = .058 - .310) compared to participants with both invalid PVT and SVT scores (r’s = -.033 - .132). However, the only significant difference in the strengths of correlations between the groups was found on Trail Making Test Part B (p = .034). In separate exploratory analyses due to low group size, those with invalid PVT scores only (fully valid SVT) demonstrated generally stronger relationships between subjective and objective scores (r’s = -.101 - .741) compared to participants with invalid SVT scores only (fully valid PVT; r’s = -.088 - .024). However, the only significant difference in the strengths of correlations between the groups was found on Trail Making Test Part A (p = .028).

The present study suggests that at least some of the discrepancies in previous studies between subjective and objective cognitive performance may be related to performance and symptom validity. Specifically, very weak relationships between objective and subjective performance were found in participants who only failed SVTs, whereas relationships were stronger in those who only failed PVTs. Therefore, findings suggest that including measures of PVTs and SVTs in future studies investigating relationships between subjective and objective cognitive performance is critical to ensuring accuracy of conclusions that are drawn.

Workload is a useful construct in human factors and neuroergonomics research that describes “the perceived relationship between the amount of mental [and physical] processing capability or resources and the amount required by the task”. We apply this concept to neuropsychology and assess several dimensions of workload as it relates to performance on the Trail Making Test.

Twenty college students completed the Trail Making Test (TMT). After completion of each Part A and B, workload was assessed with the NASA-Task Load Index (NASA-TLX), a popular self-report measure of workload including subscales: Mental Demand, Physical Demand, Temporal Demand, Performance, Effort, and Frustration, with an overall average total score as well.

Completion time differed of course between Parts A and B (p < .001). Of more interest, overall workload differed between TMT A (M = 20.33, SD = 13.32) and TMT B (M = 35.79, SD = 17.37) (p < .001, h2 = .68). The greatest subscale differences were with Mental Demand (p < .001, h2 = .68) and Effort (p < .001, h2 = .59), but Physical Demand also showed a difference (p < .007, h2 = .33). Temporal Demand showed the smallest and nonsignificant difference (p = .081, h2 = .152).

Based on previous research in our lab, most results were expected and understandable. As we know with the TMT, Part B is more cognitively demanding (in various ways) than Part A. The greater Physical Demand with Part B is a somewhat more complex finding, needing a solid explanation. Finally, the NASA-TLX appears to be a valid instrument of workload with a standard neuropsychologist test. We argue it can provide useful interesting information in the assessment of cognitive status in clinical populations.

Adverse childhood experiences (ACEs) is a broad construct that refers to negative events one may experience during childhood, including, but not limited to, childhood maltreatment, household dysfunction, and trauma. ACEs have consistently shown to be associated with negative physical and mental health outcomes. Although researchers have investigated the effects of trauma and abuse on personality measures, few studies have examined differences between those with high ACEs, low ACEs, and no ACEs on measures of personality in the context of neuropsychological evaluations.

The current study included 128 consecutive adult patients referred for outpatient neuropsychological evaluation of attention-deficit/hyperactivity disorder. The sample was 39.8% non-Hispanic White, 21.9% non-Hispanic Black, 16.4% Hispanic, 10.9% Asian/Pacific Islander, and 10.9% other race/ethnicity, with a mean age of 27.9 years (SD=6.3) and mean education of 16.1 years (SD=2.2). Multivariate analyses of variance were performed to evaluate differences on the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) between individuals who experienced high levels of ACEs (>4/10 on the Adverse Childhood Experiences Questionnaire), low levels of ACEs (1-3/10), and no ACEs (0/10).

When analyzing Higher-Order (H-O) scales, there was a significant group difference in mean elevation on the Behavioral/Externalizing Dysfunction (BXD) scale, F(2,113)=3.124, p < .05, such that individuals in the high ACEs group evidenced higher scores than those in the low ACEs group (p < .05). Additionally, there were significant differences on several Restructured Clinical (RC) scales. Specifically, there were group differences on the Low Positive Emotions (RC2) scale, F(2,113)=3.427, p < .05, such that those in the low ACEs group evidenced higher scores than those in the no ACEs group (p < .05). The Antisocial Behavior (RC4) scale also had significant differences, F(2,113)=13.703, p < .001, such that those in the high ACEs group had higher scores than those in the low and no ACEs groups (p < .001). Finally, the Ideas of Persecution (RC6) scale yielded significant group differences, F(2,113)=4.793, p < .05, such that those in the high ACEs group evidenced higher scores than those in the low and no ACEs groups (p < .05).

In sum, this study demonstrated that ACEs, particularly high levels of ACEs, are related to higher difficulties with problems with under-controlled and rule-breaking behaviors, low positive emotional responses, and beliefs that others pose a threat. As such, assessment of ACEs may serve an important role in characterizing patients’ psychological status as part of a comprehensive neuropsychological evaluation.

Previous research has found that subjective cognitive decline corresponds with assessed memory impairment and could even be predictive of neurocognitive impairment. The purpose of this study was to investigate whether a single self-report item of subjective cognitive decline corresponds with the results of a performance-based measure of episodic memory.

Older adults (n = 100; age 60-90) were given the single item measure of subjective cognitive decline developed by Verfaille et al. (2018).

Those who endorsed subjective cognitive decline (n = 68) had lower scores on the CVLT-II long delay free recall than those who did not endorse such a decline (n = 32). Additionally, older adults with a neurocognitive diagnosis believed their memory was becoming worse at a higher proportion than those without.

While a single item of subjective cognitive decline should not be substituted for a comprehensive evaluation of memory, the results suggest that it may have utility as a screening item.

Visual deficits are common after stroke and are powerful predictors for the chronic functional outcome. However, while basic visual field and recognition deficits are relatively easy to assess with standardized methods, selective deficits in visual primitives, such as shape or motion, are harder to identify, as they often require a symmetrical bilateral posterior lesion in order to provoke full field deficits. We aimed to investigate the prevalence and co-occurrence of hemifield “mid-range” visual deficits. In addition, we looked at the repercussions of these mid-range deficits on higher-order visual cognitive functions, such as visuoconstruction and memory. At a more theoretical level, we investigated whether associations between deficits in 'mid-range’ visual functions and deficits in higher-order visual cognitive functions are in line with a hierarchical, two-pathway model of the visual brain.

In 220 stroke patients and a healthy control group (N=49), we assessed the perception of colour (isoluminant stimuli in the red-green range), shape (Efron shapes), location (dot in a circle), orientation (lines at different angles), contrast (bars with converging grey-level differences), texture (from Brodatz grayscale texture album) and correlated motion (different percentages of dots moving in the same direction). All tasks started with a fixation dot presented at the centre of the screen. After one second, a target stimulus was presented on the horizontal midline at either 5° to the left or at 5° to the right side of the fixation. Then, after 1.5 seconds, two response items appeared in addition to the target stimulus for three seconds. To control for eye movements, we used an eye-tracker to present the target in a gaze contingent fashion. Thus, the target always remained in the correct retinal position independent of eye movements. In a subset of 182 ischemic stroke patients, we also assessed visuoconstruction (Copy Rey-Complex Figure Test), visual emotion recognition (FEEST test) and visual memory (Doors-test).

The results showed that deficits in motion-perception were most prevalent (26%), followed by colour (22%), texture (22%), location (21%), orientation (18%), contrast (14%), shape (14%) and glossiness (13%). 63% of the stroke patients showed one or more mid-range visual deficits. Overlap of deficits was small; they mostly occurred in isolation or co-occurred with only one or two other deficits. Impairments in mid-range visual functions could not predict performance on higher-order visual cognitive tasks. Impaired visuoconstruction and visual memory were only modestly predicted by a worse location perception. Impaired emotion perception was modestly predicted by a worse orientation perception. In addition, double dissociations were found: there were patients with selective deficits in 'mid-range’ visual functions without higher-order visual deficits and vice versa.

First, deficits in “mid-range” visual functions are very prevalent. Since we found no strong patterns of co-occurrences, we suggest that an assessment of deficits at this level of visual processing requires screening the full range of visual functions. Second, the relationship between mid-range visual tasks and higher-order visual cognitive tasks is weak. Finally, our findings are not supportive of the hierarchical, two-pathway model but more in line with an alternative patchwork model.

As part of the Research Domain Criteria (RDoC) initiative, the NIMH seeks to improve experimental measures of cognitive and positive valence systems for use in intervention research. However, many RDoC tasks have not been psychometrically evaluated as a battery of measures. Our aim was to examine the factor structure of 7 such tasks chosen for their relevance to schizophrenia and other forms of serious mental illness. These include the n-back, Sternberg, and self-ordered pointing tasks (measures of the RDoC cognitive systems working memory construct); flanker and continuous performance tasks (measures of the RDoC cognitive systems cognitive control construct); and probabilistic learning and effort expenditure for reward tasks (measures of reward learning and reward valuation constructs).

The sample comprised 286 cognitively healthy participants who completed novel versions of all 7 tasks via an online recruitment platform, Prolific, in the summer of 2022. The mean age of participants was 38.6 years (SD = 14.5, range 18-74), 52% identified as female, and stratified recruitment ensured an ethnoracially diverse sample. Excluding time for instructions and practice, each task lasted approximately 6 minutes. Task order was randomized. We estimated optimal scores from each task including signal detection d-prime measures for the n-back, Sternberg, and continuous performance task, mean accuracy for the flanker task, win-stay to win-shift ratio for the probabilistic learning task, and trials completed for the effort expenditure for reward task. We used parallel analysis and a scree plot to determine the number of latent factors measured by the 7 task scores. Exploratory factor analysis with oblimin (oblique) rotation was used to examine the factor loading matrix.

The scree plot and parallel analyses of the 7 task scores suggested three primary factors. The flanker and continuous performance task both strongly loaded onto the first factor, suggesting that these measures are strong indicators of cognitive control. The n-back, Sternberg, and self-ordered pointing tasks strongly loaded onto the second factor, suggesting that these measures are strong indicators of working memory. The probabilistic learning task solely loaded onto the third factor, suggesting that it is an independent indicator of reinforcement learning. Finally, the effort expenditure for reward task modestly loaded onto the second but not the first and third factors, suggesting that effort is most strongly related to working memory.

Our aim was to examine the factor structure of 7 RDoC tasks. Results support the RDoC suggestion of independent cognitive control, working memory, and reinforcement learning. However, effort is a factorially complex construct that is not uniquely or even most strongly related to positive valance. Thus, there is reason to believe that the use of at least 6 of these tasks are appropriate measures of constructs such as working memory, reinforcement learning and cognitive control.

Assessment of medication management, an instrumental activity of daily living (IADL), is particularly important among Veterans, who are prescribed an average of 2540 prescriptions per year (Nguyen et al., 2017). The Pillbox Test (PT) is a brief, performance-based measure that was designed as an ecologically valid measure of executive functioning (EF; Zartman, Hilsabeck, Guarnaccia, & Houtz, 2013), the cognitive domain most predictive of successful medication schedule management (Suchy, Ziemnik, Niermeyer, & Brothers, 2020). However, a validation study by Logue, Marceaux, Balldin, and Hilsabeck (2015) found that EF predicted performance on the PT more so than processing speed (PS), but not the language, attention, visuospatial, and memory domains combined. Thus, this project sought to increase generalizability of the latter study by replicating and extending their investigation utilizing a larger set of neuropsychological tests.

Participants included 176 patients in a mixed clinical sample (5.1% female, 43.2% Black/African American, 55.7% white, Mage = 70.7 years, SDage = 9.3, Medu = 12.6 years, SDedu = 2.6) who completed a comprehensive neuropsychological evaluation in a VA medical center. All participants completed the PT where they had five minutes to organize five pill bottles using a seven-day pillbox according to standardized instructions on the labels. Participants also completed some combination of 26 neuropsychological tests (i.e., participants did not complete every test as evaluations were tailored to disparate referral questions). Correlations between completed tests and number of pillbox errors were evaluated. These tests were then combined into the following six domains: language, visuospatial, working memory (WM), psychomotor/PS, memory, and EF. Hierarchical multiple regression was completed using these domains to predict pillbox errors.

Spearman’s correlation coefficients indicated that 25 tests had a weak to moderate relationship with PT total errors (rs = 0.23 -0.51); forward digit span was not significantly related (rs = 0.13). A forced-entry multiple regression was run to predict PT total errors from the six domains. The model accounted for 29% of the variance in PT performance, F(6, 169) = 11.56, p < .001. Of the domains, psychomotor/PS made the greatest contribution, f(169) = 2.73, p = .007, followed by language, f(169) = 2.41, p = .017, and WM, f(169) = 2.15, p = .033. Visuospatial performance and EF did not make significant contributions (ps>.05). Next, two hierarchical multiple regressions were run. Results indicated that EF predicted performance on the PT beyond measures of PS, AR2 = .02, p = .044, but not beyond the combination of all cognitive domains, AR2 = .00, p = .863.

Results of this study partially replicated the findings of Logue et al. (2015). Namely, EF predicted PT performance beyond PS, but not other cognitive domains. However, when all predictors were entered into the same model, visuospatial performance did not significantly contribute to the prediction of pillbox errors. These results suggest that providers may benefit from investigating medication management abilities when deficits in PS, WM, and/or language are identified. Further research is needed to better understand which domains best predict PT failure.

Craft story recall test in the National Alzheimer’s Coordinating Center Uniformed Data Set 3 (NACC UDS3) neuropsychological battery has been employed to assess verbal memory and assist clinical diagnosis of mild cognitive impairment (MCI) and dementia. While a Chinese version of the test was adapted, no existing literature has examined the diagnostic validity of the test in Chinese Americans. This study aimed to evaluate the predictive validity of both immediate and delayed recall.

The Chinese version of Craft Story was administered in to 78 Chinese participants per their language preference of Mandarin or Cantonese. Outcome measures were verbatim and paraphrase recall of the story immediately and after a 20-minute delay. A multiple linear regression was performed to investigate the association of each outcome measure with age, education, gender, age when moved to the U.S., years in the U.S., and testing language. To assess its diagnostic value, cutoff standard deviation scores of -1.5 and -2.0 from the mean of the clinically cognitive normal participants were generated for MCI and dementia diagnoses, respectively. Due to the small sample size, a normative group fitting the mean age (73 years), years of education (12 years), and the majority gender (female) of the current sample were used to identify standard cut points. A receiver-operating characteristic analysis was used to compare predicted diagnosis with actual clinical diagnosis obtained through patients’ overall performance and a consensus meeting by licensed clinicians.

Younger age (p < 0.05) and being tested in Mandarin (p < .01) were positively associated with immediate and delayed recall. Strong positive correlations between each measure were observed (all p < .001), indicating a significant relationship between information encoded and retained. Among all the participants, 15 (19.2%) were diagnosed with MCI and 22 (28.2%) with dementia. For MCI diagnosis, the standard cutoff scores demonstrated adequate sensitivity (verbatim=82%, paraphrase=91%) but low specificity (verbatim=44%, paraphrase=67%) in all outcome measures. For dementia diagnosis, delayed recall showed strong sensitivity (100%) and adequate specificity (75%) in both verbatim and paraphrasing scores. Immediate recall paraphrase (sensitivity = 95%, specificity = 50%) showed a better sensitivity but lower specificity than verbatim scoring (sensitivity = 86%, specificity = 58%). The accuracy was higher in delayed recall for both MCI and dementia diagnosis. A preliminary analysis on the optimal cut points indicated higher cutoff scores to distinguish MCI and dementia from clinically cognitive normal population, and from each other (e.g., the optimal cut point for delayed verbatim in distinguishing MCI from normal is 8.0 (sensitivity=89%, specificity=73%, AUC=84.3%)).

Consistent with previous literature, Craft Story delayed recall served as a more accurate diagnostic tool for both MCI and dementia compared to immediate recall in older Chinese Americans. However, poor specificity might increase the chance of following false positive subjects in clinical trials. In addition, testing language appeared to impact performance on verbal memory recall of constructed information. Thus, future studies should focus on developing normative scores that address both the overall cultural differences of Chinese Americans and the heterogeneity within this population.

Early detection is critical to the effective management of Alzheimer’s Disease (AD) and other forms of dementia. Existing screening assessments are often costly, require substantial expertise to administer, and may be insensitive to mild changes in cognition. A promising alternative is automatically measuring features of connected speech (c.f., Ostrand & Gunstad, 2021, Journal Geriatric Psych & Neurol) to predict impairment. Here, we built on prior work examining how well speech features predicted cognitive impairment. Unique to the current work, we attempted to capture more holistic effects of cognitive impairment by examining the relevance of linguistic features that measure sentential or discourse context properties of speech, including the context in which filler words (e.g., um) occur, and the predictability of individual words within their sentence context, computed from a large computational language model (GPT-2).

Participants completed the Cookie Theft picture description task, with data available in the DementiaBank corpus (Becker et al., 1994, Arch Neurol). Descriptions that contained at least 50 words (N = 214) were submitted to an automatic feature calculation pipeline written in Python to calculate various part-of-speech counts, lexical diversity metrics, and mean lexical frequency, as well as multiple metrics related to lexical surprisal (i.e., how surprising a word is given its context).

Surprisal of individual words was computed using the pre-trained GPT-2 transformer language model (Radford et al., 2019, Comput. Sci.) by computing word probability given the previous 12 words. Multiple linear regression was performed using 17 linguistic features jointly as predictors, and Mini-Mental State Examination (MMSE) score as the outcome variable. Simple regressions were calculated between each feature and MMSE scores to examine the predictability of each linguistic feature on cognitive decline.

A multiple linear regression model containing all linguistic features plus demographic information (age, sex, education) significantly predicted MMSE scores (Adjusted R2 = 0.41, F20, 193 = 8.37, p < .001), and explained significantly more variance in MMSE scores than did demographic variables alone (F17193 = 6.85, p < .001). Individual predictors that were significantly correlated with MMSE score included: how unexpected an individual’s word choices were, given the preceding context (median surprisal: r = -0.33, p < 0.001; interquartile range: r = 0.18, p < 0.02), mean lexical frequency (r = -0.50, p < .001), and usage of definite articles (r = 0.31, p < 0.001), nouns (r = 0.26, p < .001), and empty words (r = -0.25, p < 0.001).

Participants with lower MMSE scores, indicating greater impairment, used more frequent, yet more surprising, words, and produced more empty words and fewer definite articles and nouns. These results suggest that measures of semantic specificity and coherence of speech could be meaningful predictors of cognitive decline, and can be computed automatically from speech transcriptions. The results also provide novel evidence that computational approaches to estimating lexical predictability may have value in predicting the degree of decline, motivating future work in other speech elicitation tasks and differing clinical groups.

Diagnostic criteria for mild cognitive impairment (MCI) include a report of cognitive decline from the patient or a close informant. It is therefore important to understand the relationship between self- and informant-rated cognition and actual patient performance. Furthermore, it is unknown whether the nature of the relationship between the patient and their informant impacts accuracy of subjective reports. This study aimed to determine the association between informant report, self-report and objective cognitive performance based on relationship factors. We predicted that informant report would be more closely associated with objective performance than self-report after controlling for demographics and mood (Geriatric Depression Scale [mean= 1.4, SD=2]), especially among those who live with the participant and those who are spouses/partners.

Participants (n = 338; age= 73.5 ±6.7) of varying diagnoses and their respective informants were drawn from the longitudinal cohort of the Michigan Alzheimer’s Disease Research Center (MADRC). The majority of informants were spouses/significant others (55.6%), followed by 23.7% being other family members and 20.7% were non- family members; 58.9% of informants live with the participant. Both respondents completed the Cognitive Change Index (CCI) to rate the patient’s cognitive status (higher scores indicating worsening cognition) across three domains: memory (12 questions), language (1 question), and attention/executive functioning (7 questions). These domains were matched to objective cognitive performance measured using the MADRC neuropsychological battery. Executive functioning and attention were assessed using Number Span Test Forward and Backward (NSF, NSB) and Trail Making Test Part B and Trail- Making Test Part A and B ratio (TMTB, TMTB: A); memory was measured using Craft Story 21 (Immediate and Delayed), Hopkins Verbal Learning Test-Revised (HVLT-R) Total Recall, Delayed Recall, and Benson Complex Figure (BCF) Delayed Recall; and Language was measured by the Controlled Oral Word Association Test (COWAT) and Animal fluency.

Linear regression adjusted for sex, race, and mood indicated that both patient and informant CCI ratings were significantly (p<.05) associated with objective cognitive performance. For every one unit increase on executive CCI items, there was a significant decline in executive functioning (NSF patient and informant ß= -0.09, NSB: [ßP= -.14; ßp-0.13]) and TMTB [ßP= 3.85; ß= 3.10 [% change]). Memory performance also declined per unit increase on CCI memory items: (Craft Story 21 Immediate [ßP=-0.32; ß= -0.37] and Delayed [ßP=-.40; ßp -.47], HVLT-R Total Recall [ßP= -.31; ßI=-.37] and Delayed Recall [ßP= -.16; ß=-.20], and BCF Delayed Recall [ßP= -.18; ß= -.23]. Similarly, one unit increase on the single CCI language item was associated with a decline in COWAT (ßP= -2.27; ß= -4.61) and Animal fluency (ßP= -1.88; ß= -3.03). Effect modification by participant-informant relationship type or participant-informant cohabitation was not significant.

Patient and informant ratings are associated with objective measures of cognition regardless of the relationship between informant and patient or if they live together. This study was limited by a well-educated sample (mean= 16.1 years of education, SD= 2.4 years) with relatively limited diversity among participant-informant relationships. Future studies should replicate analyses across a larger and more diverse sample.

Accurate identification of Attention-Deficit/Hyperactivity Disorder (ADHD) is complicated by possible secondary gain, overlap of symptoms with psychiatric disorders, and face validity of measures (Suhr et al., 2011; Shura et al., 2017). To assist with diagnostic clarification, an experimental Dissimulation ADHD scale (Ds-ADHD; Robinson & Rogers, 2018) on the MMPI-2 was found to distinguish credible from non-credible respondents defined by Performance Validity Test (PVT)-based group assignment in Veterans (Burley et al., 2023). However, symptom and performance validity have been understood as unique constructs (Van Dyke et al., 2013), with Symptom Validity Tests (SVTs) more accurately identifying over-reporting of symptoms in ADHD (White et al., 2022). The current study sought to evaluate the effectiveness of the Ds-ADHD scale using an SVT, namely the Infrequency Index of CAARS (CII; Suhr et al., 2011), for group assignment within a mixed sample of Veterans.

In this retrospective study, 187 Veterans (Mage = 36.76, SDage = 11.25, Medu = 14.02, SDedu = 2.10, 83% male, 19% black, 78% white) were referred for neuropsychological evaluation of ADHD and administered a battery that included internally consistent MMPI-2 and CAARS profiles. Veterans were assigned to a credible group (n=134) if CII was <21 or a non-credible group (n=53) if CII was >21. The Ds-ADHD scale was calculated for the MMPI-2. Consistent with Robinson and Rogers (2018), “true” answers (i.e., erroneous stereotypes) were coded as 1 and “false” answers were coded as 2, creating a 10- to 20-point scale. Lower scores were associated with a higher likelihood of a feigned ADHD presentation.

Analyses revealed no significant differences in age, education, race, or gender (ps > .05) between credible and non-credible groups. An ANOVA indicated a significant difference between groups (F[1,185] = 24.78, p <.001; Cohen’s d = 0.80) for Ds-ADHD raw scores. Veterans in the non-credible group reported more “erroneous stereotypes” of ADHD (M raw score = 13.23, SD = 2.10) than those in the credible group (M = 14.94, SD = 2.13). A ROC analysis indicated AUC of .72 (95% CI = .64 to .80). In addition, a Ds-ADHD cut score of <12 resulted in specificity of 94.5% and sensitivity of 22.6%, whereas a cut score of <13 resulted in specificity of 85.8% and sensitivity of 50.9%. When analyzing other CII cut scores recommended in the literature, results were essentially similar. Specifically, analyses were repeated when group assignment was defined by cut score of CII<18 and by removing an intermediate group (CII = 18 to 21; n=24).

The Ds-ADHD scale demonstrated significant differences between credible and non-credible respondents in a Veteran population. Results suggest a cut score of <12 had adequate specificity (.95) with low sensitivity (.23). This is consistent with findings using PVTs for group assignment that indicated a cut score of <12 had adequate specificity (.92) with low sensitivity (.19; Burley et al., 2023). Taken together, findings suggest that the Ds-ADHD scale demonstrates utility in the dissociation of credible from non-credible responding. Further research should evaluate the utility of the scale in other clinical populations.