Hostname: page-component-745bb68f8f-g4j75 Total loading time: 0 Render date: 2025-02-06T08:36:32.612Z Has data issue: false hasContentIssue false

A Comparison of the Greek ACE-III, M-ACE, ACE-R, MMSE, and ECAS in the Assessment and Identification of Alzheimer’s Disease

Published online by Cambridge University Press:  21 April 2020

Panagiotis Kourtesis*
Affiliation:
Department of Psychology, Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, UK Lab of Experimental Psychology, Suor Orsola Benincasa University of Naples, Naples, Italy Interdepartmental Centre for Planning and Research “Scienza Nuova”, Suor Orsola Benincasa University of Naples, Naples, Italy
Eleni Margioti
Affiliation:
Department of Psychology, Aristotle University of Thessaloniki, Thessaloniki, Greece Department of Psychology, Athens Alzheimer’s Association, Athens, Greece
Christina Demenega
Affiliation:
Department of Psychology, Athens Alzheimer’s Association, Athens, Greece
Foteini Christidi
Affiliation:
A’ Department of Neurology, National and Kapodistrian University of Athens, Athens, Greece
Sharon Abrahams
Affiliation:
Department of Psychology, Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, UK Euan MacDonald Centre for Motor Neurone Disease Research, Royal Infirmary of Edinburgh, Edinburgh, UK
*
*Correspondence and reprint requests to: Panagiotis Kourtesis, 7 George Square, Edinburgh, EH8 9JZ, Scotland, UK. Email: pkourtes@exseed.ed.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Objective:

This study aimed to adapt the Addenbrooke’s Cognitive Examination-III (ACE-III) and Mini-Addenbrooke’s Cognitive Examination (M-ACE) into Greek and then to examine the convergent validity against their predecessors Addenbrooke’s Cognitive Examination-Revised (ACE-R) and Mini-Mental State Examination (MMSE) in a Greek population. Moreover, a primary aim was to appraise the utility of each screen by conducting a comparison of the psychometric properties of ACE-III, M-ACE, ACE-R, MMSE, and the Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis (ALS) Screen (ECAS) in detecting Alzheimer’s disease (AD).

Methods:

Forty patients with AD were recruited and matched with 38 controls. Bayesian Pearson’s correlation analysis was conducted to examine the convergent validity. Receiver operating characteristic curve analysis was implemented to appraise the sensitivity and specificity of the tests in detecting AD.

Results:

The ACE-III, M-ACE, and the ECAS scores robustly correlated with ACE-R and MMSE. The ACE-III and the ECAS-ALS Non-Specific score were the most sensitive and specific tools in detecting AD, closely followed by ECAS Total score and M-ACE. Only ECAS Total score correlated with the duration of disease. The ECAS scores were more resilient to ceiling effects than the other screens. M-ACE produced fewer ceiling effects than MMSE.

Conclusion:

The Greek ACE-III and M-ACE were successfully adapted and showed good convergent validity against their predecessors. They showed very good psychometric properties in detecting AD and may be considered in hectic clinical settings. ECAS Total score and ECAS-ALS Non-Specific showed comparable psychometric properties in the detection of AD and may be considered in polypathological clinics where motor impairments are common.

Type
Regular Research
Copyright
Copyright © INS. Published by Cambridge University Press, 2020

Introduction

Cognitive assessment is crucial for the detection of Alzheimer’s disease (AD) and for the differential diagnosis of other types of dementia, such as frontotemporal dementia (FTD) (Fields et al., Reference Fields, Ferman, Boeve and Smith2011). Comprehensive assessment of cognition and behaviour has clinical implications for patient care, regarding the available treatment options, survival expectancy, competency to drive or provide informed consent, ability to live independently at home, the carer’s burden, and quality of life (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015). However, in hectic clinical settings, briefer cognitive screening methods are often the test of choice, with patients with more complex needs or diagnostic uncertainties being referred for full neuropsychological assessment (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015).

Addenbrooke’s Cognitive Examination-Revised (ACE-R) and the embedded Mini-Mental State Examination (MMSE) are the predominant brief screening tests for dementia in the Greek population, with administration times of approximately 15 and 5 min, respectively (Konstantinopoulou et al., Reference Konstantinopoulou, Kosmidis, Ioannidis, Kiosseoglou, Karacostas and Taskos2011). Both of them were designed to briefly examine a wide range of cognitive domains: attention, memory, language, visuospatial components, and verbal fluency (Mioshi et al., Reference Mioshi, Dawson, Mitchell, Arnold and Hodges2006). ACE-R aids in the detection, differentiation, and monitoring of cognitive decline in dementia syndromes, such as FTD and AD (Hsieh et al., Reference Hsieh, Hodges, Leyton and Mioshi2012; Kipps et al., Reference Kipps, Nestor, Dawson, Mitchell and Hodges2008; Mathew et al., Reference Mathew, Bak and Hodges2011; Raimondi et al., Reference Raimondi, Gleichgerrcht, Richly, Torralva, Roca, Camino and Manes2012).

However, ACE-R has several limitations (Hsieh et al., Reference Hsieh, Schubert, Hoon, Mioshi and Hodges2013), for example, healthy adults repeatedly fail on the verbal repetition item, which might be a result of hearing problems or distraction (Hsieh et al., Reference Hsieh, Schubert, Hoon, Mioshi and Hodges2013; Valcour et al., Reference Valcour, Masaki and Blanchette2002), and ceiling effects have been observed in the measure of comprehension (Brugnolo et al., Reference Brugnolo, Nobili, Barbieri, Dessi, Ferro, Girtler and Servetto2009). Acknowledging these weaknesses led to the development of Addenbrooke’s Cognitive Examination-III (ACE-III). While the ACE-III does not incorporate MMSE, it continues to assess the same five cognitive domains, with new items in verbal repetition and language comprehension tasks, while backward spelling was replaced by serial 7 s subtraction (Brugnolo et al., Reference Brugnolo, Nobili, Barbieri, Dessi, Ferro, Girtler and Servetto2009; Ganguli et al., Reference Ganguli, Ratcliff, Huff, Belle, Kancel, Fischer and Kuller1990; Hsieh et al., Reference Hsieh, Schubert, Hoon, Mioshi and Hodges2013; Valcour et al., Reference Valcour, Masaki and Blanchette2002).

ACE-III has been validated against extensive neuropsychological tests (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015; Hsieh et al., Reference Hsieh, Schubert, Hoon, Mioshi and Hodges2013). However, even ACE-III, which demands 15–20 min to administer, has been suggested to be excessive for some busy clinical settings (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015). Mini-Addenbrooke’s Cognitive Examination (M-ACE) was subsequently developed, which appears to be more sensitive and specific than its widely used precursor, MMSE (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015; Folstein et al., Reference Folstein, Folstein and Fanjiang2001).

The Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis (ALS) Screen (ECAS) was recently developed (Abrahams et al., Reference Abrahams, Newton, Niven, Foley and Bak2014) and adapted for the Greek (Kourtesis et al., Reference Kourtesis, Christidi, Margioti, Demenega, Rentzos, Evdokimidis and Abrahams2019), Italian (Poletti et al., Reference Poletti, Solca, Carelli, Madotto, Lafronza, Faini and Doretti2016), German (Lule et al., Reference Lulé, Burkhardt, Abdulla, Böhm, Kollewe, Uttner and Ludolph2015), Chinese (Ye et al., Reference Ye, Ji, Li, He, Liu and Fan2016), and Spanish (Mora et al., Reference Mora, Salas, Fernández, Rodríguez-Castillo, Marín, Chaverri and Rodríguez-Santos2018) populations. ECAS is also a brief assessment similar to ACE-III, but it was designed for patients with various motor impairments and was found to be sensitive in ALS, Parkinson’s disease, and progressive supranuclear palsy (Foley et al., Reference Foley, Niven, Paget, Bhatia, Farmer, Jarman and Abrahams2018; Niven et al., Reference Niven, Newton, Foley, Colville, Swingler, Chandran and Abrahams2015; Strong et al., Reference Strong, Abrahams, Goldstein, Woolley, Mclaughlin, Snowden and Rosenfeld2017). ECAS has been specifically designed to detect the type of cognitive and behavioural impairment in ALS of an executive nature similar to that found in FTD. ECAS comprises an ALS-specific component (executive function and social cognition, verbal fluency, and language) and a carer’s interview to detect the behavioural and psychotic changes typical in FTD. This focus on executive functions distinguishes ECAS from ACE-III. However, the ECAS was also designed to assess the functions typically affected in other diseases common in older adults, such as AD, and therefore it includes an ALS Non-Specific segment (memory and visuospatial function) (Foley et al., Reference Foley, Niven, Paget, Bhatia, Farmer, Jarman and Abrahams2018; Niven et al., Reference Niven, Newton, Foley, Colville, Swingler, Chandran and Abrahams2015; Strong et al., Reference Strong, Abrahams, Goldstein, Woolley, Mclaughlin, Snowden and Rosenfeld2017). We have previously demonstrated that the ALS Non-Specific score is highly sensitive and specific in identifying the cognitive changes typical of AD and helps differentiate AD from ALS (Kourtesis et al., Reference Kourtesis, Christidi, Margioti, Demenega, Rentzos, Evdokimidis and Abrahams2019).

This study aimed to adapt the ACE-III and M-ACE and to examine their convergent validity against their predecessors, ACE-R and MMSE, in a Greek population. Moreover, our primary aim was to compare these screening tools (ACE-III, M-ACE, ACE-R, MMSE, and ECAS) in detecting AD in a Greek population.

Methods

Participants

All the participants and their carers signed an informed consent form in compliance with the revised Declaration of Helsinki (1987). This study was approved by the Psychology Research Ethics Committee of the University of Edinburgh, as well as the Aeginition Hospital Ethics Committee. All the participants were native Greek speakers and free from the following: (1) psychiatric disorders; (2) psychoactive drugs, antidepressants, and anticonvulsants; (3) other neurological conditions affecting cognition; (4) learning disabilities; (5) alcoholism and drug abuse; and (6) uncontrolled systemic diseases.

Patients with AD

The attendants of the Maroussi Alzheimer Clinic of the Athens Association of Alzheimer Disease and Related Disorders, Athens, Greece, were employed for this study. A total of 40 patients with AD participated; a subsample has previously been described by Kourtesis et al. (Reference Kourtesis, Christidi, Margioti, Demenega, Rentzos, Evdokimidis and Abrahams2019). Recruitment was conducted in accordance with the general inclusion criteria and the following criteria specific to AD: (1) a diagnosis of AD according to the National Institute of Neurological and Communicative Disorders and Stroke/Alzheimer’s Disease and Related Disorders Association (NINCDS-ADRDA) (McKhann et al., Reference McKhann, Drachman, Folstein, Katzman, Price and Stadlan1984) and (2) the absence of mixed concomitant dementia processes (e.g. AD and vascular dementia). In addition, a neuropsychologist or psychiatrist interviewed the patients and administered the Hospital Anxiety and Depression Scale (HADS) (Zigmond & Snaith, Reference Zigmond and Snaith1983) (cut-off ≥ 8) to exclude patients with major depression or anxiety symptoms that may compromise their performance. The duration of the disease was calculated in years, from the onset of the first symptoms to the testing date.

Healthy Subjects

In this study, 38 controls were recruited and matched in age, sex, and education to the patient group. They belonged to one of the following categories: (1) members of Athens Association of Alzheimer Disease and Related Disorders, Athens, Greece; (2) relatives of patients with AD; or (3) volunteers who responded to the calls of the above association. For recruitment, we implemented the aforementioned general inclusion criteria.

Procedures

Translation–Adaptation

Adaptation of ACE-III and embedded M-ACE required minor adjustments as the administration (e.g. instructions) of the majority of the tasks was similar to that of ACE-R. The most significant adjustment, in terms of translation, was in the section of language in the task of proverb repetition, in which the pronunciation of proverbs is required. In terms of pronunciation, the first item should be a low-difficulty proverb (i.e. ‘All that glitters is not gold’) and the second item should be a medium-to-hard-difficulty proverb (i.e. ‘A stitch in time saves nine’). The proverbs of the Greek version were culturally adjusted, and the counterparts of this difficulty measure were ‘All that glitters is not gold’ and ‘Better donkey-tying than donkey-seeking’. The original version of ACE-III (in which the M-ACE is embedded) was adapted to the Greek language using the back-translation method. The original English version was translated into Greek by a native Greek speaker fluent in English and then it was translated back into English by a native speaker of both Greek and English who was also blind to the original version of ACE-III. The procedure of translation/back translation was successful in only two iterations as there were mainly minor amendments compared to ACE-R. Finally, the adaptation of ECAS in Greek was described by Kourtesis et al. (Reference Kourtesis, Christidi, Margioti, Demenega, Rentzos, Evdokimidis and Abrahams2019).

Administration of the Tests and Inter-Rater Reliability

Administration of the tests was randomised to control for a possible practice effect (Benedict & Zgaljardic, Reference Benedict and Zgaljardic1998). Inter-rater reliability was calculated between the scores for ACE-III and M-ACE provided by the assessors and the independent reviewer. The four assessors and the independent reviewer were trained equally in the administration and scoring of ACE-III and M-ACE based on relevant guidelines. The independent reviewer was blinded to the identity of the examiner as well as the examinee.

Statistical Analyses

Bayesian statistics were preferred over null hypothesis significance testing (NHST). The Bayesian factor (BF10) has been found to be more parsimonious than the p-value in evaluating evidence against H0 (Cox & Donnelly, Reference Cox and Donnelly2011; Held & Ott, Reference Held and Ott2018; Wagenmakers et al., Reference Wagenmakers, Love, Marsman, Jamil, Ly, Verhagen and Meerhoff2018a; Wagenmakers et al., Reference Wagenmakers, Marsman, Jamil, Ly, Verhagen, Love and Matzke2018b). Importantly, the difference between BF10 and p-values is even greater (in favour of BF10) in small sample sizes, which is pertinent to the present study (Held & Ott, Reference Held and Ott2018; Wagenmakers et al., Reference Wagenmakers, Love, Marsman, Jamil, Ly, Verhagen and Meerhoff2018a; Wagenmakers et al., Reference Wagenmakers, Marsman, Jamil, Ly, Verhagen, Love and Matzke2018b). A larger BF10 postulates more evidence in support of H1 (Cox & Donnelly, Reference Cox and Donnelly2011; Held & Ott, Reference Held and Ott2018; Marsman & Wagenmakers, Reference Marsman and Wagenmakers2017; Wagenmakers et al., Reference Wagenmakers, Love, Marsman, Jamil, Ly, Verhagen and Meerhoff2018a; Wagenmakers et al., Reference Wagenmakers, Marsman, Jamil, Ly, Verhagen, Love and Matzke2018b). In this study, a threshold of BF10 ≥ 10 was set for statistical inference, which postulates strong evidence in favour of H1 (Marsman & Wagenmakers, Reference Marsman and Wagenmakers2017; Wagenmakers et al., Reference Wagenmakers, Love, Marsman, Jamil, Ly, Verhagen and Meerhoff2018a; Wagenmakers et al., Reference Wagenmakers, Marsman, Jamil, Ly, Verhagen, Love and Matzke2018b) and corresponds to a p-value of <.01 (e.g. BF10 = 10) or to a p-value of <.001 (e.g. BF10 > 11) (Cox & Donnelly, Reference Cox and Donnelly2011; Held & Ott, Reference Held and Ott2018). However, we report both BF10 and p-values in this study. Finally, BF10 allows evidence in either direction (i.e. towards H1 and H0), and its measurement of evidence is insensitive to the stopping rule, which substantially mitigates the multiple comparisons problem and generates reliable and more generalisable results (Dienes, Reference Dienes2016; Marsman & Wagenmakers, Reference Marsman and Wagenmakers2017; Wagenmakers et al., Reference Wagenmakers, Marsman, Jamil, Ly, Verhagen, Love and Matzke2018b).

The inter-rater reliability between the assessors who administered the screening procedures and the independent interviewer was appraised using the intraclass correlation coefficient (ICC), which displays outcomes from ‘no match’ = 0 to ‘seamless match’ = 1 (Weir, Reference Weir2005). The internal consistency of the Greek ACE-III and M-ACE was determined by calculating Cronbach’s alpha coefficient. A Cronbach’s alpha coefficient of .70 or greater is considered substantial (Nunnaly, Reference Nunnally1994). Demographic and cognitive data were analysed and compared. Shapiro–Wilk’s test revealed non-significant results (i.e. normal distribution) for every variable. Between-group comparisons were made using Bayesian independent samples t-tests. The convergent validity of the screening tools was examined in the whole sample (N = 78, i.e. HC = 38 + AD = 40). The convergent validity and associations between the screening tools were probed and quantified using Bayesian Pearson’s correlation analysis to ensure that our results are more reliable and generalisable. Receiver operating characteristic (ROC) curve analyses and area under the curve (AUC) were implemented to appraise the psychometric properties of the screening methods. All statistical analyses were performed using SPSS Statistics v.24.0 (scale, ROC and AUC analyses) (Release, 2016; IBM Corp., Armonk, NY, USA) and JASP v.0.8.1.2 (Bayesian Pearson’s correlation analyses and Bayesian independent samples t-tests) (JASP Team, 2017). Finally, a post hoc analysis (i.e. the achieved statistical power) of the Bayesian Pearson’s correlations (i.e. the convergent validity of the screening methods) was performed using G × Power (Faul et al., Reference Faul, Erdfelder, Lang and Buchner2007; Faul et al., Reference Faul, Erdfelder, Buchner and Lang2009).

Results

Inter-Rater Reliability and Internal Consistency

The inter-rater reliability demonstrated an almost seamless agreement between the assessors, indicating substantial suitability for clinical measures (Weir, Reference Weir2005). An ICC value of .92 was found for ACE-III and M-ACE (Weir, Reference Weir2005). The scale analyses demonstrated excellent internal consistency of ACE-III and M-ACE with Cronbach’s alpha = .79 (Nunnaly, Reference Nunnally1994). We also inspected the internal consistency of ACE-III by replacing the repetition task of the culturally adjusted proverbs with the repetition task of phrases in ACE-R. The internal consistency of ACE-III with the repetition task of phrases (ACE-R) dropped to .77, indicating that the new repetition task of culturally adjusted proverbs contributed to the improvement of the internal consistency of ACE-III.

Convergent Validity

The Bayesian Pearson’s correlation analyses robustly supported the convergent validity of ACE-III and M-ACE, as well as ECAS and its subscores, by indicating a large effect size (i.e. Pearson’s r varied from .845 to .976), highly significant p-values (i.e. p < .0001), highly extreme evidence of the Bayesian factor analysis (e.g. BF10 = 1.299e+33), and an almost perfect statistical power (i.e. ≈100%). The statistics for the Bayesian Pearson’s correlations are displayed in Table 1. ACE-III displayed a robust correlation with ACE-R. Equally, M-ACE substantially correlated with MMSE. Moreover, ECAS and its subscores significantly correlated with ACE-R.

Table 1. Convergent validity: Bayesian Pearson’s correlations

Note: BF = Bayes Factor. *BF10 > 10; **BF10 > 30; ***BF10 > 100. For post hoc statistical power, α < .001.

Sensitivity and Specificity in the Detection of AD

ROC and AUC analyses were executed to explore the psychometric properties of the screens in detecting AD. Figure 1 presents the ROC curves of each screen and subscore. All the tests confirmed an adequately high level of sensitivity and specificity. Additionally, the analysis computed the sensitivity and specificity respective to different cut-offs, and the optimum cut-off to determine abnormality is shown (see Table 2). The ACE-III, ECAS, ACE-R, M-ACE, and ECAS-ALS Non-Specific covered the greatest AUC.

Fig. 1. ROC curves: differentiation between patients with AD and controls.

Table 2. Sensitivity and specificity in the detection of AD

Note: AUC = area under curve; PPV = positive predictive value; NPV = negative predictive value; PLR = positive likelihood ratio; NLR = negative likelihood ratio. The current cut-offs (two SDs from the mean) are displayed first. The cut-offs with highest sensitivity or specificity are presented. The proposed cut-offs (based on optimal sensitivity and specificity values) are showed in bold. Where the current and proposed cut-offs are the same, only one value is given.

Cognitive Performance and Behavioural Changes in AD

In the whole sample, there were no associations between cognitive performance and age/education. In group comparisons, patients with AD performed significantly worse than healthy controls in every test (see Table 3). In the AD sample, the HADS scores (i.e. depression and anxiety) did not correlate with cognitive performance. In addition, we examined the correlation between the screening methods and the duration of disease in the sample of patients with AD. Robust correlations with the duration of disease were detected solely with the total score of ECAS (BF10 = 14.22), whereas with the rest of the screening methods and subscores, the correlations were non-significant (see Table 4). Fourteen patients (35%) had a disease duration of less than 3 years and 26 patients (65%) had a disease duration of 3–6 years, indicating that the sample of patients were in the early and early-middle stages of AD. Furthermore, the carers of 16 out of 40 patients with AD (40%) reported behavioural changes in the ECAS Behavioural Interview. The most prominent behavioural changes were apathy and loss of sympathy with some describing disinhibition (see Figure 2), whereas none of the carers reported a behavioural change pertaining to the rest of the ECAS behavioural items (i.e. compulsion, hyperorality, and psychosis).

Table 3. Comparison between controls and patients with AD

Note: SD = standard deviation; BF = Bayes factor.*BF10 > 10; **BF10 > 30; *** BF10 > 100.

Table 4. Bayesian Pearson’s correlations with the duration of disease

Note: BF = Bayes Factor.*BF10 > 10; **BF10 > 30; ***BF10 > 100.

Fig. 2. ECAS Behavioural Interview: behavioural changes in AD.

Ceiling Effects in the Screens

The ECAS scores appear to be substantially more resilient to ceiling effects compared to ACE-III, ACE-R (Figure 3), and M-ACE and MMSE (Figure 4). Ceiling effects in the last two short screens were pronounced (see Figures 3 and 4). Lastly, only 4 patients with AD (out of 40, i.e. 10%) failed to collect two points (i.e. maximum points) in the phrase repetition task of ACE-R, whereas 10 patients with AD (i.e. 25%) failed to collect the maximum points in the proverb repetition task of ACE-III.

Fig. 3. Distribution of healthy controls’ performance in the fourth quartile of the possible scores.

Fig. 4. Distribution of healthy controls’ performance in the third tier of the possible scores.

Discussion

The present study successfully produced the Greek versions of ACE-III and M-ACE. The tests showed robust convergent validity against the already adapted and validated Greek versions of ACE-R and MMSE as evidenced by the large effect size, the high significance of the correlations, the strong evidence of the Bayesian factor analysis, and the almost perfect statistical power. Furthermore, the screening methods exhibited substantial internal consistency, which allows for implementation in clinical and research settings (Nunnaly, Reference Nunnally1994). The tests also showed almost excellent inter-rater reliability, permitting extensive utilisation by various clinical practitioners (Weir, Reference Weir2005). Therefore, the Greek ACE-III and M-ACE can be considered as suitable tools for clinical and research purposes.

Detection of AD in a Greek Population

ACE-III elicited 94.7% sensitivity and 100% specificity at a cut-off of 83 (two SDs), as well as 97.4% sensitivity and 97.4% specificity at a cut-off of 84, in the detection of dementia within a sample pool of patients with AD who were predominantly in their first to fourth years after diagnosis. The sensitivity of ACE-III (94.7% and 97.4%) was superior to that of ACE-R (89.5% and 92.1%), demonstrating that ACE-III should be the tool of choice against ACE-R.

A comparison of M-ACE to MMSE revealed superior psychometrics in the former with 97.4% sensitivity and 94.7% specificity at a cut-off of 23 (MMSE, 86.8% sensitivity and 92.1% specificity at a cut-off of 24). The higher sensitivity and comparable specificity to MMSE are aligned with the validation study of M-ACE (Hsieh et al., Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015). Accordingly, M-ACE surfaces as the most appropriate brief screening tool for detecting AD. M-ACE may be considered in hectic clinical environments, in which brief screening procedures are preferred.

Furthermore, the ECAS-ALS Non-Specific score was equally able to detect AD compared to the ACE-III with 97.4% sensitivity and specificity at a cut-off of 24. In addition, the ECAS-ALS Non-Specific score was substantially more specific than M-ACE but was equally sensitive. However, the sensitivity of the total score of ECAS was slightly below that of ACE-III and M-ACE although specificity was comparable. Of note, the ECAS Total score was the only score that correlated with the disease duration, indicating that it may be more sensitive to cognitive decline than the rest of the screens, although this has yet to be demonstrated. Lastly, the ECAS-ALS Specific score appears to be less sensitive and specific compared to the above screening methods, although it displayed good psychometric properties in the identification of AD.

Utility of the Screens

The Greek version of ACE-III contains a repetition task of culturally adjusted proverbs, which replaced the repetition task of phrases in ACE-R. These items appeared to contribute to the internal consistency of ACE-III and were less prone to ceiling effects in the AD group compared to the equivalent task of ACE-R. However, both tests suffered from ceiling effects in contrast to the ECAS. The ceiling effects were most pronounced in the shorter screening tools (M-ACE and MMSE), although, the former was marginally less prone than the latter, which is in line with the findings of Hsieh et al. (Reference Hsieh, McGrory, Leslie, Dawson, Ahmed, Butler and Hodges2015). However, the ECAS-ALS Non-Specific score and in particular the ECAS Total score and ECAS-ALS Specific did not suffer from ceiling effects. These findings are in line with the findings of a previous study in which ECAS was found to be substantially less dependent on IQ and produced significantly fewer ceiling effects compared to ACE-III, which may be an advantage for use with clinical groups (De Icaza Valenzuela et al., Reference De Icaza Valenzuela, Bak, Pal and Abrahams2018).

Furthermore, ACE-III does not include a behavioural assessment, which is a shortcoming (Hsieh et al., Reference Hsieh, Schubert, Hoon, Mioshi and Hodges2013). In contrast, the ECAS has a Behavioural Interview, which may add to the cognitive profile of the patient and predict caregiver’s burden. In the current study, 40% of the carers of patients with AD reported behavioural changes. The most prominent were apathy and loss of sympathy. However, the ECAS Behavioural does not assess comprehensively apathy. Apathy is considered a multidimensional construct incorporating emotional, executive, and initiation dimensions (Caga et al., Reference Caga, Hsieh, Highton-Williamson, Zoing, Ramsey, Devenney and Kiernan2018; Marin, Reference Marin1991; Radakovic & Abrahams, Reference Radakovic and Abrahams2018). Recently, the Dimensional Apathy Scale (DAS) was developed to assess these constructs (Radakovic & Abrahams, Reference Radakovic and Abrahams2014). Notably, the DAS was implemented in AD, where a heterogenous profile emerged, enabling classification into three distinct groups (Radakovic et al., Reference Radakovic, Starr and Abrahams2017). Hence, the DAS may be used in conjunction with ACE-III or ECAS in order to further identify and differentiate the types of apathy, which may be of clinical relevance.

Moreover, ACE-III and M-ACE are not adjusted to motor impairments, whereas ECAS is adjusted to upper motor and speech impairments. In a previous study, the ECAS-ALS Non-Specific score displayed very good psychometric properties in differentiating patients with AD from non-demented patients with ALS, whereas ACE-III and M-ACE were not successful (Kourtesis et al., Reference Kourtesis, Christidi, Margioti, Demenega, Rentzos, Evdokimidis and Abrahams2019). Therefore, the ECAS might be considered as an appropriate tool in patients with motor dysfunction, which are common in many neurodegenerative diseases, and could be ideally included in future clinical trials.

Limitations and Future Studies

This study contains certain caveats that should be noted. One of the limitations of this study is the small sample size albeit the facilitation of robust statistical analyses with high statistical power. A larger and more diverse sample would allow more solid and conclusive observations. In future studies, the acquisition of normative data should be of a size that permits the computation of distinct cut-off scores that are analogous to the educational level.

Only patients with AD were recruited in this study. It would be of relevance to investigate the capacity of the tests to differentiate between patients with FTD and AD and probe FTD phenotypes. In addition, future studies should consider adapting a scale such as the DAS in Greek, which may assist with research and/or clinical endeavours. The extensive and profound study of cognitive and behavioural changes in patients with dementia can help ameliorate and adjust patient care and alleviate the caregivers’ burden.

Acknowledgements

The official adaptations of ACE-III and M-ACE in Greek were performed with the permission of J.R. Hodges. The authors deeply thank J.R. Hodges and the Brain and Mind Centre of the University of Sydney for allowing us to adapt ACE-III and M-ACE in Greek. The official adaptation of ECAS in Greek was performed with the permission of Sharon Abrahams, Thomas Bak, and Judy Newton. The official Greek versions of ACE-III and M-ACE can be downloaded from https://sydney.edu.au/brain-mind/resources-for-clinicians/dementia-test.html. The official Greek version of ECAS can be downloaded from https://ecas.psy.ed.ac.uk/ecas-international/#Greek. The authors deeply thank the members (patients with AD and their relatives) and volunteers of the Athens Alzheimer’s Association (https://alzheimerathens.gr/en/) for their contribution to our study. Lastly, the authors would like to thank Enago (www.enago.com) for the English language review and proofreading.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Conflict of Interest

The authors declare no conflicts of interest and that this study is their own work.

References

REFERENCES

Abrahams, S., Newton, J., Niven, E., Foley, J., & Bak, T.H. (2014). Screening for cognition and behaviour changes in ALS. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 15(1–2), 914.CrossRefGoogle ScholarPubMed
Benedict, R.H., & Zgaljardic, D.J. (1998). Practice effects during repeated administrations of memory tests with and without alternate forms. Journal of Clinical and Experimental Neuropsychology, 20(3), 339352.CrossRefGoogle ScholarPubMed
Brugnolo, A., Nobili, F., Barbieri, M.P., Dessi, B., Ferro, A., Girtler, N., … Servetto, G. (2009). The factorial structure of the mini mental state examination (MMSE) in Alzheimer’s disease. Archives of Gerontology and Geriatrics, 49(1), 180185.10.1016/j.archger.2008.07.005CrossRefGoogle Scholar
Caga, J., Hsieh, S., Highton-Williamson, E., Zoing, M.C., Ramsey, E., Devenney, E., … Kiernan, M.C. (2018). The burden of apathy for caregivers of patients with amyotrophic lateral sclerosis. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 19(7–8), 599605.CrossRefGoogle ScholarPubMed
Cox, DR, Donnelly, CA. (2011). Principles of Applied Statistics. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
De Icaza Valenzuela, M.M., Bak, T.H., Pal, S., & Abrahams, S. (2018). The Edinburgh Cognitive and Behavioral ALS screen: relationship to age, education, IQ and the Addenbrooke’s Cognitive Examination-III. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 19(7–8), 585590.CrossRefGoogle ScholarPubMed
Dienes, Z. (2016). How Bayes factors change scientific practice. Journal of Mathematical Psychology, 72, 7889.CrossRefGoogle Scholar
Faul, F., Erdfelder, E., Lang, A.G., & Buchner, A. (2007). G* Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175191.CrossRefGoogle ScholarPubMed
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.G. (2009). Statistical power analyses using G* Power 3.1: tests for correlation and regression analyses. Behavior Research Methods, 41(4), 11491160.CrossRefGoogle Scholar
Fields, J.A., Ferman, T.J., Boeve, B.F., & Smith, G.E. (2011). Neuropsychological assessment of patients with dementing illness. Nature Reviews Neurology, 7(12), 677.CrossRefGoogle ScholarPubMed
Foley, J.A., Niven, E.H., Paget, A., Bhatia, K.P., Farmer, S.F., Jarman, P.R., … Abrahams, S. (2018). Sensitivity and specificity of the ECAS in Parkinson’s disease and progressive supranuclear palsy. Parkinson’s Disease, 2018, 8. doi: 10.1155/2018/2426012Google ScholarPubMed
Folstein, M.F., Folstein, S.E., & Fanjiang, G. (2001). Mini-Mental State Examination: Clinical Guide. Lutz, FL: Psychological Assessment Resources.Google Scholar
Ganguli, M., Ratcliff, G., Huff, F.J., Belle, S., Kancel, M.J., Fischer, L., & Kuller, L.H. (1990). Serial sevens versus world backwards: a comparison of the two measures of attention from the MMSE. Topics in Geriatrics, 3(4), 203207CrossRefGoogle ScholarPubMed
Held, L., & Ott, M. (2018). On p-values and Bayes factors. Annual Review of Statistics and Its Application, 5, 393419.CrossRefGoogle Scholar
Hsieh, S., Hodges, J.R., Leyton, C.E., & Mioshi, E. (2012). Longitudinal changes in primary progressive aphasias: differences in cognitive and dementia staging measures. Dementia and Geriatric Cognitive Disorders, 34(2), 135141CrossRefGoogle ScholarPubMed
Hsieh, S., McGrory, S., Leslie, F., Dawson, K., Ahmed, S., Butler, C.R., … Hodges, J.R. (2015). The Mini-Addenbrooke’s Cognitive Examination: a new assessment tool for dementia. Dementia and Geriatric Cognitive Disorders, 39(1–2), 111.CrossRefGoogle ScholarPubMed
Hsieh, S., Schubert, S., Hoon, C., Mioshi, E., & Hodges, J.R. (2013). Validation of the Addenbrooke’s Cognitive Examination III in frontotemporal dementia and Alzheimer’s disease. Dementia and Geriatric Cognitive Disorders, 36(3–4), 242250.CrossRefGoogle ScholarPubMed
IBM Corp. Released 2016. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp.Google Scholar
JASP Team. (2017). JASP (Version 0.8.1.2) [Computer software].Google Scholar
Kipps, C.M., Nestor, P.J., Dawson, C.E., Mitchell, J., & Hodges, J.R. (2008). Measuring progression in frontotemporal dementia: implications for therapeutic interventions. Neurology, 70(22), 20462052.CrossRefGoogle ScholarPubMed
Konstantinopoulou, E., Kosmidis, M.H., Ioannidis, P., Kiosseoglou, G., Karacostas, D., & Taskos, N. (2011). Adaptation of Addenbrooke’s Cognitive Examination-revised for the Greek population. European Journal of Neurology, 18(3), 442447.CrossRefGoogle ScholarPubMed
Kourtesis, P., Christidi, F., Margioti, E., Demenega, C., Rentzos, M., Evdokimidis, I., & Abrahams, S. (2019). The Edinburgh cognitive and behavioural amyotrophic lateral sclerosis screen: sensitivity in differentiating between ALS and Alzheimer’s disease in a Greek Population. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 21(1–2), 7885. doi: 10.1080/21678421.2019.1655059CrossRefGoogle Scholar
Lulé, D., Burkhardt, C., Abdulla, S., Böhm, S., Kollewe, K., Uttner, I., … Ludolph, A.C. (2015). The Edinburgh cognitive and behavioural amyotrophic lateral sclerosis screen: a cross-sectional comparison of established screening tools in a German-Swiss population. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 16(1–2), 1623.CrossRefGoogle Scholar
Marin, R.S. (1991). Apathy: a neuropsychiatric syndrome. The Journal of Neuropsychiatry and Clinical Neurosciences, 3(3), 243254.Google ScholarPubMed
Marsman, M., & Wagenmakers, E.J. (2017). Bayesian benefits with JASP. European Journal of Developmental Psychology, 14(5), 545555.CrossRefGoogle Scholar
Mathew, R., Bak, T.H., & Hodges, J.R. (2011). Screening for cognitive dysfunction in corticobasal syndrome: utility of Addenbrooke’s cognitive examination. Dementia and Geriatric Cognitive Disorders, 31(4), 254258.CrossRefGoogle ScholarPubMed
McKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., & Stadlan, E.M. (1984). Clinical diagnosis of Alzheimer’s disease: Report of the NINCDS-ADRDA Work Group* under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology, 34(7), 939939.10.1212/WNL.34.7.939CrossRefGoogle ScholarPubMed
Mioshi, E., Dawson, K., Mitchell, J., Arnold, R., & Hodges, J.R. (2006). The Addenbrooke’s Cognitive Examination Revised (ACE-R): a brief cognitive test battery for dementia screening. International Journal of Geriatric Psychiatry: A Journal of the Psychiatry of Late Life and Allied Sciences, 21(11), 10781085.CrossRefGoogle ScholarPubMed
Mora, J.S., Salas, T., Fernández, M.C., Rodríguez-Castillo, V., Marín, S., Chaverri, D., & Rodríguez-Santos, F. (2018). Spanish adaptation of the edinburgh cognitive and behavioral amyotrophic lateral sclerosis screen (ECAS). Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 19(1–2), 7479.CrossRefGoogle Scholar
Niven, E., Newton, J., Foley, J., Colville, S., Swingler, R., Chandran, S., … Abrahams, S. (2015). Validation of the Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis Screen (ECAS): a cognitive tool for motor disorders. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 16(3–4), 172179.CrossRefGoogle ScholarPubMed
Nunnally, J.C. (1994). Psychometric theory 3E. Tata McGraw-Hill Education.Google Scholar
Poletti, B., Solca, F., Carelli, L., Madotto, F., Lafronza, A., Faini, A., … Doretti, A. (2016). The validation of the Italian Edinburgh cognitive and behavioural ALS screen (ECAS). Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 17(7–8), 489498.CrossRefGoogle Scholar
Radakovic, R., & Abrahams, S. (2018). Multidimensional apathy: evidence from neurodegenerative disease. Current Opinion in Behavioral Sciences, 22, 4249.CrossRefGoogle Scholar
Radakovic, R., & Abrahams, S. (2014). Developing a new apathy measurement scale: Dimensional Apathy Scale. Psychiatry Research, 219(3), 658663.10.1016/j.psychres.2014.06.010CrossRefGoogle ScholarPubMed
Radakovic, R., Starr, J.M., & Abrahams, S. (2017). A novel assessment and profiling of multidimensional apathy in Alzheimer’s disease. Journal of Alzheimer’s Disease, 60(1), 5767.CrossRefGoogle ScholarPubMed
Raimondi, C., Gleichgerrcht, E., Richly, P., Torralva, T., Roca, M., Camino, J., & Manes, F. (2012). The Spanish version of the Addenbrooke’s Cognitive Examination—Revised (ACE-R) in subcortical ischemic vascular dementia. Journal of the Neurological Sciences, 322(1–2), 228231.CrossRefGoogle Scholar
Strong, M.J., Abrahams, S., Goldstein, L.H., Woolley, S., Mclaughlin, P., Snowden, J., … Rosenfeld, J. (2017). Amyotrophic lateral sclerosis-frontotemporal spectrum disorder (ALS-FTSD): revised diagnostic criteria. Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 18(3–4), 153174.CrossRefGoogle ScholarPubMed
Valcour, V.G., Masaki, K.H., & Blanchette, P.L. (2002). The phrase:” no ifs, ands, or buts” and cognitive testing. Lessons from an Asian-American community. Hawaii Medical Journal, 61(4), 7274.Google ScholarPubMed
Wagenmakers, E.J., Love, J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., … Meerhoff, F. (2018a). Bayesian inference for psychology. Part II: example applications with JASP. Psychonomic Bulletin & Review, 25(1), 5876.CrossRefGoogle ScholarPubMed
Wagenmakers, E.J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., … Matzke, D. (2018b). Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications. Psychonomic Bulletin & Review, 25(1), 3557.CrossRefGoogle ScholarPubMed
Weir, J.P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. The Journal of Strength & Conditioning Research, 19(1), 231240.Google ScholarPubMed
Ye, S., Ji, Y., Li, C., He, J., Liu, X., & Fan, D. (2016). The Edinburgh cognitive and behavioural ALS screen in a Chinese amyotrophic lateral sclerosis population. PloS one, 11(5), e0155496.CrossRefGoogle Scholar
Zigmond, A.S., & Snaith, R.P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361370.10.1111/j.1600-0447.1983.tb09716.xCrossRefGoogle ScholarPubMed
Figure 0

Table 1. Convergent validity: Bayesian Pearson’s correlations

Figure 1

Fig. 1. ROC curves: differentiation between patients with AD and controls.

Figure 2

Table 2. Sensitivity and specificity in the detection of AD

Figure 3

Table 3. Comparison between controls and patients with AD

Figure 4

Table 4. Bayesian Pearson’s correlations with the duration of disease

Figure 5

Fig. 2. ECAS Behavioural Interview: behavioural changes in AD.

Figure 6

Fig. 3. Distribution of healthy controls’ performance in the fourth quartile of the possible scores.

Figure 7

Fig. 4. Distribution of healthy controls’ performance in the third tier of the possible scores.