Introduction
Autism spectrum disorders (ASDs) are a class of neurodevelopmental pathologies with heterogeneous genetic abnormalities that reflect a highly variable severity of behavioural phenotypes (Ruggeri & Tansella, Reference Ruggeri and Tansella2009; Tosato & Lasalvia, Reference Tosato and Lasalvia2009). The lack of medical tests or biological markers for identifying ASD has led researchers to concentrate on behavioural phenotypes to detect early signs of autism. As recommended by the practice parameters of the American Academy of Neurology and the Child Neurology Society (AACN) (Filipek et al. Reference Filipek, Accardo, Ashwal, Baranek, Cook, Dawson, Gordon, Gravel, Johnson, Kallen, Levy, Minshew, Ozonoff, Prizant, Rapin, Rogers, Stone, Teplin, Tuchman and Volkmar2000), an appropriate and timely ASD diagnosis requires two different levels of investigation: Level (1) a routine developmental surveillance; Level (2) an exhaustive evaluation restricted to children identified at risk at Level 1.
The principal aim of the present study was to investigate the possible use of child behaviour checklist (CBCL) 1.5–5 as a Level 1 tool to support non-specialized professionals (e.g. paediatricians) in their ability to detect behaviours that are suggestive of an ASD risk. Primary care providers are in the best position to screen for ASD because they see young children routinely for medical care. Thus, it would be useful to have a tool that allows them to easily identify children at risk for ASD and then refer such children for a Level 2 evaluation. In fact, even if most parents of children with autism first become concerned about their child's development in the first years of life (Chawarska et al. Reference Chawarska, Paul, Klin, Hannigen, Dichtel and Volkmar2007; Ozonoff et al. Reference Ozonoff, Young, Steinfeld, Hill, Cook, Hutman, Macari, Rogers and Sigman2009), several months or years may elapse before their worry is taken into consideration by paediatricians and a further delay may occur between the paediatric visit and a specialist's ASD diagnosis (Maestro et al. Reference Maestro, Casella, Milone, Muratori and Palacio-Espasa1999; Wiggins et al. Reference Wiggins, Baio and Rice2006). The implications of this gap extend far beyond outcome gains associated with an early intervention (Ricciardi et al. Reference Ricciardi, McAllister and Dazzan2008; Vismara & Rogers, Reference Vismara and Rogers2010); in fact, most parents of children with autism experience considerable amounts of stress because they are parenting a child with atypical development, and the uncertainty of diagnosis accentuates parental anxiety (Muratori et al. Reference Muratori, Apicella, Muratori and Maestro2010).
To help clinicians in pointing out the actual risk for autism and in reducing the gap, standardized caregivers checklists and questionnaires have been used. Such tools should differentiate well between children likely to have a disorder and typically developing children (that is high sensitivity), while their specificity is less of concern because ASD can be differentiated from other conditions in a Level 2 assessment. Some specific instruments were developed to identify very young children with ASD (Pinto-Martin et al. Reference Pinto-Martin, Young, Mandell, Poghosyan, Giarelli and Levy2008), while others (usually applied in epidemiology) have proved to be useful in detecting children at risk of general developmental and behavioural disorders (Briggs-Gowan & Carter Reference Briggs-Gowan and Carter2006; Matson et al. Reference Matson, Fodstad, Mahan and Rojahn2010). Among these latter instruments, the CBCL is one of the most widely used parent report checklist that measures a broad range of behavioural and emotional problems (Achenbach & Rescorla, Reference Achenbach and Rescorla2001). It displays adequate reliability and validity and requires little effort to be completed (it takes 5–10 min for parents and 5 min to score).
Almost 20 years ago, Rescorla was the first researcher to use the CBCL for preschoolers with autism (Rescorla, Reference Rescorla1988). In that study, the emergence of an autistic factor suggested that a future use of the CBCL as a possible instrument to recognize children with autism might be fruitful. However, after Rescorla's investigation, only a few studies have applied the CBCL scales to children with autism (Bolte et al. Reference Bölte, Dickhut and Poustka1999; Duarte et al. Reference Duarte, Bordin, De Oliveira and Bird2003). In more recent years, the preschool form of the CBCL (Achenbach & Rescorla, Reference Achenbach and Rescorla2000) was developed and used in different settings (Rescorla, Reference Rescorla2005). The 100-problem item of this CBCL 1.5–5 yields seven empirically based syndrome scales and five Diagnostic and Statistical Manual (DSM)-oriented scales. Among the latter is the Pervasive Developmental Problems (PDP) scale. To construct this new DSM-oriented scale, the relationship between DSM-IV-TR diagnostic criteria for PDP and item of CBCL 1.5–5 were studied (Krol et al. Reference Krol, De Bruyn, Coolen and van Aarle2006).
For the last several years, we have used this CBCL form for preliminary assessment in our second-level neuropsychiatric clinic. Our impression from this use of the CBCL 1.5–5 was that clinically significant elevations on the PDP scale were in good agreement with clinical ASD diagnosis. Our observation is now supported by some recent papers that applied this CBCL form to children with ASD (Sikora et al. Reference Sikora, Hall, Hartley, Gerrard-Morris and Cagle2008; Hartley et al. Reference Hartley, Sikora and McCoy2008, Reference Hartley and Sikora2009) and evaluated adequacy of CBCL/1.5–5 factor model in a well-characterized sample of preschoolers with ASD (Pandolfi et al. Reference Pandolfi, Magyar and Dill2009). Sikora et al. (Reference Sikora, Hall, Hartley, Gerrard-Morris and Cagle2008) have described a better performance of the CBCL/1.5–5 compared to a specific instrument as the Gilliam Autism Rating Scale (GARS), in identifying young children (aged 36–71 months) with ASD. Especially, in this study Withdrawn and PDP subscales of the CBCL were higher among children with autism than among non-spectrum children, and these subscales had better sensitivity and specificity in identifying children with autism than the GARS.
The present research addressed the following aims: (a) to identify CBCL scales that deviated significantly preschoolers with ASD from typical developing and other psychiatric disorders (OPDs) children; (b) to test the effects of age and gender on CBCL capacity in discriminating among the three groups; (c) to provide more detailed understanding of predictive properties of a broad-scale rating instrument such as the CBCL 1.5–5.
Method
Participants
A total of 313 children aged 24–60 months (mean age 43.8 months; s.d. 12.5) were included in the study. Participants belong to three groups: (1) an experimental group of 101 children affected by an ASD (85 M; 16 F; mean age: 44 months; s.d. 12.3; range 24–60 months); (2) a control group of 95 children with OPD (43 M; 52 F; mean age: 40 months; s.d. 12.7; range 24–56 months); (3) a second control group of 117 preschoolers with typical development (TD) (65 M; 52 F; mean age: 47 months; s.d. 12; range 26–60 months). The whole sample (ASD, OPD and TD) was composed of Caucasian children of Italian descent. All the ASD subjects were consecutively admitted to the Department of Child Neuropsychiatry of the University of Pisa, Stella Maris Scientific Institute (a suburban public academic hospital providing care to patients of all socioeconomic levels, coming from all over Italy) between September 2006 and June 2009 and diagnosed on the base of DSM-IV-TR criteria coupled with clinical judgments made by a senior child psychiatrist with expertise in autism Raffaella Tancredi (RT) and confirmed by Autism Diagnostic Observation Schedule (ADOS) (applied by a certificate MD: Elisa Santocchi (ES)). Laboratory tests to rule-out medical causes of autism included audiometry, standard karyotyping, fragile X testing and metabolic screening; structural brain Magnetic Resonance Imaging (MRI) and Electro Encefalo Gram (EEG) were performed in case of clinical indication and were all assessed as normal.
OPD subjects were selected from a large database of children with psychiatric disorders diagnosed according to the DSM-IV-TR (APA, 2000) or – for children under 3 years of age – to the DC: 0–3R (Zero to Three, 2005). For these children, an ASD diagnosis was actively excluded by a senior child psychiatrist and supported by a score under 15 (that is the cut-off point for an ASD) on the social communication questionnaire (Rutter et al. Reference Rutter, Bailey and Lord2003). Moreover, in order to avoid possible confusing overlap with ASD, also children with a DSM-IV-TR diagnosis of attention deficit hyperactivity disorder (ADHD), and children with multi-system developmental disorder (MSDD) or regulatory disorder (RD), according to DC0-3R criteria, were not included in OPD sample. Final diagnosis of the OPD children was affective disorders for 59 subjects, oppositional defiant disorder for 25 subjects and mixed disorders for 11 subjects.
Children with TD were collected in three urban kindergartens in Pisa; subjects with whatever internalizing problems or/and some parent or teacher concern about child development were excluded.
The study was approved by the research ethics boards of the Stella Maris Scientific Institute.
Measures
The CBCL 1.5–5 (Achenbach & Rescorla, Reference Achenbach and Rescorla2000; Frigerio et al. Reference Frigerio, Cozzi, Pastore, Molteni, Borgatti and Montirosso2006) is a 100-item parent-report measure designed to record the problem behaviours of preschoolers. Each item describes a specific behaviour and the parent is asked to rate its frequency on a three-point Likert scale (0, not true; 1, somewhat or sometimes true; 2, very true or often true). The scoring gives a summary profile (including internalizing, externalizing and total problems scores), a syndrome profile (emotionally reactive, anxious/depressed, somatic complaints, withdrawn, sleep problems, attention problems and aggressive behaviour) and five different DSM-oriented scales (affective problems, anxiety problems, pervasive developmental problems, attention deficit/hyperactive problems and oppositional defiant problems). A T-score of 63 and above for summary scales and of 70 and above for syndrome and DSM-oriented scales, are generally considered clinically significant; values between 60 and 63 for summary scales or between 65 and 70 for syndrome and DSM-oriented scales, identify the borderline clinical range; values under 60 or under 65 are considered not-clinical. Scores and profiles for each child were obtained, thanks to a computer scoring software. Each profile has an easy-reading layout that allows one to immediately understand whether the scores are in normal, borderline or clinical range. Even if specific interest was devoted to the 13-item PDP scale (see Appendix), this paper focuses on the potential diagnostic role of all the CBCL scales.
Procedures
Parents (mother when possible) of the 313 children filled the CBCL 1.5–5. In ASD and OPD, CBCL 1.5–5 was completed at the beginning of a multidisciplinary clinical observation at the Scientific Institute Stella Maris; parents of TD filled the CBCL 1.5–5 in anonymous way at kindergarten. In order to avoid any bias related to the fact that caregivers of the clinical groups were subjected to different diagnostic interviews, CBCL was administered before the beginning of the clinical assessment.
Data analysis
The CBCL scales were examined for normality using skewness tests and Kolmogorov–Smirnov testing. None of the scales had significant departures from normality.
Chi-square test was used to compare categorical variables among the three groups. One-way analysis of variance (ANOVA) with post hoc S-N-K was performed to test differences on age and the CBCL scales among ASD, OPD and TD groups, multivariate analysis of covariance (MANCOVA) was used to evaluate differences among the three groups on CBCL scales, regardless of gender and age.
Logistic regression analysis with odds ratios (ORs) was performed to identify CBCL scales discriminating among the three groups. We used separate logistic regression models to compare ASD v. TD and ASD v. OPD. In Model 1, the independent variable was CBCL total score; in Model 2, the independent variables were internalizing and externalizing scores; in Model 3 the independent variables were syndrome scales; in Model 4 the independent variables were the five different DSM-oriented scales.
CBCL scales that were identified as predictors of an ASD diagnosis in the logistic regression analysis at p < 0.001 were used in a receiver operating characteristic (ROC) analysis, in order to determine their optimal cut-offs to differentiate children with ASD from children with TD or OPD.
In the ROC analysis, sensitivity and specificity were plotted over the range of cut-off points. The area under the curve (AUC) represents the accuracy of the instrument in predicting children who will have or will not have ASD. The interpretation of the AUC values is traditionally as follows: an AUC < 0.7 suggests ‘low’ diagnostic accuracy; an AUC from 0.7 to 0.9 suggests ‘moderate’ diagnostic accuracy and an AUC ≥ 0.9 suggests ‘high’ diagnostic accuracy (Sweet & Picket, Reference Sweet and Picket1982).
Analyses were carried out using SPSS version 15.0 for Windows (SPSS Inc. Chicago, IL, USA).
Results
Preliminary analyses
Overall, 313 subjects were recruited (61, 6% males and 38, 4% females, mean age 43.8 ± 12.5 months).
Chi-square analysis revealed a significant difference on gender distribution among ASD, OPD and TD groups (chi-square = 36.32, p < 0.001): the percentage of females was significantly lower in the ASD group when compared with the other two groups.
Chi-square analysis showed no significant differences for socio-economic status (chi-square = 0.27, p = 0.965): children belong mostly to middle-class families according to the Hollingshead & Redlich criteria (Hollingshead & Redlich, Reference Hollingshead and Redlich1958).
One-way ANOVA indicated a significant difference on age among the groups (F[2,310] = 5.20, p = 0.006); S-N-K post hoc test revealed that the difference was due to the younger age of the OPD compared to TD group (p = 0.005); no differences were found between ASD and TD and between ASD and OPD.
Clinical characteristics
One-way ANOVA comparing the three groups (Table 1) revealed that ASD and OPD groups had significantly higher scores in all CBCL scales than TD group, except for somatic complaints and sleep problems.
Table 1. One-way ANOVA and logistic regression on CBCL T-scores (means and standard deviations) for ASD, OPD and TD groups
![](https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary-alt:20160626151127-21183-mediumThumb-S204579601100045X_tab1.jpg?pub-status=live)
ASD, autism spectrum disorder; OPD, other psychiatric disorders; TD, typical development; CBCL, child behaviour checklist; OR, odds ratio; CI, confidence interval.
Superscripts stand for S-N-K post hoc tests: aASD significantly higher v. TD (p<0.01); bASD significantly higher v. OPD (p < 0.01); cOPD significantly higher v. TD (p < 0.01); dOPD significantly higher v. ASD.
Moreover, the ASD group presented higher scores than OPD group on Withdrawn and Attention Problems scales of the CBCL syndrome profile (Fig. 1a) and on PDP scale of the CBCL DSM-oriented (Fig. 1b). OPD group had higher scores compared to ASD on Anxious/Depressed, Somatic Complaints, Sleep Problems and Aggressive Behaviour scales of the CBCL syndrome profile and on Anxiety Problems and Oppositional Defiant Problems of the CBCL DSM-oriented scales.
![](https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary-alt:20160626151124-80887-mediumThumb-S204579601100045X_fig1g.jpg?pub-status=live)
Fig. 1. (a) Means of CBCL T-scores for syndrome scales. ASD, autism spectrum disorder; OPD, other psychiatric disorders; TD, typical development; EMR, emotionally reactive; AXD, anxious/depressed; SOM, somatic complaints; WD, Withdrawn; SLE, sleep problems; ATT, attention problems; AGG, aggressive behaviour. (b) Means of CBCL T-scores for DSM-oriented scales. AFF, affective problems; AXP, anxiety problems; ODP, oppositional defiant problems; PDP, pervasive developmental problems; ADHD, attention deficit and hyperactivity disorder.
MANCOVA showed that the results were not significantly different after controlling for age and gender.
In the logistic regression analysis with OR (Table 1), CBCL scales predicting the presence of an ASD towards both TD and OPD were the Withdrawn scale, the Attention Problems scale and the PDP scale. CBCL Total and internalizing scores were predictors of the presence of an ASD, when comparing ASD with TD, while they did not distinguish between ASD and OPD.
ROC analyses
Because Withdrawn, Attention Problem and PDP scales have been identified as the best predictors of the probable presence of ASD in the logistic regression analysis, we used ROC analyses to estimate the best cut-offs for these scales (Fig. 2). In Table 2, sensitivity, specificity, NPV and PPV and AUC at the optimal cut-offs for the three scales in discriminating ASD from TD and OPD are reported.
![](https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary:43213:20160412092300923-0473:S204579601100045X_fig2g.jpeg?pub-status=live)
Fig. 2. ROC for Withdrawn (red), attention problems (yellow) and PDP (blue) scales. (A colour version of this figure is available online at http://journals.cambridge.org/eps)
Table 2. Sensitivity, specificity, positive predictive values (PPV) and negative predictive values (NPV) at the best cut-off points on Withdrawn, Attention problems and PDP scales when comparing autism spectrum disorder (ASD) v. typical developing children (TD) or v. other psychiatric disorders (OPD)
![](https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary-alt:20160626151125-60956-mediumThumb-S204579601100045X_tab2.jpg?pub-status=live)
ASD, autism spectrum disorder; TD, typical development; OPD, other psychiatric disorders; PDV, pervasive developmental problems; PPV, positive predictive values; PNV, Predictive negative value; AUC, area under the curve; PDP, pervasive developmental problems.
ASD v. TD
ROC analysis indicated that in discriminating ASD from TD group the optimal compromise between sensitivity and specificity was achieved at a score of 65 both on the PDP scale (AUC = 0.947; 95% CI 0.920–0.975) and the Withdrawn scale (AUC = 0.945; 95% CI 0.914–0.977).
For the PDP scale, the sensitivity, that is the proportion of actual ASD subjects who were correctly identified, was 0.85, and the specificity, that is the proportion of actual TD subjects who were correctly identified, was 0.90. The score of 65 yielded a positive predictive value of 0.88 (i.e. the proportion of individuals with a score of 65 or more who were diagnosed in the ASD group) and a negative predictive value of 0.87 (i.e. the proportion of individuals with a score of less than 65 who were diagnosed in the TD group).
For the Withdrawn scale, sensitivity (0.89), specificity (0.92), PPV (0.90) and NPV (0.90) were even slightly better than in case of the PDP scale.
For the Attention Problems scale, the best cut-off discriminating ASD from TD was 55 but all values (sensitivity, specificity, PPV and NPV) were lower and the AUC (0.850; 95% CI 0.799–0.902) showed a moderate diagnostic accuracy.
ASD v. OPD
In order to discriminate ASD from OPD, as far as PDP scale is regarded the optimal cut-off was 65 (AUC = 0.813; 95% CI 0.753–0.873). Using this cut-off, the proportion of subjects with ASD who were correctly diagnosed was 0.85 (sensitivity) and the proportion of cases with OPD who were correctly diagnosed was 0.60 (specificity).
For the Withdrawn scale, the optimal compromise between sensitivity (that was 0.89) and specificity (that was 0.65) was achieved at a score of 62 (AUC = 0.850; 95% CI 0.794–0.905). For the Attention Problems scale, the optimal cut-off was 55 (AUC = 0.704; 95% CI 0.632–0.776) with a sensitivity of 0.72 and a specificity of 0.55. Following Sweet & Picket criteria (Sweet & Picket, Reference Sweet and Picket1982), the AUC have to be considered moderate when comparing ASD and OPD for all the three scales (PDP, Withdrawn and Attention Problems).
Discussion
Brief and validated tools should be used in primary care settings to detect children at risk of autism and to redirect families for an in-depth examination by professionals experienced in developmental disabilities; the final aim of such tools is to reduce the significant time lag between age at first parental worry and age at first ASD diagnosis that is still consistently reported in the literature (Barbaro & Dissanayake, Reference Barbaro and Dissanayake2009). Our results on the ability of CBCL scales in discriminating ASD preschoolers suggest the following considerations.
First, we confirm the validity of the PDP scale in differentiating preschoolers with ASD from those with TD. According to Sweet & Picket (Reference Sweet and Picket1982) interpretation of the AUC, the diagnostic accuracy of the PDP scale is high. Moreover, when comparing ASD and TD, sensitivity (85%) and specificity (90%) of the PDP scale are both very high and broadly above 80%, which is the recommended cut-off for first-level instruments (Meisels, Reference Meisels1989). Sensitivity is considered the most important measure of a good Level 1 tool as it indicates the probability that a positive test reflects the underlying pathological (ASD in our case) condition; in fact, a high sensitivity corresponds to a low percentage of false negatives, so that the possibility of being affected by an ASD and not being properly diagnosed is reduced. The low rate of false negatives indicates that the PDP scale is able to identify the majority of preschoolers at risk for ASD to refer them to appropriate services with minimal delay. For this reason, our results provide support for the PDP scale as an effective Level 1 tool in individuating children at risk of ASD in the general population. Moreover, the PDP scale shows an even higher specificity that means low rates of false positives. This is the second reason to support its use as a screening tool (Sikora et al. Reference Sikora, Hall, Hartley, Gerrard-Morris and Cagle2008) because it limits to families of healthy preschoolers an unnecessary, time-consuming and emotionally exhausting referral to specialty clinics.
As a complementary finding, the Withdrawn scale has shown a power of discrimination that is even slightly higher than the PDP scale (sensitivity: 89%; specificity: 92%). The presence of Withdrawn as a discriminative scale for ASD is consistent with Sikora findings (Sikora, 2008) and with the more recent paper on older children conducted in Singapore (Ooi et al. Reference Ooi, Rescorla, Ang, Woo and Fung2010). In both these papers, elevation on this scale is reported as a specific behavioural pattern indicative of autism. It may be pointed out that the Withdrawn cluster of items has to be considered in future research and practice not only indicative of an affective or mood disorder, as usually it is intended, but also the expression of social difficulties specific to ASD. Findings from the present research support that high value on both the Withdrawn scale (which is derived from factor analysis) and the PDP scale (which is derived by expert judgment) do an excellent job of screening for ASD.
Third, the present study adds a contribution to the literature on differentiating ASD from OPD. When autism group is compared to OPD, the ASD group is marked by higher scores on Withdrawn and PDP scales and these scales obtained a high sensitivity, nevertheless these two scales showed lower specificity and PPV. It means that these scales contain the risk of over-identify ASD in children with OPD. The fact that the discrimination between ASD and OPD is not as strong as that between ASD and TD was not totally unexpected, even if we have not included in OPD group subjects with boundary conditions such ADHD, MSDD and RD. We can sustain that the moderate diagnostic accuracy could be linked to the prevalence in our OPD group of young children with internalizing disorders; usually these children have high scores in the Withdrawn scale and the fact that five out of the eight items in this scale are shared with the PDP scale could be the reason of elevations on the PDP scale in internalizing disorders. A second explanation concerns the frequent co-occurring emotional problems such as depression in autistic conditions (Pandolfi et al. Reference Pandolfi, Magyar and Dill2009). Recent meta-analyses have reported that up to 84% of ASD experience anxiety (White et al. Reference White, Oswald, Ollendick and Scahill2009) and up to 34% experience depression (Stewart et al. Reference Stewart, Barnard, Pearson, Hasan and O'Brien2006). Thus, we can hypothesize that parents of ASD children answer positively to some item considering the internalizing traits of their autistic child. For these reasons, the specificity of the PDP and Withdrawn scales decreases in differentiating ASD v. OPD; we can also imagine a further decrease when ADHD, MSDD or RD are considered, because these conditions have overlapping symptoms with ASD disorder. Nevertheless, we think that this is not a major drawback for using the CBCL as a screening tool in general population settings. First of all, because CBCL differentiates extremely well between children likely to have a disorder and typically developing children. Second, because the low specificity is due to the elevated scores on most scales in both ASD and OPD (see Figs. 1 and 2). In a primary screening programme, the low specificity towards children with OPD can be tolerated; indeed it allows the identification of children who show behavioural and developmental problems that, even if generally not severe such as in ASD, could benefit from a more specialized diagnostic assessment than the standard mental health evaluation. Thus, high scores in PDP and Withdrawn scales could represent a criterion for the paediatrician to decide whether the child needs a deeper ASD evaluation, with the knowledge that children who are shy, withdrawn (and perhaps language delayed) may turn out truly not to have ASD. Nevertheless, some other diagnosis may be made, so that these children are apparently ‘false’ positives because they are not ASD but they are not really false positives from a clinical perspective.
Finally, mean scores elevation on the Attention Problem scale in ASD compared to TD or OPD confirms, also in preschoolers, the frequently observed co-existence of attention problems in older children with autism (Bölte et al. Reference Bölte, Dickhut and Poustka1999; Sinzig et al. Reference Sinzig, Walter and Doepfner2009) and the overlap between ASD and ADHD is often reported in the literature (de Bruin et al. Reference De Bruin, Ferdinand, Meester, de Nijs and Verheij2007). Nevertheless, the Attention Problems scale does a much worse job of predicting ASD than do PDP and Withdrawn scales, regardless of which control group is used. In fact, according to the AUC, diagnostic accuracy is only moderate when ASD are compared to both TD and OPD groups. Thus, while we confirm a frequent early clinical association of ASD with attention problems, we do not suggest the utility of this scale in screening autism.
Conclusions
Our study confirms how CBCL, filled out by parents in paediatric primary care, can successfully meet the needs of a broad-scale rating instrument (Tancredi et al. Reference Tancredi, Picchi, Floriani, Seppia and Muratori2002) and shows its ability to evaluate also the risk of ASD in preschoolers. The high sensitivity and specificity of PDP and Withdrawn scales indicate these scales as a useful screening tool that can complement direct paediatric observation of the child (e.g. response to name task, joint attention task and declarative pointing), maximizing the role of the parents.
Nevertheless, there are some limitations associated with the current study. First, CBCL 1.5–5 PDP scale is able to differentiate already-diagnosed patients with ASD from TD children, but remains to investigate if the high sensitivity and specificity is maintained in a screening survey. Moreover, we have to consider the low specificity towards OPD and that the risk to over-identify ASD in children with other OPD could increase when ADHD, MSDD and RD will be considered. Second, we did not present data on the mental age of clinical samples so that present findings prevent us from claiming our data as specific of an ASD and not of a more general developmental delay. Third, in line with the epidemiological data of a strong male preponderance in ASD and a mild female prevalence in OPD (Center for Disease Control and Prevention, 2007), our sample shows significant sex differences in the three groups. However, this gender discrepancy should not interfere with our results, since statistical analysis carried out to analyse significant differences among the three groups on CBCL scales, was controlled for gender. Fourth, CBCL results are generated from primary caregivers and parental bias in interpreting the questions and quantifying the behaviours must be taken into account (Ozonoff et al. Reference Ozonoff, Young, Steinfeld, Hill, Cook, Hutman, Macari, Rogers and Sigman2009). For example, parents with anxiety or mood disorder could over-estimate maladaptive behaviours of their own kid, while others may be reluctant to acknowledge their child's problems. Nevertheless, the literature has established that parents know their child very well and are for the most part reliable informants about their child's development (Glascoe & Dworkin, Reference Glascoe and Dworkin1995; Glascoe, Reference Glascoe1999).
Notwithstanding these limits, the distinctive PDP and Withdrawn profiles have shown excellent sensitivity and specificity that are better than in other well-known tools for screening autism as M-CHAT; thus, these scales, which represent two separate and distinct templates for grouping CBCL item, could become a brief, rapid, easy, specific tool for screening of ASD in primary settings. Some problems persist for its specificity particularly towards internalizing disorders so that it could be expected to develop more research on items that have a better power of discrimination between ASD and other emotional or developmental problems.
Declaration of Interest
The author(s) declare that they have not received economic support and they have no conflict of interest related to the present paper.
Acknowledgements
The authors thank Dr. Sandra Maestro, Chief of Infant Psychiatry Unit and two anonymous manuscript reviewers for their valuable discussions and comments.
Appendix. List of the items composing the ‘Pervasive Developmental Problems’ scale
![](https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary:77302:20160412092300923-0473:S204579601100045X_tabU1.gif?pub-status=live)