Hostname: page-component-745bb68f8f-b6zl4 Total loading time: 0 Render date: 2025-02-10T05:53:06.324Z Has data issue: false hasContentIssue false

Spanish Adaptation and Psychometric Properties of the Parent Version of the Short Mood and Feelings Questionnaire (SMFQ-P) in a Non-Clinical Sample of Young School-Aged Children

Published online by Cambridge University Press:  05 November 2020

Iván Fernández-Martínez*
Affiliation:
Universidad Miguel Hernández de Elche (Spain)
Alexandra Morales
Affiliation:
Universidad Miguel Hernández de Elche (Spain)
Francisco Xavier Méndez
Affiliation:
Universidad de Murcia (Spain)
José Pedro Espada
Affiliation:
Universidad Miguel Hernández de Elche (Spain)
Mireia Orgilés
Affiliation:
Universidad Miguel Hernández de Elche (Spain)
*
Correspondence concerning this article should be addressed to Iván Fernández-Martínez. Department of Health Psychology, Miguel Hernández University of Elche. Av. de la Universidad s/n. 03202 Elche, Alicante (Spain). E-mail: i.fernandez@umh.es
Rights & Permissions [Opens in a new window]

Abstract

The parent version of the Short Mood and Feelings Questionnaire (SMFQ-P) is a brief 13-item tool for the screening of depression in children from the age of 6 years. Despite the wide use of the SMFQ-P, its psychometric properties and factor structure remain understudied, with few data available for young school-aged children. The objective of this study was to examine for the first time the factorial structure and psychometric properties of the SMFQ-P in a non-clinical sample of Spanish-speaking children aged 6–8 years. Participants were 181 children whose parents completed the Spanish-adapted version of the SMFQ-P along with the parent version of other measures of anxiety and general difficulties and positive attributes. The SMFQ-P demonstrated adequate internal consistency (α = .83) and test-retest reliability over an eight-week period (ICC = .80), and good convergent and divergent validity. Factor analysis confirmed the original 13-item model, thus supporting the unidimensionality of the measure in the Spanish sample. Overall, this study provides initial empirical evidence for the utility of the SMFQ-P with Spanish-speaking children from early school ages, and extends the international support of the measure.

Type
Research Article
Copyright
© Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2020

Along with anxiety and behavior disorders, mood disorders are one of the most common mental health problems in children, with an estimated prevalence ranging from 0.6% to 3% for major depressive disorder (Merikangas et al., Reference Merikangas, Nakamura and Kessler2009; Polanczyk et al., Reference Polanczyk, Salum, Sugaya, Caye and Rohde2015). Depressive symptoms can appear early in life, from preschool ages, remain stable or increase over time and have heterotypic continuity with other emotional problems such as anxiety (Bufferd et al., Reference Bufferd, Dougherty, Carlson, Rose and Klein2012; Lewis et al., Reference Lewis, Sae-Koew, Toumbourou and Rowland2020). Furthermore, early manifestation of depressive symptoms in children strongly predicts subsequent disorders, such as major depression disorder, anxiety, and attention deficit hyperactivity disorder during school age and early adolescence (Luby et al., Reference Luby, Gaffrey, Tillman, April and Belden2014). Thus, the need and importance of early identification of depressive symptoms has been underlined (Luby, Reference Luby2010; Wesselhoeft et al., Reference Wesselhoeft, Sørensen, Heiervang and Bilenberg2013). In this regard, there is a need to continue to develop and adapt tests to diagnose depression from an early age (Bernaras et al., Reference Bernaras, Jaureguizar and Garaigordobil2019).

The value of a multi-informant assessment for an accurate assessment of children’s internalizing problems, including parent-reports, has been supported (Izquierdo-Sotorrío et al., Reference Izquierdo-Sotorrío, Holgado-Tello and Carrasco2016; Kerr et al., Reference Kerr, Lunkenheimer and Olson2007). Although a low-to-moderate cross-informant correspondence, as well as parents’ tendency to under-report child depression have been found, the use of multiple informants allows a more comprehensive assessment, as the manifestation of children’s mental health problem may vary according to the context. This also allows the adaptation of treatment to the children’s needs, providing parents a valuable perspective of their child’s emotional problems (De Los Reyes et al., Reference De Los Reyes, Augenstein, Wang, Thomas, Drabick, Burgers and Rabinowitz2015; Kim et al., Reference Kim, Chan, McCauley and Stoep2016). It has also been noted that self-reported scales generally appear to be more helpful in adolescence, with more limited use in younger children (Rey et al., Reference Rey, Bella-Awusah, Jing and Rey2015). Moreover, following Dougherty et al.’s (Reference Dougherty, Klein, Olino, Laptook, Hunsley and Mash2008) review, parents as a source of information are especially useful in the case of pre-adolescent and younger children.

Rating scales are cost-effective and widely employed for the screening of depression (Dougherty et al., Reference Dougherty, Klein, Olino, Laptook, Hunsley and Mash2008; Rey et al., Reference Rey, Bella-Awusah, Jing and Rey2015), and several measures for the screening of childhood depression with sound psychometric properties offering a parent-rating form can be found (Bernaras et al., Reference Bernaras, Jaureguizar and Garaigordobil2019; Costello & Angold, Reference Costello and Angold1988). However, it has been argued that few instruments are available free of charge, which is critical as it may limit their accessibility and use (Jeffreys et al., Reference Jeffreys, Rozenman, Gonzalez, Warnick, Dauser, Scahill, Woolston and Weersing2016). One of the scales available for measuring childhood depression through children and parents is the Short Mood and Feelings Questionnaire (SMFQ), a 13-item scale designed to provide a quick assessment and screening of core DSM-based depressive symptoms in children and adolescents aged 6–17 years (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995). The use of the SMFQ offers sound advantages, such as being a brief, simple, and easy-to-complete screening instrument, specifically developed for children and adolescents, and available free of charge. The SMFQ allows the assessment of childhood depression including affective and cognitive items, but also others related to restlessness, lack of concentration or tiredness. Both the self-report and parent-report (SMFQ-P) have been shown to have a unifactorial structure and good psychometric properties in community samples, highlighting their ability to detect children at risk of depression and discriminate clinical from non-clinical cases (e.g., Rhew et al., Reference Rhew, Simpson, Tracy, Lymp, McCauley, Tsuang and Stoep2010; Sharp et al., Reference Sharp, Goodyer and Croudace2006; Thapar & McGuffin, Reference Thapar and McGuffin1998). Recently, this measure has been cross-culturally adapted to Norwegian (Lundervold et al., Reference Lundervold, Breivik, Posserud, Stormark and Hysing2013), Serbian (Stevanovic, Reference Stevanovic2012), Bangladeshi (Deeba et al., Reference Deeba, Rapee and Prvan2015), New Zeland (Thabrew et al., Reference Thabrew, Stasiak, Bavin, Frampton and Merry2018), Chinese (Cheng et al., Reference Cheng, Cao and Su2009), and Brazilian-Portuguese (Sucupira et al., Reference Sucupira, Neto, de Lima, Dini, de Brito and Ferreira2017) populations. However, it has not yet been validated for use in Spanish-speaking children (Bernaras et al., Reference Bernaras, Jaureguizar and Garaigordobil2019).

On another hand, although the SMFQ-P has shown to be a useful scale to assess childhood depression, even for evaluation of treatment response in early school-aged children (Creswell et al., Reference Creswell, Violato, Cruddace, Gerry, Murray, Shafran, Stein, Willetts, McIntosh and Cooper2020; Tennant et al., Reference Tennant, Martin, Rooney, Hassan and Kane2017), few data are available about its psychometric properties in young children (i.e., 6–8 years), as studies have generally focused on older ages (e.g., Karevold et al., Reference Karevold, Ystrøm, Weeks, Mathiesen and Røysamb2017; Sucupira et al., Reference Sucupira, Neto, de Lima, Dini, de Brito and Ferreira2017). Therefore, it would be valuable to provide further data regarding the factor structure, reliability (i.e., including test-retest reliability) and validity of the SMFQ-P with young school-aged children.

Thus, the aim of the present study was to examine in a sample of primary school Spanish-speaking children aged 6 to 8: (a) The factor structure; (b) the internal consistency and test-retest reliability; and (c) the convergent and divergent validity of the SMFQ-P. Based on findings in previous studies (e.g., Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995; Karevold et al., Reference Karevold, Ystrøm, Weeks, Mathiesen and Røysamb2017; Sucupira et al., Reference Sucupira, Neto, de Lima, Dini, de Brito and Ferreira2017), an adequate fit of the Spanish data to the single-factor structure of the SMFQ-P was hypothesized, and reliability was expected to be good. Regarding convergent and divergent validity, positive significant correlations were expected between the SMFQ and measures of emotional psychopathology (i.e., depression and anxiety), and lower correlations with a non-emotional construct measuring prosocial behavior (e.g., Muris et al., Reference Muris, Meesters and van den Berg2003; Zhao et al., Reference Zhao, Xing and Wang2012).

Method

Participants

The sample included 181 children aged between 6 and 8 years (M = 6.87, SD = .79); 98 boys (54.1%) and 83 girls (45.9%), all of them Caucasian. The age distribution was as follows: 38.1% were 6 years old, 37% were 7 years old, and 24.9% were 8. Participants were recruited from ten primary schools from southeastern Spain, selected according to their availability to represent the socioeconomic structure of Spanish population. Children were in Grades 1 (44.8%), 2 (35.4%), and 3 (19.8%) of primary education. Most children had been born in Spain (97.8%), whereas the remaining 2.2% had been born in other countries, but all the children were Spanish-speakers. Of all the children, 76.2% had between one and three siblings, the remaining 23.8% had none. A total of 181 parents (81.8% mothers and 18.2% fathers) completed questionnaires about their children. Regarding parental status, 86.2% were married, 12.2% divorced, and 1.6% single parents. Most of participants came from middle-class families. Parents’ levels of study were as follows: Primary education, 16.6%, secondary education, 30.9%; and higher education, 52.5%.

Measures

Short Mood and Feelings Questionnaire - Parent Version (SMFQ-P). The SMFQ-P (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995) consists of a brief 13-item measure to assess depressive symptomatology in children and adolescents, mainly assessing affective and cognitive symptoms. It comprises descriptive phrases (e.g., s/he was very restless) on which parents rate how their children have been acting and feeling over the past two weeks on a 3-point Likert scale (0 = not true; 1 = sometimes; 2 = true). The total SMFQ-P score is obtained by summing all the responses (score range: 0–39), with higher scores indicating more severe symptoms of depression. The SMFQ-P has shown good validity and reliability (α = .84–.87) (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995; Rhew et al., Reference Rhew, Simpson, Tracy, Lymp, McCauley, Tsuang and Stoep2010).

In the current study, the original English version of the SMFQ was translated into European-Spanish, after receiving permission from the author, following the accepted back-translation guidelines proposed by Hambleton (Reference Hambleton, Hambleton, Merenda and Spielberger2005). Thus, the 13 items of the scale were translated from English to Spanish by a bilingual psychologist. Then, another bilingual psychologist, who had not seen the original version, translated the items back to English. Finally, the back-translated version was compared with the original version, resolving minor differences by agreement among the Spanish-speaking translators.

Strengths and Difficulties Questionnaire-Parent version (SDQ-P). The SDQ-P (Goodman, Reference Goodman2001) is a widely used, 25-item scale assessing general difficulties (i.e., emotional and behavioral) and positive behaviors in children aged 4–17 years, and includes five subscales: Emotional symptoms (i.e., anxiety and depression), Conduct problems, Hyperactivity/Inattention, Peer problems, and Prosocial behavior. Items are rated from 0 (not true) to 2 (certainly true), with total scores in each subscale ranging from 0 to 10. Higher scores indicate more difficulties, and the Prosocial subscale is interpreted inversely. The Spanish version of the SDQ-P used in this research demonstrated to be a reliable and valid measure (Rodríguez-Hernández et al., Reference Rodríguez-Hernández, Betancort, Ramírez-Santana, García, Sanz-Álvarez and De las Cuevas-Castresana2012). Cronbach’s alpha in the current sample was .75.

Spence Children’s Anxiety Scale-Parent version (SCAS-P). The SCAS-P (Nauta et al., Reference Nauta, Scholing, Rapee, Abbott, Spence and Waters2004) is a 38-item parent-report scale that evaluates the severity of anxiety symptoms in children aged 6–18 years. It is divided into six subscales (Panic attack and agoraphobia, Separation anxiety, Social phobia, Physical injury fears, Obsessive compulsive disorder, and Generalized anxiety disorder), and the anxiety total score is obtained by summing all the item scores (score range: 0–114). Parents respond to items on a 0 (never) to 3 (always) scale. Higher scores reflect more severe symptoms. The Spanish version of the SCAS-P was used, which has shown good psychometric properties (Orgilés, Rodríguez-Menchón, et al., Reference Orgilés, Rodríguez-Menchón, Fernández-Martínez, Morales and Espada2019). Cronbach’s alpha in the current sample was .86.

Procedure

The present study was approved by the ethics boards of the author’s institution. Twelve schools from urban areas were invited to the study and 10 agreed to participate. School principals’ approval was obtained, and schools distributed a letter to parents with information about the research. Information was sent to 1,400 parents of children aged 6 to 8, of which 181 (12.9%) participated. Similar to other works addressing children’s emotional problems (e.g., Orgilés, Fernández-Martínez, et al., Reference Orgilés, Rodríguez-Menchón, Fernández-Martínez, Morales and Espada2019; Orgilés et al., Reference Orgilés, Morales, Delvecchio, Mazzeschi and Espada2020), in this study parents were asked to complete an online assessment. Parents who were interested in participating accessed an online form and voluntarily completed the questionnaires, which took around 15 minutes. Prior to the completion of questionnaires, parents were informed about the purposes and procedure of the research, that data would be treated confidentially, and that they could withdraw at any time, as participation was voluntary. All of them accepted to participate and gave informed consent. Parents were asked to complete the online form again 8 weeks later (test-retest period). No incentives were given for their collaboration.

Statistical Analyses

We run data analysis after checking that there were no missing data. The aim of the current study was to test the original unifactorial structure proposed by Angold et al. (Reference Angold, Costello, Messer, Pickles, Winder and Silver1995) to validate the SMFQ-P for Spanish children. To meet this objective, we carried out confirmatory factor analysis (CFA) using the Lavaan package in R Studio (Rossel, Reference Rossel2012). The lack of normality of the sample distribution in the SMFQ-P scores was confirmed through the Kolmogorov-Smirnov test (Steinskog et al., Reference Steinskog, Tjøstheim and Kvamstø2007). Values of skewness and kurtosis less than 1.0 were considered slight nonnormality, the values between 1.0 and about 2.3 were considered as moderate nonnormality, and the values beyond 2.3 were considered as severe nonnormality (Lei & Lomax, Reference Lei and Lomax2005). Factor analysis was based on the polychoric correlation matrix as it is recommended for ordinal polytomous items that are asymmetric or with an excess of kurtosis. The diagonally weighted least squares (DWLS) Robust was used due to its robustness with ordinal data (Forero et al., Reference Forero, Maydeu-Olivares and Gallardo-Pujol2009). The model fit indices examined to determine the appropriateness of the factor solution were: χ2/degrees of freedom (df), comparative fit index (CFI), Tucker-Lewis index (TLI), and root mean square error of approximation (RMSEA). An adequate fit of the model of the SMFQ-P for the Spanish data was set as follows: χ2/df ≤ 3, CFI and TLI ≥ .90, and RMSEA ≤ .08 (Hu & Bentler, Reference Hu and Bentler1999). Because two models were run (one with all items, and another removing item 1), Δχ2 and Δdf were also reported.

Furthermore, we computed descriptive statistics (means, standard deviations, corrected item-total correlation, and α if the item is removed) and internal consistency (α). Temporal stability of this measure was explored in a subsample of 42 children (M = 6.88, SD = .80, 40.5% girls) (23.20% of the sample) using the intraclass correlation coefficient (ICC) for test-retest. We compared scores obtained at baseline and a posttest after two months. ICC values above 0.60 were considered good (Anastasi, Reference Anastasi1998; Baumgartner & Chung, Reference Baumgartner and Chung2001). Attrition analyses were conducted to test possible differences in sociodemographic variables and in the SMFQ-P, SCAS-P and SDQ-P subscales between participants involved in the test-retest and those who were not. Convergent and divergent validity was explored through conducting bivariate correlations with the SCAS-P total score and SDQ-P Emotional symptoms and Prosocial behavior scores. Differences in SMFQ-P scores by children’s gender and age were explored using t-test and one-way ANOVA. All descriptive analyses were conducted using SPSS v25.

Results

Descriptive Statistics

Table 1 reports descriptive statistics (means, standard deviations, skewness, kurtosis, corrected item-total correlation, and α if the item is removed) of the SMFQ-P. Total SMFQ-P mean scores were 4.59 (SD = 4.27). No differences in SMFQ-P scores by children’s gender and age were found. Most items presented an excess of kurtosis or a non-normality, ranging from moderate to severe (Lei & Lomax, Reference Lei and Lomax2005). The corrected item-total correlations were considered adequate, all statistically significant, with values equal to or above .41, except for Item 1 (“S/he felt miserable or unhappy”), which was lower (.13). Cronbach alpha if the item is removed was computed and indicated that removing Item 1 would slightly increase the internal consistency of the scale, suggesting that the reliability of this item is not adequate for the Spanish sample.

Table 1. Scale Properties of the SMFQ-P

Note. M = Mean; SD = Standard Deviation; r itc = corrected item-total correlation; α-I = Cronbach alpha if the item is removed; α = Cronbach alpha; ICC = Intraclass correlation coefficient for test-retest.

Confirmatory Factor Analysis

The original one-factor model of the SMFQ-P provided a good fit to the data in the Spanish sample. The model fit indices examined suggested an appropriate fit for the single-factor solution, χ2 = 117.12, df = 65, χ2/df = 1.80, CFI = .96, TLI = .96, and RMSEA = .06, 95% CI [.04, .08]. Table 2 provides the factor loadings, all statistically significant with standardized values exceeding .30, except for Items 12 and 13, which had slightly lower values. It should be noted that Item 1 (“S/he felt miserable or unhappy”) showed the highest factor load value (.77). However, based on above described results suggesting the reliability improvement by removing Item 1, we ran a CFA to test the one-factor model, but removing this item. The new specification of the model achieved slightly better fit indices than the 13-item one-factor model: χ2 = 94.03, df = 54, χ2/df = 1.74, CFI = .97, TLI = .96, and RMSEA = .06, 95% CI [.04, .08], Δχ2 = 23.09, Δdf = 11. The factor loadings were all statistically significant with standardized values exceeding .30, except for Items 5 (.30), 12 (.23), and 13 (.25), which obtained lower values than in the 13-item model (Table 2).

Table 2. Factor Loadings for the SMFQ-P

Reliability and Validity

As shown in Table 1, internal consistency of the SMFQ-P was good, with a Cronbach’s alpha coefficient of .83 for the total score, indicating a considerable homogeneity of the items measuring the same construct, depressive symptoms. Test-rests analysis was calculated in a subsample (n = 42). Results indicated an adequate reliability (ICC = .80) of the measure over time. The attrition analyses revealed that the sample of participants included in the test-retest was equivalent to those not included (n = 139) in sociodemographic variables, as well as in the SMFQ-P, SCAS-P and SDQ-P subscales (p > .05).

Convergent and divergent validity was explored by conducting bivariate correlations (Table 3). Convergent validity was supported by moderate correlations between the total score of the SMFQ-P and the SDQ Emotional symptoms subscale (r = .60), and between the total score of the SMFQ-P and the SCAS-P, which reached a lower magnitude (r = .48). The SDQ Prosocial behavior subscale had a lower and negative correlation with the SMFQ-P total score (r = –.35), thus supporting the divergent validity of the SMFQ-P.

Table 3. Pearson correlations among the SMFQ-P and the SCAS-P, the emotional symptoms and the prosocial behavior subscales of SDQ-P

Note. SCAS-P = Spence Children’s Anxiety Scale-Parent version (SCAS-P); SDQ-P: Strengths and Difficulties Questionnaire-Parent version.

** Correlation is significant at the .01 level (2-tailed).

Discussion

The aim of the present study was to validate the SMFQ-P for Spanish-speaking children aged 6–8 years. The internal consistency of the scale was adequate (α = .83) and similar to those reported by previous studies conducted in child and adolescent samples of other countries such as the United States (α = .84–.87; Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995; Rhew et al., Reference Rhew, Simpson, Tracy, Lymp, McCauley, Tsuang and Stoep2010), Norway (α = .83; Karevold et al., Reference Karevold, Ystrøm, Weeks, Mathiesen and Røysamb2017), Brazil (α = .87; Sucupira et al., Reference Sucupira, Neto, de Lima, Dini, de Brito and Ferreira2017), and Australia (α = .89; Tennant et al., Reference Tennant, Martin, Rooney, Hassan and Kane2017). Additionally, test-retest results (ICC = .80) supported the scale as a consistent measure over time and are in line with previous findings (ICC = .79; Sucupira et al., Reference Sucupira, Neto, de Lima, Dini, de Brito and Ferreira2017). Thus, these results showed that the Spanish version of the SMFQ-P is a reliable instrument to measure depressive symptoms. Furthermore, to our knowledge, test-retest analyses have scarcely been carried out for the SMFQ-P, so our results extend the literature supporting the stability of the scale over an eight-week period. Regarding Item 1 (“S/he felt miserable or unhappy”), the explanation of the low item-total correlations obtained (.13) and the results indicating a slight improvement of the internal consistency (α = .85) if the item was removed remain unclear. However, the factor loading obtained for Item 1 (.77) was the highest in this study, indicating the considerable association between the item and the latent factor measured. In this regard, Angold et al. (Reference Angold, Costello, Messer, Pickles, Winder and Silver1995) suggested the appropriateness of considering the item’s loading in the factor under study through factor analysis, rather than through item-total correlations, as this method allows excluding some of the error variance involved in the total score.

To examine the convergent and divergent validity, we computed correlations between the SMFQ-P, two measures of emotional problems including depression and anxiety (i.e., the SDQ Emotional symptoms subscale and the SCAS-P total score), and another variable measuring a non-emotional construct (i.e., the SDQ Prosocial behavior subscale). The correlation between the SMFQ-P and the SDQ Emotional symptoms was the strongest, whereas a lower but moderate positive correlation was also found between the SMFQ-P and the total score of the SCAS-P, supporting the SMFQ-P as a measure of depressive symptoms rather than anxiety symptoms and its convergent validity. Despite that childhood anxiety frequently co-occurs with depression (Cummings et al., Reference Cummings, Caporino and Kendall2014), a lower but moderate correlation magnitude was expected for the SCAS-P in accordance with correlations between children’s scales of anxiety and depression reported by prior research (e.g., Carrillo et al., Reference Carrillo, Godoy, Gavino, Nogueira, Quintero and Casado2012; Zhao et al., Reference Zhao, Xing and Wang2012), and attending to the fact that the SCAS-P is not measuring depressive symptoms, in contrast to the SDQ Emotional symptoms subscale (Goodman, Reference Goodman2001). Furthermore, consistent with findings of other authors (Muris et al., Reference Muris, Meesters and van den Berg2003), a lower and negative correlation was found between our measure of depression and the SDQ Prosocial behavior subscale, supporting divergent validity. Low but significant correlations between the SDQ Prosocial behavior and another measure of emotional-related psychopathology, such as anxiety (i.e., SCAS), has also been previously considered evidence of divergent validity (e.g., Di Riso et al., Reference Di Riso, Chessa, Bobbio and Lis2013). These findings are also in line with previous research in the Spanish-speaking population that found positive significant correlations between measures of depression, anxiety and SDQ Emotional symptoms, as well as lower (positive or negative) correlations between the SDQ Prosocial behavior subscale and emotion-related measures (e.g., Carrillo et al., Reference Carrillo, Godoy, Gavino, Nogueira, Quintero and Casado2012; Orgilés, Rodríguez-Menchón et al., Reference Orgilés, Fernández-Martínez, Espada and Morales2019; Park et al., Reference Park, Ebesutani, Bose and Chorpita2016; Piqueras et al., Reference Piqueras, Pineda, Martin-Vivar and Sandín2017).

The results of the CFA supported the original one-factor model in Spanish children, showing that the Spanish version of the SMFQ-P measures the underlying factor of general depression. Our findings agree with previous research supporting the unidimensional structure of the scale (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995; Karevold et al., Reference Karevold, Ystrøm, Weeks, Mathiesen and Røysamb2017). Moreover, our results suggest that a 12-item model provides a slightly more reliable measure and a better fit than the 13-item model, by deleting Item 1. Although we do not have a clear explanation for this finding, it could be due to methodological reasons, for example because of the small sample size, so further research with larger and more representative samples should be addressed. It could also be due to the Spanish translation of the Item 1 "Ella/Él se sintió triste o infeliz" and a further revision of the translation may be advisable. However, as noted above, it is also worth mentioning that the factorial load of this item was the highest, even higher than that reported in the original study (.71) (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995), which shows its strong relationship with the underlying dimension of the scale. Besides, prior findings support the importance and accuracy of this item, showing its high sensitivity and predictive value, and that it is also highly reported by youth (McKenzie et al., Reference McKenzie, Toumbourou, Forbes, Mackinnon, McMorris, Catalano and Patton2011). Furthermore, maintaining this item can be important as it seems clinically relevant, measuring one of the core symptoms of depression such as depressed or low mood (i.e., sadness or unhappiness) (Rey et al., Reference Rey, Bella-Awusah, Jing and Rey2015). Therefore, although good results are obtained in the CFA by removing Item 1 from the model, it should be noted that in the current study this item was dropped only on the basis of statistical criteria, while this method may increase reliability but reduce validity. Consequently, this decision should be based on other criteria and not only on statistical criteria, so that in this study the original 13-item model is supported and maintained.

Moreover, the mean total score for depression obtained in our sample was 4.59 (SD = 4.27), which is within the range found in other SMFQ-P studies with non-diagnosed children (e.g., overall mean scores range 3.1 – 8.17; Rhew et al., Reference Rhew, Simpson, Tracy, Lymp, McCauley, Tsuang and Stoep2010; Tennant et al., Reference Tennant, Martin, Rooney, Hassan and Kane2017). Also, no differences in gender and age were found. This is consistent with the literature reporting that the frequency of childhood depression is typically similar for boys and girls, and that adolescence is where higher depression rates are observed, especially for girls (Zahn-Waxler et al., Reference Zahn-Waxler, Shirtcliff and Marceau2008).

This study has some limitations that should be considered when interpreting the results. First, the sample of the study was small and was drawn from a specific region of Spain, which limits the generalization of the results. In addition, parents with higher education were over-represented in the study sample, and this may have influenced the results. The findings of this study should be addressed in larger samples and in different regions of Spain in future studies, and the psychometric properties of the SMFQ-P need to be confirmed with older children. However, it should be noted that the sample used is even slightly larger than that used in the original study (Angold et al., Reference Angold, Costello, Messer, Pickles, Winder and Silver1995). Second, this study did not analyze the validity of the measure using a diagnostic standard, which should be a focus of attention in future studies to determine the diagnostic accuracy of the measure. Third, the study relied on the reports of one of the parents of the children, so it would be interesting for future research to evaluate the responses of both parents to explore whether there are differences according to the informant.

In conclusion, despite the above limitations, this study provides for the first time initial empirical support for the use of the original 13-item version of the SMFQ-P with Spanish-speaking children, also extending the international support for the measure. The internal consistency, test-retest reliability, validity, and factor structure of the SMFQ-P were found to be adequate, suggesting its suitability for use as a brief screening tool to identify depressive symptoms in Spanish children. Finally, this study add support to the utility of this parent-report measure of depression for young children aged 6 to 8 years, thus addressing this gap in the literature. The SMFQ-P is a valuable tool, as allows a quick assessment of core depressive symptoms (anhedonia and depressed mood), but also others, such as feelings of being unloved, self-hatred or worthlessness, which have been found to have a substantial predictive value in youths (McKenzie et al., Reference McKenzie, Toumbourou, Forbes, Mackinnon, McMorris, Catalano and Patton2011).

Footnotes

Conflicts of Interest: None

Funding Statement: This work was supported by the Ministry of Education, Culture and Sport of Spain [IFM, grant number FPU14/03900]; and the Ministry of Economy and Competitiveness (MINECO) of Spain [MO, grant number PSI2014-56446-P].

References

Anastasi, A. (1998). Psychological testing (6th Ed.). Macmillan.Google Scholar
Angold, A., Costello, E. J., Messer, S. C., Pickles, A., Winder, F., & Silver, D. (1995). Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. International Journal of Methods in Psychiatric Research, 5, 237249.Google Scholar
Baumgartner, T. A., & Chung, H. (2001). Confidence limits for intraclass reliability coefficients. Measurement in Physical Education and Exercise Science, 5(3), 179188. https://doi.org/10.1207/S15327841MPEE0503_4CrossRefGoogle Scholar
Bernaras, E., Jaureguizar, J., & Garaigordobil, M. (2019). Child and adolescent depression: A review of theories, evaluation instruments, prevention programs, and treatments. Frontiers in Psychology, 10, Article 543. https://doi.org/10.3389/fpsyg.2019.00543CrossRefGoogle ScholarPubMed
Bufferd, S. J., Dougherty, L. R., Carlson, G. A., Rose, S., & Klein, D. N. (2012). Psychiatric disorders in preschoolers: Continuity from ages 3 to 6. The American Journal of Psychiatry, 169, 11571164. https://doi.org/10.1176/appi.ajp.2012.12020268CrossRefGoogle ScholarPubMed
Carrillo, F., Godoy, A., Gavino, A., Nogueira, R., Quintero, C., & Casado, Y. (2012). “Escala de ansiedad infantil de Spence” (Spence Children´s Anxiety Scale, SCAS): Fiabilidad y validez de la versión española [Reliability and validity of the Spanish version]. Behavioral Psychology/Psicología Conductual, 20, 529545.Google Scholar
Cheng, P., Cao, F., & Su, L. (2009). Reliability and validity of the Short Mood and Feelings Questionnaire in Chinese adolescents. Chinese Mental Health Journal, 123, 6062.Google Scholar
Costello, E. J., & Angold, A. (1988). Scales to assess child and adolescent depression: Checklists, screens, and nets. Journal of the American Academy of Child & Adolescent Psychiatry, 27(6), 726737. http://doi.org/10.1097/00004583-198811000-00011CrossRefGoogle ScholarPubMed
Creswell, C., Violato, M., Cruddace, S., Gerry, S., Murray, L., Shafran, R., Stein, A., Willetts, L., McIntosh, E., & Cooper, P. J. (2020). A randomised controlled trial of treatments of childhood anxiety disorder in the context of maternal anxiety disorder: Clinical and cost‐effectiveness outcomes. The Journal of Child Psychology and Psychiatry, 61, 6276. https://doi.org/10.1111/jcpp.13089CrossRefGoogle ScholarPubMed
Cummings, C. M., Caporino, N. E., & Kendall, P. C. (2014). Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychological Bulletin, 140, 816845. https://doi.org/10.1037/a0034733CrossRefGoogle Scholar
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858900. http://doi.org/10.1037/a0038498CrossRefGoogle ScholarPubMed
Deeba, F., Rapee, R. M., & Prvan, T. (2015). Psychometric properties of two measures of childhood internalizing problems in a Bangladeshi sample. British Journal of Clinical Psychology, 54, 214232. https://doi.org/10.1111/bjc.12071CrossRefGoogle Scholar
Di Riso, D., Chessa, D., Bobbio, A., & Lis, A. (2013). Factorial structure of the SCAS and its relationship with the SDQ: A study with Italian children. European Journal of Psychological Assessment, 29, 2835. http://doi.org/10.1027/1015-5759/a000117CrossRefGoogle Scholar
Dougherty, L. R., Klein, D. N., Olino, T. M., & Laptook, R. S. (2008). Depression in children and adolescents. In Hunsley, J. & Mash, E. J. (Eds.), A guide to assessments that work (pp. 6995). Oxford University Press. http://doi.org/10.1093/med:psych/9780195310641.003.0004CrossRefGoogle Scholar
Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A Monte Carlo study comparing DWLS and ULS estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 625641. http://doi.org/10.1080/10705510903203573CrossRefGoogle Scholar
Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 13371345. https://doi.org/10.1097/00004583-200111000-00015CrossRefGoogle ScholarPubMed
Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 338). Lawrence Erlbaum Associates.Google Scholar
Hu, L.-t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 155. https://doi.org/10.1080/10705519909540118CrossRefGoogle Scholar
Izquierdo-Sotorrío, E., Holgado-Tello, F. P., Carrasco, M. A. (2016). Incremental validity and informant effect from a multi-method perspective: Assessing relations between parental acceptance and children’s behavioral problems. Frontiers in Psychology, 10, Article 664. https://doi.org/10.3389/fpsyg.2016.00664Google Scholar
Jeffreys, M., Rozenman, M., Gonzalez, A., Warnick, E. M., Dauser, C., Scahill, L., Woolston, J., & Weersing, V. R. (2016). Factor structure of the parent-report Mood and Feelings Questionnaire (MFQ) in an outpatient mental health sample. Journal of Abnormal Child Psychology, 44, 11111120. https://doi.org/10.1007/s10802-015-0108-6CrossRefGoogle Scholar
Karevold, E. B., Ystrøm, E., Weeks, M., Mathiesen, K. S., & Røysamb, E. (2017). Symptoms of anxiety and depression in early adolescence: A multitrait-multimethod factor analytic approach. Acta Psychopathologica, 3(2), Article 11. https://doi.org/10.4172/2469-6676.100083CrossRefGoogle Scholar
Kerr, D. C. R., Lunkenheimer, E. S., & Olson, S. L. (2007). Assessment of child problem behaviors by multiple informants: A longitudinal study from preschool to school entry. The Journal of Child Psychology and Psychiatry, 48, 967975. https://doi.org/10.1111/j.1469-7610.2007.01776.xCrossRefGoogle ScholarPubMed
Kim, J., Chan, Y.-F., McCauley, E., & Stoep, A. V. (2016). Parent-child discrepancies in reporting of child depression in ethnic groups. The Journal for Nurse Practitioners: JNP, 12, 374380. https://doi.org/10.1016/j.nurpra.2016.01.018CrossRefGoogle ScholarPubMed
Lei, M., & Lomax, R. G. (2005). The effect of varying degrees of nonnormality in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 12(1), 127. https://doi.org/10.1207/s15328007sem1201_1CrossRefGoogle Scholar
Lewis, A. J., Sae-Koew, J. H., Toumbourou, J. W., & Rowland, B. (2020). Gender differences in trajectories of depressive symptoms across childhood and adolescence: A multi-group growth mixture model. Journal of Affective Disorders, 260, 463472. https://doi.org/10.1016/j.jad.2019.09.027CrossRefGoogle ScholarPubMed
Luby, J. L. (2010). The importance of identification of depression early in development. Current Directions in Psychological Science, 19, 9195. https://doi.org/10.1177/0963721410364493CrossRefGoogle ScholarPubMed
Luby, J. L., Gaffrey, M. S., Tillman, R., April, L. M., & Belden, A. C. (2014). Trajectories of preschool disorders to full DSM depression at school age and early adolescence: Continuity of preschool depression. The American Journal of Psychiatry, 171, 768776. https://doi.org/10.1176/appi.ajp.2014.13091198CrossRefGoogle ScholarPubMed
Lundervold, A. J., Breivik, K., Posserud, M.-B., Stormark, K. M., & Hysing, M. (2013). Symptoms of depression as reported by Norwegian adolescents on the Short Mood and Feelings Questionnaire. Frontiers in Psychology, 11(4), Article 613. https://doi.org/10.3389/fpsyg.2013.00613CrossRefGoogle Scholar
McKenzie, D. P., Toumbourou, J. W., Forbes, A. B., Mackinnon, A. J., McMorris, B. J., Catalano, R. F., & Patton, G. C. (2011). Predicting future depression in adolescents using the Short Mood and Feelings Questionnaire: A two-nation study. Journal of Affective Disorders, 134, 151159. https://doi.org/10.1016/j.jad.2011.05.022CrossRefGoogle ScholarPubMed
Merikangas, K. R., Nakamura, E. F., & Kessler, R. C. (2009). Epidemiology of mental disorders in children and adolescents. Dialogues in Clinical Neuroscience, 11, 720.Google ScholarPubMed
Muris, P., Meesters, C., & van den Berg, F. (2003). The Strengths and Difficulties Questionnaire (SDQ)-Further evidence for its reliability and validity in a community sample of Dutch children and adolescents. European Child and Adolescent Psychiatry, 12, 18. https://doi.org/10.1007/s00787-003-0298-2CrossRefGoogle Scholar
Nauta, M. H., Scholing, A., Rapee, R. M., Abbott, M., Spence, S. H., & Waters, A. (2004). A parent report measure of children’s anxiety. Behaviour Research and Therapy, 42, 813839. https://doi.org/10.1016/S0005-7967(03)00200-6CrossRefGoogle ScholarPubMed
Orgilés, M., Fernández-Martínez, I., Espada, J. P., & Morales, A. (2019). Spanish version of Super Skills for Life: Short- and long-term impact of a transdiagnostic prevention protocol targeting childhood anxiety and depression. Anxiety, Stress & Coping, 32, 694710. https://doi.org/10.1080/10615806.2019.1645836CrossRefGoogle Scholar
Orgilés, M., Morales, A., Delvecchio, E., Mazzeschi, C., & Espada, J. P. (2020). Immediate psychological effects of the COVID–19 quarantine in youth from Italy and Spain . PsyArXiv. https://doi.org/10.31234/osf.io/5bpfzCrossRefGoogle Scholar
Orgilés, M., Rodríguez-Menchón, M., Fernández-Martínez, I., Morales, A., & Espada, J. P. (2019). Validation of the parent report version of the Spence Children’s Anxiety Scale (SCAS-P) for Spanish children. Clinical Child Psychology and Psychiatry, 24, 776790. https://doi.org/10.1177/1359104519835579CrossRefGoogle ScholarPubMed
Park, A. L., Ebesutani, C. K., Bose, D., & Chorpita, B. F. (2016). Psychometric properties of a Spanish translation of the revised Child Anxiety and Depression Scale – Parent Version. Journal of Psychopathology and Behavioral Asessment, 38, 307319. https://doi.org/10.1007/s10862-015-9517-7CrossRefGoogle Scholar
Piqueras, J. A., Pineda, D., Martin-Vivar, M., & Sandín, B. (2017). Confirmatory factor analysis and psychometric properties of the Revised Child Anxiety and Depression Scale−30 (RCADS–30) in clinical and non-clinical samples. Revista de Psicopatología y Psicología Clínica, 22, 183196. https://doi.org/10.5944/rppc.vol.22.num.3.2017.19332CrossRefGoogle Scholar
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015). Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. The Journal of Child Psychology and Psychiatry, 56, 345365. https://doi.org/10.1111/jcpp.12381CrossRefGoogle ScholarPubMed
Rey, J. M., Bella-Awusah, T. T., & Jing, L. (2015). Depression in children and adolescents (2015 Ed.). In Rey, J. M. (Ed.), IACAPAP e-Textbook of Child and Adolescent Mental Health. International Association for Child and Adolescent Psychiatry and Allied Professions. https://iacapap.org/content/uploads/E.1-Depression-2015-update.pdfGoogle Scholar
Rhew, I. C., Simpson, K., Tracy, M., Lymp, J., McCauley, E., Tsuang, D., & Stoep, A. V. (2010). Criterion validity of the Short Mood and Feelings Questionnaire and one- and two-item depression screens in young adolescents. Child and Adolescent Psychiatry and Mental Health, 4, Article 8. https://doi.org/10.1186/1753-2000-4-8CrossRefGoogle ScholarPubMed
Rodríguez-Hernández, P. J., Betancort, M., Ramírez-Santana, G. M., García, R., Sanz-Álvarez, E. J., & De las Cuevas-Castresana, C. (2012). Psychometric properties of the parent and teacher versions of the Strength and Difficulties Questionnaire (SDQ) in a Spanish sample. International Journal of Clinical and Health Psychology, 12, 265279.Google Scholar
Rossel, Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Universiteit Gent. http://users.ugent.be/~yrosseel/lavaan/lavaanIntroduction.pdfGoogle Scholar
Sharp, C., Goodyer, I. M., & Croudace, T. J. (2006). The Short Mood and Feelings Questionnaire (SMFQ): A unidimensional item response theory and categorical data factor analysis of self-report ratings from a community sample of 7-through 11-year-old children. Journal of Abnormal Child Psychology, 34, 365377. https://doi.org/10.1007/s10802-006-9027-xCrossRefGoogle ScholarPubMed
Steinskog, D. J., Tjøstheim, D. B., & Kvamstø, N. G. (2007). A cautionary note on the use of the Kolmogorov–Smirnov test for normality. Monthly Weather Review, 135, 11511157. https://doi.org/10.1175/MWR3326.1CrossRefGoogle Scholar
Stevanovic, D. (2012). Childhood depression and anxiety disorders in Serbia: A psychometric study of four screening questionnaires. Epidemiology and Psychiatric Sciences, 21, 111116. https://doi.org/10.1017/S2045796011000655CrossRefGoogle ScholarPubMed
Sucupira, E., Neto, M. S., de Lima, E. L., Dini, G. M., de Brito, M. J. A., & Ferreira, L. M. (2017). Short Mood and Feelings Questionnaire for screening children and adolescents for plastic surgery: Cross-cultural validation study. Sao Paulo Medical Journal, 135, 518528. https://doi.org/10.1590/1516-3180.2017.0036030517CrossRefGoogle ScholarPubMed
Tennant, R. G., Martin, K. K., Rooney, R., Hassan, S., & Kane, R. T. (2017). Preventing internalizing problems in young children: A randomized controlled trial of the Feelings and Friends (Year 3) Program with a motor skills component. Frontiers in Psychology, 8, Article 291. https://doi.org/10.3389/fpsyg.2017.00291CrossRefGoogle ScholarPubMed
Thabrew, H., Stasiak, K., Bavin, L.-M., Frampton, C., & Merry, S. (2018). Validation of the Mood and Feelings Questionnaire (MFQ) and Short Mood and Feelings Questionnaire (SMFQ) in New Zealand help-seeking adolescents. International Journal of Methods in Psychiatric Research, 27, Article e1610. https://doi.org/10.1002/mpr.1610CrossRefGoogle ScholarPubMed
Thapar, A., & McGuffin, P. (1998). Validity of the shortened Mood and Feelings Questionnaire in a community sample of children and adolescents: A preliminary research note. Psychiatry Research, 81, 259268. https://doi.org/10.1016/S0165-1781(98)00073-0CrossRefGoogle Scholar
Wesselhoeft, R., Sørensen, M. J., Heiervang, E. R., & Bilenberg, N. (2013). Subthreshold depression in children and adolescents - A systematic review. Journal of Affective Disorders, 151, 722. https://doi.org/10.1016/j.jad.2013.06.010CrossRefGoogle ScholarPubMed
Zahn-Waxler, C., Shirtcliff, E. A., & Marceau, K. (2008). Disorders of childhood and adolescence: Gender and psychopathology. Annual Review of Clinical Psychology, 4, 275303. https://doi.org/10.1146/annurev.clinpsy.3.022806.091358CrossRefGoogle ScholarPubMed
Zhao, J., Xing, X., & Wang, M. (2012). Psychometric properties of the Spence Children’s Anxiety Scale (SCAS) in Mainland Chinese children and adolescents. Journal of Anxiety Disorders, 26, 728736. https://doi.org/10.1016/j.janxdis.2012.05.006CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Scale Properties of the SMFQ-P

Figure 1

Table 2. Factor Loadings for the SMFQ-P

Figure 2

Table 3. Pearson correlations among the SMFQ-P and the SCAS-P, the emotional symptoms and the prosocial behavior subscales of SDQ-P