Hostname: page-component-745bb68f8f-g4j75 Total loading time: 0 Render date: 2025-02-10T10:52:52.214Z Has data issue: false hasContentIssue false

The relationship between profiles and transitions of internalizing and externalizing symptoms in children and suicidal thoughts in early adolescence

Published online by Cambridge University Press:  02 October 2019

Dylan Johnson
Affiliation:
University of Ottawa, School of Epidemiology and Public Health
John D. McLennan
Affiliation:
University of Calgary, Department of Pediatrics Children's Hospital of Eastern Ontario-Research Institute
Jon Heron
Affiliation:
University of Bristol, Bristol Medical School, Population Health Sciences, Centre for Academic Mental Health
Ian Colman*
Affiliation:
University of Ottawa, School of Epidemiology and Public Health
*
Author for correspondence: Ian Colman, E-mail: icolman@uottawa.ca
Rights & Permissions [Opens in a new window]

Abstract

Background

Adolescence is a high-risk period for the onset of suicidal thoughts and behaviors. Identification of preceding patterns of internalizing and externalizing symptoms that are associated with subsequent suicidal thoughts may offer a better understanding of how to prevent adolescent suicide.

Methods

Data from the National Longitudinal Survey of Children and Youth, a prospective population-based Canadian cohort, contained Child Behavior Checklist items which were used to examine profiles and transitions of internalizing and externalizing symptoms in children, aged 6–11 years (n = 8266). The association between these profiles/transitions and suicidal thoughts in adolescents was examined using multivariate logistic regression modeling.

Results

Latent profile analyses identified four measurement invariant profiles of internalizing and externalizing symptoms at ages 6/7 and 10/11: (1) low on all symptoms, (2) moderate on all symptoms, (3) high on all symptoms, and (4) high on hyperactivity/inattention and internalizing. Recurrent (homotypic or heterotypic) and increasing symptoms from 6/7 to 10/11 were associated with suicidal thoughts in adolescence, compared to those with stable low symptoms. Those with decreasing symptoms from 6/7 to 10/11 were not at increased risk of suicidal thought in adolescence.

Conclusions

While patterns of recurrent symptoms were associated with suicidal thoughts, a similar association was observed between profiles at age 10/11 years and suicidal thoughts. This suggests that the recent assessments of mental health symptoms in children may be as sufficient a predictor of adolescent suicidal thought as transition profiles.

Type
Original Articles
Copyright
Copyright © Cambridge University Press 2019

Background

Adolescence is a high-risk period in the development of suicidal thoughts and behaviors. It has been estimated that approximately one in five adolescents, aged 12–14, experience suicidal thoughts (Garrison et al., Reference Garrison, Addy, Jackson, McKeown and Waller1991). Suicidal thoughts have a strong association with subsequent suicide attempts (Lewinsohn et al., Reference Lewinsohn, Rohde and Seeley1994; King, Reference King, Maris, Silverman and Canetto1997), and suicide a leading cause of death for persons between 15–24 years (Navaneelan, Reference Navaneelan2010).

A broad literature suggests that internalizing and externalizing pathology early in the life course may predict subsequent suicidal thoughts and behaviors (Sourander et al., Reference Sourander, Klomek, Niemelä, Haavisto, Gyllenberg, Helenius, Sillanmäki, Ristkari, Kumpulainen, Tamminen, Moilanen, Piha, Almqvist and Gould2009; Chronis-Tuscano et al., Reference Chronis-Tuscano, Molina, Pelham, Applegate, Dahlke, Overmyer and Lahey2010; Dykxhoorn et al., Reference Dykxhoorn, Hatcher, Roy-Gagnon and Colman2017). Much of this research, however, has focused on those who meet thresholds for a clinical diagnosis, potentially missing less severe groups which still may be at risk. Therefore it may be more meaningful to explore patterns of internalizing and externalizing behaviors with continuous indicators, to better capture a full spectrum of behaviors that place children at risk. When using continuous indicators of internalizing and externalizing, research has identified both internalizing-only patterns of problems, as well as externalizing-only patterns (Willner et al., Reference Willner, Gatzke-Kopp and Bray2016). Additionally, constructs of co-occurring internalizing/externalizing, such as the Child Behavior Checklist (CBCL) Dysregulation profile have also been identified (Biederman et al., Reference Biederman, Wozniak, Kiely, Ablon, Faraone, Mick, Mundy and Kraus1995). This is a widely replicated profile of problem behavior in which children score high on symptoms of emotional and behavioral self-regulation (De Caluwé et al., Reference De Caluwé, Decuyper and De Clercq2013; Masi et al., Reference Masi, Pisano, Milone and Muratori2015; Bianchi et al., Reference Bianchi, Brambilla, Garzitto, Colombo, Fornasari, Bellina, Bonivento, Tesei, Piccin, Conte, Perna, Frigerio, Castiglioni, Fabbro, Molteni and Nobile2017). Beyond the types of symptoms exhibited, there has also been variation in severity, where mild, moderate, and severe levels of internalizing, externalizing, and co-occurrence between the two has been observed, supporting nuance beyond diagnostic thresholds (DiStefano and Kamphaus, Reference DiStefano and Kamphaus2006; Ostrander et al., Reference Ostrander, Herman, Sikorski, Mascendaro and Lambert2008; Mindrila, Reference Mindrila2016).

Beyond understanding the constructs of internalizing and externalizing at various points in childhood, an additional interest is one of understanding how children move between different patterns of internalizing/externalizing across time and how the constructs of those patterns change. In the literature, both heterotypic and homotypic transitions of internalizing/externalizing symptoms have been observed (Keenan et al., Reference Keenan, Shaw, Delliquadri, Giovannelli and Walsh1998, Mesman et al., Reference Mesman, Bongers and Koot2001, Briggs-Gowan et al., Reference Briggs-Gowan, Carter, Bosson-Heenan and Guyer2006, Vaillancourt et al., Reference Vaillancourt, Brittain, McDougall and Duku2013, Mian et al., Reference Mian, Wainwright, Briggs-Gowan and Carter2011, Basten et al., Reference Basten, Tiemeier, Althoff, van de Schoot, Jaddoe, Hofman, Hudziak, Verhulst and van der Ende2016, Willner et al.,Reference Willner, Gatzke-Kopp and Bray2016). Homotypic stability, defined as staying in the same pattern of symptoms across time, has been observed from toddlers up to adolescence. While stability has been observed in both internalizers and externalizers, it seems that the highest stability is found in individuals with co-occurring symptoms of both (Briggs-Gowan et al., Reference Briggs-Gowan, Carter, Bosson-Heenan and Guyer2006, Basten et al., Reference Basten, Tiemeier, Althoff, van de Schoot, Jaddoe, Hofman, Hudziak, Verhulst and van der Ende2016, Willner et al., Reference Willner, Gatzke-Kopp and Bray2016). Heterotypic stability has also been observed, where one set of symptoms shifts towards another across time. The most common of these reported in the literature is when children transition from externalizing to internalizing symptom patterns (Mesman et al., Reference Mesman, Bongers and Koot2001). Additionally, it has been identified that subsets of children display patterns of symptoms that persist from childhood, through adolescence, and into adulthood (Campbell and Ewing, Reference Campbell and Ewing1990; Shaw et al., Reference Shaw, Keenan and Vondra1994; Wittchen et al., Reference Wittchen, Kessler, Pfister and Lieb2000; Hofstra et al., Reference Hofstra, Van der ende and Verhulst2002; Weeks et al., Reference Weeks, Cairney, Wild, Ploubidis, Naicker and Colman2014, Weeks et al., Reference Weeks, Ploubidis, Cairney, Wild, Naicker and Colman2016).

While a wealth of research has been conducted that investigated patterns of internalizing and externalizing symptoms in children, and how they change across time, less research has looked at how these temporal sequences of internalizing and externalizing symptoms relate to suicidal thoughts. Identification of such patterns, and how they change across time, may serve as useful predictors of suicidal thoughts, highlighting potential target groups for intervention. One relevant study recently conducted by Orri et al. (Reference Orri, Galera, Turecki, Forte, Renaud, Boivin, Tremblay, Côté and Geoffroy2018) used mixture modeling to explore the role of internalizing symptoms and irritability scores, and how they relate to suicidal thoughts in adolescence. The authors found that high scores on internalizing and irritability increased the odds of subsequent suicidal ideation and attempts. To add to such research, similar methods were utilized in the present investigation with the addition of including externalizing symptoms of conduct problems and hyperactivity/inattention in the modeling.

The present study investigated patterns of internalizing and externalizing symptoms at two time points in childhood, at ages 6 and 10 years, and the stability of these symptoms across this period. These unique profiles, as well as the transition patterns between them, were then examined as possible predictors of suicidal thoughts in early adolescence. It was hypothesized that profiles of internalizing-only, externalizing-only, and co-occurring internalizing and externalizing symptoms would be observed at ages 6 and 10. Additionally, it was hypothesized that all symptomatic groups would be associated with suicidal thoughts, but that the symptom co-occurring groups that persisted across time would have the strongest association.

Methods

Participants

Participants were selected from the National Longitudinal Survey of Children and Youth (NLSCY), a prospective and representative cohort of Canadian children across eight biennial cycles from 1994/95 to 2008/09 (Statistics Canada, 1995a). Participant's ages ranged from 0–11 years at the time of enrollment. Eligible participants included children who had complete data on internalizing/externalizing symptoms at age 6/7 years (n = 10 234) and follow-up data on suicidal thoughts at age 14/15 (n = 5692; see online Supplementary Fig. S1).

Measures

Childhood internalizing and externalizing symptoms

Three types of symptoms were assessed throughout childhood: (1) conduct disorder/physical aggression (6 items), (2) hyperactivity/inattention (7 items), and (3) depression/anxiety (7 items) based on caregiver report. We refer throughout this paper to conduct disorder/physical aggression and hyperactivity/inattention as externalizing symptoms. Response options for each item were ‘Never or not true’ (=0), ‘Sometimes or somewhat true’ (=1), and ‘Often or very true’ (=2). Scores were summed for each of the three symptom types to form three scales. These items that comprised these scales were taken from the Ontario Child Health Survey and the Montreal Longitudinal Survey, which were initially drawn from items in the CBCL (Achenbach, Reference Achenbach1991, Statistics Canada, 1995a, Université de Montréal, 2007, Statistics Canada, 2017). Factor analyses were conducted to identify these unique scales of internalizing and externalizing symptoms for individuals aged 4–11 years (National Longitudinal Survey). Factor analyses were conducted on two NLSCY subsamples of ~6600 cases each (Statistics Canada, 1995b). These measures have been shown to have good reliability, with Cronbach's Alpha ranging from 0.76–0.78, 0.78–0.84, and 0.69–0.79, for conduct disorder/physical aggression, hyperactivity/inattention, and depression/anxiety, respectively (Statistics Canada, 1995b). These items were reported by the primary caregiver.

Suicidal thoughts

Suicidal thoughts were assessed at ages 12/13 and 14/15, with the question ‘In the past 12 months, did you seriously consider attempting suicide?’ asked of the youth respondent (Statistics Canada, 1999). The outcome of suicidal thoughts was a combined measure from both ages 12/13 and 14/15. If the adolescent responded ‘yes’ at either 12/13 or 14/15, they were considered to have experienced suicidal thought; participants who responded ‘no’ at both ages formed the comparison group. Those who were missing at one time and ‘no’ at another were treated as missing; a sensitivity analysis was conducted where these cases were treated as ‘no’. These items were self-reported by the youth themselves.

Additional covariates

In order to mitigate potential confounding, the following covariates were adjusted for: sex, parental status of the home (i.e. one v. two parent households), socioeconomic status (SES), stressful life events, high-parental depressive symptoms, and high-parental alcohol use. Sex was also explored as a potential effect modifier in the association between internalizing/externalizing symptoms and suicidal thoughts.

Socioeconomic status is a derived variable created by Statistics Canada using information on caregiver education, caregiver occupation, and household income. This variable was dichotomized and the sample in the ⩽10th percentile was classified as having low SES. In order to capture stressful life events, when the child was 10/11 years, the caregiver responded to a question which asked them if in the past 2 years, there have been any events in their child's life that caused the child a great amount of worry or unhappiness. This was a dichotomous yes or no response. A short-form version of the Center for Epidemiologic Studies Depression (CES-D) Scale was used to capture parental depressive symptoms (>95% of caregivers were mothers). Based on the previous use of this variable in the NLSCY, individuals with scores at or above the 90th percentile were deemed to have high-parental depressive symptoms (Weeks et al., Reference Weeks, Cairney, Wild, Ploubidis, Naicker and Colman2014). Lastly, caregivers who reported having five or more drinks on one occasion, more than once per month, were classified as having high-parental alcohol use. Both parental depressive symptoms and alcohol use were captured by the mother when the child was 10/11 years of age.

Statistical analyses

Latent profile analysis

Two latent profile analyses were conducted at ages 6/7 and 10/11 years, where item variances were constrained to be equal across profiles, but allowed to vary between items. Multiple fit indices were utilized: bootstrapped likelihood ratio testing, Bayesian information criterion, entropy, profile sample size (requiring that each unique profile had to be > = 1% of the overall sample), and that an additional profile should differ substantively from other profiles. To increase the sample size, partial respondent data (i.e. at least one complete scale of internalizing or externalizing symptoms) were included through the use of full information maximum likelihood estimation under the missing at random assumption. Cases were assigned into their most-likely profile of belongingness based on posterior probabilities. This analysis was carried out using MPlus Software, version 7.4 (Muthén and Muthén, Reference Muthén and Muthén2011).

Measurement invariance

Prior to measurement invariance testing, class enumeration was determined based on the results of each time point latent profile analysis (i.e. at 6/7 and 10/11). In order to assess for measurement equivalence across the latent profiles identified at each time point, measurement variant and measurement invariant models were explored. This was done by conducting latent transition analyses with imposed model constraints on the mean scores of the indicator variables, across time, and comparing with a different model in which mean scores were not constrained. The Bayesian information criterion fit index was used to select the best fitting model, supported by the large sample size (Nylund et al., Reference Nylund, Asparouhov and Muthén2007; Kim et al., Reference Kim, Cao, Wang and Nguyen2017). This analysis was carried out using MPlus Software, version 7.4 (Muthén and Muthén, Reference Muthén and Muthén2011).

Multivariable logistic regression

In order to investigate the association between childhood internalizing and externalizing symptoms and early adolescent suicidal thoughts, multivariate logistic regression modeling was used. Three unique independent variables were modeled for suicidal thoughts and included the profile of internalizing and externalizing symptoms at age 6/7 and 10/11 years, as well as internalizing and externalizing symptom transition groups which are unique types of transitions between profile belongingness at age 6/7 and profile belongingness at age 10/11 years (e.g. heterotypic, homotypic, stable-low). Both unadjusted and adjusted models were computed for each logistic regression. Due to the known association with both childhood internalizing and externalizing and adolescent suicidal thoughts, multivariate logistic regression models were adjusted for sex, socioeconomic status, stressful life events, parental depressive symptoms, parental alcohol use, and single parent households. All analyses were conducted in SAS software, version 9.4, using PROC SURVEYLOGISTIC (SAS Institute Inc., 2013). Multinomial outcomes were modeled using the GLOGIT function. All regression analyses were computed using study survey weights in order to take into account the sampling frame of the NLSCY, accounting for the unique sample and design effects.

Non-response analyses

In order to investigate differences between those that dropped out of the NLSCY survey, individuals were compared on key variables. Those who had dropped out by age 10/11 were compared to those who did not on internalizing and externalizing profiles and sociodemographics at age 6/7. Similarly, those who were missing outcome data in adolescence were compared to those who were not on internalizing and externalizing profiles in childhood and sociodemographics.

Results

At age 6/7 years of age, 10 234 individuals had complete data on at least one of the three indicators of internalizing and externalizing symptoms and were included in latent profile analysis. By 10/11 years, 15.4% of this original sample were lost to follow-up (n = 1575; online Supplementary Fig. S1).

Latent profile fit indices supported a best-fitting, 4-profile model at both ages 6/7 and 10/11 years (online Supplementary Table S1; Figures 1a and 1b). Similar profiles of symptoms were identified at both time points. The first profile, defined as the ‘Low’ group, was the largest profile at both time points and was characterized by individuals who scored low on all three indicators of internalizing and externalizing. The second and third profiles, defined as the ‘Moderate’ and ‘High’ groups, were characterized by consistent elevated scores across time on all three indicators of internalizing and externalizing. Lastly, the final profile was defined as the ‘Hyperactivity/internalizing’ group. These individuals showed patterns of high hyperactivity/inattentiveness, high internalizing, but lower levels of conduct problems. A test of measurement invariance supported a model in which the within-class item means were longitudinally invariant (BIC = 36 075. 77), compared to a variant model (BIC = 44 759.70), suggesting the profiles have the same interpretation and are comparable over time.

Figure 1. (a) Latent profiles at age 6/7 years and (b) latent profiles at age 10/11 years.

With four profiles being identified at each time point, a possible 16 unique transitions were possible (e.g. ‘Low’ to ‘Low’). In order to account for some cell combinations being rare, and similar to what has been done in other research, a collapsing approach was employed whereby 16 transition groups were reduced into five larger transition cluster groups based on the broader qualities of symptomatic changes (Lanza and Collins, Reference Lanza and Collins2008; online Supplementary Table S2). These clusters included (1) stable low symptoms; characterized by being in the ‘Low’ profile at both time points (60.8%), (2) decreasing to low symptoms; characterized from transitioning from any of the three groups experiencing internalizing and externalizing symptoms at age 6/7 to the ‘Low’ profile at age 10/11 (15.7%), (3) increasing from low to symptoms; characterized by individuals who were in the ‘Low’ group at age 6/7 and transitioned into any of the other internalizing and externalizing groups by age 10/11 (9.8%), (4) homotypic; characterized by staying in the same internalizing and externalizing profile across time (7.5%), and (5) heterotypic; transitioning into a different internalizing and externalizing profile across time (6.2%).

Of those who had complete data on all covariates (n = 7926; 340 cases removed via listwise deletion (4.1%)), 50.5% of the sample were female, 7.1% were from low-SES homes, 17.1% were from single parent homes, 10.5% had a mother with high-depressive symptoms, 2.6% had parental alcohol use, and 32.8% had experienced stressful life events. Several significant and similar associations were found between covariates and latent profiles (at both time points), as well as the transition cluster groups, such that the symptom groups had the higher proportions of low SES, non-two parent homes, high-parental depressive symptoms, and stressful life events, compared with low and stable low groups. Higher proportions of males were observed in the more symptomatic groups (Table 1).

Table 1. Distribution of covariates in latent profile and transition groups with respective chi-squared (χ2) tests of independence (N = 7926)

Hyperactivity/internalizing: hyperactivity/inattention and internalizing

SES: socioeconomic status

The combined prevalence of suicidal thoughts from ages 12/13 to 14/15 years was 13.8%. The prevalence of suicidal thoughts was higher in the symptomatic profiles/transition groups (Table 2). In relation to the covariates, individuals experiencing suicidal thoughts were more likely to be female, come from non-two parent homes, low-socioeconomic status backgrounds, have a caregiver with high-parental depressive symptoms and high-alcohol use, and to have experienced stressful life events.

Table 2. Distribution of covariates among adolescents with and without suicidal thoughts, with respective χ2 tests of independence

LPA: latent profile analysis

SES: socioeconomic status

a Prevalence rates are weighted to take into account complex survey design

Relative to those in the ‘Low’ profile at age 6/7, individuals in the ‘High’ group showed a two and half fold increase in the odds of suicidal thoughts, while the ‘Hyperactivity/internalizing’ group showed a 33% increase in the odds of suicidal thoughts (Table 3). Increased odds of suicidal thought were not observed in the ‘Moderate’ group. At ages 10/11, belonging to any of the three internalizing and externalizing groups was associated with a 73–83% increase in the odds of suicidal thoughts in adolescence. Similarly, heterotypic, homotypic, and increasing internalizing and externalizing symptom transitions were all associated with between 72–94% increased odds of suicidal thoughts in adolescence compared to those who stayed in the ‘Low’ profile at both time points. Individuals who decreased from an internalizing and externalizing symptom group at age 6/7 to the ‘Low’ profile at age 10/11 did not have increased odds of suicidal thoughts, relative to those who stayed low across both time points. No evidence suggested that there was a difference in the strength of the association with suicidal thoughts based on which significant internalizing and externalizing symptom profile/transition groups the individual belonged to. Sex was not identified as an effect modifier in any association with suicidal thoughts and internalizing/externalizing symptom profiles/transitions. The sensitivity analysis using only those with complete data on suicidal thoughts at both ages 12/13 and 14/15 showed similar results to the original model (online Supplementary Table S3).

Table 3. Unadjusted and adjusted logistic regression models showing the association between latent profile(s) and transition clusters on suicidal thoughts

CI, confidence interval

Hyperactivity/internalizing: hyperactivity/inattention & internalizing

LPA: latent profile analysis – profiles of internalizing and externalizing symptoms

n: sample size

OR: odds ratio

a Analyses weighted to take into account complex survey design

b Adjusted for gender, socioeconomic status, stressful life events, high-parental depressive symptoms, high-parental alcohol use, and non-two parent household

Non-response analysis

Individuals who dropped out by age 10/11 years were more likely to come from low-socioeconomic backgrounds (p < 0.001) and had significantly higher scores of conduct problems at age 6/7 years (p < 0.05). These individuals did not differ on sex, parental status of the home, hyperactivity/inattention, nor internalizing. When comparing dropouts and responders on outcome data, results showed that dropouts were more likely to be male (p < 0.001), from low-socioeconomic backgrounds (p < 0.001), come from non-two parent homes (p < 0.001), and have mothers who reported more depressive symptoms (p < 0.001). Additionally, dropouts were more likely to belong to the ‘Low’, ‘High’, and ‘Hyperactivity/internalizing’ groups at age 6/7 years (p < 0.0001), but no differences were observed in profile belongingness at age 10/11 years (p = 0.39).

Conclusions

The present study sought out to identify unique profiles of internalizing/externalizing symptoms in childhood, how they changed across time, and their relationship to suicidal thoughts in early adolescence. The results identified four unique profiles of symptoms that were structurally similar at ages 6/7 and 10/11 years. Interestingly, all of them were characterized by varying levels of internalizing and externalizing co-occurrence. Indeed, a commonly reported profile in the CBCL literature is one characterized by high scores of internalizing, conduct problems, and hyperactivity/inattention, often referred to as the dysregulation profile (Biederman et al., Reference Biederman, Wozniak, Kiely, Ablon, Faraone, Mick, Mundy and Kraus1995). The dysregulation profile has been empirically replicated in numerous population and clinical samples (Ayer et al., Reference Ayer, Althoff, Ivanova, Rettew, Waxler, Sulman and Hudziak2009; Althoff et al., Reference Althoff, Rettew, Ayer and Hudziak2010a; De Caluwé et al., Reference De Caluwé, Decuyper and De Clercq2013; Masi et al., Reference Masi, Pisano, Milone and Muratori2015; Bianchi et al., Reference Bianchi, Brambilla, Garzitto, Colombo, Fornasari, Bellina, Bonivento, Tesei, Piccin, Conte, Perna, Frigerio, Castiglioni, Fabbro, Molteni and Nobile2017). While the dysregulation profile is most in line with the ‘High’ profile of the present findings, other latent profile analyses have identified less severe co-occurring groups, similar to our ‘Moderate’ profile (DiStefano and Kamphaus, Reference DiStefano and Kamphaus2006; Mindrila, Reference Mindrila2016). The final profile identified in the present research, defined as the ‘Hyperactivity/internalizing’ profile has also been replicated in other latent research, in which an ‘internal inattentive’ group was identified, characterized by clinically significant levels of depression with moderate symptoms of inattention and anxiety (Ostrander et al., Reference Ostrander, Herman, Sikorski, Mascendaro and Lambert2008). Additionally, other research has reported extensively on the co-occurrence of internalizing symptoms and hyperactivity/inattention in children, particularly in clinical settings (Biederman, Reference Biederman2005; Jarrett and Ollendick, Reference Jarrett and Ollendick2012; Meinzer et al., Reference Meinzer, Pettit and Viswesvaran2014; Steinberg and Drabick, Reference Steinberg and Drabick2015).

The finding that the majority of children stayed in the ‘Low’ group from ages 6/7–10/11 years is consistent with other research (Luby et al., Reference Luby, Mrakotsky, Heffelfinger, Brown, Hessler and Spitznagel2003; Althoff et al., Reference Althoff, Rettew, Faraone, Boomsma and Hudziak2006, Reference Althoff, Verhulst, Rettew, Hudziak and van der Ende2010b; Basten et al., Reference Basten, Althoff, Tiemeier, Jaddoe, Hofman, Hudziak, Verhulst and van der Ende2013, Bonadio et al., Reference Bonadio, Dynes, Lackey, Tompsett and Amrhein2016; Weeks et al., Reference Weeks, Ploubidis, Cairney, Wild, Naicker and Colman2016; Bianchi et al., Reference Bianchi, Brambilla, Garzitto, Colombo, Fornasari, Bellina, Bonivento, Tesei, Piccin, Conte, Perna, Frigerio, Castiglioni, Fabbro, Molteni and Nobile2017). The largest proportion of individuals who were in the ‘Moderate’ or the ‘Hyperactivity/internalizing’ profiles at age 6/7 years also ended up in the ‘Low’ profile by age 10/11 years. This suggests that a substantial proportion of young children may experience a desistance of their elevated internalizing and externalizing symptoms across development. It is also important to note that the largest proportion of individuals in the ‘High’ profile at the first time point was still in this profile at age 10/11 years. This is in line with other research which has showed that children exhibiting high levels of co-occurring internalizing and externalizing are more likely to show persistence in these symptoms across time, relative to those experiencing less severe symptoms (Keenan et al., Reference Keenan, Shaw, Delliquadri, Giovannelli and Walsh1998; Briggs-Gowan et al., Reference Briggs-Gowan, Carter, Bosson-Heenan and Guyer2006; Althoff et al., Reference Althoff, Verhulst, Rettew, Hudziak and van der Ende2010b; Basten et al., Reference Basten, Tiemeier, Althoff, van de Schoot, Jaddoe, Hofman, Hudziak, Verhulst and van der Ende2016).

At age 6/7 years, the ‘High’ and ‘Hyperactivity/internalizing’ profiles were associated with suicidal thoughts. By age 10/11 years, all three of the internalizing and externalizing symptom profiles (‘Moderate’, ‘High’, and ‘Hyperactivity/internalizing’) were associated with suicidal thoughts. While this research cannot determine how these symptoms are related to suicidal thoughts, it does suggest that different patterns of co-occurrence present similar risks in the development of suicidal thoughts. While synergistic effects cannot be accounted for, the fact that the ‘Hyperactivity/internalizing’ showed comparable odds of suicidal thoughts relative to the other two high-symptom profiles, suggests that symptoms of hyperactivity, inattention, and internalizing may be the symptoms of the ‘Moderate’ and ‘High’ profiles which are most strongly associated with suicidal thoughts. Indeed, the literature does support strong associations between internalizing disorders and suicidal thoughts and behaviors, while other research has found similar associations in children with hyperactivity/inattention (Chronis-Tuscano et al., Reference Chronis-Tuscano, Molina, Pelham, Applegate, Dahlke, Overmyer and Lahey2010; Balazs and Kereszteny,Reference Balazs and Kereszteny2017). A systematic review which explored the association between ADHD and suicide found that more than half of ADHD patients also showed patterns of suicide (Balazs and Kereszteny, Reference Balazs and Kereszteny2017). Relevant to the present findings, this research also demonstrated that the association was stronger in the presence of other psychiatric co-occurrences, such as symptoms of internalizing.

Relative to the ‘Stable low’ transition pattern, all transitions were associated with suicidal thoughts except for the ‘Decreasing to low’ transition. The fact that those in the ‘Increasing from low’ group had similar odds of suicidal thoughts to those in the persistent transitions (heterotypic or homotypic), and that the associations were similar to the profiles at age 10/11 years, suggests that the most recent profile/assessment may be as useful of a predictor of suicidal thoughts as the dual-time point transitions. The identification of an association between the age 6/7-year profile and suicidal thoughts may be an indirect one, in that the age 6/7-year profile is associated with the age 10/11-year profile, which in turn, is associated with suicidal thoughts. This suggests that the profile in which an individual is in by late childhood may be more important than earlier patterns of symptoms or transition patterns, at predicting adolescent suicidal thoughts.

Methodological considerations

Drop-out occurred across the eight years of follow-up for this study. Some key differences were identified between those with and without outcome data, such as dropouts being more likely to be males from low-SES, non-two parent households and also have higher rates of parental depressive symptoms. Considering these factors are associated with both the exposure and outcome, the present findings underestimate the true association between internalizing/externalizing symptoms and subsequent suicidal thoughts.

Another limitation of the study was relying on only one reporter at collection of internalizing/externalizing symptoms (i.e. mothers) and suicidal thoughts (i.e. self-reported by child). One contrary finding to some of the other literature studies was the inability to identify an internalizing only profile. Relying only on mother report may be an explanation as it is possible that the symptoms of internalizing are inherently more difficult to identify for an observer, relative to externalizing symptoms. However, evidence does support that caregivers are the best informant when it comes to childhood psychopathology (Smith, Reference Smith2007). Additionally, self-reporting of suicidal thoughts presents the possibility of social desirability bias, and underreporting of the true rate. It is important to note, however, that the respondents were informed that their responses would be kept confidential and following the independent completion of the survey, the respondent sealed their survey in an envelope. Such collection strategies have been suggested as useful precautions to mitigate bias and increase validity (Krumpal, Reference Krumpal2013).

Additionally, cases were grouped into latent profiles based on their most probable profile membership. None of the cases had a perfect posterior probability (p = 1.0) of modal assignment (i.e. belonging to their particular profile), introducing measurement error. However, the literature does support assigning cases to their most probable profile when entropy scores are high, confirming good class delineation (Celeux and Soromenho, Reference Celeux and Soromenho1996; Clark and Muthén, Reference Clark and Muthén2009).

These limitations are offset by some notable strengths, including the large population-based sample, the prospective data collection, and the extensive number of measures and covariates assessed.

Implications

The first noteworthy implication of the present study is that the profiles of internalizing and externalizing symptoms identified emphasize high levels of co-occurrence between internalizing and externalizing symptoms. Despite a large sample and a significant number of symptoms assessed, we were unable to identify profiles of children that could be characterized as only internalizing or only externalizing. As such, it is important that domains of both internalizing and externalizing are considered by stakeholders when designing and implementing population level interventions. Targeting these symptoms earlier in the life course may help to reduce the risk of suicidal thoughts later in adolescence. Beyond this, the findings highlighted that males from impoverished and unstable households were at the highest risk for belonging to symptomatic profiles. This research highlights the need for societal and community changes that positively improve the outlook for at-risk groups, such as community and school programs built to foster self-esteem and resiliency.

Another implication of the present study was the significant proportion of individuals whose internalizing and externalizing symptoms decreased from ages 6/7 to 10/11. Approximately 30% of the sample was in a symptomatic profile at age 6/7, however by age 10/11, half of those had transitioned to the ‘low’ symptom profile. Additionally, these children were not at increased risk of suicidal thought when aged 12 to 15. Alternatively, children who had increasing symptoms or stable symptoms from 6/7 to 10/11 had similar increased risk of suicidal thought. Consequently, symptoms in later childhood may be a more useful predictor of suicidal thought than prediction based on earlier childhood variables or trajectories across two time points. Focused interventions targeted at children with symptoms of mental disorder may be most effective in reducing suicidal thought if delivered in early adolescence (Lewinsohn et al., Reference Lewinsohn, Rohde and Seeley1994; King, Reference King, Maris, Silverman and Canetto1997).

Future research

While the present investigation taken into account the role of internalizing and externalizing trajectories and how they were associated with subsequent suicidal thoughts, future research can expand on this modeling. While the present investigation chose to take a more general approach to problem behaviors in childhood, instead looking at how covariates differed among profile belongingness, future research should explore whether the constructs themselves differ among sex, socioeconomic class, attachment styles, and household structures. Furthermore, it may be interesting to include other indicators of internalizing/externalizing in the model such as relational aggression, or including hyperactivity and inattention as unique constructs – a limitation of the NLSCY dataset. Additionally, it may be interesting to expand on the temporal modeling by exploring the role of neglect/abuse in the household and peer relationships at mediating the effects between internalizing/externalizing and subsequent suicidal thoughts.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291719002733

References

Achenbach, T (1991) Manual for the Child Behavior Checklist/4 – 18 and 1991 Profile. Burlington: University of Vermont Department of Psychiatry.Google Scholar
Althoff, R, Rettew, D, Faraone, S, Boomsma, D and Hudziak, J (2006) Latent class analysis shows strong heritability of the child behavior checklist–juvenile bipolar phenotype. Biological Psychiatry 60, 903911.Google ScholarPubMed
Althoff, R, Rettew, D, Ayer, L and Hudziak, J (2010 a) Cross-informant agreement of the dysregulation profile of the child behavior checklist. Psychiatry Research 178, 550555.CrossRefGoogle ScholarPubMed
Althoff, R, Verhulst, F, Rettew, D, Hudziak, J and van der Ende, J (2010 b) Adult outcomes of childhood dysregulation: a 14-year follow-up study. Journal of the American Academy of Child & Adolescent Psychiatry 49, 11051116.Google ScholarPubMed
Ayer, L, Althoff, R, Ivanova, M, Rettew, D, Waxler, E, Sulman, J and Hudziak, J (2009) Child behavior checklist juvenile bipolar disorder (CBCL-JBD) and CBCL posttraumatic stress problems (CBCL-PTSP) scales are measures of a single dysregulatory syndrome. Journal of Child Psychology and Psychiatry 50, 12911300.CrossRefGoogle ScholarPubMed
Balazs, J and Kereszteny, A (2017) Attention-deficit/hyperactivity disorder and suicide: a systematic review. World Journal of Psychiatry 7, 4459.CrossRefGoogle ScholarPubMed
Basten, M, Althoff, R, Tiemeier, H, Jaddoe, V, Hofman, A, Hudziak, J, Verhulst, F and van der Ende, J (2013) The dysregulation profile in young children: empirically defined classes in the generation R study. Journal of the American Academy of Child and Adolescent Psychiatry 52, 841850.CrossRefGoogle ScholarPubMed
Basten, M, Tiemeier, H, Althoff, R, van de Schoot, R, Jaddoe, V, Hofman, A, Hudziak, J, Verhulst, F and van der Ende, J (2016) The stability of problem behavior across the preschool years: an empirical approach in the general population. Journal of Abnormal Child Psychology 44, 393404.CrossRefGoogle ScholarPubMed
Bianchi, V, Brambilla, P, Garzitto, M, Colombo, P, Fornasari, L, Bellina, M, Bonivento, C, Tesei, A, Piccin, S, Conte, S, Perna, G, Frigerio, A, Castiglioni, I, Fabbro, F, Molteni, M and Nobile, M (2017) Latent classes of emotional and behavioural problems in epidemiological and referred samples and their relations to DSM-IV diagnoses. European Child & Adolescent Psychiatry 26, 549557.CrossRefGoogle ScholarPubMed
Biederman, J (2005) Attention-deficit/hyperactivity disorder: a selective overview. Biological Psychiatry 57, 12151220.CrossRefGoogle ScholarPubMed
Biederman, J, Wozniak, J, Kiely, K, Ablon, S, Faraone, S, Mick, E, Mundy, E and Kraus, I (1995) CBCL clinical scales discriminate prepubertal children with structured interview-derived diagnosis of mania from those with ADHD. Journal of the American Academy of Child and Adolescent Psychiatry 34, 464471.CrossRefGoogle ScholarPubMed
Bonadio, F, Dynes, M, Lackey, J, Tompsett, C and Amrhein, K (2016) Grouping youth with similar symptoms: a person-centered approach to transdiagnostic subgroups. Journal of Clinical Psychology 72, 676688.CrossRefGoogle ScholarPubMed
Briggs-Gowan, M, Carter, A, Bosson-Heenan, J and Guyer, A (2006) Are infant-toddler social-emotional and behavioral problems transient? Journal of the American Academy of Child & Adolescent Psychiatry 45, 849858.CrossRefGoogle ScholarPubMed
Campbell, S and Ewing, L (1990) Follow-up of hard-to-manage preschoolers: adjustment at age 9 and predictors of continuing symptoms. Journal of Child Psychology and Psychiatry 31, 871889.CrossRefGoogle ScholarPubMed
Celeux, G and Soromenho, G (1996) An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification 13, 195212.CrossRefGoogle Scholar
Chronis-Tuscano, A, Molina, B, Pelham, W, Applegate, B, Dahlke, A, Overmyer, M and Lahey, B (2010) Very early predictors of adolescent depression and suicide attempts in children with attention-deficit/hyperactivity disorder. Archives of General Psychiatry 67, 10441051.CrossRefGoogle ScholarPubMed
Clark, S and Muthén, B (2009) Relating Latent Class Analysis Results to Variables not Included in the Analysis. Los Angeles: University of California.Google Scholar
De Caluwé, E, Decuyper, M and De Clercq, B (2013) The child behavior checklist dysregulation profile predicts adolescent DSM-5 pathological personality traits 4 years later. European Child & Adolescent Psychiatry 22, 401411.CrossRefGoogle ScholarPubMed
DiStefano, C and Kamphaus, R (2006) Investigating subtypes of child development. Educational and Psychological Measurement 66, 778794.Google Scholar
Dykxhoorn, J, Hatcher, S, Roy-Gagnon, M and Colman, I (2017) Early life predictors of adolescent suicidal thoughts and adverse outcomes in two population-based cohort studies. PLoS ONE 12, 115.CrossRefGoogle ScholarPubMed
Garrison, C, Addy, C, Jackson, K, McKeown, R and Waller, J (1991) A longitudinal study of suicidal ideation in young adolescents. Journal of the American Academy of Child & Adolescent Psychiatry 30, 597603.CrossRefGoogle ScholarPubMed
Hofstra, M, Van der ende, J and Verhulst, F (2002) Child and adolescent problems predict DSM-IV disorders in adulthood: a 14-year follow-up of a Dutch epidemiological sample. Journal of the American Academy of Child & Adolescent Psychiatry 41, 182189.CrossRefGoogle ScholarPubMed
Jarrett, M and Ollendick, T (2012) Treatment of comorbid attention-deficit/hyperactivity disorder and anxiety in children: a multiple baseline design analysis. Journal of Consulting and Clinical Psychology 80, 239244.CrossRefGoogle ScholarPubMed
Keenan, K, Shaw, D, Delliquadri, E, Giovannelli, J and Walsh, B (1998) Evidence for the continuity of early problem behaviors: application of a developmental model. Journal of Abnormal Child Psychology 26, 441452.CrossRefGoogle ScholarPubMed
Kim, E, Cao, C, Wang, Y and Nguyen, D (2017) Measurement invariance testing with many groups: a comparison of five approaches. Structural Equation Modeling: A Multidisciplinary Journal 24, 524544.CrossRefGoogle Scholar
King, C (1997) Suicidal behavior in adolescence. In Review of Suicidology (ed. Maris, R., Silverman, M. and Canetto, S.), New York City: Guilford Press pp. 6195.Google Scholar
Krumpal, I (2013) Determinants of social desirability bias in sensitive surveys: a literature review. Quality & Quantity 47, 20252047.CrossRefGoogle Scholar
Lanza, S and Collins, L (2008) A new SAS procedure for latent transition analysis: transitions in dating and sexual risk behavior. Developmental Psychology 44, 446456.Google ScholarPubMed
Lewinsohn, P, Rohde, P and Seeley, J (1994) Psychosocial risk factors for future adolescent suicide attempts. Journal of Consulting and Clinical Psychology 62, 297305.Google ScholarPubMed
Luby, J, Mrakotsky, C, Heffelfinger, A, Brown, K, Hessler, M and Spitznagel, E (2003) Modification of DSM-IV criteria for depressed preschool children. American Journal of Psychiatry 160, 11691172.CrossRefGoogle ScholarPubMed
Masi, G, Pisano, S, Milone, A and Muratori, P (2015) Child behavior checklist dysregulation profile in children with disruptive behavior disorders: a longitudinal study. Journal of Affective Disorders 186, 249253.CrossRefGoogle ScholarPubMed
Meinzer, M, Pettit, J and Viswesvaran, C (2014) The co-occurrence of attention-deficit/hyperactivity disorder and unipolar depression in children and adolescents: a meta-analytic review. Clinical Psychology Review 34, 595607.CrossRefGoogle ScholarPubMed
Mesman, J, Bongers, I and Koot, H (2001) Preschool developmental pathways to preadolescent internalizing and externalizing problems. Journal of Child Psychology and Psychiatry 42, 679689.CrossRefGoogle ScholarPubMed
Mian, N, Wainwright, L, Briggs-Gowan, M and Carter, A (2011) An ecological risk model for early childhood anxiety: the importance of early child symptoms and temperament. Journal of Abnormal Child Psychology 39, 501512.CrossRefGoogle ScholarPubMed
Mindrila, D (2016) A typology of child school behavior: investigation using latent profile analysis and cluster analysis. Psychology in the Schools 53, 471487.CrossRefGoogle Scholar
Muthén, L and Muthén, B (2011) Mplus User's Guid, 6th edn. Los Angeles, CA: Muthén & Muthén.Google Scholar
Navaneelan, T (2010) Health at a Glance, Statistics Canada Catalogue no. 82-624-X. Available at http://www.statcan.gc.ca/pub/82-624-x/2012001/article/11696-eng.htm (Accessed 29 June 2018).Google Scholar
Nylund, K, Asparouhov, T and Muthén, B (2007) Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal 14, 535569.CrossRefGoogle Scholar
Orri, M, Galera, C, Turecki, G, Forte, A, Renaud, J, Boivin, M, Tremblay, R, Côté, S and Geoffroy, M (2018) Association of childhood irritability and depressive/anxious mood profiles with adolescent suicidal ideation and attempts. JAMA Psychiatry 75, 465473.CrossRefGoogle ScholarPubMed
Ostrander, R, Herman, K, Sikorski, J, Mascendaro, P and Lambert, S (2008) Patterns of psychopathology in children with ADHD: a latent profile analysis. Journal of Clinical Child & Adolescent Psychology 37, 833847.CrossRefGoogle ScholarPubMed
SAS Institute Inc (2013) SAS 9.4. Cary, NC: SAS Institute Inc.Google Scholar
Shaw, D, Keenan, K and Vondra, J (1994) Developmental precursors of externalizing behavior: ages 1 to 3. Developmental Psychology 30, 355364.Google Scholar
Smith, S (2007) Making sense of multiple informants in child and adolescent psychopathology: a guide for clinicians. Journal of Psychoeducational Assessment 25, 139149.CrossRefGoogle Scholar
Sourander, A, Klomek, A, Niemelä, S, Haavisto, A, Gyllenberg, D, Helenius, H, Sillanmäki, L, Ristkari, T, Kumpulainen, K, Tamminen, T, Moilanen, I, Piha, J, Almqvist, F and Gould, M (2009) Childhood predictors of completed and severe suicide attempts. Archives of General Psychiatry 66, 398406.CrossRefGoogle ScholarPubMed
Statistics Canada (1995 a) National Longitudinal Survey of Children and Youth: Microdata User Guide - Cycle 1. Ottawa: Government of Canada. Volume 1, pp. 118.Google Scholar
Statistics Canada (1995 b) NLSCY - Content and Validation of NLSCY DATA (9.1-9.11). Available at http://people.ucalgary.ca/~libdata/adc/old_file_info/kids/k96-9a.htm (Accessed 10 November 2018).Google Scholar
Statistics Canada (1999) National Longitudinal Survey of Children and Youth: Microdata User Guide - Cycle 3. Ottawa: Government of Canada.Google Scholar
Statistics Canada (2017) Ontario Child Health Survey (OCHS). Available at http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=3824 (Accessed 28 May 2019).Google Scholar
Steinberg, E and Drabick, D (2015) A developmental psychopathology perspective on ADHD and comorbid conditions: the role of emotion regulation. Child Psychiatry & Human Development 46, 951966.CrossRefGoogle ScholarPubMed
Université de Montréal (2007) The montreal longitudinal and experimental study: The intervention program and its long term effects. Available at http://www.gripinfo.ca/grip/public/www/doc/Intervention%20program.pdf (Accessed 28 May 2019).Google Scholar
Vaillancourt, T, Brittain, H, McDougall, P and Duku, E (2013) Longitudinal links between childhood peer victimization, internalizing and externalizing problems, and academic functioning: developmental cascades. Journal of Abnormal Child Psychology 41, 12031215.CrossRefGoogle ScholarPubMed
Weeks, M, Cairney, J, Wild, T, Ploubidis, G, Naicker, K and Colman, I (2014) Early-life predictors of internalizing symptom trajectories in Canadian children. Depression And Anxiety 31, 608616.CrossRefGoogle ScholarPubMed
Weeks, M, Ploubidis, G, Cairney, J, Wild, T, Naicker, K and Colman, I (2016) Developmental pathways linking childhood and adolescent internalizing, externalizing, academic competence, and adolescent depression. Journal of Adolescence 51, 3040.CrossRefGoogle ScholarPubMed
Willner, C, Gatzke-Kopp, L and Bray, B (2016) The dynamics of internalizing and externalizing comorbidity across the early school years. Developmental Psychopathology 28, 10331052.CrossRefGoogle ScholarPubMed
Wittchen, H, Kessler, R, Pfister, H and Lieb, M (2000) Why do people with anxiety disorders become depressed? A prospective-longitudinal community study. Acta Psychiatrica Scandinavica. Supplementum 406, 1423.CrossRefGoogle Scholar
Figure 0

Figure 1. (a) Latent profiles at age 6/7 years and (b) latent profiles at age 10/11 years.

Figure 1

Table 1. Distribution of covariates in latent profile and transition groups with respective chi-squared (χ2) tests of independence (N = 7926)

Figure 2

Table 2. Distribution of covariates among adolescents with and without suicidal thoughts, with respective χ2 tests of independence

Figure 3

Table 3. Unadjusted and adjusted logistic regression models showing the association between latent profile(s) and transition clusters on suicidal thoughts

Supplementary material: File

Johnson et al. supplementary material

Figure S1 and Tables S1-S3

Download Johnson et al. supplementary material(File)
File 186.7 KB