Next Article in Journal
Can ‘Script Elicitation’ Methods Be Used to Promote Physical Activity? An Acceptability Study
Previous Article in Journal
The Complex Role Played by the Default Mode Network during Sexual Stimulation: A Cluster-Based fMRI Meta-Analysis
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Behavioral Sciences
Volume 14
Issue 7
10.3390/bs14070571
behavsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Are Children Following High Trajectories of Disruptive Behaviors in Early Childhood More or Less Likely to Follow Concurrent High Trajectories of Internalizing Problems?

by
Rene Carbonneau
1,2,3,*,
Frank Vitaro
2,3,4,
Mara Brendgen
2,3,5,
Michel Boivin
3,6 and
Richard E. Tremblay
1,2,3,7
1
Department of Pediatrics, University of Montreal, Montreal, QC H3T 1J7, Canada
2
Centre de Recherche Azrieli du CHU Sainte-Justine, Montréal, QC H3T 1C5, Canada
3
Research Unit on Children’s Psychosocial Maladjustment, University of Montreal, Montréal, QC H3T 1C5, Canada
4
Department of Psychoeducation, University of Montreal, Montréal, QC H3C 3J7, Canada
5
Department of Psychology, University of Quebec in Montreal, Montréal, QC H3C 3P8, Canada
6
Department of Psychology, Université Laval, Québec City, QC G1V 0A6, Canada
7
Department of Psychology, University of Montreal, Montréal, QC H3C 3J7, Canada
*
Author to whom correspondence should be addressed.
Behav. Sci. 2024, 14(7), 571; https://doi.org/10.3390/bs14070571
Submission received: 24 May 2024 / Revised: 28 June 2024 / Accepted: 3 July 2024 / Published: 5 July 2024
Browse Figures
Versions Notes

Abstract

:
The developmental association between disruptive behaviors (DBs: hyperactivity-impulsivity, non-compliance, physical aggression) and internalizing problems in early childhood is not well understood and has generated competing hypotheses and mixed results. Using a person-centered strategy, the present study aimed to examine concurrent trajectories of DBs and trajectories of internalizing problems from age 1.5 to 5 years in a population-representative sample (N = 2057; 50.7% boys). Six trajectories of DBs and three trajectories of internalizing problems, based on parent reports and obtained via latent growth modeling across five periods of assessment, were used as longitudinal indicators of each type of behaviors. Children following low or moderate trajectories served as the reference class. Compared to children in the reference class, those in trajectory classes characterized by high levels of co-occurring DBs (OR = 6.60) and, to a lesser extent, those in single high DB classes (OR = 2.78) were more likely to follow a high trajectory of internalizing problems simultaneously. These results support a multiple problem hypothesis regarding the association between DBs and internalizing problems, consistent with a developmental perspective that includes a general factor underpinning different psychopathologies. These findings highlight the importance of considering the co-occurrence between DBs and internalizing problems when studying either construct in children.

1. Introduction

Over the last two decades, longitudinal studies using a dual variable- and person-centered approach [1,2] have been useful in describing the development of disruptive behavior (DB) in childhood [3,4,5,6,7,8,9,10,11,12,13]. Overall, these studies support the idea that based on differences and similarities between children, a number of distinct developmental patterns of DB can be drawn across time (e.g., low, moderate or high stable, increasing, decreasing) and differentially linked with earlier risk factors or later outcomes. Most of these investigations examined single behaviors such as hyperactivity, opposition, or physical aggression, but a number of studies jointly examined the development of distinct DBs [3,10,11]. These latter studies generally showed a high level of co-occurrence of DBs, in addition to significant proportions of children displaying mainly one type of DB over time. Given the high risk of later psychosocial adjustment reported for children with concurrent DBs [3,14], these findings on the early development of such co-occurrence are important for early risk assessment and for screening children for prevention programs. However, another aspect of early developmental co-occurrence that may potentially differentiate trajectories of DBs is their association with internalizing problems [15] (which encompass inward-directed or overcontrolled behavior, such as mood disorders, anxiety or distress, and inhibition). Still, this association has received less attention in children’s early years.
Recent advances in developmental psychopathology support a hierarchical structure that includes a common underlying factor of general psychopathology shared by all psychopathological conditions [16], while second-level factors influence externalizing and internalizing problems, respectively [17,18]. This model has been validated in behavioral genetic studies, showing a significant common genetic factor influencing both externalizing and internalizing problems [16,19]. Internalizing problems may thus develop concurrently with DBs from the first years of life, and such early co-occurrence therefore warrants investigation.
In comparison to studies focussing on DBs, a smaller number of investigations have examined longitudinally the co-occurrence between these latter problems and internalizing problems in children [20]. Moreover, results across studies are mixed. Indeed, some reports showed evidence of positive associations over time between externalizing and internalizing problems [21,22,23,24], suggesting cumulative conditions and supporting a multiple problem hypothesis [25]. Such results echo those of cross-sectional and longitudinal studies linking, for example, children’s anxiety and externalizing [26], oppositional-defiant behaviors and internalizing [27], or specific syndromes such as attention-deficit/hyperactivity and anxiety or depressive symptoms [28,29], as well as conduct or oppositional behaviors and anxiety or depressive symptoms [29,30,31]. Thus, DBs have been similarly associated with different forms of internalizing problems as well as global measures of internalization. Importantly, consistent with a multiple problem hypothesis, poorer long-term outcomes were reported for children exhibiting co-occurring internalizing and externalizing problems in comparison to their peers showing essentially one type of difficulty [23,32].
However, contrary to the aforementioned findings, other studies examining the developmental co-occurrence between DBs and internalizing problems in children have suggested that the presence of internalizing symptoms may have a dampening effect, aligning with a buffer hypothesis [25] on the development of DBs [33,34,35]. Such a buffering effect implies a negative association over time—opposite to the positive association involved in the multiple problem hypothesis—between DBs and internalizing problems. For instance, higher anxiety has been shown to moderate impulsive decision-making among individuals with high trait impulsivity [34]. In another study, children with externalizing traits and concurrent fearfulness/anxiousness at age 9 were less likely to develop aggressive behavior by age 12 than their peers with low fearfulness/anxiousness [35]. Consistent with the latter and supporting a buffer hypothesis, less-severe long-term outcomes were reported for children exhibiting concurrent internalizing and externalizing problems compared to their peers, who primarily exhibited externalizing problems [36,37].
The mixed support for the competing multiple problem or buffer hypotheses may be attributable, in part, to the cross-sectional nature of many reviewed studies and to the different ages of children at the time of assessment across studies. The developmental period considered may indeed affect the applicability of each explanation and potentially explain the mixed evidence. The mixed support for the competing hypotheses may also suggest that more than one developmental pathway involving the co-occurrence between both types of problems is possible. In this context, given the significant developmental heterogeneity described above concerning DBs, it may be particularly important to examine whether internalizing problems are similarly linked with different types or co-occurring longitudinal manifestations of DB. For instance, in a cross-sectional study of hyperactive boys aged 7–15, anxiety was associated with oppositional problems but not with symptoms of core conduct behavior, such as aggression [38]. Furthermore, a prior investigation based on the same sample as the one used in the present study showed that the association between preschool externalizing and internalizing problems varied depending on the type of externalizing profile among different DBs, the type of internalizing problems, and the specific preschool period (i.e., early, middle or late) [24]. Moreover, there are mixed results regarding sex differences in the association between externalizing and internalizing problems in early childhood, with some studies reporting a stronger association for boys [26,39], and others reporting no sex differences [27,40]. Given that several studies used at-risk or clinical samples, population-based studies are needed to clearly understand the association between developmental pathways of DBs and internalizing problems in the context of normative child development [41].
A comprehensive understanding of the co-occurrence between DBs and internalizing problems should start with the examination of individual patterns of their concurrent manifestations in children’s early years [15,20]. As early childhood is a developmental period marked by children’s accelerated maturation and changes in behaviors [42,43], a longitudinal appraisal of DBs and internalizing problems is necessary to avoid the caveats of cross-sectional assessments. To address this issue, a dual variable- and person-centered strategy allows us to describe the progression of the two types of problems using longitudinal data and to compare the behavior of the child to the behavior of his/her peers of the same age throughout early childhood [1,2]. The resulting longitudinal patterns thus provide a valid account of the development of a child with reference to the peer group for both types of problems. Such developmental patterns are a necessary prelude to comprehensive developmental models, including potentially common risk factors at the biological, individual, and sociofamilial level [42], which may distinguish DBs with and without concurrent internalizing problems [15], and which could eventually translate into early and personalized preventive interventions [43]. However, the potential concurrent development of DBs and internalizing problems in early childhood remains to be examined [26].

The Present Study

Aiming to help fill this gap, we examined the extent to which distinct developmental trajectories across different types of DBs are concurrently associated with the trajectories of internalizing problems over the early childhood years. To this end, we capitalized on young children’s longitudinal DBs trajectory classes identified in a previous study [3]. That study documented the joint longitudinal courses of mother-rated hyperactivity–impulsivity (HI), non-compliance (NC), and physical aggression (PA) using five assessments from ages 1.5 to 5 years in a representative birth cohort (Figure 1), as well as their association with teacher ratings of DBs in the first grade. The results showed that (1) for the three types of DBs, children followed either a low-, moderate-, or high-frequency trajectory throughout the early childhood years; (2) between 13% and 20% of children manifested higher levels of either HI, NC, or PA; (3) developmental co-occurrence between HI, NC, and PA was frequent, as 14.4% of the sample (boys: 18.3%; girls: 10.4%) followed the highest trajectory for more than one DB; and (4) early childhood longitudinal patterns of DBs were associated with teacher-rated indicators of DBs and school adjustment in the first grade.
In the present study, we aimed to examine the association of these previously identified trajectories of DBs with the trajectories of internalizing problems over the same early childhood period in order to determine (1) whether the two types of trajectories are positively associated (i.e., in line with the multiple problems hypothesis), or, alternatively, whether they are negatively linked (i.e., in line with the buffer hypothesis); (2) whether such an association is more pronounced for concurrent or single manifestations of DB (i.e., HI, NC, or PA); and (3) whether these associations differ for males and females.
The multiple problem hypothesis would be supported if trajectory classes reflecting high levels of DBs were linked with similar trajectories of internalizing problems rather than with classes with low or moderate levels of such problems. Moreover, children in trajectory classes reflecting high levels of concurrent DBs would be more likely to follow high trajectories of internalizing problems than their peers in high trajectory classes for a single DB. Conversely, the buffer hypothesis would be consistent with children in high DB trajectory classes being more likely to follow lower-level trajectories of internalizing problems than children in trajectory classes with a low or moderate frequency of DB. This hypothesis would also be consistent with children in high trajectory classes for a single DB showing higher levels of internalizing problems than their peers in classes of concurrent high DBs.
Given that associations between DBs and internalizing problems have been reported for both global and specific measures of the latter (e.g., anxiety or depression symptoms), and given the high comorbidity consistently reported between anxiety and depression symptoms in early childhood [24,28,44,45], the present study focussed on a global indicator of internalizing problems in association with longitudinal patterns of DBs. Furthermore, given the absence of consensus noted earlier with regard to the multiple problem or buffer hypotheses, the lack of studies in young children on the association between patterns of single or concurrent high DBs with internalizing problems, and the mixed results regarding gender differences in prior studies, the present investigation remains exploratory with respect to these issues.

2. Materials and Methods

2.1. Participants

A population-based birth cohort of 2057 infants (92% white of European ancestry, 51.2% boys) representative of the children born (single births) in the province of Quebec, Canada, in 1997–1998 was used. Mothers giving birth after 24 weeks’ and not later than 42 weeks’ gestation who spoke English or French (Canada’s official languages) were eligible (French is the first language for 80% of the population in Quebec). A complete description of the cohort is available elsewhere [3]. Children and their families were first assessed 5 months after birth (T1) and annually thereafter. The annual assessments consisted of a face-to-face interview with the most knowledgeable person about the child (the mother in 99% of cases) over an average of one hour and forty-five minutes. Assessments at the ages of 1.5, 2.5, 3.5, 4.5, and 5 years (T2–T6; response rate of 97.7%, 95.4%, 95.1%, nd 86.0%, respectively) were used for trajectory analysis of DBs [3] and internalizing problems. Participants with valid trajectory data (n = 2057; 92.4%) were compared to those lost due to attrition (n = 169; 7.6%) with regard to demographic and socioeconomic family characteristics (i.e., mother’s and father’s age and family SES). A slightly higher SES of the remaining families was observed F(df = 1) = 17.72, p < 0.001, but the difference (Cohen’s d = 0.19) is considered to be extremely small (i.e., < 0.20) [46,47]. The characteristics of the participating families at the first assessment are presented in Supplementary Table S1.

2.2. Measures

2.2.1. Joint Trajectories of DBs

Trajectories of DBs were based on maternal ratings of hyperactivity–impulsivity (HI): cannot stand still; is agitated, fidgety, and/or impulsive; acts without thinking; difficulty waiting for his/her turn; difficulty remaining quiet; non-compliance (NC): is rebellious/defiant or refuses to comply with adults’ requests or rules; has no remorse after misconduct; does not change his/her behavior after being punished; and physical aggression (PA): fights; physically attacks others; hits, bites, or kicks. As recommended for scales with few items, internal consistency reliability was assessed by using confirmatory factor analysis to test the fit of a single factor model for each scale [48] from which a composite reliability coefficient (CR) [49] can be computed (>0.60 recommended) [50]. The average CR coefficient across assessment times was 0.81 (0.77–0.82) for HI, 0.78 (0.72–0.82) for NC, and 0.83 (0.81–0.85) for PA. A latent class growth mixture analysis [2,51] similar to that used in the present study (see Data analysis) generated the trajectory classes.
Figure 1 shows the observed means of HI, NC, and PA for the six joint DBs trajectory classes that included a high-frequency trajectory for at least one DB. Overall, 34.8% of boys and 21.3% of girls were in joint DBs trajectory classes that included at least one high trajectory. Of note, a co-occurrent profile of HI+PA (i.e., without high NC) was not found. Among children following a high trajectory for a single-DB (HI, NC, or PA), the corresponding single high DB joint trajectory classes (i.e., high—HIonly, NConly, or PAonly) represented 25.3% to 36.2% of girls across DBs, and 19.4% to 39.1% of boys. Thus, for both genders, trajectory classes of co-occurrent DBs (i.e., including a high trajectory for two or more DBs: High—HI+NC, NC+PA, HI+NC+PA) represented the majority of children following a High trajectory within each DB.

2.2.2. Internalizing Problems

Measures of internalizing problems were based on maternal ratings of items originating from the Preschool Behavior Questionnaire [52] and the Child Behavior Checklist 2/3 [53] and were previously used in large population studies [24,54,55,56]. The items describe manifestations of anxiety, separation anxiety, and emotional or depressive problems; if the child is too fearful or anxious; is worried; cries a lot; is nervous or very tense; clings to adults or too dependent; does not want to sleep alone; reacts very badly away from his parents; seems unhappy or sad/not as happy as other children; has trouble having fun. Measures were collected at the same five assessment times as the DBs data from age 1.5 to 5 years. All items were rated on a 3-point scale: 0/never; 1/sometimes; and 2/often. Confirmatory factor analysis was used to assess the construct validity of a global measure of internalizing problems. The average fit indicators over the 5 assessment times were 0.056 (range: 0.05–0.06) for RMSEA, 0.88 (0.86–0.89) for CFI, 0.85 (0.83–0.86) for CLI, and 0.038 (0.03–0.04) for SRMR, indicating an overall acceptable fit. Average loading from factor analysis was 0.520 (range 0.500–0.545) across the 5 assessment times. Thus, items were summed into a global internalizing score at each assessment time. The average CR coefficient of internal consistency reliability across assessment times was 0.78 (range: 0.73–0.81). The average correlation between successive assessment times for the internalizing scale was 0.50 (range: 0.45–0.55, p < 0.001).

2.3. Data Analysis

Following previous studies investigating the link between individual characteristics and trajectories of DBs [4,5,11,24], we compared children on a high vs. a low or moderate trajectory of DBs. Thus, children in the high-DB trajectory classes (Figure 1)—either for a single DB (i.e., high—HIonly, NConly, or PAonly) or for co-occurrent DBs (high—HI+NC, NC+PA, HI+NC+PA)—were compared to a reference class (n = 1479) that aggregated their peers who followed low or moderate trajectories for all DBs across the preschool years. Of note, the moderate trajectory was the modal category, followed by the Low category, for all three DBs [3]. Class members’ posterior assignment probabilities to trajectory classes were used as sampling weights in the analysis to account for uncertainty in the assignment of individuals to trajectory classes [2,57].
On the basis of the data collected at the five assessment times for all children in the sample, a similar method to that used to estimate trajectory classes of DBs was performed for internalizing problems. To this end, latent class growth mixture modeling (LCGMM) in Mplus/version−8.6 [51] was used. In a first step, a latent growth curve model (LGCM) of children’s level and growth in internalizing problems across time was tested.
Interindividual variability in internalizing problems is estimated as the variance of the latent intercept (i.e., the initial level at time 1) and of the latent slope (i.e., change in behavior across assessment times). To assess this first model, where all individuals are essentially considered part of the same “class”, the significance levels of the mean and variance of the intercept, linear slope, and quadratic slope, as well as their covariance, were examined. The variances suggested significant heterogeneity within the sample with regard to children’s level (intercept) and the rate of change across time (slope) of the internalizing problems (see Section 3). Therefore, LCGMM (an extension of LGCM) was used to test whether a better fit would be obtained with the estimation of two or more latent classes of children who have different intercept or slopes of internalizing problems. To this end, subsequent models were tested sequentially, starting with comparing the fit of a 2-class model (k) to the initial 1-class model (k−1). If the 2-class model showed an improvement in fit, suggesting that aggregating individuals in 2 classes better fit the data than a single-class model, a 3-class model was tested, and so on. This was repeated until the k class model did not show a further improvement in fit, indicating that the prior model (k−1) would be the best-fitting model.
The LCGMM procedure was conducted in accordance with the recommended guidelines [58], testing different trajectory models starting with latent class growth analysis (LCGA, which assumes no intra-class variance within the distinct latent classes) to determine whether constraints can be applied to simplify the number of parameters. Model-fit was determined by (1) information criteria statistics: Akaike information criterion (AIC), Bayesian information criterion (BIC), and consistent Akaike information criterion (CAIC); (2) likelihood ratio test (LRT) and adjusted-LRT to identify the optimal number of classes; (3) two indicators of classification: entropy, which indexes class separation, and the average probabilities of assignment (APA) of individuals in trajectory classes (satisfactory when ≥0.70) [2]; and (4) relative class-size above 5% of the sample to avoid selecting an over extracted and potentially unstable class solution, most likely to be sample-specific with poor replicability [59].
In the last step, to examine the association between trajectory classes of DBs and trajectories of internalizing problems, multivariate analyses based on a generalized linear models (GLMs) platform were used. GLMs can be used alternately with normal or non-normal data with skewed distributions [60] and provide information criteria (IC) that include penalties for the number of model parameters, which leads to adjusted estimates. A model including sex and its potential interaction with DB trajectory classes was fit first to examine each term’s contribution within the multivariate context and to obtain IC representing initial fit statistics. For all IC, the smallest value indicates the best model. Models with IC differences of less than 2 provide little evidence for favoring one over the other, whereas a difference of 10 or more is considered strong evidence [61]. Based on estimates of predictor coefficients and significance levels and variations in fit statistics, the model was sequentially reduced to the most parsimonious combination of predictors (i.e., trajectory classes of DBs, with or without sex and their interaction) in association with trajectories of internalizing problems [62].

3. Results

3.1. Longitudinal Growth Curve Model and Trajectory Classes of Internalizing

The best-fitting growth curve model showed significant intercept (2.175, p < 0.001), linear (0.996, p < 0.001), and quadratic (−0.091, p < 0.001) slopes. This indicated that all three growth parameters were part of the model describing the sample’s development of internalizing behaviors over time. The variances of the intercept (3.79, p < 0.001) and of the linear (1.15, p < 0.001) and quadratic (0.037, p = 0.018) slopes were also statistically significant. In other words, there was significant heterogeneity among children in the initial level and course of internalizing problems. This finding justified extending the analyses to test whether a better fit would be obtained with the estimation of two or more latent classes of children with distinct levels and rates of internalizing problems growth.
Using LCGMM, one- through four-class models were tested, along with alternative link functions based on normal and censored normal distributions, given the positive skewness of the internalizing problems data. The best solution was a censored normal link-based three-class quadratic model, with a fixed variance–covariance matrix structure within classes (LCGA) and a fixed variance–covariance matrix structure across classes (Table 1). The fit of this model was better than those of models based on a normal distribution, free variance–covariance matrix structure within classes (growth mixture model) and linear parameterization. Despite the improvement in IC values and significant LRT results observed in the four-class model, its classification indicators were below the tolerance level for entropy (E = 0.66 < 0.70) and lower for APA (mean = 0.78, range: 0.72 – 0.84), and one of the classes represented only 2.2% (n = 46) of the sample. The comparison with the three-class solution (E = 0.72; mean APA = 0.85, range: 0.83 – 0.89) pointed to the latter as the best model for subsequent analyses.
The three trajectory classes of the selected model are shown in Figure 2. Overall, children in all three classes showed a fairly similar trend over time, although the curves become increasingly pronounced (or less flattened) from the lower trajectory class to the higher trajectory class. Specifically, a slight decline between 1.5 and 2.5 years for the two lower classes and a slight increase for the higher class were followed by a significant increase for all three classes up to age 3.5 years and then by relative stability until the age of 5 years. Trajectory classes clearly differed in their level of internalizing problems, particularly from age 2.5 years onwards. The low (49.5% sample; modal trajectory class) and moderate (43.7%) classes each had large proportions of participants with respective average scores below (T1–T5 Average: −0.62 SD) or somewhat above (0.48 SD) the sample mean, representing 93.2% of preschoolers. The third, high trajectory class included 6.8% of children, which were consistently rated well above (1.61 SD) the sample mean. Expressed in proportion of sample SD, the average difference between the low and moderate classes across times of assessment was 1.05 SD (range: 0.84–1.17), 1.18 (range: 0.76–1.48) between the moderate and high classes, and 2.23 (range: 1.60–2.63) between the low and high classes. There were no significant differences in the proportion of boys and girls across trajectory classes (X2(2) = 2.40, p = 0.30).

3.2. Associations between Trajectory Classes of DBs and Trajectory Classes of Internalizing Problems

Table 2 shows the proportion of children in the different trajectory classes of high DBs and in the DB reference trajectory class (i.e., children who followed a low or moderate trajectory for all DBs) who simultaneously followed a low, moderate, or high trajectory of internalizing problems from age 1.5 to 5 years. While the moderate internalizing class was the modal class for children of all high DB trajectory classes, a majority (56.0%) of children of the DB reference class were in the low internalizing problems class. Furthermore, at 3.7%, the proportion of children of the DB reference class simultaneously in the higher class of internalizing problems was lower than that observed for children of the high DB classes (range: 7.3–22.7%). Among the latter, children of the high—HI+NC and HI+NC+PA trajectory classes stand out, with 20.6% and 22.7%, respectively, also following a high trajectory of internalizing problems over the early childhood years compared to 10.4%, on average (range: 7.3–12.9%), for their peers in the other high DB trajectory classes.
To examine further the associations between trajectory classes of DBs and classes of internalizing problems, the former were used as the independent variable and the latter as the dependent variable in GLM analysis using sex as a covariate, along with its potential interaction with DB trajectory classes. The model including solely DB classes as a predictor of internalizing trajectory class showed a better fit (∆AIC = 1.886; ∆BIC = −37.517; ∆CAIC = −44.517) than the models that also included sex and/or its potential interaction with DB trajectory classes (see Table S2). This suggests that the associations between trajectory classes of DB and classes of internalizing problems did not vary between boys and girls. The odds ratios (OR) derived from the selected model are shown in Table 2. Children in all high DB trajectory classes showed higher odds of simultaneously following a moderate (rather than a low) trajectory of internalizing problems than their peers in the DB reference class (i.e., children who followed a low or moderate trajectory for all DBs), with average ORs of 1.97 for high single-DB classes and 2.66 for high concurrent DBs classes. They also showed higher odds of simultaneously following a high (rather than a low) trajectory of internalizing problems, with average ORs of 4.04 for high single-DB classes and 10.52 for high concurrent DBs classes. Children in trajectory classes of HI+NC (OR: 14.6) and HI+NC+PA (OR: 11.6) showed the highest odds. Finally, the odds of simultaneously following a high rather than a low or moderate trajectory of internalizing problems were, on average, 2.86 for high single-DB classes and 6.10 for high concurrent DBs classes compared to their peers in the DB reference class. Children in trajectory classes of HI+NC (OR: 6.85) and HI+NC+PA (OR: 7.75) showed the highest odds.
When grouping children into a concurrent high DB class and a single-high DB class (Figure 3), the ORs were 2.56 and 1.90, respectively (both at p < 0.001), simultaneously following a moderate (rather than a low) trajectory of internalizing problems, compared to their peers of the DB reference class—a non-significant (p = 0.391) difference in odds. Comparing the odds of the two aggregated classes to simultaneously following a high (rather than a low) trajectory of internalizing problems, the ORs were 10.90 and 3.83, respectively (p < 0.001)—a significant (p = 0.002) difference in odds. Finally, the ORs were 6.60 and 2.78, respectively (p < 0.001), simultaneously following a high trajectory of internalizing problems (rather than a low or moderate trajectory), compared to their peers of the DB reference class—a significant (p = 0.007) difference in odds.

4. Discussion

The aim of the present study was to investigate whether distinct developmental trajectories of DBs were concurrently and differentially associated with trajectories of internalizing problems in children from age 1.5 to 5 years. Overall, the findings are consistent with a multiple problem hypothesis, which posits that internalizing symptoms are positively associated with DBs [25]. Thus, the results with our population-representative sample did not provide evidence that internalizing problems may have a dampening effect (i.e., the buffer hypothesis) on the development of DBs. Specifically, children in all trajectory classes of high DBs were more likely to simultaneously follow a higher trajectory of internalizing problems throughout the early childhood years than their peers of the DB reference class following low or moderate DB trajectories. This finding was more marked for children in trajectory classes of high—HI+NC and HI+NC+PA and, on average, for those in DB trajectory classes of any high co-occurring DBs than for their peers in classes showing a single high-DB.
Thus, with regard to a differential association of internalizing problems with distinct types of DB, the results suggest that the two DB trajectory classes more likely to also follow the highest trajectory of internalizing problems were those comprising high HI+NC (i.e., HI+NC and HI+NC+PA). In comparison, the other class with co-occurring DBs, high NC+PA, showed odds of following a high internalizing trajectory closer to the range observe for single-high DB classes. These results suggest that a high level of HI combined with a high level of NC in young children is a pattern of DB likely to be associated with higher internalizing problems. This finding is consistent with prior reports suggesting that children struggling with negative emotionality [25,63,64], irritability [65,66], emotion regulation [67,68], or executive functions and effortful control [69,70] are more likely to show both externalizing and internalizing problems. Indeed, previous research found stronger associations of such endophenotypes representing heritable internal liabilities [71] with symptoms of either hyperactivity–inattention or opposition than with symptoms of aggression [38,72]. Consistent associations with internalizing symptoms were also observed [25,65,66]. Thus, among children with DB, those exhibiting high HI and NC may be more likely to struggle with both behavioral and emotional self-control. However, more research is needed in order to understand to what extent the specific endophenotypes involved in the mechanisms that underlie this early emotional–behavioral developmental pattern involve liabilities for experiencing negative emotions, for expressing discontent and anger in response to frustrations, or for difficulties managing emotions or behaviors.
Of note, although the present study was not designed to formally test this issue, the concurrent higher levels of internalizing problems observed in young children with high DBs levels from the age of 1.5 years provide very limited support for the hypothesis that one type of problems may precede the other at this early age period [25]. Rather, the results suggest that this co-occurrence is rooted earlier in children’s development, which likely involves intergenerational transmission through either or both genetic [16,19] and pre- to early-post-natal environmental risk factors, consistent with a developmental biopsychosocial perspective [42,43]. This early dual pathway is also consistent with the existence of a general, highly heritable underlying factor common to different forms of psychopathology, in addition to specific-second level factors influencing externalizing and internalizing problems [16,17,18]. Scholars have suggested that endophenotypes such as negative emotionality, irritability, emotion regulation, or effortful control discussed above in relation to DBs and internalizing problems [63,66,67,69,70] may be intermediates of this general factor’s influence on concurrent DBs and internalizing problems [18,19].
At the same time, on average, a third (33.2%) of children in high DBs trajectory classes (i.e., 37.5% in single high DB classes and 28.8% in high concurrent DBs classes, representing 9.3% of the sample) concurrently followed the modal low trajectory of internalizing problems, which includes nearly half (49.5%) of the sample. It is thus possible that some of these children develop later internalizing symptoms as a consequence of early life-course experiences tainted by their DBs problems, as suggested in previous reports [25]. Conversely, however, 3.7% of children in the reference class (following either a low or moderate trajectory for all DBs), representing 2.6% of the sample, concurrently followed the high trajectory of internalizing problems (6.8% sample). Thus, although the present study did not specifically test this, the results suggest that the likelihood of a significant proportion of children with high internalizing problems and without high DB in early childhood subsequently developing DBs is much less strong than the reverse, i.e., children with high DBs and without high internalizing in early childhood developing future internalizing problems. Future studies based on the long-term follow-up of young children, as well as studies across different developmental periods, are needed to clarify this issue.
Given the higher risk of later social maladjustment for youth showing concurrent DBs and internalizing problems [23,32], the present findings suggest that children showing a higher level of both DBs and internalizing problems from the second year of life onward are an important group to screen for a more comprehensive assessment and potentially to target for preventive intervention aimed at reducing early risk factors [73,74]. This seems to apply equally to both boys and girls, as no significant sex difference was found regarding the association between the DBs trajectories and trajectories of internalizing problems. Similar results were observed in preschool and elementary school children in prior reports [23,24,27]. However, as sex differences in internalizing problems are known to emerge later [75], it is possible that the association between concurrent patterns of DBs and internalizing problems differs over time for boys and girls, and this should be the focus of further research. In a related vein, future research should examine the extent to which different levels of concurrent DBs and internalizing problems in young children may be differentially associated with later outcomes. Such an investigation is important, as there is mixed evidence regarding the potential additive, synergetic, or buffering influence of high concurrent DBs and internalizing problems, for instance, with regard to adolescent substance use [36,37,76]. Such long-term follow-up may also help determine whether the early co-occurrence between the two types of problems represents an early manifestation of a specific developmental pathway toward later psychopathology or not.

Strengths and Limitations

The large population cohort and the longitudinal patterns based on multiple assessments to represent DBs and internalizing problems are important strengths of the present study. However, several limitations should be noted. First, relying essentially on parental reports to assess children’s DBs and internalizing problems may implicate participants’ self-presentation concerns, recall bias, or halo effect. However, as in other similar large-scale studies, there is no easily available alternative when assessing large population-based samples at this early age, and parental reports remain the most widely used method for surveys in the general population [4,56]. Of note, parental—often maternal—reports of young children’s behavioral and emotional well-being from the first year of life throughout early childhood have been consistently shown to be valid assessments, even at such an early age [63,77,78].
Second, despite the advantage provided by the longitudinal patterns, the method used requires the examination of the same behaviors across different time points, and there are obvious constraints regarding which behaviors could be reasonably and meaningfully assessed in children from age 1.5 to 5 years. However, other non-measured behaviors may have captured additional developmentally based distinctions among children. Third, as this was an exploratory study of the association between DBs trajectories and trajectories of internalizing problems, a global measure of the latter was used. As noted, this is consistent with previous reports of the association of DB with both global and discrete measures of internalizing problems, as well as the high comorbidity reported between the latter [24,29,44,45]. Thus, the results should be interpreted in this context and the potential specificity of such an association for one type of internalizing problem or another will require further investigation. Fourth, the results of LCGMM have been criticized for not being easily replicated across studies and samples [79]. The lack of methodological details provided in many studies and the disparity in samples, criteria, and indicators used likely account for this difficulty in replication [79]. Hence, we followed the recommendations for conducting analyses and reporting in latent trajectory studies, such as reporting on preliminary steps of analysis and on alternative models tested and using a range of indices and criteria when enumerating classes [58]. Fifth, this study was based on a North American population sample of predominantly white and mostly French-speaking families of European ancestry. Replications are needed to examine the generalizability of the results to different populations and children of diverse cultural and social backgrounds.
The results of the present study, which jointly examined the longitudinal patterns of DBs and the concurrent patterns of internalizing problems throughout early childhood, suggest that these two types of problems in children develop concurrently from the age of 1.5 onwards. Thus, the findings support a multiple problem hypothesis regarding the early association between DBs and internalizing problems [25]. They also highlight the importance of considering the developmental co-occurrence between these two types of problems when studying either construct in children [80]. Future studies across diverse populations, developmental stages, and subgroups of individuals may help elucidate the discrepancies between reports regarding the competing “multiple problem” or “buffer” hypotheses [25,27], explaining the association between disruptive behaviors and internalizing problems in children.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/bs14070571/s1, Table S1: Socioeconomic characteristics of the families at the first assessment time; Table S2: Results of GLM model testing for the association between trajectory classes of DBs and trajectory classes of internalizing problems.

Author Contributions

Conceptualization, R.C.; methodology, R.C.; software, R.C.; validation, R.C. and F.V.; formal analysis, R.C.; investigation, R.C., F.V. and M.B. (Mara Brendgen); resources, F.V., M.B. (Michel Boivin) and R.E.T.; data curation, R.C.; writing—original draft preparation, R.C.; writing—review and editing, R.C., F.V. and M.B. (Mara Brendgen); visualization, R.C.; project administration, M.B. (Michel Boivin) and R.E.T.; funding acquisition, M.B. (Michel Boivin) and R.E.T. All authors have read and agreed to the published version of the manuscript.

Funding

Quebec Government Ministry of Health, Fond Quebecois de la Recherche sur la Societe et la Culture, Canada’s Social Science and Humanities Research Council, Canadian Institutes of Health Research.

Institutional Review Board Statement

The study design was reviewed and ethical approval for all aspects of the study was provided by the Institutional Review Board of the University of Montreal and the Institut de la statistique du Québec for phases I and II of the Quebec Longitudinal Study of Child Development (QLSCD). This study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of the Quebec Institute of Statistics.

Informed Consent Statement

Informed written consent of the participants was obtained separately for each assessment wave.

Data Availability Statement

Data used in the present study are owned by Gouvernement du Québec and are under the responsibility of Institut de la statistique du Québec. Data cannot be shared publicly and are protected by the ACCESS TO INFORMATION ACT (Québec), as indicated in the consent form signed by the participants and approved by the Ethics Committee of Santé Québec Division. Data are available from the Centre d’accès aux données de recherche de l’Institut de la Statistique du Québec (CADRISQ) for researchers who meet the criteria for access to confidential data. Please contact Nancy Illick: [email protected]. See also: http://www.jesuisjeserai.stat.gouv.qc.ca/informations_chercheurs/acces_an.html.

Acknowledgments

We thank the families and teachers of the Quebec Longitudinal Study of Child Development (QLSCD) for their collaboration to this project, as well as the Quebec Institute of Statistics, Mireille Jetté, and the staff of the Research Unit on Children’s Psychosocial Maladjustment for data collection and management.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Muthén, B.; Muthén, L.K. Integrating Person-Centered and Variable-Centered analyses: Growth mixture modeling with latent trajectory classes. Alcohol./Alcohol. Clin. Exp. Res. 2000, 24, 882–891. [Google Scholar] [CrossRef] [PubMed]
  2. Nagin, D.S. Group-Based Modeling of Development; Harvard University Press: Cambridge, MA, USA, 2005. [Google Scholar]
  3. Carbonneau, R.; Boivin, M.; Brendgen, M.; Nagin, D.S.; Tremblay, R.E. Comorbid Development of Disruptive Behaviors from age 1½ to 5 Years in a Population Birth-Cohort and Association with School Adjustment in First Grade. J. Abnorm. Child Psychol. 2016, 44, 677–690. [Google Scholar] [CrossRef] [PubMed]
  4. Côté, S.; Vaillancourt, T.; LeBlanc, J.C.; Nagin, D.S.; Tremblay, R.E. The Development of Physical Aggression from Toddlerhood to Pre-Adolescence: A Nation Wide Longitudinal Study of Canadian Children. J. Abnorm. Child Psychol. 2006, 34, 68–82. [Google Scholar] [CrossRef] [PubMed]
  5. Galéra, C.; Côté, S.M.; Bouvard, M.P.; Pingault, J.-B.; Melchior, M.; Michel, G.; Boivin, M.; Tremblay, R.E. Early risk factors for Hyperactivity-Impulsivity and inattention trajectories from age 17 months to 8 years. Arch. Gen. Psychiatry 2011, 68, 1267. [Google Scholar] [CrossRef] [PubMed]
  6. Gutman, L.M.; Joshi, H.; Schoon, I. Developmental Trajectories of Conduct Problems and Cumulative Risk from Early Childhood to Adolescence. J. Youth Adolesc. 2019, 48, 181–198. [Google Scholar] [CrossRef] [PubMed]
  7. Miner, J.L.; Clarke-Stewart, K.A. Trajectories of externalizing behavior from age 2 to age 9: Relations with gender, temperament, ethnicity, parenting, and rater. Dev. Psychol. 2008, 44, 771–786. [Google Scholar] [CrossRef] [PubMed]
  8. NICHD Early Child Care Research Network. Trajectories of Physical Aggression from Toddlerhood to Middle School: Predictors, correlates, and outcomes. Monogr. Soc. Res. Child Dev. 2004, 69, 1–129. [Google Scholar]
  9. Petitclerc, A.; Boivin, M.; Dionne, G.; Zoccolillo, M.; Tremblay, R.E. Disregard for rules: The early development and predictors of a specific dimension of disruptive behavior disorders. J. Child Psychol. Psychiatry Allied Discip. 2009, 50, 1477–1484. [Google Scholar] [CrossRef] [PubMed]
  10. Pingault, J.; Tremblay, R.E.; Vitaro, F.; Carbonneau, R.; Génolini, C.; Falissard, B.; Côté, S. Childhood Trajectories of Inattention and Hyperactivity and Prediction of Educational Attainment in Early Adulthood: A 16-Year Longitudinal Population-Based Study. Am. J. Psychiatry 2011, 168, 1164–1170. [Google Scholar] [CrossRef]
  11. Shaw, D.S.; Lacourse, É.; Nagin, D.S. Developmental trajectories of conduct problems and hyperactivity from ages 2 to 10. J. Child Psychol. Psychiatry Allied Discip. 2005, 46, 931–942. [Google Scholar] [CrossRef]
  12. Teymoori, A.; Côté, S.; Jones, B.; Nagin, D.S.; Boivin, M.; Vitaro, F.; Orri, M.; Tremblay, R.E. Risk factors associated with boys’ and girls’ developmental trajectories of physical aggression from early childhood through early adolescence. JAMA Netw. Open 2018, 1, e186364. [Google Scholar] [CrossRef] [PubMed]
  13. Tremblay, R.E.; Nagin, D.S.; Séguin, J.R.; Zoccolillo, M.; Zelazo, P.D.; Boivin, M.; Pérusse, D.; Japel, C. Physical aggression during Early Childhood: Trajectories and predictors. Pediatrics 2004, 114, e43–e50. [Google Scholar] [CrossRef] [PubMed]
  14. Finsaas, M.C.; Bufferd, S.J.; Dougherty, L.R.; Carlson, G.A.; Klein, D.N. Preschool psychiatric disorders: Homotypic and heterotypic continuity through middle childhood and early adolescence. Psychol. Med. 2018, 48, 2159–2168. [Google Scholar] [CrossRef] [PubMed]
  15. Lévy, F.; Hawes, D.J.; Johns, A. Externalizing and internalizing comorbidity. In The Oxford Handbook of Externalizing Spectrum Disorders; Beauchaine, T.P., Hinshaw, S.P., Eds.; Oxford University Press: Oxford, UK, 2016; pp. 443–460. [Google Scholar]
  16. Lahey, B.B.; Moore, T.M.; Kaczkurkin, A.N.; Zald, D.J. Hierarchical models of psychopathology: Empirical support, implications, and remaining issues. World Psychiatry 2021, 20, 57–63. [Google Scholar] [CrossRef] [PubMed]
  17. Forbes, M.K.; Tackett, J.L.; Markon, K.E.; Krueger, R.F. Beyond comorbidity: Toward a dimensional and hierarchical approach to understanding psychopathology across the life span. Dev. Psychopathol. 2016, 28 Pt 1, 971–986. [Google Scholar] [CrossRef] [PubMed]
  18. Tully, E.C.; Iacono, W.G. An integrative common liabilities model for the comorbidity of substance use disorders with externalizing and internalizing disorders. In The Oxford Handbook of Substance Use and Substance Use Disorders; Sher, K.J., Ed.; Oxford University Press: Oxford, UK, 2016; pp. 187–212. [Google Scholar]
  19. Rhee, S.H.; Lahey, B.B.; Waldman, I.D. Comorbidity among Dimensions of Childhood Psychopathology: Converging Evidence from Behavior Genetics. Child Dev. Perspect. 2014, 9, 26–31. [Google Scholar] [CrossRef] [PubMed]
  20. Bubier, J.L.; Drabick, D.A. Co-occurring anxiety and disruptive behavior disorders: The roles of anxious symptoms, reactive aggression, and shared risk processes. Clin. Psychol. Rev. 2009, 29, 658–669. [Google Scholar] [CrossRef]
  21. Gilliom, M.; Shaw, D.S. Codevelopment of externalizing and internalizing problems in early childhood. Dev. Psychopathol. 2004, 16, 313–333. [Google Scholar] [CrossRef] [PubMed]
  22. Moilanen, K.L.; Shaw, D.S.; Maxwell, K.L. Developmental cascades: Externalizing, internalizing, and academic competence from middle childhood to early adolescence. Dev. Psychopathol. 2010, 22, 635–653. [Google Scholar] [CrossRef]
  23. Papachristou, E.; Flouri, E. The codevelopment of internalizing symptoms, externalizing symptoms, and cognitive ability across childhood and adolescence. Dev. Psychopathol. 2019, 32, 1375–1389. [Google Scholar] [CrossRef]
  24. Carbonneau, R.; Vitaro, F.; Brendgen, M.; Boivin, M.; Tremblay, R.E. Internalizing problems associated with developmental patterns of single and co-occurrent externalizing behaviors over the preschool years. Dev. Psychol. 2024. [Google Scholar] [CrossRef]
  25. Drabick, D.G.; Ollendick, T.H.; Bubier, J.L. Co-occurrence of ODD and anxiety: Shared risk processes and evidence for a dual-pathway model. Clin. Psychol. 2010, 17, 307–318. [Google Scholar] [CrossRef]
  26. Isdahl-Troye, A.; Villar, P.; Domínguez-Álvarez, B.; Romero, E.; Deater-Deckard, K. The Development of Co-Occurrent Anxiety and Externalizing Problems from Early Childhood: A Latent Transition Analysis Approach. Res. Child Adolesc. Psychopathol. 2021, 50, 505–519. [Google Scholar] [CrossRef]
  27. Mahendran, N.; Aitken, M.; Andrade, B.F. Comorbid Internalizing Symptoms in Children with Disruptive Behavior Disorders: Buffering Effects or Multiple Problem Effects? J. Child Fam. Stud. 2021, 30, 474–482. [Google Scholar] [CrossRef]
  28. Øvergaard, K.R.; Aase, H.; Torgersen, S.; Reichborn-Kjennerud, T.; Oerbeck, B.; Myhre, A.M.; Zeiner, P. Continuity in features of anxiety and attention deficit/hyperactivity disorder in young preschool children. Eur. Child Adolesc. Psychiatry 2014, 23, 743–752. [Google Scholar] [CrossRef]
  29. Wichström, L.; Berg-Nielsen, T.S.; Angold, A.; Egger, H.L.; Solheim, E.; Sveen, T.H. Prevalence of psychiatric disorders in preschoolers. J. Child Psychol. Psychiatry Allied Discip. 2012, 53, 695–705. [Google Scholar] [CrossRef] [PubMed]
  30. Ezpeleta, L.; Granero, R.; De La Osa, N.; Penelo, E.; Domènech, J. Dimensions of oppositional defiant disorder in 3-year-old preschoolers. J. Child Psychol. Psychiatry Allied Discip. 2012, 53, 1128–1138. [Google Scholar] [CrossRef]
  31. Halldorsdottir, T.; Fraire, M.G.; Drabick, D.a.G.; Ollendick, T.H. Co-Occurring Conduct Problems and Anxiety: Implications for the Functioning and Treatment of Youth with Oppositional Defiant Disorder. Int. J. Environ. Res. Public Health 2023, 20, 3405. [Google Scholar] [CrossRef] [PubMed]
  32. Fanti, K.A.; Henrich, C.C. Trajectories of pure and co-occurring internalizing and externalizing problems from age 2 to age 12: Findings from the National Institute of Child Health and Human Development Study of Early Child Care. Dev. Psychol. 2010, 46, 1159–1175. [Google Scholar] [CrossRef]
  33. BīLgīÇ, A.; Türkoğlu, S.; Özcan, Ö.; Tufan, A.E.; Savaş, Y.; Yüksel, T. Relationship between anxiety, anxiety sensitivity and conduct disorder symptoms in children and adolescents with attention-deficit/hyperactivity disorder (ADHD). Eur. Child Adolesc. Psychiatry 2013, 22, 523–532. [Google Scholar] [CrossRef]
  34. Haines, N.; Beauchaine, T.P.; Galdo, M.; Rogers, A.H.; Hahn, H.; Pitt, M.A.; Myung, J.I.; Turner, B.M.; Ahn, W.-Y. Anxiety modulates preference for immediate rewards among trait-impulsive individuals: A hierarchical Bayesian analysis. Clin. Psychol. Sci. 2020, 8, 1017–1036. [Google Scholar] [CrossRef]
  35. Kotelnikova, Y.; Mackrell, S.V.M.; Clark, L.A.; Hayden, E.P. A longitudinal, multimethod study of children’s early emerging maladaptive personality traits: Stress sensitivity as a protective factor. J. Res. Personal. 2024, 109, 104448. [Google Scholar] [CrossRef]
  36. Carbonneau, R.; Vitaro, F.; Brendgen, M.; Tremblay, R.E. Alcohol, Marijuana and Other Illicit Drugs Use Throughout Adolescence: Co-occurring Courses and Preadolescent Risk-Factors. Child Psychiatry Hum. Dev. 2022, 53, 1194–1206. [Google Scholar] [CrossRef] [PubMed]
  37. Colder, C.R.; Scalco, M.; Trucco, E.M.; Read, J.P.; Lengua, L.J.; Wieczorek, W.F.; Hawk, L.W., Jr. Prospective associations of internalizing and externalizing problems and their co-occurrence with early adolescent substance use. J. Abnorm. Child Psychol. 2013, 41, 667–677. [Google Scholar] [CrossRef] [PubMed]
  38. Polier, G.G.; Herpertz-Dahlmann, B.; Matthias, K.; Konrad, K.; Vloet, T.D. Associations between trait anxiety and psychopathological characteristics of children at high risk for severe antisocial development. Adhd Atten. Deficit Hyperact. Disord. 2010, 2, 185–193. [Google Scholar] [CrossRef] [PubMed]
  39. Mesman, J.; Bongers, I.L.; Koot, H.M. Preschool Developmental Pathways to preadolescent internalizing and externalizing problems. J. Child Psychol. Psychiatry Allied Discip. 2001, 42, 679–689. [Google Scholar] [CrossRef]
  40. Martín, V.; Granero, R.; Ezpeleta, L. Comorbidity of oppositional defiant disorder and anxiety disorders in preschoolers. Psicothema 2014, 26, 27–32. [Google Scholar] [PubMed]
  41. Angold, A.; Costello, E.J.; Erkanli, A. Comorbidity. J. Child Psychol. Psychiatry 1999, 40, 57–87. [Google Scholar] [CrossRef] [PubMed]
  42. Carbonneau, R.; Tremblay, R.E. Antisocial Behavior Prevention: Toward a developmental biopsychosocial perspective. In Clinical Forensic Psychology: Introductory Perspectives on Offending; Garofalo, C., Sijtsema, J.J., Eds.; Palgrave Macmillan: London, UK, 2022; pp. 29–47. [Google Scholar]
  43. Tremblay, R.E.; Vitaro, F.; Côté, S. Developmental Origins of Chronic Physical Aggression: A Bio-Psycho-Social model for the next generation of Preventive Interventions. Annu. Rev. Psychol. 2018, 69, 383–407. [Google Scholar] [CrossRef] [PubMed]
  44. Bufferd, S.J.; Dougherty, L.R.; Carlson, G.A.; Klein, D.N. Parent-reported mental health in preschoolers: Findings using a diagnostic interview. Compr. Psychiatry 2011, 52, 359–369. [Google Scholar] [CrossRef]
  45. Tandon, M.; Cardeli, E.; Luby, J. Internalizing disorders in early childhood: A review of depressive and anxiety disorders. Child Adolesc. Psychiatr. Clin. N. Am. 2009, 18, 593–610. [Google Scholar] [CrossRef] [PubMed]
  46. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Erlbaum: Hillsdale, NJ, USA, 1988. [Google Scholar]
  47. Sawilowsky, S.S. New effect size rules of thumb. J. Mod. Appl. Stat. Methods 2009, 8, 597–599. [Google Scholar] [CrossRef]
  48. Simms, U.; Watson, D. The construct validation approach to personality scale construction. In Handbook of Research Methods in Personality Psychology; Robins, R.W., Frayley, R.C., Kruger, R.F., Eds.; Guilford Press: New York, NY, USA, 2007; pp. 240–258. [Google Scholar]
  49. Raykov, T. Estimation of composite reliability for congeneric measures. Appl. Psychol. Meas. 1997, 21, 173–184. [Google Scholar] [CrossRef]
  50. Fornell, C.; Larcker, D.F. Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. J. Mark. Res. 1981, 18, 382–388. [Google Scholar] [CrossRef]
  51. Muthén, L.K.; Muthén, B.O. Mplus User’s Guide, 8th ed.; Muthén & Muthén: Los Angeles, CA, USA, 1998–2017. [Google Scholar]
  52. Behar, L.; Stringfield, S. A behavior rating scale for the preschool child. Dev. Psychol. 1974, 10, 601–610. [Google Scholar] [CrossRef]
  53. Achenbach, T.M. Child Behavior Checklist; Department of Psychiatry, University of Vermont: Burlington, VT, USA, 1991. [Google Scholar]
  54. Battaglia, M.; Touchette, É.; Garon-Carrier, G.; Dionne, G.; Côté, S.M.; Vitaro, F.; Tremblay, R.E.; Boivin, M. Distinct trajectories of separation anxiety in the preschool years: Persistence at school entry and early-life associated factors. J. Child Psychol. Psychiatry 2016, 57, 39–46. [Google Scholar] [CrossRef] [PubMed]
  55. Côté, S.; Boivin, M.; Liu, X.; Nagin, D.S.; Zoccolillo, M.; Tremblay, R.E. Depression and anxiety symptoms: Onset, developmental course and risk factors during early childhood. J. Child Psychol. Psychiatry Allied Discip. 2009, 50, 1201–1208. [Google Scholar] [CrossRef] [PubMed]
  56. Zdebik, M.A.; Boivin, M.; Battaglia, M.; Tremblay, R.E.; Falissard, B.; Côté, S. Childhood multi-trajectories of shyness, anxiety and depression: Associations with adolescent internalizing problems. J. Appl. Dev. Psychol. 2019, 64, 101050. [Google Scholar] [CrossRef]
  57. Clark, S.L.; Muthen, B. Relating Latent Class Analysis Results to Variables Not Included in the Analysis. 2009. Available online: http://www.statmodel.com/download/Relatinglca.pdf (accessed on 28 June 2024).
  58. Wickrama, K.S.; Lee, T.K.; O’Neal, C.W.; Lorenz, F.O. Higher-Order Growth Curves and Mixture Modeling with Mplus; Routledge: New York, NY, USA, 2022. [Google Scholar]
  59. Nylund-Gibson, K.; Choi, A.Y. Ten frequently asked questions about latent class analysis. Transl. Issues Psychol. Sci. 2018, 4, 440–461. [Google Scholar] [CrossRef]
  60. Hardin, J.W.; Hilbe, J.M. Generalized Linear Models and Extensions, 4th ed.; Stata Press: College Station, TX, USA, 2018. [Google Scholar]
  61. Dziak, J.J.; Coffman, D.L.; Lanza, S.T.; Li, R.; Jermiin, L.S. Sensitivity and specificity of information criteria. Brief. Bioinform. 2020, 21, 553–565. [Google Scholar] [CrossRef]
  62. Burnham, K.P.; Anderson, D.R. Model Selection and Multimodel Inference, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 2002. [Google Scholar]
  63. Kostyrka-Allchorne, K.; Wass, S.V.; Sonuga-Barke, E.J.S. Research Review: Do parent ratings of infant negative emotionality and self-regulation predict psychopathology in childhood and adolescence? A systematic review and meta-analysis of prospective longitudinal studies. J. Child Psychol. Psychiatry 2020, 61, 401–416. [Google Scholar] [CrossRef] [PubMed]
  64. Lilienfeld, S.O. Comorbidity between and within childhood externalizing and internalizing disorders: Reflections and directions. J. Abnorm. Child Psychol. 2003, 31, 285–291. [Google Scholar] [CrossRef] [PubMed]
  65. Beauchaine, T.P.; Tackett, J.L. Irritability as a Transdiagnostic Vulnerability Trait: Current Issues and Future Directions. Behav. Ther. 2020, 51, 350–364. [Google Scholar] [CrossRef] [PubMed]
  66. Finlay-Jones, A.L.; Ang, J.E.; Brook, J.; Lucas, J.D.; MacNeill, L.A.; Mancini, V.O.; Kottampally, K.; Elliott, C.; Smith, J.D.; Wakschlag, L.S. Systematic Review and Meta-Analysis: Early Irritability as a Transdiagnostic Neurodevelopmental Vulnerability to Later Mental Health Problems. J. Am. Acad. Child Adolesc. Psychiatry 2024, 63, 184–215. [Google Scholar] [CrossRef] [PubMed]
  67. Aldao, A.; Gee, D.G.; De Los Reyes, A.; Seager, I. Emotion regulation as a transdiagnostic factor in the development of internalizing and externalizing psychopathology: Current and future directions. Dev. Psychopathol. 2016, 28 Pt 1, 927–946. [Google Scholar] [CrossRef]
  68. Fraire, M.G.; Ollendick, T.H. Anxiety and Oppositional Defiant Disorder: A Transdiagnostic Conceptualization. Clin. Psychol. Rev. 2013, 33, 229–240. [Google Scholar] [CrossRef] [PubMed]
  69. Santens, E.; Claes, L.; Dierckx, E.; Dom, G. Effortful control—A transdiagnostic dimension underlying internalizing and externalizing psychopathology. Neuropsychobiology 2020, 79, 255–269. [Google Scholar] [CrossRef]
  70. Shields, A.N.; Reardon, K.W.; Brandes, C.M.; Tackett, J.L. The p factor in children: Relationships with executive functions and effortful control. J. Res. Pers. 2019, 82, 103853. [Google Scholar] [CrossRef]
  71. Kendler, K.S.; Neale, M.C. Endophenotype: A conceptual analysis. Mol. Psychiatry 2010, 15, 789–797. [Google Scholar] [CrossRef]
  72. Atherton, O.E.; Lawson, K.M.; Ferrer, E.; Robins, R.W. The role of effortful control in the development of ADHD, ODD, and CD symptoms. J. Pers. Soc. Psychol. 2020, 118, 1226–1246. [Google Scholar] [CrossRef]
  73. Latimer, K.; Wilson, P.; Kemp, J.; Thompson, L.; Sim, F.; Gillberg, C.; Puckering, C.; Minnis, H. Disruptive behaviour disorders: A systematic review of environmental antenatal and early years risk factors. Child Care Health Dev. 2012, 38, 611–628. [Google Scholar] [CrossRef] [PubMed]
  74. Dong, X.; Burke, M.D.; Ramirez, G.; Xu, Z.; Bowman-Perrott, L. A Meta-Analysis of Social Skills Interventions for Preschoolers with or at Risk of Early Emotional and Behavioral Problems. Behav. Sci. 2023, 13, 940. [Google Scholar] [CrossRef] [PubMed]
  75. Martel, M.M. Sexual selection and sex differences in the prevalence of childhood externalizing and adolescent internalizing disorders. Psychol. Bull. 2013, 139, 1221–1259. [Google Scholar] [CrossRef] [PubMed]
  76. Rothenberg, W.A.; Lansford, J.E.; Chang, L.; Deater-Deckard, K.; Di Giunta, L.; Dodge, K.A.; Malone, P.S.; Oburu, P.; Pastorelli, C.; Skinner, A.T.; et al. Examining the internalizing pathway to substance use frequency in 10 cultural groups. Addict. Behav. 2020, 102, 106214. [Google Scholar] [CrossRef] [PubMed]
  77. Carter, A.S.; Briggs-Gowan, M.J.; Davis, N. Assessment of young children’s social-emotional development and psychopathology: Recent advances and recommendations for practice. J. Child Psychol. Psychiatry 2004, 45, 109–134. [Google Scholar] [CrossRef] [PubMed]
  78. Biedzio, D.; Wakschlag, L.S. Developmental emergence of disruptive behaviors beginning in infancy: Delineating normal-abnormal boundaries to enhance early identification. In Handbook of Infant Mental Health, 4th ed.; Zeenah, C., Ed.; Chapter 24; Guilford: New York, NY, USA, 2019. [Google Scholar]
  79. Petersen, K.; Qualter, P.; Humphrey, N. The Application of Latent Class Analysis for Investigating Population Child Mental Health: A Systematic review. Front. Psychol. 2019, 10, 1214. [Google Scholar] [CrossRef]
  80. Achenbach, T.M.; Ivanova, M.Y.; Rescorla, L.A.; Turner, L.V.; Althoff, R.R. Internalizing-externalizing problems: Review and recommendations for clinical and research applications. J. Am. Acad. Child Adolesc. Psychiatry 2016, 55, 647–656. [Google Scholar] [CrossRef]
Behavsci 14 00571 g001
Figure 1. Observed standardized means1 for high single and co-occurrent trajectory classes of DBs from age 1.5 to 5 years Adapted from [3] Carbonneau et al., 2016 (http://creativecommons.org/licenses/by/4.0/, accessed on 28 June 2024). HI: hyperactivity–impulsivity; NC: non-compliance; PA: physical aggression. The co-occurrent trajectory class of HI+PA (i.e., without high NC) was not part of the observed joint trajectory classes. 1 Standardized scores. 2 % sample: girls; boys. From 1.5 to 5 years, the mean of the reference class (n = 1479; not shown above) ranged from −0.20 to −0.33 (average: −0.29) for HI, from −0.16 to −0.33 (average: −0.28) for NC, and from −0.23 to −0.28 (average: −0.31) for PA.
Figure 1. Observed standardized means1 for high single and co-occurrent trajectory classes of DBs from age 1.5 to 5 years Adapted from [3] Carbonneau et al., 2016 (http://creativecommons.org/licenses/by/4.0/, accessed on 28 June 2024). HI: hyperactivity–impulsivity; NC: non-compliance; PA: physical aggression. The co-occurrent trajectory class of HI+PA (i.e., without high NC) was not part of the observed joint trajectory classes. 1 Standardized scores. 2 % sample: girls; boys. From 1.5 to 5 years, the mean of the reference class (n = 1479; not shown above) ranged from −0.20 to −0.33 (average: −0.29) for HI, from −0.16 to −0.33 (average: −0.28) for NC, and from −0.23 to −0.28 (average: −0.31) for PA.
Behavsci 14 00571 g001
Behavsci 14 00571 g002
Figure 2. Trajectory classes1 of internalizing problems from age 1.5 to 5 years (n = 2057). 1: % girls (G); boys (B). Low trajectory: G: 47.9; B: 52.1. Moderate trajectory: G: 51.2; B: 48.8. High trajectory: G: 47.1; B: 52.9. Sample: G: 49.3; B: 50.7.
Figure 2. Trajectory classes1 of internalizing problems from age 1.5 to 5 years (n = 2057). 1: % girls (G); boys (B). Low trajectory: G: 47.9; B: 52.1. Moderate trajectory: G: 51.2; B: 48.8. High trajectory: G: 47.1; B: 52.9. Sample: G: 49.3; B: 50.7.
Behavsci 14 00571 g002
Behavsci 14 00571 g003
Figure 3. Estimated odds of simultaneously following a moderate or a high trajectory of internalizing problems from age 1.5 to 5 years in comparison to the reference class.
Figure 3. Estimated odds of simultaneously following a moderate or a high trajectory of internalizing problems from age 1.5 to 5 years in comparison to the reference class.
Behavsci 14 00571 g003
Table 1. Results from LCGMM analysis of internalizing problems from age 1.5 to 5 years.
Table 1. Results from LCGMM analysis of internalizing problems from age 1.5 to 5 years.
ModelLCGALCGMM
DistributionNormalCensored NormalCensored Normal
Fit IndicatorsThree classesFour classesThree classesFour classes3-classes
AIC44,193.0943,993.9843,535.3543,415.2343,547.35
BIC44,283.1544,106.5643,625.4143,527.8143,671.19
SSA-BIC44,232.3244,043.0243,574.5843,464.2643,601.29
VLMR-LRT (p)0.0030.0030.0340.0030.035
LMR-ALRT (p)0.0040.0030.0370.0030.036
Entropy0.740.740.720.660.70
Table 2. Proportion (%) of children in sample, high DB, or DB reference trajectory classes following a low, moderate, or high trajectory of internalizing problems from age 1.5 to 5 years, and estimated odds of following a moderate or high internalizing trajectory in comparison to children of the DB reference class.
Table 2. Proportion (%) of children in sample, high DB, or DB reference trajectory classes following a low, moderate, or high trajectory of internalizing problems from age 1.5 to 5 years, and estimated odds of following a moderate or high internalizing trajectory in comparison to children of the DB reference class.
DB Trajectory Classes (n)Trajectory Classes of
Internalizing Problems		Moderate vs. LowHigh vs. LowHigh vs. Low or Moderate
Low (1019)Moderate (899)High (139)Sig.OROR 95% CISig.OROR 95% CISig.OROR 95% CI
DB reference class 1 (1479)56.040.43.7
HIonly (67)34.356.79.00.0022.291.35–3.890.0044.001.56–10.240.0342.601.08–6.27
NConly (93)36.650.512.90.0051.921.22–3.02<0.0015.412.65–11.05<0.0013.912.01–7.60
PAonly (123)41.551.27.30.0061.711.17–2.520.0102.711.27–5.790.0492.081.03–4.33
HI+NC (97)21.657.720.6<0.0013.702.22–6.17<0.00114.607.46–28.58<0.0016.853.91–12.02
NC+PA (57)35.152.612.30.0132.081.17–3.70<0.0015.372.17–13.250.0023.691.60–8.53
HI+NC+PA (141)29.847.522.7<0.0012.211.48–3.30<0.00111.66.84–19.97<0.0017.754.80–12.50
Sample (2057)49.543.76.8
Odds ratio (OR): Estimated odds of following a moderate or high trajectory of internalizing problems versus a low trajectory, and a high versus a low or moderate trajectory. 1: The DB reference class includes children who followed a low or moderate trajectory for all DBs.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Carbonneau, R.; Vitaro, F.; Brendgen, M.; Boivin, M.; Tremblay, R.E. Are Children Following High Trajectories of Disruptive Behaviors in Early Childhood More or Less Likely to Follow Concurrent High Trajectories of Internalizing Problems? Behav. Sci. 2024, 14, 571. https://doi.org/10.3390/bs14070571

AMA Style

Carbonneau R, Vitaro F, Brendgen M, Boivin M, Tremblay RE. Are Children Following High Trajectories of Disruptive Behaviors in Early Childhood More or Less Likely to Follow Concurrent High Trajectories of Internalizing Problems? Behavioral Sciences. 2024; 14(7):571. https://doi.org/10.3390/bs14070571

Chicago/Turabian Style

Carbonneau, Rene, Frank Vitaro, Mara Brendgen, Michel Boivin, and Richard E. Tremblay. 2024. "Are Children Following High Trajectories of Disruptive Behaviors in Early Childhood More or Less Likely to Follow Concurrent High Trajectories of Internalizing Problems?" Behavioral Sciences 14, no. 7: 571. https://doi.org/10.3390/bs14070571

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop