Next Article in Journal
A Digital Math Game and Multiple-Try Use with Primary Students: A Sex Analysis on Motivation and Learning
Previous Article in Journal
Clear Yet Crossed: Athletes’ Retrospective Reports of Coach Violence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Childhood Environmental Instabilities and Their Behavioral Implications: A Machine Learning Approach to Studying Adverse Childhood Experiences

by
Priscilla Mansah Codjoe
1,*,†,
Nii Adjetey Tawiah
2,† and
Daniel Alhassan
3
1
College of Arts and Sciences, Southern Illinois University Edwardsville, Campus Box 1653, Edwardsville, IL 62026, USA
2
College of Humanities, Education and Social Sciences, Delaware State University, 1200 N. DuPont Highway, Dover, DE 19901, USA
3
Wells Fargo, 11625 N. Community Hse Rd, Charlotte, NC 28277, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Behav. Sci. 2024, 14(6), 487; https://doi.org/10.3390/bs14060487
Submission received: 21 April 2024 / Revised: 27 May 2024 / Accepted: 4 June 2024 / Published: 8 June 2024
(This article belongs to the Section Child and Adolescent Psychiatry)

Abstract

:
Adverse childhood experiences (ACEs) include a range of abusive, neglectful, and dysfunctional household behaviors that are strongly associated with long-term health problems, mental health conditions, and societal difficulties. The study aims to uncover significant factors influencing ACEs in children aged 0–17 years and to propose a predictive model that can be used to forecast the likelihood of ACEs in children. Machine learning models are applied to identify and analyze the relationships between several predictors and the occurrence of ACEs. Key performance metrics such as AUC, F1 score, recall, and precision are used to evaluate the predictive strength of different factors on ACEs. Family structures, especially non-traditional forms such as single parenting, and the frequency of relocating to a new address are determined as key predictors of ACEs. The final model, a neural network, achieved an AUC of 0.788, a precision score of 0.683, and a recall of 0.707, indicating its effectiveness in accurately identifying ACE cases. The model’s ROC and PR curves showed a high true positive rate for detecting children with two or more ACEs while also pointing to difficulties in classifying single ACE instances accurately. Furthermore, our analysis revealed the intricate relationship between the frequency of relocation and other predictive factors. The findings highlight the importance of familial and residential stability in children’s lives, with substantial implications for child welfare policies and interventions. The study emphasizes the need for targeted educational and healthcare support to promote the well-being and resilience of at-risk children.

1. Introduction

Adverse childhood experiences (ACEs) are distressing events that happen during a person’s early years and tend to have long-lasting effects on their lives [1]. ACEs have emerged as a critical focus in public health research due to their profound implications on long-term health and psychological outcomes. Since Felitti, Anda, and their team’s landmark study in 1998, the scope of ACEs research has expanded significantly, revealing deeper connections between early life stressors and a multitude of adverse adult outcomes [1,2].
ACEs encompass various forms of abuse, neglect, and household dysfunction, which have been consistently linked to chronic health issues, mental illnesses, and social challenges [3,4]. Research has shown that ACEs are more prevalent in certain demographics, notably among economically disadvantaged or minority communities [5]. While the cumulative effect of multiple ACEs and their exacerbation of health issues is well-documented [6,7], there is a growing recognition of the need for early identification and trauma-informed intervention [8].
Research on ACEs has identified a range of traumatic experiences, including physical, emotional, and sexual abuse, household dysfunction, and various forms of neglect. These experiences have been linked to a wide array of negative outcomes, such as increased risk of mental health disorders, substance abuse, chronic diseases, and socio-economic challenges [9,10]. Studies have also highlighted the cumulative nature of ACEs, where an increase in the number of adverse experiences correlates with a heightened risk of negative health outcomes [2,11]. The prevalence of ACEs is notably higher in populations facing socio-economic disadvantages, indicating a clear link between childhood adversity and later life inequalities [5,12].
While a considerable volume of research has examined the direct impacts of ACEs, less attention has been given to the predictive factors that might predispose individuals to these experiences. Predominantly, factors such as socioeconomic status, family history of mental health issues or substance abuse, and exposure to violence have been identified as primary predictors of ACEs [13,14]. However, these factors often provide a limited view, neglecting the potential influence of more subtle and interactive elements like family structure, parental education level, and frequency of relocations to a new address.
There exists a notable gap in the literature regarding the complex interplay of these less-explored predictors. While traditional studies have acknowledged the individual impact of factors such as family structure and economic conditions, the complex interactions between these factors and their collective influence on the incidence of ACEs remain underexplored [13,15,16]. To address this gap, our study employs advanced machine learning techniques to dissect the combined predictive power of family structure, parental education levels, and the frequency of relocations to a new address, as well as other predictors, in relation to ACEs. This novel approach allows for the exploration of intricate patterns and interactions that traditional statistical methods might overlook, offering a more refined understanding of these predictors and their synergistic effects on ACEs.
The purpose of this study is to employ a machine learning methodology in identifying key factors that impact ACEs in children aged 0–17 years and to develop a predictive model to estimate the likelihood of ACEs.
The article is structured as follows: Section 2 details the data sources and methodological approach, emphasizing the use of machine learning for comprehensive analysis. Section 3 presents the results, focusing on the nuanced effects of family structure, parental education, and relocation frequency on ACEs. Section 4 and Section 5 contain the discussion and limitation of study respectively. Finally, the conclusion in Section 6 discusses the implications of these findings for future research, policy development, and intervention strategies in the realm of childhood adversities.

2. Materials and Methods

2.1. Data and Source

This study utilizes a secondary dataset from the National Survey of Children’s Health (NSCH), specifically focusing on data from the years 2018–2019. This dataset provides extensive insights into various aspects of the health and well-being of children aged 0–17 years in the United States of America. It is publicly accessible (accessed on 29 September 2021) on the NSCH website: https://www.childhealthdata.org/learn-about-the-nsch/NSCH (accessed on 20 April 2024). Initially comprising 59,963 cases, the dataset was refined to 59,077 cases after excluding those with missing cases in the outcome. This sample forms the basis of our analysis. The NSCH is known for its robust methodologies, including random sampling, stratification, and weighting, to achieve a nationally representative sample. Detailed information on data collection methods can be found in the NSCH codebook, available here: https://www.childhealthdata.org/learn-about-the-nsch/nsch-codebooks (accessed on 20 April 2024). For this study, 70% of the sample, or 41,352 cases, was used as the training set (the subset of data used to train the machine learning model). The dataset was divided into training and test samples with stratification based on the outcome variable, ensuring balanced representation across both samples. The remaining 30%, or 17,725 cases, was used as the independent test sample (the subset of data used to evaluate the performance of the trained model).

2.2. Outcome: ACEs

The outcome variable in our study is the ACEs measure from the NSCH dataset. This variable categorizes ACEs into three levels based on the child’s exposure to one or more of the nine specified ACEs. These ACEs cover a range of experiences crucial for understanding their potential impact on a child’s well-being. They include family income challenges, parental separation or divorce, the death of a parent or guardian, the incarceration of a parent or guardian, exposure to domestic violence, victimization or witnessing of neighborhood violence, living with someone who has mental illness or substance abuse issues, and experiencing racial or ethnic discrimination. Each factor represents a significant aspect of a child’s environment that can influence their overall health and development.

2.3. Machine Learning Approach

In analyzing ACEs through machine learning techniques, we leveraged the capabilities of the tidymodels ecosystem in R [17]. This analysis was conducted using R version 4.3.2 [18]. The chosen machine learning algorithms were specifically selected for their proficiency in addressing the intricacies and unique characteristics of the ACEs dataset.

2.3.1. Overview of Machine Learning Algorithms

In our investigation of ACEs, we employed a variety of machine learning algorithms, each selected for its unique strengths in addressing specific aspects of the dataset.
We began with Logistic Regression [19], a robust method for binary classification problems, which is crucial for estimating the likelihood of ACE occurrences based on various predictors. Additionally, the K-Nearest Neighbors (KNN) algorithm, applied through the kknn package [20], was utilized for its effectiveness in situations where feature similarity influences classification, which is particularly useful in cases with non-linear decision boundaries. In addition, the decision tree algorithm, from the rpart package [21], was incorporated for its clear interpretability and simplicity. This approach provides an accessible understanding of the decision-making processes within the data.
Furthermore, the random forest algorithm, using the randomForest package [22], was employed. This algorithm enhances prediction accuracy and stability by combining multiple decision trees and is particularly valuable in managing high-dimensional data. Also, AdaBoost, implemented via the C50 package [23], was included in our analysis. This technique effectively amalgamates weaker models to improve prediction precision by reducing bias and variance.
The study utilized extreme gradient boosting (XGBoost) [24], from the xgboost package [25], known for its exceptional performance in classification tasks and its capability to handle complex and unstructured datasets. Lastly, neural networks, facilitated by the nnet package [26], were chosen for their capacity to model complex non-linear relationships and discern intricate patterns within large datasets, which is particularly relevant in ACE research. Each algorithm was rigorously tuned for optimal performance, and a 10-fold repeated cross-validation scheme was employed to ensure the reliability and robustness of our models.

2.3.2. Preprocessing

In the preprocessing stage of our machine learning approach, significant emphasis was placed on refining the quality of our training data to enhance the robustness of our analysis. A key procedure involved collapsing the rarest factor levels in the training samples [27]. This tactic aimed to minimize the noise associated with very rare factor levels while ensuring the preservation of at least two factor levels in our dataset. Implementing such a strategy is essential for maintaining the integrity and interpretability of our models, particularly given the diversity and potential sparsity of datasets in ACE studies.
Our initial assessment revealed approximately 0.05% missing data in ACE predictors and 0.01% missing data in the ACE outcome. All missing data in the outcome were removed. To address the missing data in the predictors, we implemented a strategic approach for imputation, which is vital for ensuring the dataset’s completeness and reliability. For numeric predictors, mean imputation was employed to preserve the central tendency of the data. In contrast, for categorical predictors, mode imputation was utilized, effectively maintaining the distributional characteristics of the variable by replacing missing values with the most frequent category.

2.3.3. Hyperparameter Optimization

In our study, we conducted comprehensive hyperparameter tuning (the process of optimizing the settings that govern the training process of a machine learning model) for several predictive models, informed by contemporary machine learning methodologies [27]. For the decision tree model, the focus was on optimizing two key parameters: cost complexity (cost_complexity) and the minimum number of data points required at each node (min_n). In the random forest model, adjustments were made to the number of trees (trees) and the minimum size of nodes (min_n). Neural network models were fine-tuned by adjusting the regularization parameter (penalty) and the number of training epochs (epochs), ensuring a balance between model complexity and adequate training. The Gradient Boosting model’s tuning involved modifying the number of boosting rounds, tree depth (tree_depth), and learning rate (learn_rate), which are integral to guiding the model’s learning efficacy and capacity. For the K-Nearest Neighbors (KNN) model, the tuning concentrated on the number of neighbors (neighbors), and for the AdaBoost model, it involved the number of boosting rounds (trees). The hyperparameter optimization for each model was meticulously carried out with an emphasis on maximizing the AUC. A grid search strategy was employed to systematically navigate the defined parameter spaces. Details on the ranges of tuned hyperparameters can be found in the supplementary text.

2.3.4. Application to Independent Test Sample

We refined all seven models by retraining them on the entirety of the training dataset. This retraining process was informed by the optimal hyperparameter settings, which were identified through a comprehensive 10-fold cross-validation approach. The objective was to accurately predict ACE levels in a completely independent test sample, thereby ensuring a distinct separation between the training and testing phases of the model.

2.4. Model Evaluation Metrics

In our comprehensive study, we employed a range of key performance metrics to evaluate the efficacy of machine learning models in categorizing ACEs. These metrics included the area under the receiver operating curve (AUC), F1 score, recall, precision, balanced accuracy, and the MCC. The AUC was pivotal in quantifying the model’s ability to differentiate between ACE categories, with higher values indicating superior discriminatory capabilities [28,29]. Precision was critical for accurately classifying each ACE category, particularly in identifying children with multiple ACEs [30]. Recall or sensitivity was equally important, measuring the model’s ability to correctly identify all instances of ACE exposure out of the actual cases of ACEs. This is crucial in not missing cases in children with multiple ACEs [31]. The F1 score, a harmonic mean of precision and recall, provided a balanced view of the model’s accuracy across ACE levels, ensuring unbiased performance toward any specific category. Balanced accuracy contributed valuable insights into the model’s performance across the ACE spectrum, especially in datasets with skewed ACE distributions [32]. The MCC gives a comprehensive evaluation of the model’s overall performance, accounting for all aspects of the confusion matrix. It is a robust measure of accuracy in all ACE categories [33]. These diverse metrics ensured a rigorous and multifaceted evaluation, recognizing the intricate nature of ACE categorization. For the “best” performing model, identified based on its superiority in most metrics, we further analyzed its receiver operating characteristic (ROC) curve and the AUC of the precision–recall curve. Employing the methodology suggested by [34] for multiclass problems, we used the One-versus-Rest (OvR) approach on both the ROC and the PR curves, providing a comprehensive view of the model’s performance across all ACE categories.

Feature Importance

After the best performing model (final model) is selected, we calculated the feature importance of the predictors using a permutation-based approach [35,36] based on a random sample of 1000 observations and 100 permutation rounds on each variable from the test data. This involves assessing the increase in prediction error after the values of a feature are randomly shuffled. This shuffling breaks the association between the feature and the outcome, thereby revealing its importance: the more the error increases, the more significant the feature is for the model’s predictions [35,37]. To ensure robustness, we calculated this importance using an independent test sample rather than the training sample, following best practices suggested in the literature [35]. To complement the understanding of feature influence, we utilized Accumulated Local Effect (ALE) plots and partial-dependence profile (PDP) plots [38] to describe ALE as a technique that visualizes the effects of features in black box models. This method is particularly valuable for handling correlated features, as it provides an unbiased view of their effects on the model’s output. Additionally, we incorporated PDP plots as outlined by [39]. The PDP plots, which are useful for visualizing the marginal effect of a feature on the predicted outcome, were averaged over the distribution of the other features. The feature importance, ALE, and PDP plots were obtained using the DALEX and DALEXtra R packages [40,41].

3. Results

3.1. Samples

Our study’s analysis of demographic and clinical characteristics in both the training and test samples provides a picture of the prevalence and diversity of ACEs and related factors.
In the training sample, a significant portion (61.49%) reported no exposure to ACEs, while 20.78% had experienced one ACE, and 17.73% encountered two or more ACEs. This distribution highlights the varied prevalence of ACEs, illustrating the different levels of exposure among participants. The test sample displayed a similar pattern, reflecting consistency in ACE prevalence across both groups. Notably, the mean number of relocations was slightly higher in the training sample (average 1.62, SD = 1.97) compared to the test sample, though this difference was not statistically significant. This pattern extended to the average number of children per household, with the training sample reporting slightly more children (average 1.86, SD = 0.87) than the test sample.
A significant difference emerged in household sizes, where the training sample averaged approximately 4.03 members (SD = 1.1), which was marginally larger than the test sample’s average of 4.01 members (SD = 1.1), with a p-value of 0.029. Variations in family composition ranged from single- or two-person households to those with six or more members in both samples, but a higher incidence of smaller households was noted in the test sample. Both samples showed a low prevalence of grade repetition among children (4.08% in the training sample), suggesting consistent academic progression. The age distribution was evenly spread across children aged 6–17 years in both groups. Parental health status was predominantly reported as excellent for both mothers (68.41% in training, 68.52% in test) and fathers (74.65% in training, 74.98% in test).
Household habits, such as smoking indoors, were uncommon (85.89% smoke-free in the training sample), and parental aggravation was rarely reported (95%, indicating infrequent occurrences in the training sample), indicative of low-stress family environments. The majority of children in both samples slept for the recommended duration appropriate for their age (69.17% in the training sample and 69.53% in the test sample), and a large proportion of families did not receive food or cash assistance (74.67% in training, 74.47% in test), pointing to economic stability. Neighborhood dynamics were similarly perceived in both samples, with 60.56% of the training sample and a comparable proportion in the test sample acknowledging supportive neighborhoods, and 69.38% in the training sample definitely agreeing on the safety of their neighborhoods.
These descriptive statistics offer a detailed comparison across various crucial predictors in both the training and test samples. The consistency observed in these characteristics underscores the robustness of our machine learning analysis, as illustrated in the figures in the supplementary text.

3.2. Selecting ML Model

Among the models analyzed, tree-based approaches such as random forest, adaptive boosting, and extreme gradient boosting demonstrated comparable performances across the six metrics. These models, known for their robustness and ability to handle complex datasets, showed a consistent level of accuracy and predictive power in identifying ACEs (Table 1). However, the decision tree model stood out for its notably lower performance, particularly in terms of the AUC and accuracy. The standout model in our analysis was the neural network, which achieved the highest scores across several key metrics. It recorded the best AUC at 0.788, demonstrating its superior ability to distinguish between different ACE categories. Additionally, it achieved the highest recall (0.707) and precision (0.683) scores, indicating its effectiveness in correctly identifying ACE cases and its reliability in positive predictions, respectively. The model also excelled in accuracy (0.708) and the Matthews Correlation Coefficient (MCC) (0.451), further underscoring its overall predictive strength. Interestingly, the neural network and the extreme gradient boosting model shared the same performance level in terms of the F1 score (0.68). These findings underscore the neural network model’s suitability as the “best” performing model for this dataset, given its superior performance across most metrics.

3.3. Prediction of ACEs

The ROC curve for children who had experienced two or more ACEs indicates a high true positive rate and a low false positive rate, underscoring the model’s robust performance in accurately distinguishing these more complex cases from other categories. This effectiveness, however, slightly diminishes when predicting the “No ACE” class, where the model still demonstrates solid effectiveness but with a marginally reduced discriminative ability compared to the “Experienced 2 or more ACEs” category.
The model encounters notable challenges in the “Experienced 1 ACE” category, as evidenced by a lower true positive rate and a higher false positive rate relative to the other classes. This finding suggests a potential area for improvement in the model’s ability to accurately classify instances of a single ACE (see Figure 1). The PR curve further shows high precision across all recall levels for the “No ACE” class, indicating a confident classification of cases with no ACE exposure against those with one or more ACEs. However, for the “Experienced 1 ACE” class, the model begins with high precision, which decreases as recall increases, implying that the model, in its efforts to include more true positives, starts to inaccurately classify some instances from other categories as “Experienced 1 ACE”. A similar trend is observed in the “Experienced 2 or more ACEs” class, where the precision notably decreases with rising recall, reflecting the model’s challenge in consistently and accurately identifying multiple ACE exposures (see Figure 2).
In Figure 3, the permutation feature importance indicates the paramount role of the child’s family structure in ensuring robust predictions in the independent test sample, as denoted by a mean cross entropy value of 948. Uncertainty related to the application of 100 permutations is represented in the boxplot. Subsequent to family structure, the factor most affecting average prediction accuracy is how often the child has changed addresses. The count of children in the household, household size, and dependence on food and cash assistance are also key predictors, listed in order of their importance. To further elucidate how these important predictors specifically influence ACE prediction, we turn to PDP and ALE plots, focusing on the two most influential factors. These factors also feature prominently in the top five of our next best model, the extreme gradient boosting, reaffirming their predictive power. Figure 4 and Figure 5 present the PDP plots for the child’s family structure. Our analysis reveals varied contributions of different family types to the prediction of ACEs. A two-parent married household significantly predicts a lower likelihood of ACEs, as depicted in Figure 4. Conversely, families with two parents who are not married, single parents, or other family structures tend to predict higher ACEs. Further stratification by the parents’ highest education level in Figure 5 highlights intricate variations in predictions. Notably, in households where both parents are married, higher educational attainment correlates with a lower prediction of ACEs. However, for families with less educated single parents or other family structures, the likelihood of predicting one or more ACEs increases.
Figure 6 and Figure 7 present the PDP plots for the number of times a child changed address. Figure 6 reveals that a higher number of times a child changed address is a greater predictor of children who experienced two or more ACEs. As one will suggest, there is a negative relationship between the number of times a child changed address and the average prediction of the no-ACE effect. In other words, if a child has changed homes more times, it becomes less and less likely for that predictor to contribute importantly to predicting the group with no ACEs. The number of times a child changed address did not seem to affect the average prediction for predicting the likelihood of having one ACE.
To comprehensively understand the effects of our predictive factors, we further examined the ALE plots. In the context of the child’s family structure, Figure 8 reveals a pattern that is broadly consistent with the one observed in Figure 4 from the PDP plot. However, a notable difference emerges within the “other family type” group. This discrepancy suggests a relatively low correlation between the child’s family structure and another predictor in the model. This observation is pivotal as it indicates the uniqueness of the “other family type” group’s influence on ACE predictions, potentially hinting at complex dynamics within this category that are not as pronounced in more traditional family structures. Similarly, for the number of times a child changed address, or the frequency of relocations, the ALE plot (Figure 9) provides additional insights. It indicates a moderate correlation between the frequency of relocations and another predictor, compared to the pattern observed in Figure 6. This correlation is significant as it highlights the complex relationship between the instability of a child’s living situation and other factors that might contribute to ACEs.

4. Discussion

The present study’s exploration of the predictive power of ACEs, particularly emphasizing the roles of family structure and frequency of relocations, reveals profound insights into the dynamics that shape a child’s developmental environment. Our machine-learning-based approach not only underscores the predictive significance of these factors but also aligns with a body of existing empirical research that draws similar conclusions about their impact.

4.1. Family Structure and Its Impact on ACEs

The finding that family structure emerges as a robust predictor of ACEs resonates with the work of [42], who emphasize the vulnerability of children in non-traditional family settings to adverse experiences. Specifically, our results regarding children living in single-parent households align with the findings of [43], who reported an increased likelihood of experiencing environmental stressors and emotional neglect in such settings. Furthermore, the role of economic hardship, as discussed by [44], in exacerbating ACEs in single-parent and non-married parent families cannot be overstated. These economic challenges often translate into reduced emotional and developmental support for children, thereby increasing their ACE scores. Conversely, the lower likelihood of ACEs in two-parent married households, as shown in our findings, is consistent with studies emphasizing the benefits of a stable, two-parent environment in terms of emotional and economic support [43,45].

4.2. The Role of Frequent Relocations

The significant predictive value of the frequency of relocations highlights the profound impact of environmental instability on children. Frequent moves can disrupt children’s sense of security and attachment, contributing to emotional and behavioral issues. This aligns with the research by [46], who found that residential moves, particularly during critical developmental periods, can have lasting adverse effects on children’s emotional well-being. In fact, [47] further supports this by identifying a direct correlation between geographic mobility and emotional and behavioral adjustment difficulties in children. Additionally, [48] found that frequent relocation was linked to increased rates across all measures of child dysfunction. With frequent relocations come several school changes, which cause social disruption in the lives of the children. This can be particularly detrimental, impairing children’s ability to form lasting, supportive relationships [47].
These insights into the predictive power of family structure and relocation frequency can guide clinicians and social scientists in developing more targeted interventions and support systems. Understanding these key predictors allows for the stratification of risk and tailoring of preventive measures, an approach supported by the longitudinal research of [49,50]. For instance, enhanced support for children in high-risk family situations or those experiencing frequent relocations could mitigate the long-term impacts of ACEs.

5. Limitations of the Study

A key limitation of this study stems from its reliance on data from the NSCH. The use of self-reported information can introduce biases, notably recall and social desirability biases, which may affect the accuracy of reported ACEs [51]. Additionally, the NSCH’s variable scope, while extensive, might not capture all nuanced factors influencing ACEs, such as detailed family dynamics or specific cultural influences. This limitation is echoed in research emphasizing the need for diverse and longitudinal data for comprehensive child health analysis [52]. Moreover, the survey’s generalizability to specific sub-populations or different socio-cultural contexts could be limited, suggesting the need for caution in the broader application of the findings.

6. Conclusions

This study’s exploration of the predictive factors of ACEs using advanced machine learning techniques has uncovered significant insights into the roles of family structure, parental education levels, and the frequency of relocations. Our findings not only reinforce the complexity of the factors contributing to ACEs but also highlight the complex interactions between these elements. The use of machine learning has enabled a more in-depth analysis of these interactions, revealing patterns that traditional statistical methods may overlook.
Future research should continue the trajectory set by this study, aiming to refine predictive models of ACEs further. Incorporating a broader range of variables, cultural background, and access to community resources is imperative for a more comprehensive understanding of ACEs [53]. Additionally, exploring the impact of emerging factors, such as digital media exposure and changing social norms, could provide valuable insights into the evolving landscape of childhood experiences. Longitudinal studies would be particularly beneficial in understanding the long-term effects of these predictors on individuals’ life trajectories.
From a policy perspective, the findings of this study underscore the need for developing targeted support programs in educational and healthcare settings. Such programs should be designed to mitigate the impact of identified risk factors on children’s well-being. This could include enhanced training for educators and healthcare providers in recognizing and addressing the signs of ACEs, as well as the implementation of comprehensive support systems for at-risk families.
Moreover, our study advocates for greater community engagement in preventing and addressing ACEs. Community-based initiatives, such as parenting support programs and awareness campaigns, can play a crucial role in creating environments that nurture and protect children. Engaging community leaders and stakeholders in these efforts can help ensure that interventions are culturally sensitive and effectively address the unique needs of different communities.
In conclusion, the application of machine learning in ACE research represents a significant advancement in our understanding of the multifaceted nature of these experiences. By continuing to explore and refine these predictive models, we can contribute to the development of more effective strategies for preventing and mitigating the impact of ACEs. Ultimately, the goal is to foster a society where all children have the opportunity to grow and develop in a healthy and supportive environment.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bs14060487/s1.

Author Contributions

Conceptualization, P.M.C. and N.A.T.; methodology, P.M.C. and D.A.; software, D.A.; validation, P.M.C., N.A.T. and D.A.; formal analysis, D.A.; investigation, D.A.; resources, N.A.T.; data curation, N.A.T.; writing—original draft preparation, P.M.C., N.A.T. and D.A.; writing—review and editing, P.M.C. and D.A.; visualization, D.A.; supervision, P.M.C.; project administration, D.A.; funding acquisition, P.M.C. All authors have read and agreed to the published version of the manuscript.

Funding

This publication was supported by the STEM US Analytic hub, NSF HBCU-UP [grant number 8012032]. The sponsor did not participate in the data analysis, nor were they involved in the composition of the manuscript.

Institutional Review Board Statement

Not applicable since a public dataset was used with approval from NSCH.

Informed Consent Statement

This work utilizes anonymized secondary data originally collected from human participants. The authors did not directly interact with or obtain informed consent from the subjects. However, the NSCH affirms that the original data collection process strictly adhered to ethical standards, including obtaining informed consent from all participants. The authors have therefore ensured that the use of this anonymized dataset complies with the ethical guidelines and data usage policies set forth by the NSCH.

Data Availability Statement

Data are contained within the article and Supplementary Materials.

Conflicts of Interest

Author Daniel Alhassan was employed by the company Wells Fargo. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Webster, E.M. The impact of adverse childhood experiences on health and development in young children. Glob. Pediatr. Health 2022, 9, 2333794X221078708. [Google Scholar] [CrossRef]
  2. Felitti, V.; Anda, R.; Nordenberg, D.; Williamson, D. Adverse childhood experiences and health outcomes in adults: The Ace study. J. Fam. Consum. Sci. 1998, 90, 31. [Google Scholar]
  3. Briggs, E.C.; Amaya-Jackson, L.; Putnam, K.T.; Putnam, F.W. All adverse childhood experiences are not equal: The contribution of synergy to adverse childhood experience scores. Am. Psychol. 2021, 76, 243. [Google Scholar] [CrossRef]
  4. Anda, R.F.; Felitti, V.J.; Bremner, J.D.; Walker, J.D.; Whitfield, C.; Perry, B.D.; Dube, S.R.; Giles, W.H. The enduring effects of abuse and related adverse experiences in childhood: A convergence of evidence from neurobiology and epidemiology. Eur. Arch. Psychiatry Clin. Neurosci. 2006, 256, 174–186. [Google Scholar] [CrossRef]
  5. Mersky, J.P.; Choi, C.; Lee, C.P.; Janczewski, C.E. Disparities in adverse childhood experiences by race/ethnicity, gender, and economic status: Intersectional analysis of a nationally representative sample. Child Abus. Negl. 2021, 117, 105066. [Google Scholar] [CrossRef]
  6. Kerker, B.D.; Zhang, J.; Nadeem, E.; Stein, R.E.; Hurlburt, M.S.; Heneghan, A.; Landsverk, J.; Horwitz, S.M. Adverse childhood experiences and mental health, chronic medical conditions, and development in young children. Acad. Pediatr. 2015, 15, 510–517. [Google Scholar] [CrossRef]
  7. Finkelhor, D.; Turner, H.; LaSelva, D. Receipt of behavioral health services among us children and youth with adverse childhood experiences or mental health symptoms. JAMA Netw. Open 2021, 4, e211435. [Google Scholar] [CrossRef]
  8. Substance Abuse and Mental Health Services Administration (SAMHSA). 2012 National Survey on Drug Use and Health (NSDUH); S. Prepared by Office of Applied Studies (OAS), RTI International (RTI International is a trade name of Research Triangle Institute), Eds.; Substance Abuse and Mental Health Services Administration: Rockville, MD, USA, 2020.
  9. Hughes, K.; Bellis, M.A.; Hardcastle, K.A.; Sethi, D.; Butchart, A.; Mikton, C.; Jones, L.; Dunne, M.P. The effect of multiple adverse childhood experiences on health: A systematic review and meta-analysis. Lancet Public Health 2017, 2, e356–e366. [Google Scholar] [CrossRef]
  10. Danese, A.; McEwen, B.S. Adverse childhood experiences, allostasis, allostatic load, and age-related disease. Physiol. Behav. 2012, 106, 29–39. [Google Scholar] [CrossRef]
  11. Bellis, M.A.; Hughes, K.; Leckenby, N.; Perkins, C.; Lowey, H. National household survey of adverse childhood experiences and their relationship with resilience to health-harming behaviors in England. BMC Med. 2014, 12, 1–10. [Google Scholar] [CrossRef]
  12. Turney, K.; Wildeman, C. Adverse childhood experiences among children placed in and adopted from foster care: Evidence from a nationally representative survey. Child Abus. Negl. 2017, 64, 117–129. [Google Scholar] [CrossRef]
  13. Merrick, M.T.; Ford, D.C.; Ports, K.A.; Guinn, A.S. Prevalence of adverse childhood experiences from the 2011–2014 behavioral risk factor surveillance system in 23 states. JAMA Pediatr. 2018, 172, 1038–1044. [Google Scholar] [CrossRef]
  14. Bair-Merritt, M.H.; Blackstone, M.; Feudtner, C. Physical health outcomes of childhood exposure to intimate partner violence: A systematic review. Pediatrics 2006, 117, e278–e290. [Google Scholar] [CrossRef]
  15. Bethell, C.D.; Carle, A.; Hudziak, J.; Gombojav, N.; Powers, K.; Wade, R.; Braveman, P. Methods to assess adverse childhood experiences of children and families: Toward approaches to promote child well-being in policy and practice. Acad. Pediatr. 2017, 17, S51–S69. [Google Scholar] [CrossRef]
  16. Finkelhor, D.; Shattuck, A.; Turner, H.A.; Hamby, S.L. The lifetime prevalence of child sexual abuse and sexual assault assessed in late adolescence. J. Adolesc. Health 2014, 55, 329–333. [Google Scholar] [CrossRef]
  17. Kuhn, M.; Wickham, H. Tidymodels: A Collection of Packages for Modeling and Machine Learning Using Tidyverse Principles; O’Reilly Media, Inc.: Sebastopol, CA, USA, 2020. [Google Scholar]
  18. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2023. [Google Scholar]
  19. Hosmer, D.W., Jr.; Lemeshow, S.; Sturdivant, R.X. Applied Logistic Regression; John Wiley & Sons: New York, NY, USA, 2013; Volume 398. [Google Scholar]
  20. Schliep, K.; Hechenbichler, K. kknn: Weighted k-Nearest Neighbors, R Package Version 1.3.1; R Team: Vienna, Austria, 2016.
  21. Quinlan, J.R. Induction of decision trees. Mach. Learn. 1986, 1, 81–106. [Google Scholar] [CrossRef]
  22. Liaw, A.; Wiener, M. Classification and Regression by randomForest. R News 2002, 2, 18–22. [Google Scholar]
  23. Freund, Y.; Schapire, R.E. Experiments with a new boosting algorithm. In Proceedings of the 1996 ICML, Bari, Italy, 3–6 July 1996; Volume 96, pp. 148–156. [Google Scholar]
  24. Friedman, J.H. Greedy function approximation: A gradient boosting machine. Ann. Stat. 2001, 29, 1189–1232. [Google Scholar] [CrossRef]
  25. Chen, T.; He, T.; Benesty, M.; Khotilovich, V.; Tang, Y.; Cho, H.; Chen, K.; Mitchell, R.; Cano, I.; Zhou, T.; et al. xgboost: Extreme Gradient Boosting, R Package Version 1.7.5.1; R Team: Vienna, Austria, 2023.
  26. Goodfellow, I.; Bengio, Y.; Courville, A. Deep Learning; MIT Press: Cambridge, MA, USA, 2016. [Google Scholar]
  27. Kuhn, M.; Johnson, K. Applied Predictive Modeling; Springer: New York, NY, USA, 2013; Volume 26. [Google Scholar]
  28. Fawcett, T. An introduction to ROC analysis. Pattern Recognit. Lett. 2006, 27, 861–874. [Google Scholar] [CrossRef]
  29. Flach, P.A. ROC analysis. In Encyclopedia of Machine Learning and Data Mining; Springer: New York, NY, USA, 2016; pp. 1–8. [Google Scholar]
  30. Davis, J.; Goadrich, M. The relationship between Precision-Recall and ROC curves. In Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA, 25–29 June 2006; pp. 233–240. [Google Scholar]
  31. Powers, D.M.W. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv 2011, arXiv:2010.16061. [Google Scholar]
  32. Brodersen, K.H.; Ong, C.S.; Stephan, K.E.; Buhmann, J.M. The balanced accuracy and its posterior distribution. In Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey, 23–26 August 2010; IEEE: New York, NY, USA, 2010; pp. 3121–3124. [Google Scholar]
  33. Chicco, D.; Jurman, G. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom. 2020, 21, 1–13. [Google Scholar] [CrossRef]
  34. Hand, D.J.; Till, R.J. A simple generalisation of the area under the ROC curve for multiple class classification problems. Mach. Learn. 2001, 45, 171–186. [Google Scholar] [CrossRef]
  35. Molnar, C. Interpretable Machine Learning, 2nd ed.; Independently Published: Chicago, IL, USA, 2022. [Google Scholar]
  36. Fisher, A.; Rudin, C.; Dominici, F. All Models are Wrong, but Many are Useful: Learning a Variable’s Importance by Studying an Entire Class of Prediction Models Simultaneously. J. Mach. Learn. Res. 2019, 20, 1–81. [Google Scholar]
  37. Biecek, P.; Burzykowski, T. Explanatory Model Analysis; Chapman and Hall/CRC: New York, NY, USA, 2021. [Google Scholar]
  38. Apley, D.W.; Zhu, J. Visualizing the effects of predictor variables in black box supervised learning models. J. R. Stat. Soc. Ser. Stat. Methodol. 2020, 82, 1059–1086. [Google Scholar] [CrossRef]
  39. Greenwell, B.M. pdp: An R package for constructing partial dependence plots. R J. 2017, 9, 421. [Google Scholar] [CrossRef]
  40. Biecek, P. DALEX: Explainers for complex predictive models in R. J. Mach. Learn. Res. 2018, 19, 1–5. [Google Scholar]
  41. Maksymiuk, S.; Gosiewska, A.; Biecek, P. Landscape of R packages for eXplainable Artificial Intelligence. arXiv 2020, arXiv:2009.13248. [Google Scholar]
  42. Baglivio, M.T.; Epps, N.; Swartz, K.; Huq, M.S.; Sheer, A.; Hardt, N.S. The prevalence of adverse childhood experiences (ACE) in the lives of juvenile offenders. J. Juv. Justice 2014, 3, 1–23. [Google Scholar]
  43. Fomby, P.; Cherlin, A.J. Family instability and child well-being. Am. Sociol. Rev. 2007, 72, 181–204. [Google Scholar] [CrossRef]
  44. Gershoff, E.T.; Aber, J.L.; Raver, C.C.; Lennon, M.C. Income is not enough: Incorporating material hardship into models of income associations with parenting and child development. Child Dev. 2007, 78, 70–95. [Google Scholar] [CrossRef]
  45. Brown, S.L.; Manning, W.D.; Stykes, J.B. Family structure and child well-being: Integrating family complexity. J. Marriage Fam. 2015, 77, 177–190. [Google Scholar] [CrossRef]
  46. Adam, E.K.; Chase-Lansdale, P.L. Home sweet home(s): Parental separations, residential moves, and adjustment problems in low-income adolescent girls. Dev. Psychol. 2002, 38, 792. [Google Scholar] [CrossRef]
  47. Simpson, G.A.; Fowler, M.G. Geographic mobility and children’s emotional/behavioral adjustment and school functioning. Pediatrics 1994, 93, 303–309. [Google Scholar] [CrossRef]
  48. Wood, D.; Halfon, N.; Scarlata, D.; Newacheck, P.; Nessim, S. Impact of family relocation on children’s growth, development, school function, and behavior. JAMA 1993, 270, 1334–1338. [Google Scholar] [CrossRef]
  49. Anda, R.F.; Butchart, A.; Felitti, V.J.; Brown, D.W. Building a framework for global surveillance of the public health implications of adverse childhood experiences. Am. J. Prev. Med. 2010, 39, 93–98. [Google Scholar] [CrossRef]
  50. Merrick, M.T.; Ports, K.A.; Ford, D.C.; Afifi, T.O.; Gershoff, E.T.; Grogan-Kaylor, A. Unpacking the impact of adverse childhood experiences on adult mental health. Child Abus. Negl. 2017, 69, 10–19. [Google Scholar] [CrossRef]
  51. Finkelhor, D.; Ormrod, R.K.; Turner, H.A. The developmental epidemiology of childhood victimization. J. Interpers. Violence 2009, 24, 711–731. [Google Scholar] [CrossRef]
  52. Reuben, A.; Moffitt, T.E.; Caspi, A.; Belsky, D.W.; Harrington, H.; Schroeder, F.; Hogan, S.; Ramrakha, S.; Poulton, R.; Danese, A. Lest we forget: Comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health. J. Child Psychol. Psychiatry 2016, 57, 1103–1112. [Google Scholar] [CrossRef]
  53. Bethell, C.D.; Newacheck, P.; Hawes, E.; Halfon, N. Adverse childhood experiences: Assessing the impact on health and school engagement and the mitigating role of resilience. Health Aff. 2014, 33, 2106–2115. [Google Scholar] [CrossRef]
Figure 1. ROC curve of the best performing model, the neural network.
Figure 1. ROC curve of the best performing model, the neural network.
Behavsci 14 00487 g001
Figure 2. PR curve of the neural network.
Figure 2. PR curve of the neural network.
Behavsci 14 00487 g002
Figure 3. Permutation-based feature importance for the neural network model.
Figure 3. Permutation-based feature importance for the neural network model.
Behavsci 14 00487 g003
Figure 4. Partial-dependence profile plot for child family structure.
Figure 4. Partial-dependence profile plot for child family structure.
Behavsci 14 00487 g004
Figure 5. Partial-dependence profile plot for child family structure grouped by highest adult education.
Figure 5. Partial-dependence profile plot for child family structure grouped by highest adult education.
Behavsci 14 00487 g005
Figure 6. Partial-dependence profile plot for the number of times a child changed address.
Figure 6. Partial-dependence profile plot for the number of times a child changed address.
Behavsci 14 00487 g006
Figure 7. Partial-dependence profile plot for the number of times a child changed address grouped by the child’s family structure.
Figure 7. Partial-dependence profile plot for the number of times a child changed address grouped by the child’s family structure.
Behavsci 14 00487 g007
Figure 8. ALE plot for child family structure.
Figure 8. ALE plot for child family structure.
Behavsci 14 00487 g008
Figure 9. ALE plot for the number of times a child changed address.
Figure 9. ALE plot for the number of times a child changed address.
Behavsci 14 00487 g009
Table 1. Comparison of performance metrics across the seven models.
Table 1. Comparison of performance metrics across the seven models.
ModelAUCF1 ScoreRecallPrecisionAccuracyMCC
Logistic Regression0.7830.6800.7040.6740.7010.440
KNN0.7100.6320.6520.6210.6410.323
Decision tree0.5000.7620.6150.6150.500-
Random forest0.7680.6760.7000.6680.6890.425
Adaptive Boosting0.7570.6690.6860.6610.6850.405
XGBoost0.7850.6880.7040.6810.7060.444
Neural Network0.7880.6870.7070.6830.7080.451
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Codjoe, P.M.; Tawiah, N.A.; Alhassan, D. Childhood Environmental Instabilities and Their Behavioral Implications: A Machine Learning Approach to Studying Adverse Childhood Experiences. Behav. Sci. 2024, 14, 487. https://doi.org/10.3390/bs14060487

AMA Style

Codjoe PM, Tawiah NA, Alhassan D. Childhood Environmental Instabilities and Their Behavioral Implications: A Machine Learning Approach to Studying Adverse Childhood Experiences. Behavioral Sciences. 2024; 14(6):487. https://doi.org/10.3390/bs14060487

Chicago/Turabian Style

Codjoe, Priscilla Mansah, Nii Adjetey Tawiah, and Daniel Alhassan. 2024. "Childhood Environmental Instabilities and Their Behavioral Implications: A Machine Learning Approach to Studying Adverse Childhood Experiences" Behavioral Sciences 14, no. 6: 487. https://doi.org/10.3390/bs14060487

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop