Next Article in Journal
A Convexity-Preserving Level-Set Method for the Segmentation of Tumor Organoids
Next Article in Special Issue
Continuous Detection of Stimulus Brightness Differences Using Visual Evoked Potentials in Healthy Volunteers with Closed Eyes
Previous Article in Journal
The Osteogenic Peptide P-15 for Bone Regeneration: A Narrative Review of the Evidence for a Mechanism of Action
Previous Article in Special Issue
ResnetAge: A Resnet-Based DNA Methylation Age Prediction Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Precision Non-Alcoholic Fatty Liver Disease (NAFLD) Diagnosis: Leveraging Ensemble Machine Learning and Gender Insights for Cost-Effective Detection

1
Department of Electrical Engineering, College of Electrical Engineering and Computer Science, National Taipei University of Technology, Taipei 10608, Taiwan
2
Innovation Frontier Institute of Research for Science and Technology, National Taipei University of Technology, Taipei 10608, Taiwan
*
Author to whom correspondence should be addressed.
Bioengineering 2024, 11(6), 600; https://doi.org/10.3390/bioengineering11060600
Submission received: 19 April 2024 / Revised: 23 May 2024 / Accepted: 6 June 2024 / Published: 12 June 2024

Abstract

:
Non-Alcoholic Fatty Liver Disease (NAFLD) is characterized by the accumulation of excess fat in the liver. If left undiagnosed and untreated during the early stages, NAFLD can progress to more severe conditions such as inflammation, liver fibrosis, cirrhosis, and even liver failure. In this study, machine learning techniques were employed to predict NAFLD using affordable and accessible laboratory test data, while the conventional technique hepatic steatosis index (HSI)was calculated for comparison. Six algorithms (random forest, K-nearest Neighbors, Logistic Regression, Support Vector Machine, extreme gradient boosting, decision tree), along with an ensemble model, were utilized for dataset analysis. The objective was to develop a cost-effective tool for enabling early diagnosis, leading to better management of the condition. The issue of imbalanced data was addressed using the Synthetic Minority Oversampling Technique Edited Nearest Neighbors (SMOTEENN). Various evaluation metrics including the F1 score, precision, accuracy, recall, confusion matrix, the mean absolute error (MAE), receiver operating characteristics (ROC), and area under the curve (AUC) were employed to assess the suitability of each technique for disease prediction. Experimental results using the National Health and Nutrition Examination Survey (NHANES) dataset demonstrated that the ensemble model achieved the highest accuracy (0.99) and AUC (1.00) compared to the machine learning techniques that we used and HSI. These findings indicate that the ensemble model holds potential as a beneficial tool for healthcare professionals to predict NAFLD, leveraging accessible and cost-effective laboratory test data.

1. Introduction

Non-Alcoholic Fatty Liver Disease (NAFLD) is a prevalent liver condition with a significant worldwide impact, posing a substantial risk for the development of cirrhosis and hepatocellular carcinoma (HCC) [1]. Its prevalence affects around one-fourth of the global population [2], leading to considerable morbidity, increased mortality rates, and imposing a significant burden on affected individuals, their families, and healthcare systems [3]. Remarkably, the prevalence of NAFLD in Asian countries is comparable to that in Western countries [2,4]. NAFLD is characterized by the abnormal accumulation of fat in liver cells (hepatocytes) and is increasingly recognized as a major public health concern due to its high prevalence worldwide. The rise in obesity and metabolic syndrome contributes to NAFLD becoming the leading cause of chronic liver disease and abnormal liver function tests in China [2,5,6]. Recently, NAFLD has emerged as the primary cause of chronic liver disease and the fastest-growing indication for liver transplantation [2,3,7].
Liver biopsy has long been regarded as the gold standard for diagnosing Non-Alcoholic Fatty Liver Disease (NAFLD). However, this diagnostic method has several drawbacks that limit its routine use in public health check-up studies [8,9]. The procedure is invasive, posing a risk of bleeding, and may not be suitable for widespread application. To address these concerns, alternative diagnostic techniques have been explored, such as ultrasonography, magnetic resonance imaging, and computed tomography, which can also detect NAFLD. However, these imaging methods come with their own limitations, including being time-consuming, expensive, and often not easily accessible, particularly in remote regions. Although abdominal ultrasound has been widely used for the assessment of NAFLD, while ultrasound is a non-invasive and relatively affordable imaging technique, it does have some limitations when applied to NAFLD diagnosis and characterization. One of the primary challenges lies in its sensitivity to detecting mild levels of fat infiltration, often resulting in false negatives in cases of early stage NAFLD. The presence of obesity can also hinder the clarity of ultrasound images, making it challenging to accurately assess liver fat content and inflammation. Abdominal ultrasound for NAFLD presents additional complexities that demand specialized expertise. Interpreting ultrasound images for NAFLD requires skilled radiologists or sonographers familiar with the specific nuances of liver appearance associated with fatty infiltration. However, not all regions have access to such specialized medical professionals, exacerbating the diagnostic challenge [10,11,12]. Due to the invasiveness and cost associated with a liver biopsy, it is not routinely performed, prompting the need for non-invasive and more practical diagnostic approaches to effectively identify and manage NAFLD [13].
Recent advancements in the field of Non-Alcoholic Fatty Liver Disease (NAFLD) have led to the development of several new indices for its diagnosis and assessment, including the hepatic steatosis index (HSI) and fatty liver index (FLI). These novel indices integrate various non-invasive parameters, such as clinical, biochemical, and imaging data, to offer a more comprehensive and accurate evaluation of NAFLD. Unlike traditional methods that require invasive liver biopsies, these new indices provide a safer and less burdensome approach to diagnosing and monitoring NAFLD. These innovative indices can be easily implemented in routine clinical practice, enabling earlier detection, intervention, and improved management of NAFLD to mitigate its potential complications. As research continues in this area, FLI and HSI, and other emerging indices hold great potential to revolutionize the diagnosis and management of NAFLD, ultimately contributing to better patient outcomes and reducing the disease’s global burden [5,14,15].
HSI is a non-invasive index used to assess the presence of hepatic steatosis, also known as fatty liver disease. It is based on easily obtainable clinical and biochemical parameters, making it a practical tool for diagnosing and monitoring NAFLD. HSI incorporates factors such as body mass index (BMI), and the levels of certain liver enzymes, including aspartate aminotransferase (AST) and alanine aminotransferase (ALT). The index is calculated using a specific formula. The simplicity and effectiveness of HSI make it a valuable screening tool, particularly in settings where more sophisticated imaging or liver biopsy options might be limited. However, like other non-invasive indices, HSI may not provide a definitive diagnosis and is often used in conjunction with other diagnostic tools to assess the severity and progression of hepatic steatosis. Ongoing research and validation studies are further refining the utility of HSI in clinical practice, offering a valuable contribution to the management of NAFLD.
If indices utilized for NAFLD diagnosis, including HSI, showcase varying degrees of accuracy and area under the curve (AUC), it underscores an ongoing requirement to explore innovative avenues for enhancing early NAFLD detection with heightened precision. A notable drawback of these indices lies in their limited potential to consistently achieve this goal. This drawback accentuates the urgency for more sophisticated and precise methodologies, such as employing machine learning techniques, to refine NAFLD prediction by encompassing a wider array of clinical and biochemical variables. Machine learning harnesses advanced algorithms to scrutinize intricate patterns and relationships within extensive datasets, thereby fostering the development of more refined and personalized diagnostic models. By integrating diverse clinical, imaging, and biochemical data points, machine learning algorithms can heighten the precision of identifying hepatic steatosis, thereby contributing to the early recognition of individuals at risk. This proactive strategy holds significant promise in enhancing patient outcomes by enabling timely interventions and tailored management strategies.
The field of medicine is abundant with data, yet physicians may inadvertently overlook crucial information necessary for accurate disease diagnosis and treatment. Machine learning techniques, widely employed across diverse areas of health sciences, offer a potential solution to this problem. Leveraging large datasets, these techniques can effectively address the challenges of information extraction and analysis. In fact, machine learning has already been successfully utilized in numerous medical disciplines for disease prediction. Predicting NAFLD plays a crucial role in early detection, resource allocation, and public health planning, ultimately leading to improved management. However, the available data on the use of machine learning models for NAFLD prediction worldwide have been limited.
Machine learning models have been employed for several years to predict NAFLD [16,17,18]. Weidong Ji et al. [16] employed four machine learning algorithms to predict NAFLD in 304,145 adults, with XGBoost showing the best accuracy (0.880) and AUC (0.951). Xu et al. [17] used 11 techniques on a dataset of 2,522 individuals to achieve an 83% accuracy for NAFLD prediction. Liu et al. [18] found XGBoost to have the highest accuracy (0.795) among seven models for diagnosing NAFLD in 15,315 Chinese subjects.
The aim of our study is to develop an ensemble machine learning model for the prediction of NAFLD and compare its performance with HSI, using laboratory tests that are easily obtainable and cost-effective. By utilizing such data, we seek to enhance the accuracy and performance of NAFLD prediction, which could have important implications for both diagnosing and treating NAFLD.

2. Materials and Methods

This research adopts a comprehensive approach to develop an ensemble machine learning model to predict NAFLD, encompassing several key steps. Firstly, the datasets underwent thorough review and preprocessing. Next, feature ranking was performed. Subsequently, multiple machine learning models were developed and applied. The performance of each model was evaluated utilizing various metrics such as F1 score, precision, accuracy, recall, confusion matrix, receiver operating characteristics (ROC), AUC, and the mean absolute error (MAE). Based on the results, the most effective models for predicting NAFLD were determined. Subsequently, a novel ensemble machine learning model was introduced. Additionally, HSI was calculated and compared, and its performance was evaluated using the same set of metrics. Lastly, the two evaluated results were compared to determine their relative performance. These models were developed using the Python programming language on Google Colab (Colaboratory).

2.1. Dataset Description

This study utilized the National Health and Nutrition Examination Survey (NHANES) dataset, administered by the Centers for Disease Control (CDC) of the United States [19]. The dataset comprises 2505 subjects. Our focus was on 23 specific relevant features that are crucial for NAFLD investigation. These features were meticulously selected based on their potential significance in improving our understanding of NAFLD. Notably, the selected features include laboratory tests levels of Total Cholesterol, Weight, Height, BMI, Waist Circumference, white blood cell count (WBC), red blood cell count (RBC), systolic blood pressure (SBP), diastolic blood pressure (DBP), Hemoglobin, albumin, alkaline phosphatase (ALP), aspartate aminotransferase (AST), alanine aminotransferase (ALT), γ-glutamyl transferase (GGT), Creatinine, Triglycerides, LDL, HDL, and Fasting Glucose. Furthermore, demographic variables comprising age and gender, alongside the presence of NAFLD were included.

2.2. Preprocessing Data and Feature Ranking

To ensure the accuracy of our diagnosis models and disease predictions, it was essential to use procedure of data cleaning. Before analysis, the dataset used in this study contained instances of duplicate and missing data. A median imputation approach was employed for handling missing data. This method is widely accepted and effective in addressing missing data with random missing data. Using the median has advantages like being less affected by outliers and being a reliable estimate. Additionally, median imputation is straightforward, robust, and commonly utilized in various medical research. The median imputation method holds the original distribution of the data while effectively mitigating the influence of missing values on the analysis outcomes. Earlier studies have demonstrated that it surpasses other methods in enhancing analysis accuracy and reducing bias. So, median imputation was deemed suitable for this study because it is effective in handling missing data and can improve the quality of our findings.
After handling missing data, removing duplicates, and converting certain string features to numeric, the datasets underwent data standardization. Following that, the Synthetic Minority Oversampling Technique Edited Nearest Neighbors (SMOTEENN) was applied to tackle the issue of imbalanced data. Given the imbalance between the majority and minority classes in classification problems, the majority class often has a significantly larger number of examples compared to the minority class, leading to biased models. SMOTEENN combats this by generating synthetic samples of the minority class using SMOTE and subsequently cleaning the samples using ENN. This approach creates a more balanced dataset and reduces bias in machine learning models, enhancing the representation of the minority class.
In the next step, feature importance analysis was performed to assess the predictive efficacy of input attributes and to prioritize them accordingly. This study utilized embedded methods, a category of feature importance techniques. These methods integrate feature selection into the model training process, assigning weights or coefficients to individual features based on their importance. Features with greater coefficients or weights are considered more significant. By incorporating feature selection during model training, embedded methods select the most relevant features, contributing to improved model accuracy.
To address leakage, which is a problem in machine learning studies [20], SMOTEENN was exclusively applied to the training set after the dataset was split. This adjustment was made to ensure the absence of potential data leakage and to ensure the robustness of our model evaluation.

2.3. HSI Calculations

HSI is a validated predictive index developed by Lee et al. in 2009 for determining the presence of NAFLD. This index employs the parameters of body mass index (BMI), ALT/AST ratio, and the presence of diabetes or female gender, to calculate the likelihood of NAFLD, as indicated by the following formula [21,22,23,24]:
HSI = 8 alanine aminotransferase/aspartate aminotransferase ratio + body mass index (BMI) + 2 if diabetes + 2 if female

2.4. Model Selection

To predict NAFLD and facilitate early diagnosis and treatment, this study utilized affordable and easily accessible laboratory test data. An approach in machine learning for medical diagnosis was introduced, leveraging the capabilities of diverse algorithms. Specifically, six different algorithms known for their effectiveness in medical diagnosis were selected, including random forest, K-nearest Neighbors (KNN), Logistic Regression, Support Vector Machine (SVM), extreme gradient boosting (XGBoost), and decision tree. Extensive research has demonstrated the efficacy of these algorithms in various medical diagnosis tasks.
A novel ensemble consisting of three of these algorithms was developed to further enhance the robustness and accuracy of the model. By combining the predictions of the base models (SVM, XGBoost, random forest), the ensemble was formed using a voting technique. To achieve a more reliable and accurate outcome, the ensemble aggregates individual predictions and makes the final prediction based on a majority vote, thereby leveraging the collective knowledge of the models. The selection of the base models was carefully executed to create an ensemble that outperforms each individual model in isolation, achieving a superior performance.

2.5. Evaluation of Model Performance

To assess the performance of the developed machine learning algorithms, various statistical methods were employed. This included the calculation of performance metrics such as False Negatives (FN), True Positives (TP), True Negatives (TN), and False Positives (FP). These metrics were utilized to compute seven performance indicators: F1 score, precision, accuracy, recall, confusion matrix, AUC, and ROC. The confusion matrix provided an overview of the predicted outcomes. Furthermore, MAE was computed for the testing and training datasets.

3. Experimental Results

The dataset used in this study comprised a total of 2505 individuals, including 1310 females and 1195 males. It encompassed 23 features, thoroughly detailed in Table 1, along with additional analysis and information.
After performing the necessary data preprocessing steps, such as elimination of duplicates, the treatment of missing values, and converting specific string attributes into numerical formats, the datasets underwent standardization. Following this, a comprehensive analysis of correlations was conducted, resulting in the production of heat maps that visually illustrated the relationships between the dataset’s features. This visualization is presented in Figure 1, providing valuable insights into the correlations between different variables.
Following a thorough analysis, each feature’s value was determined through embedded methods, enabling the ranking of features by their importance. The resulting feature importance rankings are presented in Table 2. Notably, the analysis revealed that gender holds the highest score among the features, indicating its significant impact.
The datasets utilized in this study were divided into a testing set, accounting for 20% of the data, and a training set, representing the remaining 80%. Table 3 displays the number of subjects in both the training and testing sets, along with the counts of individuals testing positive and negative for NAFLD.
The objective was to determine the most appropriate technique for predicting Non-Alcoholic Fatty Liver Disease (NAFLD), so six distinct machine learning techniques were developed and implemented. Additionally, an ensemble model was constructed to further enhance prediction accuracy. The performance of these models was then evaluated.
After calculating the HSI using a specific formula, the best cutoff (which is found to be 46.47) was determined to maximize AUC, accuracy. The primary goal of this evaluation was to assess the effectiveness of HSI in predicting NAFLD. Following this evaluation, the two sets of results were compared to determine their relative performance. The comparative results of these models are presented in Table 4.
To evaluate the performance of the implemented techniques, several evaluation metrics were considered. The evaluation metrics included accuracy, precision, recall, F1 score, and AUC. These metrics are detailed in Table 4.
Figure 2 visually depicts AUC values and ROC curves acquired through employing the ensemble model and the machine learning algorithms. These metrics are crucial in assessing the performance and discrimination capabilities of the models. To compare the predicted values of the implemented techniques with the actual values, the confusion matrix was utilized. The confusion matrix, which outlines the true positives, true negatives, false positives, and false negatives, is detailed in Table 5. Additionally, MAE values for the testing and training datasets are provided in Table 6. These values are crucial indicators for assessing model performance and determining whether the model is overfitting to the training data. By comparing the MAE values, one can evaluate the generalization ability of the model.
Table 7, Table 8, Table 9 and Table 10 and Figure 3 present the comparative results after exclusively applying SMOTEENN to the training set after dataset splitting.

4. Discussion

Based on the experimental results, the findings suggest that an ensemble model incorporating techniques random forest, XGBoost, and SVM, can serve as an effective tool for healthcare professionals and doctors in predicting NAFLD, utilizing affordable laboratory test data. This ensemble model demonstrates superior performance compared to this index, which has been utilized by doctors for evaluating and screening NAFLD.
Conventional statistical techniques have limitations in directly predicting NAFLD due to their reliance on selecting potential risk factors from data. To overcome these limitations, this study introduces machine learning techniques, which leverage statistical methods for data analysis and evaluation. Machine learning algorithms offer powerful tools for disease study and diagnosis, with the advantage of simultaneously considering multiple features without the need for variable selection. By applying machine learning techniques, this research aims to enhance NAFLD prediction by comprehensively analyzing diverse factors and their complex relationships, providing a data-driven and multivariate approach to improve diagnostic accuracy.
Furthermore, in our study, it was observed that HSI exhibited lower accuracy and AUC compared to the machine learning models utilized. This indicates that HSI was limited in its ability to accurately identify individuals with NAFLD, as it could only detect a small number of patients with the condition. Conversely, all of the machine learning models demonstrated higher F1 scores than HSI. This indicates that the machine learning models outperformed HSI in terms of precision and recall, achieving a better balance between correctly identifying true positives and minimizing false positives and false negatives. The higher F1 scores achieved by the machine learning models provide supporting evidence that they exhibited superior performance in predicting NAFLD compared to HSI.
SMOTEENN was also exclusively applied to the training set after the dataset was split. This adjustment was made to ensure the absence of potential data leakage and to ensure the robustness of our model evaluation. Our evaluation metrics, including accuracy, precision, recall, F1-score, and AUC, remained consistently high. Minor variations observed in certain metrics were within an acceptable range and did not compromise the overall performance of the model. Furthermore, the Mean Absolute Error (MAE) for both the training and testing datasets remained very low, indicating a strong fit of the model to the data. Confusion matrices were generated for both scenarios to provide a comprehensive assessment of our model’s performance. Given these results, confidence is asserted that data leakage did not occur. Additionally, it can be confirmed that no subject contributed data to both the training and test sets. In conclusion, applying SMOTEENN exclusively to the training set after splitting the dataset maintains the integrity of our findings while addressing potential concerns regarding data leakage. The consistency of our evaluation metrics reaffirms the robustness of our approach and the validity of our results.
Over the years, the utilization of machine learning techniques in disease prediction has been widely explored by numerous researchers. In a study conducted by Weidong Ji et al. [16], four machine learning algorithms were employed to predict Non-Alcoholic Fatty Liver Disease (NAFLD) using a dataset consisting of 304,145 adults. Among these four algorithms, XGBoost demonstrated the highest performance, with accuracy of 0.880 and AUC value of 0.951. Xu et al. [17] undertook a study to evaluate the optimal predictive clinical model for NAFLD using machine learning techniques. The study encompassed a dataset of 2,522 individuals who met the diagnostic criteria for NAFLD. Among the 11 different techniques employed, the best performance was observed, yielding an accuracy of 83%. Liu et al. [18] conducted a study aiming to explore the predictive capabilities of seven machine learning tools for NAFLD on 15,315 Chinese subjects. Among these models, the XGBoost model exhibited the highest accuracy, achieving a value of 0.795. This model demonstrated the best prediction ability among all the models constructed in the study, highlighting its superior performance in accurately diagnosing NAFLD.
Atsawarungruangkit et al. conducted a study aiming to create machine learning models for predicting Non-Alcoholic Fatty Liver Disease (NAFLD), utilizing data from the NHANES 1988–1994 dataset comprising 3235 participants, sourced from the National Center for Health Statistics (NCHS). Comparing the results, they found that the ensemble of random undersampling (RUS) boosted trees achieved the highest accuracy at 71.1%. Interestingly, a simpler model, referred to as “coarse trees,” outperformed this with an accuracy of 74.9% [25].
The findings of previous studies strongly support the effectiveness of machine learning tools in predicting NAFLD. These studies provide compelling evidence of the significant potential of machine learning algorithms in screening and identifying individuals at risk of NAFLD. The results affirm that machine learning techniques can be valuable tools in improving the accuracy and efficiency of NAFLD diagnosis. Consistent with the aforementioned studies, our own research corroborated the effectiveness of machine learning tools in NAFLD prediction. In our study, we developed an ensemble model using machine learning techniques, which achieved an impressive accuracy of 99% and an AUC of 100%. These results serve as further validation of the utility and efficacy of machine learning models in predicting NAFLD. Additionally, our findings highlight the potential of employing an ensemble approach to enhance the accuracy of NAFLD predictions. Together, the cumulative evidence from previous studies and our own research underscores the robustness and promising nature of machine learning tools in NAFLD prediction. These results emphasize the valuable contribution of machine learning algorithms in improving the screening and diagnosis of this prevalent liver disease. It is crucial to emphasize that while the ensemble model shows promising results in the accurate prediction of NAFLD, its effectiveness and integration into clinical practice require further research and validation studies. Nonetheless, the current findings indicate its potential as a valuable tool for healthcare professionals, utilizing affordable laboratory test data to aid in the diagnosis of NAFLD. To ensure its reliable implementation, additional research is warranted to validate its performance and establish its role in the healthcare setting.
Gender has emerged as a critically important factor in NAFLD, which is currently the most common liver disorder worldwide. Sexual dimorphism is evident in NAFLD, with notable disparities in both prevalence and severity based on gender. These differences are not solely influenced by sociocultural factors or lifestyle variations, but also attributed to biological disparities resulting from chromosomal makeup and sex hormone levels [26]. Numerous studies have demonstrated the impact of gender on NAFLD prevalence. For instance, a Japanese study conducted over 12 years found that the average prevalence of fatty liver in men was double that observed in women (26% vs. 13%). Interestingly, women exhibited a gradual increase in prevalence with age, whereas men demonstrated a relatively stable prevalence across all age groups. In the 70–79 age group, the prevalence of NAFLD was higher in females compared to males. Similarly, a study conducted in South China revealed a significantly higher prevalence of NAFLD in men compared to women below the age of 50 (22.4% vs. 7.1%). However, the prevalence reversed among individuals over the age of 50, with higher rates observed in women (27.6% vs. 20.6%). In humans, NAFLD predominantly affects men, while premenopausal women are equally protected from NAFLD and cardiovascular disease [27]. In our study, we conducted an analysis to determine the importance value of each feature and ranked them accordingly. Strikingly, the results indicated that gender exhibited the highest scores in terms of feature importance, reinforcing its significance in predicting NAFLD. These findings align with previous studies that have demonstrated the prominent role of gender in the prevalence and severity of NAFLD. Therefore, gender is a significant and influential feature in NAFLD. It plays a crucial role in the varying prevalence and severity of the disease. Understanding the mechanisms underlying gender disparities in NAFLD is crucial for developing targeted therapeutic interventions. Further research is needed to explore the complex interplay between gender, sex hormones, and NAFLD to optimize management strategies and improve patient outcomes.
This study has notable strengths that contribute to its robustness and generalizability. Firstly, it utilizes the NHANES dataset, which encompasses a diverse racial and ethnic background of individuals in the United States. The dataset is specifically designed to represent the non-institutionalized civilian population and includes oversampling of specific demographic groups, ensuring adequate representation. This approach enhances the study’s findings and minimizes potential bias. Additionally, this study leverages large-scale datasets for testing and training the algorithms, enabling a comprehensive evaluation across different models. Notably, an ensemble model is developed to enhance accuracy and optimize algorithm performance. These strengths collectively enhance the reliability and applicability of the study’s results.
Nevertheless, our study has certain limitations, notably the utilization of restricted datasets, the absence of clinical data, and the lack of a clinical trial. For future endeavors, our goal is to integrate further attributes pertaining to NAFLD, which will aid in the creation of more dependable and effective machine learning methods. Additionally, we strongly advocate for the implementation of a clinical trial to authenticate the efficacy of these techniques in real-world situations.

5. Conclusions

The results of our study highlight the effectiveness of the ensemble model, combining random forest, XGBoost, and SVM techniques, in accurately diagnosing NAFLD. The ensemble model achieved a remarkable performance, with an accuracy of 0.99 and an AUC of 1.00, indicating its high precision and reliability. Notably, our analysis identified gender as the most important feature in predicting NAFLD, further emphasizing its significance in this disease. In comparison to the other indices like HSI, our ensemble model demonstrated superior diagnostic capabilities and yielded substantially better results. These findings underscore the potential of the ensemble model for early detection and diagnosis of NAFLD, useful in screening.

Author Contributions

Conceptualization, A.A.; Data curation, A.A.; Formal analysis, A.A.; Investigation, A.A.; Software, A.A.; Supervision, Y.-L.C., M.A., and T.-H.T.; Writing—original draft, A.A.; Writing—review and editing, Y.-L.C., M.A., and T.-H.T. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Science and Technology Council of the Republic of China (Taiwan) under Contract NSTC 113-2119-M-027-003, 113-2119-M-006-007, 112-2221-E-027-097 and 112-2221-E-027-107.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The NHANES dataset, the Centers for Disease Control (CDC) of the United States as a part of the National Health and Nutrition Examination Survey (NHANES), available online at https://wwwn.cdc.gov/nchs/nhanes/continuousnhanes/default.aspx?BeginYear=2017 (accessed on 15 February 2020).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Su, P.-Y.; Chen, Y.-Y.; Lin, C.-Y.; Su, W.-W.; Huang, S.-P.; Yen, H.-H. Comparison of Machine Learning Models and the Fatty Liver Index in Predicting Lean Fatty Liver. Diagnostics 2023, 13, 1407. [Google Scholar] [CrossRef] [PubMed]
  2. Younossi, Z.M.; Koenig, A.B.; Abdelatif, D.; Fazel, Y.; Henry, L.; Wymer, M. Global Epidemiology of Nonalcoholic Fatty Liver Disease-Meta-Analytic Assessment of Prevalence, Incidence, and Outcomes. Hepatology 2016, 64, 73–84. [Google Scholar] [CrossRef]
  3. Castellana, M.; Donghia, R.; Guerra, V.; Procino, F.; Lampignano, L.; Castellana, F.; Zupo, R.; Sardone, R.; De Pergola, G.; Romanelli, F.; et al. Performance of Fatty Liver Index in Identifying Non-Alcoholic Fatty Liver Disease in Population Studies. A Meta-Analysis. J. Clin. Med. 2021, 10, 1877. [Google Scholar] [CrossRef] [PubMed]
  4. Fan, J.-G.; Kim, S.-U.; Wong, V.W.-S. New Trends on Obesity and NAFLD in Asia. J. Hepatol. 2017, 67, 862–873. [Google Scholar] [CrossRef] [PubMed]
  5. Chen, L.-D.; Huang, J.-F.; Chen, Q.-S.; Lin, G.-F.; Zeng, H.-X.; Lin, X.-F.; Lin, X.-J.; Lin, L.; Lin, Q.-C. Validation of Fatty Liver Index and Hepatic Steatosis Index for Screening of Non-Alcoholic Fatty Liver Disease in Adults with Obstructive Sleep Apnea Hypopnea Syndrome. Chin. Med. J. 2019, 132, 2670–2676. [Google Scholar] [CrossRef] [PubMed]
  6. Fan, J.G.; Wei, L.; Zhuang, H. Guidelines of Prevention and Treatment of Nonalcoholic Fatty Liver Disease (2018, China). J. Dig. Dis. 2019, 20, 163–173. [Google Scholar] [CrossRef] [PubMed]
  7. Younossi, Z.; Stepanova, M.; Ong, J.P.; Jacobson, I.M.; Bugianesi, E.; Duseja, A.; Eguchi, Y.; Wong, V.W.; Negro, F.; Yilmaz, Y.; et al. Nonalcoholic Steatohepatitis Is the Fastest Growing Cause of Hepatocellular Carcinoma in Liver Transplant Candidates. Clin. Gastroenterol. Hepatol. Off. Clin. Pract. J. Am. Gastroenterol. Assoc. 2019, 17, 748–755.e3. [Google Scholar] [CrossRef] [PubMed]
  8. Chalasani, N.; Younossi, Z.; Lavine, J.E.; Charlton, M.; Cusi, K.; Rinella, M.; Harrison, S.A.; Brunt, E.M.; Sanyal, A.J. The Diagnosis and Management of Nonalcoholic Fatty Liver Disease: Practice Guidance from the American Association for the Study of Liver Diseases. Hepatology 2018, 67, 328–357. [Google Scholar] [CrossRef]
  9. Sîrbu, O.; Floria, M.; Dăscălița, P.; Şorodoc, V.; Şorodoc, L. Non-Alcoholic Fatty Liver Disease-From the Cardiologist Perspective. Anatol. J. Cardiol. 2016, 16, 534–541. [Google Scholar] [CrossRef]
  10. Pirmoazen, A.M.; Khurana, A.; El Kaffas, A.; Kamaya, A. Quantitative ultrasound approaches for diagnosis and monitoring hepatic steatosis in nonalcoholic fatty liver disease. Theranostics 2020, 10, 4277–4289. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  11. Zhang, Y.N.; Fowler, K.J.; Hamilton, G.; Cui, J.Y.; Sy, E.Z.; Balanay, M.; Hooker, J.C.; Szeverenyi, N.; Sirlin, C.B. Liver fat imaging-a clinical overview of ultrasound, CT, and MR imaging. Br. J. Radiol. 2018, 91, 20170959. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  12. Petzold, G. Role of Ultrasound Methods for the Assessment of NAFLD. J. Clin. Med. 2022, 11, 4581. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  13. Decharatanachart, P.; Chaiteerakij, R.; Tiyarattanachai, T.; Treeprasertsuk, S. Application of Artificial Intelligence in Non-Alcoholic Fatty Liver Disease and Liver Fibrosis: A Systematic Review and Meta-Analysis. Therap. Adv. Gastroenterol. 2021, 14, 17562848211062808. [Google Scholar] [CrossRef] [PubMed]
  14. Bedogni, G.; Bellentani, S.; Miglioli, L.; Masutti, F.; Passalacqua, M.; Castiglione, A.; Tiribelli, C. The Fatty Liver Index: A Simple and Accurate Predictor of Hepatic Steatosis in the General Population. BMC Gastroenterol. 2006, 6, 33. [Google Scholar] [CrossRef] [PubMed]
  15. Kahl, S.; Straßburger, K.; Nowotny, B.; Livingstone, R.; Klüppelholz, B.; Keßel, K.; Hwang, J.-H.; Giani, G.; Hoffmann, B.; Pacini, G.; et al. Comparison of Liver Fat Indices for the Diagnosis of Hepatic Steatosis and Insulin Resistance. PLoS ONE 2014, 9, e94059. [Google Scholar] [CrossRef] [PubMed]
  16. Ji, W.; Xue, M.; Zhang, Y.; Yao, H.; Wang, Y. A Machine Learning Based Framework to Identify and Classify Non-Alcoholic Fatty Liver Disease in a Large-Scale Population. Front. Public Health 2022, 10, 846118. [Google Scholar] [CrossRef] [PubMed]
  17. Ma, H.; Xu, C.; Shen, Z.; Yu, C.; Li, Y. Application of Machine Learning Techniques for Clinical Predictive Modeling: A Cross-Sectional Study on Nonalcoholic Fatty Liver Disease in China. BioMed Res. Int. 2018, 2018, 4304376. [Google Scholar] [CrossRef] [PubMed]
  18. Liu, Y.-X.; Liu, X.; Cen, C.; Li, X.; Liu, J.-M.; Ming, Z.-Y.; Yu, S.-F.; Tang, X.-F.; Zhou, L.; Yu, J.; et al. Comparison and Development of Advanced Machine Learning Tools to Predict Nonalcoholic Fatty Liver Disease: An Extended Study. Hepatobiliary Pancreat. Dis. Int. 2021, 20, 409–415. [Google Scholar] [CrossRef] [PubMed]
  19. CDC Database. Available online: https://wwwn.cdc.gov/nchs/nhanes/continuousnhanes/default.aspx?BeginYear=2017 (accessed on 15 February 2020).
  20. Kapoor, S.; Narayanan, A. Leakage and the reproducibility crisis in machine-learning-based science. Patterns 2023, 4, 100804. [Google Scholar] [CrossRef]
  21. Lee, J.-H.; Kim, D.; Kim, H.J.; Lee, C.-H.; Yang, J.I.; Kim, W.; Kim, Y.J.; Yoon, J.-H.; Cho, S.-H.; Sung, M.-W.; et al. Hepatic Steatosis Index: A Simple Screening Tool Reflecting Nonalcoholic Fatty Liver Disease. Dig. Liver Dis. Off. J. Ital. Soc. Gastroenterol. Ital. Assoc. Study Liver 2010, 42, 503–508. [Google Scholar] [CrossRef]
  22. Lee, Y.; Bang, H.; Park, Y.M.; Bae, J.C.; Lee, B.-W.; Kang, E.S.; Cha, B.S.; Lee, H.C.; Balkau, B.; Lee, W.-Y.; et al. Non-Laboratory-Based Self-Assessment Screening Score for Non-Alcoholic Fatty Liver Disease: Development, Validation and Comparison with Other Scores. PLoS ONE 2014, 9, e107584. [Google Scholar] [CrossRef] [PubMed]
  23. Chon, Y.E.; Jung, K.S.; Kim, S.U.; Park, J.Y.; Park, Y.N.; Kim, D.Y.; Ahn, S.H.; Chon, C.Y.; Lee, H.W.; Park, Y.; et al. Controlled Attenuation Parameter (CAP) for Detection of Hepatic Steatosis in Patients with Chronic Liver Diseases: A Prospective Study of a Native Korean Population. Liver Int. Off. J. Int. Assoc. Study Liver 2014, 34, 102–109. [Google Scholar] [CrossRef] [PubMed]
  24. Shih, K.-L.; Su, W.-W.; Chang, C.-C.; Kor, C.-T.; Chou, C.-T.; Chen, T.-Y.; Wu, H.-M. Comparisons of Parallel Potential Biomarkers of 1H-MRS-Measured Hepatic Lipid Content in Patients with Non-Alcoholic Fatty Liver Disease. Sci. Rep. 2016, 6, 24031. [Google Scholar] [CrossRef] [PubMed]
  25. Atsawarungruangkit, A.; Laoveeravat, P.; Promrat, K. Machine learning models for predicting non-alcoholic fatty liver disease in the general United States population: NHANES database. World J. Hepatol. 2021, 13, 1417–1427. [Google Scholar] [CrossRef] [PubMed]
  26. Nagral, A.; Bangar, M.; Menezes, S.; Bhatia, S.; Butt, N.; Ghosh, J.; Manchanayake, J.H.; Mahtab, M.A.; Singh, S.P. Gender Differences in Nonalcoholic Fatty Liver Disease. Euroasian J. Hepato-Gastroenterol. 2022, 12 (Suppl. S1), S19–S25. [Google Scholar] [CrossRef]
  27. Ballestri, S.; Nascimbeni, F.; Baldelli, E.; Marrazzo, A.; Romagnoli, D.; Lonardo, A. NAFLD as a Sexual Dimorphic Disease: Role of Gender and Reproductive Status in the Development and Progression of Nonalcoholic Fatty Liver Disease and Inherent Cardiovascular Risk. Adv. Ther. 2017, 34, 1291–1326. [Google Scholar] [CrossRef]
Figure 1. Heat map illustrating the interrelationships among various attributes.
Figure 1. Heat map illustrating the interrelationships among various attributes.
Bioengineering 11 00600 g001
Figure 2. AUC and ROC curve obtained by Ensemble Model and Machine Learning Algorithms.
Figure 2. AUC and ROC curve obtained by Ensemble Model and Machine Learning Algorithms.
Bioengineering 11 00600 g002
Figure 3. AUC and ROC curve obtained by Ensemble Model and Machine Learning Algorithms after applying SMOTEENN exclusively to the training set.
Figure 3. AUC and ROC curve obtained by Ensemble Model and Machine Learning Algorithms after applying SMOTEENN exclusively to the training set.
Bioengineering 11 00600 g003
Table 1. Features Description.
Table 1. Features Description.
FeaturesRangeMeanStdRangeMeanStd
NAFLDNon-NAFLD
Age (years) 13–8051.9419.9312–8045.3820.60
BMI (kg/m2) 20.70–55.3031.778.3915.10–65.3028.867.23
ALP (IU/L) 37–37391.1855.7120–62488.4048.83
ALT (IU/L) 7–18131.0331.553–42021.2516.78
AST (IU/L) 12–7725.9413.076–19821.4411.91
DBP (mm Hg) 36–9270.9811.5539–12069.8812.93
SBP (mm Hg) 98–176130.1617.1178–216122.4719.02
GGT (IU/L) 9–13738.4232.204–41428.2333.05
Creatinine (mg/dL) 0.49–1.450.880.210.25–11.460.860.41
Triglycerides (mg/dL) 47–329130.1858.7225–423117.3164.07
Fasting Glucose (mg/dL) 81–268122.9439.4047–451111.2934.55
RBC (million cells/uL) 3.49–6.274.820.552.87–7.044.780.49
LDL (mg/dL) 46–178109.8834.0818–357107.5935.62
HDL (mg/dL) 30–8747.5410.7311–17853.6014.92
WBC (1000 cells/uL) 3.60–12.807.282.242.30–38.16.742.10
Total Cholesterol (mg/dL) 112–255180.3739.1376–446181.5441.03
Weight (kg) 51.70–16385.8724.4530.70–191.4080.1522.26
Height (cm) 144.80–187.20164.249.32134–195.30166.3210.07
Hemoglobin (g/dL) 8.90–17.2014.071.676.40–18.7014.051.54
Waist Circumference (cm) 76.40–151.90106.1418.4859.20–169.5097.7417.75
Albumin (g/dL) 3.30–4.804.050.312.1–5.24.020.33
std: Standard deviation; GGT: γ-glutamyl transferase; AST: aspartate aminotransferase; ALT: alanine aminotransferase; ALP: Alkaline phosphatase.
Table 2. Rank of features importance.
Table 2. Rank of features importance.
FeaturesRank
ALT0.0302475
Albumin0.03000044
ALP0.03011238
AST0.03231525
Creatinine0.03287693
GGT0.02722758
Triglycerides0.04470876
LDL0.03276697
Age0.05981952
Total Cholesterol0.03232777
Fasting Glucose0.02749087
HDL0.04328872
SBP0.0530115
DBP0.03660032
Hemoglobin0.02463633
Weight0.02756716
Height0.03652343
BMI0.03185026
Waist Circumference0.04027026
WBC0.02362244
RBC0.02518571
Gender0.27754989
Table 3. Number of subjects in the training and testing sets.
Table 3. Number of subjects in the training and testing sets.
DatasetNAFLDNon-NAFLD
Training set19071683
Testing set467444
Table 4. Comparison of Results: Ensemble Model and Machine Learning Algorithms and HIS index.
Table 4. Comparison of Results: Ensemble Model and Machine Learning Algorithms and HIS index.
Machine Learning TechniquesAccuracyPrecisionRecallF1-ScoreSensitivitySpecificityArea under the Curve
Decision Tree0.920.920.920.920.970.850.915
KNN0.880.900. 870. 8710.740.968
Random Forest0.980.980.980.980.990.960.999
SVM0.970.970.970.9710.931.000
XGBoost0.980.980.980.980.990.961.000
Logistic Regression0.840.850.840.840.910.760.907
Ensemble Model0.990.990.990.9910.971.000
HSI index0.740.770.620.680.620.720.73
Table 5. Numbers of TP, FN, TN, and FP cases of Ensemble Model and Machine Learning Algorithms.
Table 5. Numbers of TP, FN, TN, and FP cases of Ensemble Model and Machine Learning Algorithms.
Machine Learning TechniquesTPTNFNFP
Decision Tree 4543811363
Random Forest 466430114
K-nearest Neighbors classifier (KNN) 4673310113
Support Vector Machine (SVM) 467415029
Logistic Regression 42833939105
Extreme Gradient Boosting (XGBoost) 466429115
Ensemble Model 467433011
Table 6. MAE in testing and training phases of Ensemble Model and Machine Learning Algorithms.
Table 6. MAE in testing and training phases of Ensemble Model and Machine Learning Algorithms.
Machine Learning TechniquesTestingTraining
Decision Tree0.1160.080
Random Forest0.0800.028
KNN0.1420.0
SVM0.0190.015
Logistic Regression0.2310.226
XGBoost0.0260.003
Ensemble Model0.0390.013
Table 7. Comparison of Results after applying SMOTEENN exclusively to the training set.
Table 7. Comparison of Results after applying SMOTEENN exclusively to the training set.
Machine Learning TechniquesAccuracyPrecisionRecallF1-ScoreSensitivitySpecificityArea under the Curve
Decision Tree0.890.940.890.910.850.890.901
KNN0.940.960.940.940.950.930.964
Random Forest0.990.990.990.990.9210.975
SVM0.960.960.960.950.4710.993
XGBoost0.970.970.970.970.6710.965
Logistic Regression0.860.910.860.880.600.880.854
Ensemble Model0.990.990.990.990.8510.981
HSI index0.740.770.620.680.620.720.73
Table 8. Numbers of TP, FN, TN, and FP cases after applying SMOTEENN exclusively to the training set.
Table 8. Numbers of TP, FN, TN, and FP cases after applying SMOTEENN exclusively to the training set.
Machine Learning TechniquesTPTNFNFP
Decision Tree 34411650
Random Forest 3746130
K-nearest Neighbors classifier (KNN) 38431230
Support Vector Machine (SVM) 19461210
Logistic Regression 244071654
Extreme Gradient Boosting (XGBoost) 27461130
Ensemble Model 3446160
Table 9. MAE in testing and training phases after applying SMOTEENN exclusively to the training set.
Table 9. MAE in testing and training phases after applying SMOTEENN exclusively to the training set.
Machine Learning TechniquesTestingTraining
Decision Tree0.110.11
Random Forest0.000.00
KNN0.080.00
SVM0.040.00
Logistic Regression0.150.14
XGBoost0.020.00
Ensemble Model0.020.00
Table 10. Number of subjects in the training and testing sets after applying SMOTEENN exclusively to the training set.
Table 10. Number of subjects in the training and testing sets after applying SMOTEENN exclusively to the training set.
DatasetNAFLDNon-NAFLD
Training set18811588
Testing set40461
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Alizargar, A.; Chang, Y.-L.; Alkhaleefah, M.; Tan, T.-H. Precision Non-Alcoholic Fatty Liver Disease (NAFLD) Diagnosis: Leveraging Ensemble Machine Learning and Gender Insights for Cost-Effective Detection. Bioengineering 2024, 11, 600. https://doi.org/10.3390/bioengineering11060600

AMA Style

Alizargar A, Chang Y-L, Alkhaleefah M, Tan T-H. Precision Non-Alcoholic Fatty Liver Disease (NAFLD) Diagnosis: Leveraging Ensemble Machine Learning and Gender Insights for Cost-Effective Detection. Bioengineering. 2024; 11(6):600. https://doi.org/10.3390/bioengineering11060600

Chicago/Turabian Style

Alizargar, Azadeh, Yang-Lang Chang, Mohammad Alkhaleefah, and Tan-Hsu Tan. 2024. "Precision Non-Alcoholic Fatty Liver Disease (NAFLD) Diagnosis: Leveraging Ensemble Machine Learning and Gender Insights for Cost-Effective Detection" Bioengineering 11, no. 6: 600. https://doi.org/10.3390/bioengineering11060600

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop