Next Article in Journal
Optimization Challenges in Vehicle-to-Grid (V2G) Systems and Artificial Intelligence Solving Methods
Previous Article in Journal
Machine Learning-Based Classification of Rock Bursts in an Active Coal Mine Dominated by Non-Destructive Tremors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Ground Reaction Forces and Joint Moments Predict Metabolic Cost in Physical Performance: Harnessing the Power of Artificial Neural Networks

by
Arash Mohammadzadeh Gonabadi
1,2,*,
Farahnaz Fallahtafti
1,
Prokopios Antonellis
1,3,
Iraklis I. Pipinos
4,5 and
Sara A. Myers
1,5
1
Department of Biomechanics and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE 68182, USA
2
Institute for Rehabilitation Science and Engineering, Madonna Rehabilitation Hospitals, Lincoln, NE 68506, USA
3
Department of Neurology, Oregon Health & Science University, Portland, OR 97239, USA
4
Department of Surgery, University of Nebraska Medical Center, Omaha, NE 68105, USA
5
Department of Surgery and Research Service, Nebraska-Western Iowa Veterans Affairs Medical Center, Omaha, NE 68105, USA
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(12), 5210; https://doi.org/10.3390/app14125210
Submission received: 23 April 2024 / Revised: 5 June 2024 / Accepted: 12 June 2024 / Published: 15 June 2024

Abstract

:
Understanding metabolic cost through biomechanical data, including ground reaction forces (GRFs) and joint moments, is vital for health, sports, and rehabilitation. The long stabilization time (2–5 min) of indirect calorimetry poses challenges in prolonged tests. This study investigated using artificial neural networks (ANNs) to predict metabolic costs from the GRF and joint moment time series. Data from 20 participants collected over 270 walking trials, including the GRF and joint moments, formed a detailed dataset. Two ANN models were crafted, netGRF for the GRF and netMoment for joint moments, and both underwent training, validation, and testing to validate their predictive accuracy for metabolic cost. NetGRF (six hidden layers, two input delays) showed significant correlations: 0.963 (training), 0.927 (validation), 0.883 (testing), p < 0.001. NetMoment (three hidden layers, one input delay) had correlations of 0.920 (training), 0.956 (validation), 0.874 (testing), p < 0.001. The models’ low mean squared errors reflect their precision. Using Partial Dependence Plots, we demonstrated how gait cycle phases affect metabolic cost predictions, pinpointing key phases. Our findings show that the GRF and joint moments data can accurately predict metabolic costs via ANN models, with netGRF being notably consistent. This emphasizes ANNs’ role in biomechanics as a crucial method for estimating metabolic costs, impacting sports science, rehabilitation, assistive technology development, and fostering personalized advancements.

1. Introduction

Measuring the metabolic cost from biomechanical data, like ground reaction forces and joint moments, is vital for enhancing health, rehabilitation, and sports through human movement science [1]. Traditional methods need up to five minutes to average metabolic cost data, but recent advances have cut this to about two minutes [2]. However, these techniques still cannot quickly assess metabolic costs during a gait cycle, posing challenges for patients in lengthy walking tests.
The significance of ground reaction forces (GRFs) in biomechanical analysis is well-documented, with methodologies ranging from direct force plate measurements to sophisticated estimations using wearable sensors and inertial motion capture systems [3]. Such advancements have democratized gait and movement analysis, extending the reach of biomechanical assessments beyond the confines of specialized laboratories [4]. Similarly, joint moments offer a window into the internal dynamics of the musculoskeletal system, revealing the intricate interplay between muscle forces and the resulting movements [4,5]. Recent research has further pushed the boundaries of biomechanical analysis by integrating these metrics with advanced computational models to predict metabolic cost [5,6,7,8,9]. This interdisciplinary approach melds the precision of biomechanical measurements with the predictive power of computational algorithms, unveiling new perspectives on the energetics of human movement. The use of neural networks, in particular, exemplifies this trend, showcasing the potential of machine learning in deciphering complex relationships between biomechanical inputs and metabolic outcomes [10].
Drawing from a broader spectrum of artificial intelligence (AI) applications, our previous work has demonstrated the efficacy of optimization methods and artificial neural networks (ANNs) across diverse domains [11,12,13]. These studies underscore AI techniques’ adaptability and bring novel insights into biomechanical analysis. A unified model was developed that leverages walking mechanics to estimate metabolic costs under various conditions, demonstrating the potential of using biomechanical measurements, such as the GRF and joint moments, to predict metabolic costs in human walking [1]. The model’s capability to accommodate different walking conditions underscores its versatility and applicability in biomechanical analysis, offering new insights into the energetic efficiency of gait. Another study [14] compared metabolic cost calculations in gait using musculoskeletal energy models. They evaluated the correlation of several metabolic energy expenditure models with experimental data, enriching our understanding of how different models predict the metabolic costs of gait under varied conditions. Integrating the GRF, marker data, and pulmonary gas exchange measurements in their methodology provides a comprehensive approach to assessing the metabolic implications of gait dynamics.
By synthesizing insights from multiple studies, our research underscores the value of merging biomechanical data with AI models to predict metabolic costs. It leverages AI to evaluate how the GRF and joint moments data forecast metabolic costs, enhancing our theoretical and practical understanding of biomechanical energetics. This work paves the way for developing interventions and devices to improve movement efficiency and health.
ANNs are computational models inspired by the human brain’s structure and function [15,16]. Recent research has leveraged ANNs to gain deeper insights into the mechanics of movement and the prediction of metabolic costs, offering substantial advancements in personalized healthcare and athletic performance optimization. For instance, a literature review [17] demonstrated the application of ANNs in predicting the metabolic cost associated with different physical activities, showcasing the potential of machine learning in enhancing our understanding of energy expenditure in human motion.
Machine learning algorithms are widely used to analyze joint kinetics, providing a novel approach to assessing the biomechanical factors influencing athletic performance and injury risk [18]. Furthermore, an editorial section in ‘Frontiers in Sports and Active Living’ [19] discussed the integration of AI and machine learning in biomechanical research, highlighting how these technologies are reshaping the analysis and interpretation of complex biomechanical data. The incorporation of ANN models enables a more nuanced understanding of human movement, facilitating the development of targeted interventions and assistive technologies designed to optimize movement efficiency and reduce the risk of injury. Expanding on Takallou et al.’s work [20], this research explores the potential of deep learning to elucidate complex biomechanical data connections. Their study, centered on distinguishing individuals with peripheral artery disease through gait analysis using acceleration data, exemplifies AI’s broad applicability, including biomechanics to support clinical decision making.
Based on the established groundwork, our research introduces two main hypotheses to advance the investigation into estimating metabolic costs using biomechanical data. First, we hypothesize that GRF signals, when analyzed through ANNs, can accurately estimate the metabolic cost associated with human locomotion. This hypothesis is predicated on the integral role that the GRF plays in reflecting the external forces acting on the body during movement, which are closely linked to the energetic demands of such activities. Second, we propose that joint moments—quantitative measures of the forces acting around the joints—can also be reliable predictors of metabolic cost when processed through an ANN. This hypothesis stems from the understanding that joint moments enclose the internal biomechanical dynamics, including muscle forces and their lever arms, which are key determinants of the metabolic energy required for movement. Our study rigorously tested these hypotheses to compare the effectiveness of the GRF and joint moments data in predicting metabolic cost, thus enriching our understanding of energy efficiency in human movement.

2. Materials and Methods

2.1. Data Sources and Preprocessing

This study incorporated the time series data from two distinct research projects, each with 10 different participants, exploring various aspects of human gait over treadmill walking. The ‘Footwear Study’ focused on the effects of shoe design on gait under 15 conditions, using 200 Hz for motion capture and 2000 Hz for GRF data [21]. In this study, ten healthy male participants (age 24.9 ± 2.7 years, mass 75.7 ± 13.4 kg, height 173.2 ± 6.4 cm; mean ± s.d.) were recruited. The ‘Hip Exoskeleton Study’ assessed the biomechanical impact of hip exoskeletons under 12 conditions, using 120 Hz for motion capture and 1000 Hz for GRF data acquisition [22]. In this study, ten healthy adults (four males, six females; age: 27.6 ± 5.9 years, body mass: 65.3 ± 13.1 kg, height: 1.66 ± 0.08 m) participated. Both experiments were performed at a constant walking speed of 1.25 m/s on a treadmill. One dataset included variations in outsole geometry, slopes, and treadmill inclination, while the other involved walking with an exoskeleton providing different hip assistance timings. The equipment used included a bilateral semi-rigid exoskeleton for hip motion assistance, and precise sensor calibration ensured high accuracy in data collection. In both studies, the net metabolic rate for walking, expressed in watts per kilogram (W/kg), was determined by the indirect calorimetry method [23]. These computed metabolic cost values serve as the ‘target values’ in our research. Combining the two studies, 270 trials of biomechanical data were collected, including the GRF, normalized as N/kg, and joint moments, normalized as N·m/kg for biological relevance. Data were preprocessed to calculate stride-average time series, ensuring consistency and comparability across the various trials and conditions. To maintain uniformity and ensure comparability across the 270 trials, we standardized the sample rates; GRF signals were normalized to a sample rate of 1000 Hz and motion capture data to 120 Hz. Additionally, we transformed each time series from the trials into 100 data points, reflecting the percentage of the gait cycle. This approach ensured consistency in data analysis and allowed us to focus on the biological moments in the joint moment time series, providing a clear and comparable biomechanical insight across the 270 trials from the two distinct studies.

2.2. Neural Network Design and Implementation

Our analytical framework primarily leverages ANNs, specifically Nonlinear Autoregressive Networks with Exogenous Inputs (NARX) [16], to derive metabolic costs from biomechanical time series data. Our choice to utilize ANNs, particularly NARX, over traditional statistical methods in this investigation is driven by their superior capability in modeling complex nonlinear dynamics often inherent in time series datasets, such as those encountered in biomechanical data analysis [15]. In ANNs, ‘hidden layers’ are intermediary layers between the input and output, crucial for learning complex data patterns. These layers do not interact directly with the input or output but process and transform the information, allowing the ANN to handle intricate problems. ‘Delays’ in the context of ANNs, mainly when dealing with time series data, are essentially a way to incorporate historical information into the model’s current prediction. The concept revolves around using data from previous time steps as input for predicting future outcomes.
In our investigation, we operationalized two distinct NARX models tailored to the two types of biomechanical data: the GRF and joint moments. This bifurcation was strategically aimed at harnessing the specific strengths of NARX networks in handling the diverse complexities inherent in each data type [16]. Each NARX network was configured with an input layer tailored to accommodate the stride-averaged time series data, hidden layers whose size was optimized based on preliminary trials to balance the trade-off between model complexity and predictive accuracy, and an output layer designed to estimate the metabolic cost. The networks underwent rigorous training, validation, and testing processes, utilizing a subset of the compiled dataset, with performance metrics, such as the mean squared error (MSE) and correlation coefficients (R-values), serving as key evaluative criteria [24].
We developed two distinct ANN models using time series data from the GRF and joint moments across a dataset of 270 trials (Figure 1). We selected a 70% (188 trials) training, 15% validation (41 trials), and 15% testing (41 unseen trials) split for each model to ensure a robust learning foundation while maintaining enough data for meaningful validation and testing. The NARX model was trained using the Levenberg–Marquardt backpropagation algorithm. The training process utilized a learning rate of 0.001, a batch size of 15, and 1000 epochs.

2.3. Neural Network Optimization Process

To enhance the robustness of our NARX neural network models, we adopted an exhaustive optimization strategy inspired by Nogueira et al. [25]. This involved nested for-loops to systematically explore various network configurations, focusing on hidden layer size (ranging from 2 to 50 to evaluate network complexity’s impact on accuracy), delays (adjusted from 1 to 4 to capture temporal dependencies), and model reiterations (repeating the ANN 1000 times for each parameter combination to ensure stability and minimize stochastic variations). Each configuration was rigorously evaluated based on predefined performance metrics, including the MSE, for training, validation, test sets, and R-values to assess the model’s predictive accuracy. This systematic exploration ensured that the final selected models were optimal regarding network architecture and demonstrated reliable performance across multiple iterations.

2.4. Computational Implementation

The entire optimization process was implemented in MATLAB (MathWorks, Natick, MA, USA), utilizing its neural network toolbox for model construction and training, along with a customized MATLAB code we developed for this study.

2.5. Partial Dependence Plots (PDPs)

PDPs are a valuable tool in model interpretation, providing insights into the relationship between the predictors and the response variable in machine learning [26,27,28]. We identified which phases are most influential by adjusting the value of one gait cycle percentage at a time and observing the Root-Mean-Square Error (RMSE) changes. The plots generated reveal the dependency of the predicted metabolic cost on the selected gait cycle percentage, providing a clear visual representation of how changes in the gait cycle correlate with prediction accuracy. This method is applied to various models based on the GRF and joint moments to uncover which gait cycle phases are critical for accurate metabolic cost estimation.

2.6. Statistical Analyses

The statistical analysis focused on evaluating the accuracy and reliability of the ANN models by comparing the predicted metabolic cost to the actual data. This involved assessing the model’s performance in terms of error distribution, response correlation, and predictive strength across different phases of data (training, validation, and testing). The analysis also included examining patterns in the prediction errors (MSE) and their correlation with input variables, providing insights into the model’s behavior and areas for improvement. To provide a comprehensive evaluation of our ANN models, we expanded our assessment metrics to include accuracy [29], recall, precision, F1 score [30], and k-fold cross-validation (with k = 5) [31]. Regression analysis further quantified the degree to which the model’s outputs aligned with the target values, offering a comprehensive overview of its effectiveness. We performed all statistical analyses in MATLAB. For all the statistical tests, we set the significance threshold at 0.05.

3. Results

The netGRF, with a hidden layer size of six and input delays set to two, achieved significant (p-value < 0.001) strong R-values across training, validation, and testing datasets, with the R-value of the training at 0.962, the R-value of the validation at 0.937, and the R-value of the test at 0.883 (Figure 2 and Table 1). These values indicate a robust correlation between the predicted and actual metabolic costs, underscoring the model’s efficacy. The MSEs were notably low, with training performance at 0.0036, validation performance at 0.0064, and test performance at 0.0140 in (W/kg)2, further affirming the model’s precision (Table 1).
The joint moments ANN model (netMoment), with a more streamlined architecture featuring a hidden layer size of three and input delays of one, likewise exhibited solid predictive capabilities. The R-values for this model were similarly solid and significant (p-value < 0.001), with the R-value of the training reaching 0.920, the R-value of the validation at 0.956, and the R-value of the test at 0.874 (Figure 3 and Table 1). These results highlight the model’s ability to estimate metabolic cost from joint moments data accurately.
The netMomen model showed strong performance, achieving training, validation, and test scores of 0.0071, 0.0046, and 0.0121 in (W/kg)2, respectively, underscoring its accuracy (Figure 4b and Table 1). An ‘epoch’ in machine learning, specifically in training ANNs, refers to one complete pass of the entire training dataset through the network [15,16]. The green circle in Figure 4a,b symbolizes the epoch at which the model’s validation performance is at its peak.
Figure 5 demonstrates the GRF and joint moment model error histograms (Figure 5a and Figure 5b, respectively). Comparing the two models, both demonstrated exceptional predictive abilities, as evidenced by their high R-values and low MSEs. The GRF model, despite its more complex network structure, did not significantly outperform the joint moments model in terms of R-values, suggesting that both the GRF and joint moments are valuable predictors of metabolic cost. However, the GRF model showed slightly better consistency across different performance metrics (MSEs and R-values), potentially offering a more versatile tool for estimating metabolic cost in varied applications.
To further our understanding of how specific phases within the gait cycle influence metabolic cost predictions, we employed the PDPs [26,27,28]. This analysis was applied to GRF-based and moment-based networks to discern which gait cycle phases exert a more pronounced effect on the models’ predictive accuracy, as quantified by the RMSE. For the GRF-based network, we systematically varied the GRF vertical and anterior–posterior signals across different gait cycle percentages from zero to their maximum observed values. By isolating one percentage at a time and observing the resultant changes in the RMSE, we could pinpoint phases of the gait cycle that are critical for accurate metabolic cost estimation. The first two plots focus on the GRF vertical and AP directions, respectively (Figure 6). Similarly, an analogous approach was undertaken for the moment-based network (Figure 7).

4. Discussion

Our study aimed to advance the understanding of metabolic cost estimation through biomechanical data, focusing on the predictive capabilities of the GRF and joint moments using ANNs. We hypothesized that both the GRF and joint moments could accurately estimate metabolic costs. Our objective was to assess their comparative predictive power, offering insights into the biomechanics of energy efficiency in human locomotion. Our results supported these hypotheses, as the results indicate that both the GRF and moment ANN models can predict metabolic cost. The comparative analysis reveals that the netGRF model, with more neurons in the hidden layer, showed slightly better overall performance and higher R-value of the training component (p-value < 0.001) than the netMoment model. However, the netMoment model demonstrated a more robust correlation and significant R-value for the validation component (p-value < 0.001), indicating potential differences in generalization capabilities. The netGRF model resulted in a higher test performance error, suggesting possible overfitting compared to the netMoment model, which had a more balanced error distribution across training, validation, and testing phases (Table 1).
Determining the ‘best’ model between netGRF and netMoment depends on specific criteria and application needs. If predictive accuracy and lower training errors are prioritized, the netGRF model might be preferred due to its significant, stronger (p-value < 0.001) R-value in training and overall performance. However, for applications valuing generalization to unseen data, the netMoment model, with its stronger, significant validation (p-value < 0.001) R-value, could be more suitable, despite its slightly lower overall R-value. The choice ultimately hinges on whether the focus is on training accuracy or validation performance.
The GRF model demonstrates higher accuracy and superior performance across the other evaluation metrics (accuracy, recall, precision, F1 score, and k-fold cross-validation) compared to the moment prediction model (Table 1). This indicates that the GRF model provides more reliable and precise predictions, making it a more effective tool for our study’s objectives.
The regression analysis for the netGRF model across ‘validation’, ‘test’, ‘training’, and ‘all’ datasets (Figure 2) illustrates a robust linear relationship between the predicted and actual metabolic costs, with the R-values serving as a quantitative measure of this relationship. Strong R-values across all subsets suggest that the netGRF model has learned the underlying patterns effectively and can generalize well to new data. The closeness of data points to the line where predicted values match actual values in the plots signifies the model’s precision. This is particularly evident in the validation subset, where a close alignment highlights the model’s accuracy with validation data. Similarly, the regression analysis for the netMoment model (Figure 3) demonstrates that while the overall trend of the data points suggests a reasonable fit, the spread of the points around the line of unity is more pronounced than in the netGRF model, especially in the ‘test’ subset, as indicated by the lower R-value. This suggests that while the netMoment model has learned to an extent, its predictive performance may not be as robust as the netGRF model when applied to new data.
Figure 2 and Figure 3 underscore the nuanced differences in the performance of the two models. The netGRF model’s stronger R-values imply a more reliable predictive model for estimating metabolic costs from biomechanical data. The data points’ distribution to the fit line and the line of unity across all plots serves as a graphical testament to the netGRF model’s superior ability to capture the essential patterns of the underlying biomechanical processes.
In Figure 4, the training and validation performance plots for the netGRF and netMoment models offer critical insights into the learning dynamics of each network. Figure 4a demonstrates a consistent decrease in the MSE for the netGRF model as the number of epochs increases, with the best validation performance occurring at epoch 9. This suggests that the netGRF model is effectively learning the underlying patterns in the data without signs of significant overfitting, as indicated by the convergence of training and validation error rates. Figure 4b, on the other hand, illustrates the netMoment model’s learning progression, with the best validation performance achieved at an earlier epoch, epoch 6. The green circle indicates a key moment where the validation error minimizes before the test error rises, which may signal the onset of overfitting. This point is crucial for model tuning, as it identifies the epoch after which the model may start to learn noise from the training data rather than underlying trends, reducing its generalization performance on new data. The comparative analysis of these learning curves informs the model selection process, guiding the implementation of early stopping or other regularization techniques to optimize model performance.
The error histograms presented in Figure 5 for both the netGRF and netMoment models visually represent the variance between predicted and actual metabolic costs. Figure 5a shows a concentration of errors closer to zero for the netGRF model, indicating a tighter clustering of predicted values around the actual metabolic costs and, consequently, a higher accuracy. In contrast, Figure 5b shows a broader spread of errors for the netMoment model, implying a greater variance in the accuracy of predictions. The histograms assist in pinpointing areas where predictions consistently deviate from actual values and identifying outlier errors, which can be pivotal for subsequent model refinements. This graphical analysis of error distribution is instrumental in assessing the predictive performance of the models, guiding efforts to optimize them for enhanced accuracy in estimating metabolic costs.
Our findings, demonstrating a solid predictive relationship between the GRF, biomechanical measurements, and metabolic costs in human walking, align with other studies ([1,32]). The superior performance of our netGRF model, demonstrated by stronger R-values and lower MSEs, resonates with the understanding that the GRF, due to its direct relationship with the external forces during locomotion, can provide a more reliable estimate of metabolic cost compared to joint moments. This is further exemplified in our study, where the netGRF model showed a slightly better consistency across various performance metrics, highlighting its robustness and potential as a versatile tool for biomechanical analysis and intervention design to optimize human movement efficiency.
In the current study, the RMSE across the gait cycle for both the GRF and joint moment models reveals the prediction accuracy at various gait cycle phases. This illustrates the variability in predicted metabolic cost based on biomechanical parameters at different stages of gait. The variability and consistency of these predictions are illustrated through the standard deviation of the RMSE, depicted as vertical lines in Figure 6 and Figure 7. Our models analyze data from various gait cycle phases, enhancing prediction accuracy and providing a complete view of energy efficiency in movement. This approach ensures the models’ effectiveness in real-world scenarios, capturing the full complexity of the gait cycle for precise metabolic cost estimations.
A study by Gonabadi et al. [5] presents the stride average metabolic rate and the time profile of the metabolic rate during different walking conditions. They focused on estimating the stride average metabolic rate and creating a time profile of the metabolic rate during different walking conditions using two methods: musculoskeletal estimation and joint-space estimation. Our study and the previous research found that the push-off phase in the gait cycle generates the largest peaks for both the metabolic cost time profile and the RMSEs. Additionally, a notable peak occurs at approximately 17% of the gait cycle in Figure 6c and Figure 7d, corresponding to the peak in the joint-space model’s metabolic cost time profile in Gonabadi et al.’s study [5]. Moreover, using the musculoskeletal method, the single support phase had the highest metabolic cost. In contrast, the joint-space method estimated the highest metabolic cost during the second double-support phase [5]. Our results are within this range, corresponding to 38% and 50% of the gait cycle (Figure 6c and Figure 7d).
Our method can have practical applications, including identifying and characterizing gait disabilities by pinpointing the most energy-intensive phase of the stride cycle in patients, devising targeted rehabilitation exercises, such as treadmill walking, with robotic resistance during the least metabolically efficient phase of the stride cycle, and contributing to the engineering of efficient assistive devices, like designing an exoskeleton that aids the least economically efficient phase of the stride cycle. It may pose a challenge to characterize the time profile of metabolic cost in individual patients due to limited walking endurance. Therefore, a future challenge involves developing methods that enable the characterization of the time profile of metabolic cost with shorter experimental protocols for patients, potentially by integrating our method with other approaches, such as simulation [5,7,8] or blood flow measurements [33,34]. To address the stability and reliability of our ANN model, we suggest continuous performance monitoring, periodic re-evaluation, and retraining using new data.
This study faces limitations beyond its potential overfitting due to its small sample and potential biases, including the specific design of the ANN models for particular datasets, which may limit their use in broader populations or different biomechanical contexts. The models might also simplify the complex nature of movements, focusing mainly on vertical and parallel GRF signals and lower body joints, potentially neglecting essential elements, like lateral movements and upper body contributions. This could restrict a comprehensive view of biomechanical efficiency and energy use. Furthermore, excluding three-dimensional joint data and other GRF directions rather than vertical and anterior–posterior might be a constraint. This study utilized data from two separate experiments, both conducted at a constant walking speed of 1.25 m/s on a treadmill. One dataset included variations in outsole geometry, slopes, and treadmill inclination, while the other involved walking on a level treadmill with an exoskeleton providing different hip assistance timings. As a limitation, future studies should consider incorporating different walking speeds, overground walking, and various surface textures to further generalize the ANN model.

5. Conclusions

The current study underscores the significant promise of ANN models in leveraging biomechanical data to predict metabolic costs, paving the way for advancements in robotics and rehabilitation. The precision of these models, particularly the netGRF model, marks progress in creating customized assistive devices with actual metabolic data. The results indicate a bright future for ANN applications in various fields, enhancing rehabilitation technologies with diverse data and real-world feedback. Future studies could further refine these models by integrating cutting-edge technologies, like augmented and virtual reality, to improve rehabilitation and training results.

Author Contributions

Conceptualization, A.M.G.; methodology, A.M.G., F.F. and P.A.; software, A.M.G.; validation, A.M.G.; formal analysis, A.M.G.; investigation, A.M.G., F.F. and P.A.; resources, A.M.G., F.F., S.A.M. and I.I.P.; data curation, A.M.G., F.F. and S.A.M.; writing—original draft preparation, A.M.G. and F.F.; writing—review and editing, A.M.G., F.F., P.A., S.A.M. and I.I.P.; visualization, A.M.G. and F.F.; supervision, A.M.G. and S.A.M.; project administration, A.M.G.; funding acquisition, S.A.M. and I.I.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Institutes of Health (P20GM109090, R01HD090333, R01AG077803, and R01AG062198) and the U.S. Department of Veterans Affairs Rehabilitation Research and Development Service (I01RX000604 and I01RX003266). The content is solely the authors’ responsibility and does not necessarily represent the official views of the National Institutes of Health or the National Science Foundation.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

We thank Philippe Malcolm for his insightful advice.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Faraji, S.; Wu, A.R.; Ijspeert, A.J. A Simple Model of Mechanical Effects to Estimate Metabolic Cost of Human Walking. Sci. Rep. 2018, 8, 10998. [Google Scholar] [CrossRef] [PubMed]
  2. Selinger, J.C.; Donelan, J.M. Estimating Instantaneous Energetic Cost during Non-Steady-State Gait. J. Appl. Physiol. 2014, 117, 1406–1415. [Google Scholar] [CrossRef] [PubMed]
  3. Zhu, Y.; Xia, D.; Zhang, H. Using Wearable Sensors to Estimate Vertical Ground Reaction Force Based on a Transformer. Appl. Sci. 2023, 13, 2136. [Google Scholar] [CrossRef]
  4. Karatsidis, A.; Bellusci, G.; Schepers, H.; de Zee, M.; Andersen, M.; Veltink, P. Estimation of Ground Reaction Forces and Moments During Gait Using Only Inertial Motion Capture. Sensors 2016, 17, 75. [Google Scholar] [CrossRef] [PubMed]
  5. Mohammadzadeh Gonabadi, A.; Antonellis, P.; Malcolm, P. Differences between Joint-Space and Musculoskeletal Estimations of Metabolic Rate Time Profiles. PLoS Comput. Biol. 2020, 16, e1008280. [Google Scholar] [CrossRef] [PubMed]
  6. Arones, M.M.; Shourijeh, M.S.; Patten, C.; Fregly, B.J. Musculoskeletal Model Personalization Affects Metabolic Cost Estimates for Walking. Front. Bioeng. Biotechnol. 2020, 8, 588925. [Google Scholar] [CrossRef] [PubMed]
  7. Joo, H.; Kim, D.R.D.; Kim, J.H.; Roberts, D. A Joint-Space Numerical Model of Metabolic Energy Expenditure for Human Multibody Dynamic System. Int. J. Numer. Methods Biomed. Eng. 2015, 31, e02721. [Google Scholar] [CrossRef]
  8. Umberger, B.R. Stance and Swing Phase Costs in Human Walking. J. R. Soc. Interface 2010, 7, 1329–1340. [Google Scholar] [CrossRef]
  9. Umberger, B.R.; Gerritsen, K.G.M.M.; MARTIN, P.E. A Model of Human Muscle Energy Expenditure. Comput. Methods Biomech. Biomed. Eng. 2003, 6, 99–111. [Google Scholar] [CrossRef]
  10. Pandi, A.; Koch, M.; Voyvodic, P.L.; Soudier, P.; Bonnet, J.; Kushwaha, M.; Faulon, J.-L. Metabolic Perceptrons for Neural Computing in Biological Systems. Nat. Commun. 2019, 10, 3880. [Google Scholar] [CrossRef]
  11. Mohammadzadeh, A.A.; Mahdipour, N.; Mohammadzadeh, A.A. Forecasting the Cost of Water Using a Neural Network Method in the Municipality of Isfahan. J. Optim. Ind. Eng. 2012, 11, 73–85. [Google Scholar] [CrossRef]
  12. Mohammadzadeh, A.A.; Mahdipour, N.; Mohammadzadeh, A.A.; Ghadamyari, M. Comparison of Forecasting the Cost of Water Using Statistical and Neural Network Methods: Case Study of Isfahan Municipality. African J. Bus. Manag. 2012, 6, 3001–3013. [Google Scholar] [CrossRef]
  13. Mohammadzadeh, G.; Arash, F.; Farahnaz, P.; Iraklis, I.; Myers, S.A. Predicting Lower Body Joint Moments and Electromyography Signals Using Ground Reaction Forces During Walking and Running: An Artificial Neural Network Approach. Gait Posture, 2024; under revision. [Google Scholar]
  14. Koelewijn, A.D.; Heinrich, D.; van den Bogert, A.J. Metabolic Cost Calculations of Gait Using Musculoskeletal Energy Models, a Comparison Study. PLoS ONE 2019, 14, e0222037. [Google Scholar] [CrossRef] [PubMed]
  15. Mandrikova, O.; Polozov, Y.; Zhukova, N.; Shichkina, Y. Approximation and Analysis of Natural Data Based on NARX Neural Networks Involving Wavelet Filtering. Mathematics 2022, 10, 4345. [Google Scholar] [CrossRef]
  16. MathWorks. Design Time Series NARX Feedback Neural Networks. Available online: https://www.mathworks.com/help/deeplearning/ug/design-time-series-narx-feedback-neural-networks.html (accessed on 1 October 2016).
  17. Halilaj, E.; Rajagopal, A.; Fiterau, M.; Hicks, J.L.; Hastie, T.J.; Delp, S.L. Machine Learning in Human Movement Biomechanics: Best Practices, Common Pitfalls, and New Opportunities. J. Biomech. 2018, 81, 1–11. [Google Scholar] [CrossRef]
  18. Li, X.; Liu, X.; Deng, X.; Fan, Y. Interplay between Artificial Intelligence and Biomechanics Modeling in the Cardiovascular Disease Prediction. Biomedicines 2022, 10, 2157. [Google Scholar] [CrossRef] [PubMed]
  19. David, S.; Bačić, B.; Richter, C.; Mundt, M. Editorial: Artificial Intelligence to Enhance Biomechanical Modelling. Front. Sport. Act. Living 2023, 5, 1188035. [Google Scholar] [CrossRef]
  20. Takallou, M.A.; Fallahtafti, F.; Hassan, M.; Al-Ramini, A.; Qolomany, B.; Pipinos, I.; Myers, S.; Alsaleem, F. Diagnosis of Disease Affecting Gait with a Body Acceleration-Based Model Using Reflected Marker Data for Training and a Wearable Accelerometer for Implementation. Sci. Rep. 2024, 14, 1075. [Google Scholar] [CrossRef]
  21. Antonellis, P.; Frederick, C.M.; Gonabadi, A.M.; Malcolm, P. Modular Footwear That Partially Offsets Downhill or Uphill Grades Minimizes the Metabolic Cost of Human Walking. R. Soc. Open Sci. 2020, 7, 191527. [Google Scholar] [CrossRef]
  22. Mohammadzadeh Gonabadi, A.; Antonellis, P.; Dzewaltowski, A.C.; Myers, S.A.; Pipinos, I.I.; Malcolm, P. Design and Evaluation of a Bilateral Semi-Rigid Exoskeleton to Assist Hip Motion. Biomimetics 2024, 9, 211. [Google Scholar] [CrossRef] [PubMed]
  23. Brockway, J.M. Derivation of Formulae Used to Calculate Energy Expenditure in Man. Hum. Nutr. Clin. Nutr. 1987, 41, 463–471. [Google Scholar] [PubMed]
  24. Bermejo, S.; Cabestany, J. Oriented Principal Component Analysis for Large Margin Classifiers. Neural Netw. 2001, 14, 1447–1461. [Google Scholar] [CrossRef] [PubMed]
  25. Nogueira, I.B.R.; Dias, R.O.M.; Rebello, C.M.; Costa, E.A.; Santana, V.V.; Rodrigues, A.E.; Ferreira, A.; Ribeiro, A.M. A Novel Nested Loop Optimization Problem Based on Deep Neural Networks and Feasible Operation Regions Definition for Simultaneous Material Screening and Process Optimization. Chem. Eng. Res. Des. 2022, 180, 243–253. [Google Scholar] [CrossRef]
  26. Hastie, T.; Tibshirani, R.; Friedman, J. The Elements of Statistical Learning; Springer Series in Statistics; Springer: New York, NY, USA, 2009; ISBN 978-0-387-84857-0. [Google Scholar]
  27. Friedman, J.H. Greedy Function Approximation: A Gradient Boosting Machine. Ann. Stat. 2001, 29, 1189–1232. [Google Scholar] [CrossRef]
  28. Goldstein, A.; Kapelner, A.; Bleich, J.; Pitkin, E. Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional Expectation. J. Comput. Graph. Stat. 2015, 24, 44–65. [Google Scholar] [CrossRef]
  29. Bishop, C.M.; Nasrabadi, N.M. Pattern Recognition and Machine Learning; Springer: New York, NY, USA, 2006. [Google Scholar]
  30. Powers, D.M.W. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness and Correlation. arXiv 2020, arXiv:2010.16061. [Google Scholar]
  31. Arlot, S.; Celisse, A. A Survey of Cross-Validation Procedures for Model Selection. Stat. Surv. 2010, 4, 40–79. [Google Scholar] [CrossRef]
  32. Donelan, J.M.; Kram, R.; Kuo, A.D. Mechanical Work for Step-to-Step Transitions Is a Major Determinant of the Metabolic Cost of Human Walking. J. Exp. Biol. 2002, 205, 3717–3727. [Google Scholar] [CrossRef]
  33. Umberger, B.R.; Rubenson, J. Understanding Muscle Energetics in Locomotion: New Modeling and Experimental Approaches. Exerc. Sport. Sci. Rev. 2011, 39, 59–67. [Google Scholar] [CrossRef]
  34. Marsh, R.L.; Ellerby, D.J.; Carr, J.A.; Henry, H.T.; Buchanan, C.I. Partitioning the Energetics of Walking and Running: Swinging the Limbs Is Expensive. Science 2004, 303, 80–83. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The architecture of the neural network model. This schematic represents the ANN models for predicting metabolic cost from biomechanical data. The upper network illustrates the model using hip, knee, and ankle moments as inputs to predict metabolic cost. The lower network demonstrates the model utilizing vertical (GRFver) and anterior–posterior (GRFAP) ground reaction forces as inputs to predict metabolic cost. Both models highlight the data flow from the input through the hidden layers to the output, depicting the ANN’s ability to process complex biomechanical inputs to predict energetic expenditure.
Figure 1. The architecture of the neural network model. This schematic represents the ANN models for predicting metabolic cost from biomechanical data. The upper network illustrates the model using hip, knee, and ankle moments as inputs to predict metabolic cost. The lower network demonstrates the model utilizing vertical (GRFver) and anterior–posterior (GRFAP) ground reaction forces as inputs to predict metabolic cost. Both models highlight the data flow from the input through the hidden layers to the output, depicting the ANN’s ability to process complex biomechanical inputs to predict energetic expenditure.
Applsci 14 05210 g001
Figure 2. Comprehensive regression analysis of the netGRF model. This figure delineates the regression plots for the netGRF model across (a) ‘validation’, (b) ‘test’, (c) ‘training’, and (d) ‘all’ datasets, illustrating the model’s predictive accuracy and generalization capability. The plots compare the predicted metabolic costs against actual values, with each subset providing insights into the model’s performance in different phases of data handling, from learning to generalization on unseen data.
Figure 2. Comprehensive regression analysis of the netGRF model. This figure delineates the regression plots for the netGRF model across (a) ‘validation’, (b) ‘test’, (c) ‘training’, and (d) ‘all’ datasets, illustrating the model’s predictive accuracy and generalization capability. The plots compare the predicted metabolic costs against actual values, with each subset providing insights into the model’s performance in different phases of data handling, from learning to generalization on unseen data.
Applsci 14 05210 g002
Figure 3. Comprehensive regression analysis of the netMoment model. This figure delineates the regression plots for the netMoment model across (a) ‘validation’, (b) ‘test’, (c) ‘training’, and (d) ‘all’ datasets, illustrating the model’s predictive accuracy and generalization capability. The plots compare the predicted metabolic costs against actual values, with each subset providing insights into the model’s performance in different phases of data handling, from learning to generalization on unseen data.
Figure 3. Comprehensive regression analysis of the netMoment model. This figure delineates the regression plots for the netMoment model across (a) ‘validation’, (b) ‘test’, (c) ‘training’, and (d) ‘all’ datasets, illustrating the model’s predictive accuracy and generalization capability. The plots compare the predicted metabolic costs against actual values, with each subset providing insights into the model’s performance in different phases of data handling, from learning to generalization on unseen data.
Applsci 14 05210 g003
Figure 4. Performance of the ANN models for the GRF and joint moments. Panel (a) illustrates the training and validation performance over epochs for the netGRF model, while Panel (b) does the same for the netMoment model. These plots showcase the models’ learning progress, highlighting moments of optimal learning and potential overfitting through changes in error rates and performance metrics. The green circle highlights optimal learning epochs and signs of overfitting.
Figure 4. Performance of the ANN models for the GRF and joint moments. Panel (a) illustrates the training and validation performance over epochs for the netGRF model, while Panel (b) does the same for the netMoment model. These plots showcase the models’ learning progress, highlighting moments of optimal learning and potential overfitting through changes in error rates and performance metrics. The green circle highlights optimal learning epochs and signs of overfitting.
Applsci 14 05210 g004
Figure 5. Error histograms for the GRF and joint moment models. Panel (a) presents the error distribution for netGRF model, and Panel (b), for the netMoment model, illustrates the variance between predicted and actual metabolic costs. The histograms elucidate the frequency of error magnitudes, aiding in identifying consistent prediction deviations and outlier errors for model refinement. A concentration of errors closer to zero for the netGRF model indicates a tighter clustering of predicted values around the actual metabolic costs and, consequently, a higher accuracy. In contrast, there is a broader spread of errors for the netMoment model, implying a greater variance in the accuracy of predictions.
Figure 5. Error histograms for the GRF and joint moment models. Panel (a) presents the error distribution for netGRF model, and Panel (b), for the netMoment model, illustrates the variance between predicted and actual metabolic costs. The histograms elucidate the frequency of error magnitudes, aiding in identifying consistent prediction deviations and outlier errors for model refinement. A concentration of errors closer to zero for the netGRF model indicates a tighter clustering of predicted values around the actual metabolic costs and, consequently, a higher accuracy. In contrast, there is a broader spread of errors for the netMoment model, implying a greater variance in the accuracy of predictions.
Applsci 14 05210 g005
Figure 6. Analysis of ground reaction force influences on metabolic cost prediction under netGRF. (a) Displays the vertical ground reaction force (GRFVer) signals throughout various percentages of the gait cycle, aggregated across all trials (270 in total). (b) Shows the progression of anterior–posterior ground reaction force (GRFAP) signals over the gait cycle and across all trials. (c) Presents a detailed view of how each percentage of the gait cycle impacts the Root-Mean-Square Error (RMSE) between the predicted and actual metabolic costs under netGRF. This visualization, the Partial Dependence Plot (PDP), underscores the significance of distinct phases of the gait cycle in the model’s prediction accuracy. Vertical lines represent the standard deviation of the RMSE, indicating variability and confidence at each point in the gait cycle. The constancy of other factors during this analysis suggests these influences are directly attributable to variations in the gait cycle’s ground reaction forces.
Figure 6. Analysis of ground reaction force influences on metabolic cost prediction under netGRF. (a) Displays the vertical ground reaction force (GRFVer) signals throughout various percentages of the gait cycle, aggregated across all trials (270 in total). (b) Shows the progression of anterior–posterior ground reaction force (GRFAP) signals over the gait cycle and across all trials. (c) Presents a detailed view of how each percentage of the gait cycle impacts the Root-Mean-Square Error (RMSE) between the predicted and actual metabolic costs under netGRF. This visualization, the Partial Dependence Plot (PDP), underscores the significance of distinct phases of the gait cycle in the model’s prediction accuracy. Vertical lines represent the standard deviation of the RMSE, indicating variability and confidence at each point in the gait cycle. The constancy of other factors during this analysis suggests these influences are directly attributable to variations in the gait cycle’s ground reaction forces.
Applsci 14 05210 g006
Figure 7. Analysis of joint moments’ influences on metabolic cost prediction under netmoment. (a) Depicts the hip joint moment (HipM) variations across different gait cycle percentages, compiled from all trials (270 in total). (b) Illustrates the progression of knee joint moment (KneeM) signals throughout the gait cycle, encompassing all trials. (c) Portrays ankle joint moment (AnkleM) fluctuations over the gait cycle and aggregates data from all trials. (d) Provides a granular analysis of each gait cycle percentage’s influence on the Root-Mean-Square Error (RMSE) between the model’s predicted and the actual joint moments under netmoment. This plot, the Partial Dependence Plot (PDP), highlights the critical phases of the gait cycle that significantly affect the model’s accuracy in predicting joint moments. The vertical lines indicate the standard deviation of the RMSE, offering insights into the variability and reliability of the model’s predictions at each gait cycle percentage. The stability of other variables in this analysis implies that these effects are directly linked to changes in the joint moments during the gait cycle.
Figure 7. Analysis of joint moments’ influences on metabolic cost prediction under netmoment. (a) Depicts the hip joint moment (HipM) variations across different gait cycle percentages, compiled from all trials (270 in total). (b) Illustrates the progression of knee joint moment (KneeM) signals throughout the gait cycle, encompassing all trials. (c) Portrays ankle joint moment (AnkleM) fluctuations over the gait cycle and aggregates data from all trials. (d) Provides a granular analysis of each gait cycle percentage’s influence on the Root-Mean-Square Error (RMSE) between the model’s predicted and the actual joint moments under netmoment. This plot, the Partial Dependence Plot (PDP), highlights the critical phases of the gait cycle that significantly affect the model’s accuracy in predicting joint moments. The vertical lines indicate the standard deviation of the RMSE, offering insights into the variability and reliability of the model’s predictions at each gait cycle percentage. The stability of other variables in this analysis implies that these effects are directly linked to changes in the joint moments during the gait cycle.
Applsci 14 05210 g007
Table 1. Comparative analysis of ANN parameters and performance for the GRF and moment models. This table summarizes key parameters and performance metrics, including training, validation, testing (unseen data) ratios, hidden layer sizes, input delays, and performance measures, across training, validation, testing, and overall datasets, as well as accuracy with the acceptable error margin of ± 20%, recall, precision, F1 score, and k-fold cross-validation (k = 5). It highlights the predictive accuracy and correlation coefficients, illustrating the nuanced differences in model performance and efficacy.
Table 1. Comparative analysis of ANN parameters and performance for the GRF and moment models. This table summarizes key parameters and performance metrics, including training, validation, testing (unseen data) ratios, hidden layer sizes, input delays, and performance measures, across training, validation, testing, and overall datasets, as well as accuracy with the acceptable error margin of ± 20%, recall, precision, F1 score, and k-fold cross-validation (k = 5). It highlights the predictive accuracy and correlation coefficients, illustrating the nuanced differences in model performance and efficacy.
ANN Parameters and PerformanceNetGRFNetMoment
SettingsTraining ratio (%)7070
Validation ratio (%)1515
Test ratio (%)1515
Hidden layer size (neurons)63
Delays (count of time steps)21
MSE (W/kg)2Training0.00360.0071
Validation0.00640.0046
Test0.01400.0121
Total trials0.00560.0075
K-fold cross-validation test (k = 5)0.0157 ± 0.00190.0123 ± 0.0013
R-valueTraining0.9630.920
Validation0.9270.956
Test0.8820.874
Total trials0.9420.918
K-fold cross-validation test (k = 5)0.842 ± 0.0160.850 ± 0.024
p-valueTraining<0.001<0.001
Validation<0.001<0.001
Test<0.001<0.001
Total trials<0.001<0.001
K-fold cross-validation test (k = 5)<0.001<0.001
Performance MetricsAccuracy (%)81.7277.32
Recall (%)83.2777.32
Precision (%)81.7277.32
F1 score0.820.77
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mohammadzadeh Gonabadi, A.; Fallahtafti, F.; Antonellis, P.; Pipinos, I.I.; Myers, S.A. Ground Reaction Forces and Joint Moments Predict Metabolic Cost in Physical Performance: Harnessing the Power of Artificial Neural Networks. Appl. Sci. 2024, 14, 5210. https://doi.org/10.3390/app14125210

AMA Style

Mohammadzadeh Gonabadi A, Fallahtafti F, Antonellis P, Pipinos II, Myers SA. Ground Reaction Forces and Joint Moments Predict Metabolic Cost in Physical Performance: Harnessing the Power of Artificial Neural Networks. Applied Sciences. 2024; 14(12):5210. https://doi.org/10.3390/app14125210

Chicago/Turabian Style

Mohammadzadeh Gonabadi, Arash, Farahnaz Fallahtafti, Prokopios Antonellis, Iraklis I. Pipinos, and Sara A. Myers. 2024. "Ground Reaction Forces and Joint Moments Predict Metabolic Cost in Physical Performance: Harnessing the Power of Artificial Neural Networks" Applied Sciences 14, no. 12: 5210. https://doi.org/10.3390/app14125210

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop