Comparative Analysis of Machine Learning Techniques for Heart Rate Prediction Employing Wearable Sensor Data
Abstract
:1. Introduction
- Integrating HR with other indicators, such as BR and RR intervals, improves accuracy but increases model complexity [30].
- Achieving accurate predictions in varying environmental conditions and for heterogeneous populations remains challenging, as physical activity and fitness level variability affect HR prediction accuracy [31].
- Balancing prediction accuracy with the processing power constraints of wearable devices is crucial for real-time applications, especially in low-resource settings [32].
- Ensuring models perform well across different physical activities and populations without specific recalibration is crucial for broader applicability [31].
- Evaluate and compare the performance of ML models in predicting HR using ECG-derived data.
- Assess the impact of incorporating additional physiological parameters (BR and RR intervals) on the accuracy of HR predictions [28].
- Investigate the effectiveness of a hybrid approach in improving HR prediction accuracy and robustness.
- Analyze the computational efficiency and practicality of implementing these models in wearable devices for on-the-go predictions [32].
2. Data and Methodology
2.1. Data Collection and Preprocessing
- Collect HR, BR, and RR interval data using a validated wearable sensor across multiple sports disciplines.
- Apply statistical methods to remove outliers, normalize physiological signals, and extract relevant features.
- Train and test machine learning models, including SSA-augmented LSTM, CNN, PINN, and RNN architectures.
- Compare models based on MAE, assessing the impact of SSA and auxiliary inputs (BR and RR) on HR prediction accuracy.
- Discuss the implications for real-time health monitoring and future model improvements.
2.2. A Hybrid Models to Predict HR
Singular Spectrum Analysis (SSA)
- Embedding: A sliding window with length L forms a trajectory matrix, X, transforming the original one-dimensional series into a multidimensional series of lagged vectors.
- Decomposition: Singular value decomposition (SVD) is applied to X to identify the principal components.
- Grouping: Singular values are grouped into deterministic components (trend and periodic) and stochastic components (residuals).
- Reconstruction: The final step involves reconstructing the time series through diagonally averaging grouped matrices.
2.3. Recurrent Neural Networks (RNN)
2.4. Long Short-Term Memory (LSTM)
- Forget Gate : Decides what portion of the cell state should be forgotten.
- Input Gate : Determines new information to add to the cell state.
- Output Gate : Controls what part of the cell state flows to the hidden state .
2.5. One-Dimensional Convolutional Neural Networks (1D CNN)
2.6. Physics-Informed Neural Networks (PINNs)
- measures the error between predictions and ground truth HR labels.
- enforces adherence to the physiological dynamics.
- and are weighting factors balancing the accuracy with the physical constraints.
Hybrid SSA-ML/DL Models
- SSA Decomposition and Prediction: Apply SSA to the input time series to decompose it into deterministic components, including trend and periodic patterns, as well as residuals. Then, the deterministic part is extrapolated using SSA.
- Residual Prediction with ML/DL: Use an ML/DL model to predict the residual component, capturing complex, nonlinear relationships in the time series data.
- Combined predicted HR: Combine the SSA-derived deterministic components with the ML/DL-predicted residuals to produce the final HR prediction, leveraging predictable trends and learned residual patterns.
- SSA + LSTM.
- SSA + 1D CNN.
- SSA + PINNs.
- SSA + RNN.
2.7. Model Training and Evaluation
3. Results
3.1. Model Performance
3.2. Impact of Input Parameters
- The HR + BR + RR combination consistently outperformed all other input configurations across the tested models, aligning with previous findings that highlight the value of incorporating multiple physiological inputs.
- While HR + BR and HR + RR both improved prediction accuracy compared to HR alone, they were less effective than the comprehensive HR + BR + RR combination.
- Including BR and RR data added valuable information, resulting in more accurate predictions.
Model | HR + BR | HR + RR | HR + BR + RR |
---|---|---|---|
SSA + CNN | 5.09 | 2.54 | 5.90 |
SSA + LSTM | 2.04 | 4.38 | 4.99 |
SSA + PINNs | 4.23 | 1.73 | 4.99 |
SSA + RNN | 3.39 | -4.66 | 4.03 |
3.3. Comparison of Standalone ML and SSA-Enhanced Models
3.4. Computational Time Analysis
4. Discussion
- SSA’s noise reduction likely contributes to enhanced model generalization. Physiological data from wearables can be noisy due to sensor inaccuracies or user movement; SSA mitigates this noise, resulting in improved predictive performance and more reliable HR monitoring across diverse conditions [12].
- Known for its strength in modelling long-term dependencies in time series data, the LSTM benefits from SSA’s preprocessing by concentrating on long-term trends after irrelevant or noisy components are removed, making it especially effective for HR prediction [34].
- This research relied on a specific dataset, which may limit applicability to other populations or settings. Further research should validate these findings across diverse demographics, age ranges, and conditions. It is also recommended that various physical activities, stress levels, climate, variables, and environments be included. Large-scale validation studies with heterogeneous data can help ensure broader model generalizability [30].
- While our study primarily focused on predictive accuracy, computational efficiency remains a limitation. The SSA-LSTM model, in particular, is computationally intensive due to its sequential processing, which may hinder real-time deployment in low-resource environments. Future work should systematically analyse model efficiency and explore optimization strategies such as model compression, pruning, and hardware acceleration [32].
- Our study mainly focuses on short-term HR forecasting. Evaluating model performance for longer time horizons, such as hourly or daily forecasts. It may be beneficial for chronic disease management and long-term fitness monitoring.
- Although we focused on HR, BR, and RR intervals, additional parameters, such as skin temperature, galvanic skin response, and blood oxygen levels, may offer further insights into cardiovascular health. Examining the impact of these variables on HR prediction accuracy could lead to more comprehensive models that assess a wider range of health metrics [3].
- The complexity of the SSA-LSTM model may limit its interpretation and its ability to achieve high accuracy. It is therefore challenging to understand the contribution of individual physiological parameters or components to the final prediction. Future research should develop ways to increase model transparency [34].
- While HR monitoring is valuable, it may not fully capture aerobic capacity in high-intensity exercise, where max plays a key role. Since our dataset does not include max, this study does not explore its relationship with HR. Future research should incorporate additional physiological markers, such as lactate threshold, to improve HR prediction models for high-intensity training.
- The primary computational cost associated with the offline training phase. While real-time prediction on the wearable device is significantly faster, ensuring practical applicability, and while SSA integration increases training time, this is a one-time process; prediction, the crucial on-device operation, remains computationally efficient. Despite the training overhead, the prediction phase, essential for wearable device functionality, exhibits rapid execution, mitigating concerns about real-time performance. Investigating the computation cost of real-time monitoring and prediction in future studies is beneficial.
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
AR | Autoregressive |
ARIMA | AutoRegressive Integrated Moving Average |
ARMA | Autoregressive-Moving Average |
BiLSTM | Bidirectional Long Short-Term Memory |
BPTT | BackPropagation Through Time |
BR | Breathing Rate |
CNN | Convolutional Neural Network |
DL | Deep Learning |
ECG | Electrocardiogram |
HR | Heart Rate |
LSTM | Long Short-Term Memory |
MAE | Mean Absolute Error |
ML | Machine Learning |
PINN | Physics-Informed Neural Network |
RF | Random Forest |
RNN | Recurrent Neural Network |
RR | RR-Interval (time between consecutive heartbeats) |
SVD | Singular Value Decomposition |
SVM | Support Vector Machine |
SSA | Singular Spectrum Analysis |
References
- Achten, J.; Jeukendrup, A.E. Heart Rate Monitoring: Applications and Limitations. Sport. Med. 2003, 33, 517–538. [Google Scholar] [CrossRef] [PubMed]
- Schneider, M.; Mücke, S. Implementing Wearable Sensors for Real-time Monitoring in Team Sports: Challenges and Solutions. Eur. J. Sport Sci. 2018, 18, 612–620. [Google Scholar]
- Seshadri, D.R.; Drummond, C.; Craker, J.; Rowbottom, J.R.; Voos, J.E. Wearable Sensors for Monitoring the Physiological and Biochemical Profile of the Athlete. NPJ Digit. Med. 2019, 2, 72. [Google Scholar] [CrossRef] [PubMed]
- Seçkin, A.Ç.; Ateş, B.; Seçkin, M. Review on Wearable Technology in sports: Concepts, Challenges and opportunities. Appl. Sci. 2023, 13, 10399. [Google Scholar] [CrossRef]
- Latino, F.; Tafuri, F. Wearable Sensors and the Evaluation of Physiological Performance in Elite Field Hockey Players. Sports 2024, 12, 124. [Google Scholar] [CrossRef]
- Düking, P.; Hotho, A.; Holmberg, H.C.; Fuss, F.K.; Sperlich, B. Comparison of non-invasive individual monitoring of the training and health of athletes with commercially available wearable technologies. Front. Physiol. 2016, 7, 71. [Google Scholar] [CrossRef]
- Dong, J.G. The role of heart rate variability in sports physiology. Exp. Ther. Med. 2016, 11, 1531–1536. [Google Scholar] [CrossRef]
- Ding, X.; Clifton, D.; Ji, N.; Lovell, N.H.; Bonato, P.; Chen, W.; Yu, X.; Xue, Z.; Xiang, T.; Long, X.; et al. Wearable sensing and telehealth technology with potential applications in the coronavirus pandemic. IEEE Rev. Biomed. Eng. 2020, 14, 48–70. [Google Scholar] [CrossRef]
- Khashei, M.; Bijari, M. A novel hybridization of artificial neural networks and ARIMA models for time series forecasting. Appl. Soft Comput. 2011, 11, 2664–2675. [Google Scholar] [CrossRef]
- Staffini, A.; Svensson, T.; Chung, U.-i.; Svensson, A.K. Heart Rate Modeling and Prediction Using Autoregressive Models and Deep Learning. Sensors 2021, 22, 34. [Google Scholar] [CrossRef]
- Sadeghi, M.; Sasangohar, F.; McDonald, A.D.; Hegde, S. Understanding heart rate reactions to Post-Traumatic Stress Disorder (PTSD) among veterans: A naturalistic study. Hum. Factors 2022, 64, 173–187. [Google Scholar] [CrossRef] [PubMed]
- Namazi, A. On the improvement of heart rate prediction using the combination of singular spectrum analysis and copula-based analysis approach. PeerJ 2022, 10, e14601. [Google Scholar] [CrossRef] [PubMed]
- Henriksen, A.; Haugen Mikalsen, M.; Woldaregay, A.Z.; Muzny, M.; Hartvigsen, G.; Hopstock, L.A.; Grimsgaard, S. Using Fitness Trackers and Smartwatches to Measure Physical Activity in Research: Analysis of Consumer Wrist-worn Wearables. J. Med. Internet Res. 2018, 20, e110. [Google Scholar] [CrossRef] [PubMed]
- Gillinov, S.; Etiwy, M.; Wang, R.; Blackburn, G.; Phelan, D.; Gillinov, A.M.; Houghtaling, P.; Javadikasgari, H.; Desai, M.Y. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sport. Exerc. 2017, 49, 1697–1703. [Google Scholar] [CrossRef]
- Shaffer, F.; Ginsberg, J.P. An Overview of Heart Rate Variability Metrics and Norms. Front. Public Health 2017, 5, 258. [Google Scholar] [CrossRef]
- Massaroni, C.; Nicolò, A.; Lo Presti, D.; Sacchetti, M.; Silvestri, S.; Schena, E. Contact-based methods for measuring respiratory rate. Sensors 2019, 19, 908. [Google Scholar] [CrossRef]
- Shcherbina, A.; Mattsson, C.M.; Waggott, D.; Salisbury, H.; Christle, J.W.; Hastie, T.; Wheeler, M.T.; Ashley, E.A. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Pers. Med. 2017, 7, 3. [Google Scholar] [CrossRef]
- Modiri, E.; Bárdossy, A. Clustering simultaneous occurrences of the extreme floods in the Neckar catchment. Water 2021, 13, 399. [Google Scholar] [CrossRef]
- Yu, Y.; Si, X.; Hu, C.; Zhang, J. A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures. Neural Comput. 2019, 31, 1235–1270. [Google Scholar] [CrossRef]
- Ahmed, D.M.; Hassan, M.M.; Mstafa, R.J. A review on deep sequential models for forecasting time series data. Appl. Comput. Intell. Soft Comput. 2022, 2022, 6596397. [Google Scholar] [CrossRef]
- Raissi, M.; Perdikaris, P.; Karniadakis, G.E. Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. J. Comput. Phys. 2019, 378, 686–707. [Google Scholar] [CrossRef]
- Kiranyaz, S.; Ince, T.; Gabbouj, M. 1D Convolutional Neural Networks and Applications: A Survey. Mech. Mater. 2019, 18, 173–184. [Google Scholar] [CrossRef]
- Guessoum, S.; Belda, S.; Ferrandiz, J.M.; Modiri, S.; Raut, S.; Dhar, S.; Heinkelmann, R.; Schuh, H. The short-term prediction of length of day using 1D convolutional neural networks (1D CNN). Sensors 2022, 22, 9517. [Google Scholar] [CrossRef]
- Chen, X.; Gao, Z.; Zhang, Y. Dynamic Heart Rate Prediction During Exercises Using CNN-LSTM Hybrid Model. Biomed. Signal Process. Control 2019, 47, 373–380. [Google Scholar]
- Wu, K.; Wu, J.; Feng, L.; Yang, B.; Liang, R.; Yang, S.; Zhao, R. An attention-based CNN-LSTM-BiLSTM model for short-term electric load forecasting in integrated energy system. Int. Trans. Electr. Energy Syst. 2021, 31, e12637. [Google Scholar] [CrossRef]
- Hu, J.; Zheng, W. Multistage Attention Network for Multivariate Time Series Prediction. Neurocomputing 2020, 383, 122–137. [Google Scholar] [CrossRef]
- Xiao, F.; Chen, Y.; Yuchi, M.; Ding, M.; Jo, J. Heart Rate Prediction Model Based on Physical Activities Using Evolutionary Neural Network. IEEE Trans. Biomed. Eng. 2022, 69, 1234–1243. [Google Scholar]
- Knorr, M.; Brederecke, J.; Bremer, J.; Neyazi, M.; Blankenberg, S.; Doerr, M.; Vollmer, M.; Schnabel, R. Improving cardiovascular risk stratification with ECG-predicted risk factors in primary prevention. Eur. Heart J. 2024, 45, 402–403. [Google Scholar] [CrossRef]
- Naseri, A.; Tax, D.M.; Reinders, M.; van der Bilt, I. Heart disease detection using an acceleration-deceleration curve-based neural network with consumer-grade smartwatch data. Heliyon 2024, 10, e39927. [Google Scholar] [CrossRef]
- Garbern, S.C.; Mamun, G.M.S.; Shaima, S.N.; Hakim, N.; Wegerich, S.; Alla, S.; Sarmin, M.; Afroze, F.; Sekaric, J.; Genisca, A.; et al. A novel digital health approach to improving global pediatric sepsis care in Bangladesh using wearable technology and machine learning. PLoS Digit. Health 2024, 3, e0000634. [Google Scholar] [CrossRef]
- Mojtahed, H.; Rao, R.; Paolini, C.; Sarkar, M. Temporal Modeling of Instantaneous Interbeat Interval based on Physical Activity. IEEE Access 2023, 11, 138279–138291. [Google Scholar] [CrossRef]
- Oyeleye, M.; Chen, T.; Titarenko, S.; Antoniou, G. Predictive Analysis of Heart Rates Using Machine Learning Techniques. Int. J. Environ. Res. Public Health 2022, 19, 2417. [Google Scholar] [CrossRef]
- Golyandina, N.; Korobeynikov, A.; Zhigljavsky, A. Singular Spectrum Analysis with R; Springer Science & Business Media: Heidelberg, Germany, 2013. [Google Scholar]
- Modiri, S.; Belda, S.; Heinkelmann, R.; Hoseini, M.; Ferrándiz, J.M.; Schuh, H. Polar motion prediction using the combination of SSA and Copula-based analysis. Earth Planets Space 2018, 70, 115. [Google Scholar] [CrossRef]
- Sbrollini, A.; Morettini, M.; Maranesi, E.; Marcantoni, I.; Nasim, A.; Bevilacqua, R.; Riccardi, G.R.; Burattini, L. Sport Database: Cardiorespiratory Data Acquired Through Wearable Sensors While Practicing Sports. Data Brief 2019, 27, 104793. [Google Scholar] [CrossRef]
- Modiri, S. On the Improvement of Earth Orientation Parameters Estimation: Using Modern Space Geodetic Techniques. Ph.D. Thesis, Technische Universitaet Berlin, Berlin, Germany, 2021. [Google Scholar]
- Sherstinsky, A. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Phys. D Nonlinear Phenom. 2020, 404, 132306. [Google Scholar] [CrossRef]
- Schmidhuber, J.; Hochreiter, S. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar]
- Huang, R.; Wei, C.; Wang, B.; Yang, J.; Xu, X.; Wu, S.; Huang, S. Well performance prediction based on Long Short-Term Memory (LSTM) neural network. J. Pet. Sci. Eng. 2022, 208, 109686. [Google Scholar] [CrossRef]
- Kamilaris, A.; Prenafeta-Boldú, F.X. A review of the use of convolutional neural networks in agriculture. J. Agric. Sci. 2018, 156, 312–322. [Google Scholar] [CrossRef]
- Kiani Shahvandi, M.; Adhikari, S.; Dumberry, M.; Modiri, S.; Heinkelmann, R.; Schuh, H.; Mishra, S.; Soja, B. Contributions of core, mantle and climatological processes to Earth’s polar motion. Nat. Geosci. 2024, 17, 705–710. [Google Scholar] [CrossRef]
Characteristic | Mean ± SD | Range |
---|---|---|
Age (years) | 30 ± 13 | 18–45 |
Gender (M/F) | 53/28 | - |
Height (cm) | 170 ± 30 | 159–190 |
Weight (kg) | 71 ± 21 | 50–90 |
Smoking (No/Yes) | 39/29 | - |
Alcohol Consumption (No/Sometimes) | 11/55 | - |
Weekly Training (hours) | 4 ± 1 | 2–15 |
Sports Experience (%) | Beginner (30%), Intermediate (50%), Advanced (20%) | - |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Namazi, A.; Modiri, E.; Blesić, S.; Knežević, O.M.; Mirkov, D.M. Comparative Analysis of Machine Learning Techniques for Heart Rate Prediction Employing Wearable Sensor Data. Sports 2025, 13, 87. https://doi.org/10.3390/sports13030087
Namazi A, Modiri E, Blesić S, Knežević OM, Mirkov DM. Comparative Analysis of Machine Learning Techniques for Heart Rate Prediction Employing Wearable Sensor Data. Sports. 2025; 13(3):87. https://doi.org/10.3390/sports13030087
Chicago/Turabian StyleNamazi, Asieh, Ehsan Modiri, Suzana Blesić, Olivera M. Knežević, and Dragan M. Mirkov. 2025. "Comparative Analysis of Machine Learning Techniques for Heart Rate Prediction Employing Wearable Sensor Data" Sports 13, no. 3: 87. https://doi.org/10.3390/sports13030087
APA StyleNamazi, A., Modiri, E., Blesić, S., Knežević, O. M., & Mirkov, D. M. (2025). Comparative Analysis of Machine Learning Techniques for Heart Rate Prediction Employing Wearable Sensor Data. Sports, 13(3), 87. https://doi.org/10.3390/sports13030087