A Real-Time, Open-Source, IoT-like, Wearable Monitoring Platform
Abstract
:1. Introduction
- The use of open-source components: We adopt freely usable and customizable software to implement each system architecture block.
- Scalability: We propose a modular system capable of interfacing several wearable devices.
- Real-time processing: The processing is done in a short time period as the data are inputted, providing near-continuous output.
- Remote storage: Both raw data and estimated features are remotely stored in purposely selected databases.
2. Materials and Methods
2.1. Platform Architecture
2.2. The Sensor Fusion Unit
2.3. The Remote Data Storage and Processing Unit
- The EDA is decomposed into two main components: the skin conductance level (SCL) and the skin conductance responses (SCRs). The EDA components contain complementary information about the sympathetic nervous system (SNS). In particular, the SCL represents the EDA slow varying baseline and reflects the subjects’ general psychophysiological state [38]. The SCRs, instead, are relatively quick stimulus-evoked changes in the EDA signal [39]. In the WMP, the SCRs are obtained by passing the 30 s-long window of the EDA signal through a Butterworth high-pass filter with a cutoff frequency of 0.05 Hz [40]. The SCL is derived by subtracting the isolated fast-varying component from the original EDA signal. After the decomposition process, several features are extracted: the mean value (meanSCL, meanSCR) and the standard deviation (stdSCL, stdSCR) of both the SCR and SCL signals, the number of SCRs (nSCR), and the sum of their amplitudes (sSCR).
- The ECG signals are processed to derive and analyze the heart rate variability (HRV) [41]. Operationally, the peak detection phase is performed by leveraging morphological changes in the ECG series by using an adaptive peak detection threshold followed by outlier detection and rejection. The algorithm threshold is adjusted stepwise, exploiting the relative regularity of the heart rate signal to minimize the standard deviation between successive differences. The R peaks are found using a 0.75 s-long window on both sides of each data point. Once the HRV time series are derived from the ECG signals, several time-domain, frequency domain, and nonlinear features are estimated. More specifically, in the time domain, we extract the mean value (meanRR) and the standard deviation (stdRR) of the R-to-R intervals, the square root of the mean squared differences of successive normal-to-normal (NN) intervals (RMSSD), and the percentage of the successive interval differences greater than 50 ms (pNN50). In the frequency domain, the low-frequency (LF; 0.04–0.15 Hz) and high-frequency (HF; 0.15–0.40 Hz) HRV spectral powers as well as their ratio (LF/HF ratio) are computed. Finally, the standard deviations of instantaneous beat-to-beat interval variability obtained from a Poincarè plot as the ellipse width (SD1) and length (SD2) are derived as nonlinear features. Such a feature set estimates the parasympathetic and sympathetic activities regulating the cardiovascular dynamics.
- The EEG data are processed to estimate the EEG power within the classical frequency bandwidths: (1–4 Hz), (4–8 Hz), (8–14 Hz), (14–30 Hz), and (30–40 Hz) using the Welch’s method (window length = 4 s, overlap = 75%). Additionally, the frontal alpha asymmetry (FAA) is computed as the difference between right and left alpha activity over frontal regions (i.e., F4 and F3) [42]. This feature is thought to be a measure of the propensity to adopt approaching or avoiding behaviors and to be involved in the regulation of emotional stress [43].
- The RESP is analyzed to derive the breathing rate within each 30 s-long time window. To this end, the RESP spectral power is obtained by applying the Fast Fourier Transform algorithm. Starting from the power spectrum, the breathing rate is estimated as the frequency corresponding to the maximum value of the spectrum.
- The PPG is redundantly analyzed to derive the HRV, as in the case of the ECG signal. To this end, the PPG pulses are identified by comparing neighboring samples to identify all local maxima. Spurious PPG peaks are discarded by applying an adaptive amplitude threshold and a minimum distance between consecutive pulses. The HRV is then obtained by cubic-spline interpolation and resampling (at 4 Hz [44]) of the inter-pulse intervals time series. Afterwards, starting from the HRV signal, the same features described above (i.e., ECG features) are estimated.
2.4. Experimental Evaluation
2.4.1. Experimental Protocol
2.4.2. Computational Performance Analysis
- Physiological data streaming and remote storing.
- Physiological data streaming, remote storing, and real-time processing of peripheral (ANS) signals.
- Physiological data streaming, remote storing, and real-time processing of CNS signals.
- Physiological data streaming, remote storing and real-time processing of peripheral and CNS signals.
2.4.3. Statistical Analysis
3. Results
3.1. Computational Performance Results
3.2. Statistical Analysis Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Ghiasi, S.; Patane, A.; Laurenti, L.; Gentili, C.; Scilingo, E.P.; Greco, A.; Kwiatkowska, M. Physiologically-informed gaussian processes for interpretable modelling of psycho-physiological states. IEEE J. Biomed. Health Inform. 2022, 26, 5793–5804. [Google Scholar] [CrossRef] [PubMed]
- Greco, A.; Valenza, G.; Bicchi, A.; Bianchi, M.; Scilingo, E.P. Assessment of muscle fatigue during isometric contraction using autonomic nervous system correlates. Biomed. Signal Process. Control 2019, 51, 42–49. [Google Scholar] [CrossRef]
- Aminosharieh Najafi, T.; Affanni, A.; Rinaldo, R.; Zontone, P. Driver attention assessment using physiological measures from EEG, ECG, and EDA signals. Sensors 2023, 23, 2039. [Google Scholar] [CrossRef] [PubMed]
- Can, Y.S.; Gokay, D.; Kılıç, D.R.; Ekiz, D.; Chalabianloo, N.; Ersoy, C. How laboratory experiments can be exploited for monitoring stress in the wild: A bridge between laboratory and daily life. Sensors 2020, 20, 838. [Google Scholar] [CrossRef] [Green Version]
- Smets, E.; De Raedt, W.; Van Hoof, C. Into the wild: The challenges of physiological stress detection in laboratory and ambulatory settings. IEEE J. Biomed. Health Inform. 2018, 23, 463–473. [Google Scholar] [CrossRef]
- Esposito, D.; Centracchio, J.; Andreozzi, E.; Gargiulo, G.D.; Naik, G.R.; Bifulco, P. Biosignal-Based Human–Machine Interfaces for Assistance and Rehabilitation: A Survey. Sensors 2021, 21, 6863. [Google Scholar] [CrossRef]
- Cogan, D.; Birjandtalab, J.; Nourani, M.; Harvey, J.; Nagaraddi, V. Multi-biosignal analysis for epileptic seizure monitoring. Int. J. Neural Syst. 2017, 27, 1650031. [Google Scholar] [CrossRef]
- Kim, S.W.; Lee, K.; Yeom, J.; Lee, T.H.; Kim, D.H.; Kim, J.J. Wearable multi-biosignal analysis integrated interface with direct sleep-stage classification. IEEE Access 2020, 8, 46131–46140. [Google Scholar] [CrossRef]
- Hosseini, S.A.; Khalilzadeh, M.A.; Changiz, S. Emotional stress recognition system for affective computing based on bio-signals. J. Biol. Syst. 2010, 18, 101–114. [Google Scholar] [CrossRef]
- Supratak, A.; Wu, C.; Dong, H.; Sun, K.; Guo, Y. Survey on feature extraction and applications of biosignals. In Machine Learning for Health Informatics; Springer: Berlin/Heidelberg, Germany, 2016; pp. 161–182. [Google Scholar]
- Lee, B.G.; Chung, W.Y. Driver alertness monitoring using fusion of facial features and bio-signals. IEEE Sens. J. 2012, 12, 2416–2422. [Google Scholar] [CrossRef]
- Tangtisanon, P. Real time Human Emotion Monitoring based on Bio-signals. In Proceedings of the 2018 18th International Conference on Control, Automation and Systems (ICCAS), Pyeongchang, Republic of Korea, 17–20 October 2018. [Google Scholar]
- Kim, K.H.; Bang, S.W.; Kim, S.R. Emotion recognition system using short-term monitoring of physiological signals. Med. Biol. Eng. Comput. 2004, 42, 419–427. [Google Scholar] [CrossRef] [PubMed]
- He, C.; Yao, Y.-J.; Ye, X.-S. An emotion recognition system based on physiological signals obtained by wearable sensors. In Wearable Sensors and Robots; Springer: Berlin/Heidelberg, Germany, 2017; pp. 15–25. [Google Scholar]
- Greco, A.; Lanata, A.; Citi, L.; Vanello, N.; Valenza, G.; Scilingo, E.P. Skin admittance measurement for emotion recognition: A study over frequency sweep. Electronics 2016, 5, 46. [Google Scholar] [CrossRef] [Green Version]
- Dias, R.; Da Silva, J.M. A flexible wearable sensor network for bio-signals and human activity monitoring. In Proceedings of the 2014 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops, Zurich, Switzerland, 16–19 June 2014. [Google Scholar]
- Alizadeh, M.; Shaker, G.; De Almeida, J.C.M.; Morita, P.P.; Safavi-Naeini, S. Remote monitoring of human vital signs using mm-wave FMCW radar. IEEE Access 2019, 7, 54958–54968. [Google Scholar] [CrossRef]
- Murali, S.; Rincon, F.; Atienza, D. A wearable device for physical and emotional health monitoring. In Proceedings of the 2015 Computing in Cardiology Conference (CinC), Nice, France, 6–9 September 2015. [Google Scholar]
- Kadhim, K.T.; Alsahlany, A.M.; Wadi, S.M.; Kadhum, H.T. An overview of patient’s health status monitoring system based on Internet of Things (IoT). Wirel. Pers. Commun. 2020, 114, 2235–2262. [Google Scholar] [CrossRef]
- ActiveOS. Available online: https://activeos.com/ (accessed on 6 February 2023).
- Chételat, O.; Oster, J.; Grossenbacher, O.; Hutter, A.; Krauss, J.; Giannakis, A. A highly integrated wearable multi-parameter monitoring system for athletes. In Proceedings of the 15th Nordic-Baltic Conference on Biomedical Engineering and Medical Physics (NBC 2011), Aalborg, Denmark, 14–17 June 2011. [Google Scholar]
- Coates, J.; Chipperfield, A.; Clough, G. Wearable multimodal skin sensing for the diabetic foot. Electronics 2016, 5, 45. [Google Scholar] [CrossRef] [Green Version]
- McGregor, C. A cloud computing framework for real-time rural and remote service of critical care. In Proceedings of the 2011 24th International Symposium on Computer-Based Medical Systems (CBMS), Bristol, UK, 27–30 June 2011. [Google Scholar]
- Oliver, N.; Flores-Mangas, F. HealthGear: A real-time wearable system for monitoring and analyzing physiological signals. In Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks (BSN’06), Berkeley, CA, USA, 3–5 June 2009. [Google Scholar]
- Posthuma, L.; Downey, C.; Visscher, M.; Ghazali, D.; Joshi, M.; Ashrafian, H.; Khan, S.; Darzi, A.; Goldstone, J.; Preckel, B. Remote wireless vital signs monitoring on the ward for early detection of deteriorating patients: A case series. Int. J. Nurs. Stud. 2020, 104, 103515. [Google Scholar] [CrossRef]
- Nabian, M.; Yin, Y.; Wormwood, J.; Quigley, K.S.; Barrett, L.F.; Ostadabbas, S. An open-source feature extraction tool for the analysis of peripheral physiological data. IEEE J. Transl. Eng. Health Med. 2018, 6, 1–11. [Google Scholar] [CrossRef]
- Teller, A.; Stivoric, J. The bodymedia platform: Continuous body intelligence. In Proceedings of the the 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, New York, NY, USA, 15 October 2004; pp. 114–115. [Google Scholar]
- Bhat, G.; Deb, R.; Ogras, U.Y. OpenHealth: Open-source platform for wearable health monitoring. IEEE Des. Test 2019, 36, 27–34. [Google Scholar] [CrossRef] [Green Version]
- Bahmani, A.; Alavi, A.; Buergel, T.; Upadhyayula, S.; Wang, Q.; Ananthakrishnan, S.K.; Alavi, A.; Celis, D.; Gillespie, D.; Young, G.; et al. A scalable, secure, and interoperable platform for deep data-driven health management. Nat. Commun. 2021, 12, 5757. [Google Scholar] [CrossRef]
- Ranjan, Y.; Rashid, Z.; Stewart, C.; Conde, P.; Begale, M.; Verbeeck, D.; Boettcher, S.; Dobson, R.; Folarin, A.; Consortium, R.C.; et al. RADAR-base: Open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. JMIR mHealth uHealth 2019, 7, e11734. [Google Scholar] [CrossRef] [Green Version]
- Stroop, J.R. Studies of interference in serial verbal reactions. J. Exp. Psychol. 1935, 18, 643. [Google Scholar] [CrossRef]
- Gioia, F.; Greco, A.; Callara, A.L.; Scilingo, E.P. Towards a Contactless Stress Classification Using Thermal Imaging. Sensors 2022, 22, 976. [Google Scholar] [CrossRef] [PubMed]
- Atmoko, R.; Riantini, R.; Hasin, M. IoT real time data acquisition using MQTT protocol. In Proceedings of the Journal of Physics: Conference Series, Madrid, Spain, 30 August–4 September 2015. [Google Scholar]
- Spielberger, C.; Gorsuch, R.; Lushene, R.; Vagg, P.; Jacobs, G. Manual for the State-Trait Anxiety Inventory (Form Y1—Y2); Consulting Psychologists Press: Palo Alto, CA, USA, 1983; Volume IV. [Google Scholar]
- Richter, P.; Werner, J.; Heerlein, A.; Kraus, A.; Sauer, H. On the validity of the Beck Depression Inventory. Psychopathology 1998, 31, 160–168. [Google Scholar] [CrossRef] [PubMed]
- Heimberg, R.G.; Horner, K.; Juster, H.; Safren, S.; Brown, E.; Schneier, F.; Liebowitz, M. Psychometric properties of the Liebowitz social anxiety scale. Psychol. Med. 1999, 29, 199–212. [Google Scholar] [CrossRef] [PubMed]
- Willman, J.M. Beginning PyQt; Springer: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
- Greco, A.; Valenza, G.; Lázaro, J.; Garzón-Rey, J.M.; Aguiló, J.; De-la Camara, C.; Bailón, R.; Scilingo, E.P. Acute stress state classification based on electrodermal activity modeling. IEEE Trans. Affect. Comput. 2021, 14, 788–799. [Google Scholar] [CrossRef]
- Dawson, M.E.; Schell, A.M.; Filion, D.L. The Electrodermal System; Cambridge University Press: Cambridge, UK, 2017. [Google Scholar]
- Setz, C.; Arnrich, B.; Schumm, J.; La Marca, R.; Tröster, G.; Ehlert, U. Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans. Inf. Technol. Biomed. 2009, 14, 410–417. [Google Scholar] [CrossRef]
- van Ravenswaaij-Arts, C.M.; Kollee, L.A.; Hopman, J.C.; Stoelinga, G.B.; van Geijn, H.P. Heart rate variability. Ann. Intern. Med. 1993, 118, 436–447. [Google Scholar] [CrossRef]
- Davidson, R.J.; Ekman, P.; Saron, C.D.; Senulis, J.A.; Friesen, W.V. Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology: I. J. Personal. Soc. Psychol. 1990, 58, 330. [Google Scholar] [CrossRef]
- Goodman, R.N.; Rietschel, J.C.; Lo, L.C.; Costanzo, M.E.; Hatfield, B.D. Stress, emotion regulation and cognitive performance: The predictive contributions of trait and state relative frontal EEG alpha asymmetry. Int. J. Psychophysiol. 2013, 87, 115–123. [Google Scholar] [CrossRef]
- Chen, H.K.; Hu, Y.F.; Lin, S.F. Methodological considerations in calculating heart rate variability based on wearable device heart rate samples. Comput. Biol. Med. 2018, 102, 396–401. [Google Scholar] [CrossRef]
- Xu, Q.; Nwe, T.L.; Guan, C. Cluster-based analysis for personalized stress evaluation using physiological signals. IEEE J. Biomed. Health Inform. 2014, 19, 275–281. [Google Scholar] [CrossRef]
- Gioia, F.; Callara, A.L.; Bruderer, T.; Ripszam, M.; Di Francesco, F.; Scilingo, E.P.; Greco, A. Potential physiological stress biomarkers in human sweat. In Proceedings of the 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Messina, Italy, 22–24 June 2022. [Google Scholar]
- Lee, J.; Shields, R.K. Sympathetic Vagal Balance and Cognitive Performance in Young Adults during the NIH Cognitive Test. J. Funct. Morphol. Kinesiol. 2022, 7, 59. [Google Scholar] [CrossRef] [PubMed]
- Mestanik, M.; Mestanikova, A.; Visnovcova, Z.; Calkovska, A.; Tonhajzerova, I. Cardiovascular sympathetic arousal in response to different mental stressors. Physiol. Res. 2015, 64, S585. [Google Scholar] [CrossRef] [PubMed]
- Mendl, M. Performing under pressure: Stress and cognitive function. Appl. Anim. Behav. Sci. 1999, 65, 221–244. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Baldini, A.; Garofalo, R.; Scilingo, E.P.; Greco, A. A Real-Time, Open-Source, IoT-like, Wearable Monitoring Platform. Electronics 2023, 12, 1498. https://doi.org/10.3390/electronics12061498
Baldini A, Garofalo R, Scilingo EP, Greco A. A Real-Time, Open-Source, IoT-like, Wearable Monitoring Platform. Electronics. 2023; 12(6):1498. https://doi.org/10.3390/electronics12061498
Chicago/Turabian StyleBaldini, Andrea, Roberto Garofalo, Enzo Pasquale Scilingo, and Alberto Greco. 2023. "A Real-Time, Open-Source, IoT-like, Wearable Monitoring Platform" Electronics 12, no. 6: 1498. https://doi.org/10.3390/electronics12061498
APA StyleBaldini, A., Garofalo, R., Scilingo, E. P., & Greco, A. (2023). A Real-Time, Open-Source, IoT-like, Wearable Monitoring Platform. Electronics, 12(6), 1498. https://doi.org/10.3390/electronics12061498