Next Article in Journal
Play-Based Activities with a CoderBot Robot on a Pediatric Ward: A Case Study
Previous Article in Journal
How Patients Who Are Transported by Ambulance Experience Dyspnea and the Use of a Dyspnea Scale: A Qualitative Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review

1
Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China
2
School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
3
Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA
4
School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
5
Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
*
Authors to whom correspondence should be addressed.
Healthcare 2022, 10(7), 1210; https://doi.org/10.3390/healthcare10071210
Submission received: 31 May 2022 / Revised: 20 June 2022 / Accepted: 23 June 2022 / Published: 28 June 2022

Abstract

:
With the rapid development of Internet of Things (IoT) technologies, traditional disease diagnoses carried out in medical institutions can now be performed remotely at home or even ambient environments, yielding the concept of the Internet of Health Things (IoHT). Among the diverse IoHT applications, inertial measurement unit (IMU)-based systems play a significant role in the detection of diseases in many fields, such as neurological, musculoskeletal, and mental. However, traditional numerical interpretation methods have proven to be challenging to provide satisfying detection accuracies owing to the low quality of raw data, especially under strong electromagnetic interference (EMI). To address this issue, in recent years, machine learning (ML)-based techniques have been proposed to smartly map IMU-captured data on disease detection and progress. After a decade of development, the combination of IMUs and ML algorithms for assistive disease diagnosis has become a hot topic, with an increasing number of studies reported yearly. A systematic search was conducted in four databases covering the aforementioned topic for articles published in the past six years. Eighty-one articles were included and discussed concerning two aspects: different ML techniques and application scenarios. This review yielded the conclusion that, with the help of ML technology, IMUs can serve as a crucial element in disease diagnosis, severity assessment, characteristic estimation, and monitoring during the rehabilitation process. Furthermore, it summarizes the state-of-the-art, analyzes challenges, and provides foreseeable future trends for developing IMU-ML systems for IoHT.

1. Introduction

Patients suffering from neurological and musculoskeletal diseases have different levels of mobility. The ones with higher levels of mobility impairments suffer from physical pain stemming from their condition and a lower quality of life, both debilitating to their mental health. To help them regain their independence, plenty of medical institutions provide motion monitoring and evaluation-based rehabilitation services, such as disease diagnosis and exercise training [1,2].
Conventionally, camera-based three-dimensional (3D) motion capture systems [3] and pressure sensor-enabled electronic walkways [4] have been used to monitor body motions for diverse medical evaluation purposes. The former track the positions of markers placed on body segments and form a segmented 3D pose; in contrast, the latter quantify plantar stress distributions for a gait analysis. Both setups are expensive and restricted to laboratory settings; hence, they are mainly employed in medical or research institutions. Due to multiple reasons (limited healthcare resources, challenges of commute for some physical disabled patients, etc.), treatment or rehabilitation in medical institutions might not be viable for every patient. Especially for patients that require longer rehabilitation periods, this is a significant issue. In order to make medical monitoring and rehabilitation more accessible to patients, new methods based on the Internet of Things (IoT) are currently being explored [5,6,7].
The IoT’s application in this domain mainly aims for real-time data collection and providing physicians the necessary information to track their patients reliably. Internet of Health Things (IoHT) systems, such as normal IoT systems, are made up of data acquisition, the user interface, and cloud component [8], data that are collected from wearable sensors and processed by smartphones, tablets, and even smartwatches. This data is then transmitted to a central server, from which the physician can access the patient’s information and make judgments [9]. Islam et al. [10] predicted many potential areas for IoT-based healthcare, such as frameworks for elderly patients that provide more continuous assistance, called ambient assisted living, community-wide health monitoring, and applications such as monitoring a wide variety of vitals such as blood sugar, body temperature, and oxygen saturation. In addition to monitoring vitals, several IoHT systems were proposed for rehabilitation and disease monitoring. Dobkin et al. [11] proposed an in-home Rehabilitation Internet of Things framework that focuses on the improvement of motor functions. Frameworks such as Dobkin’s rely on a wide array of metrics, depending on the type of illness that is being monitored or the circumstance of rehabilitation. For example, metrics such as activity patterns and gait have been proposed to be utilized for monitoring illnesses such as Parkinson’s disease and osteoarthritis [12]. There is also the possibility of monitoring multiple illnesses at the same time. AbdulGhaffar et al.’s proposed system monitors three illnesses: hypertension, glaucoma, and chronic obstructive pulmonary disease (COPD), by monitoring the patient’s blood and intraocular pressures and the blood saturation levels [13].
IoHT systems rely on a wide variety of wearable sensors to collect patient data. Broadly utilized wearable motion-sensing technologies include electromyography (EMG), optical fiber sensors (OFS), Radio Frequency Identifications (RFID), and inertial measurement unit (IMU)-based systems. Among them, EMG reflects users’ motions by capturing the physiological metrics of muscle activity [14,15]. However, the sensitive nature of the sensors makes them prone to noisy data collection, and poor wearability limits their usage in daily life. OFS measures the bending angle by calculating the light intensity attenuation of the optical fiber during a motion [16]. RFID offers body segment inclination using dual-polarized antennas [17]. Both OFS and RFID technologies suffer from low sensitivity and can only offer limited motion information [18]. Compared to the aforementioned technologies, IMUs offer direct motion measurements such as acceleration, angular rate, and magnetic field, which is a convenient and cost-efficient way for continuous human motion detection. Hence, IMU-based technologies have the potential to be widely utilized in future IoHT-based telerehabilitation applications.
Traditional methods to interpret IMU data are based on numerical calculations. However, IMUs suffer from considerable measurement noise and drifting issues, resulting in severe motion misregistration [19,20,21]. To address this issue, researchers have attempted to use machine learning (ML) approaches to find relationships between the messy IMU data and diverse neurological and musculoskeletal diseases. In [22], support vector machine methodology is used to classify different walking conditions for hemiparetic subjects for the gait analysis. Lee et al. [23] utilized the expectation-maximization clustering algorithm to scale the clinical scores of dyskinesia. Inspired by emerging deep learning approaches, [24] proposes a CNN-LSTM model to detect the freezing of gait of Parkinson’s disease patients. Furthermore, a linear regression model is used in [25] to provide accurate joint loading values for hip osteoarthritis patients. The selection of articles above represents only a small fraction of the current prolific output of studies that develop ML algorithms to interpret IMU data for disease analysis and rehabilitation. Researchers and medical staff have increasingly been exploring how artificial intelligence technologies can help in assistive disease diagnosis. The basic generalized workflow of these approaches is illustrated in Figure 1.
However, there is still an enigma when facing a specific monitoring and assessment issue with an ocean of potential data processing methods and not knowing which is the most efficient and suited. The same confusion arises when choosing from different sensor attachment locations, IMU sensor types, feature selection strategies, and evaluation metrics. In order to illustrate the recent developments and outcomes in this field, introduce professionals to this line of research, and inspire more colleagues towards conducting research in this direction, we decided to compose this review of studies that have combined IMU and ML algorithms for body motion monitoring for diseases analysis. In particular, we aim to clarify the following issues in our review:
(1)
To inventory and classify various ML methods to process IMU data and locate the widely used and state-of-the-art methods regarding different application scenarios and tasks.
(2)
To inventory the target disorders that can benefit from IMU-ML systems based on movement-related medical conditions that regard specialized areas of rehabilitation.
(3)
To gauge the implementation details to build IMU-ML systems for assistive diagnosis and management, such as feature selection strategy, sensor attachment selection, and evaluation methods.
The remainder of this paper is structured as follows. Section 2 proposes the methodology of article selection and taxonomy of the selected works. Section 3 summarizes the traditional and mainstream ML methods for monitoring body movements. Section 4 presents the results of our review from the view of different diseases. The findings in this section are organized by the types of disorders. Each type of disorder is complemented with a table that provides detailed parameters obtained per article. In Section 5, we identify the main challenges and the most promising future directions. Table A1 lists all the acronyms.

2. Methods and Taxonomy of Existing Approaches

Four databases, including PubMed, Web of Science, IEEE, and ACM, were selected. The search string was created as (inertial sensors OR inertial measurement unit OR IMU OR accelerometer OR gyroscope) AND (machine learning OR deep learning) AND (monitor OR assessment OR motion OR movement OR locomotion) AND (healthcare OR rehabilitation OR physical therapy). The above terms were used to search the titles and abstracts of the articles. The search was conducted on 13th June 2021, and we excluded articles published before 2016.
After retrieving the articles, first, the duplicates were removed. A total of 610 articles were screened in three stages. In the first stage, the titles and, in the second stage, the abstracts of the articles were reviewed. A total of 140 articles were selected for full-text review. Since the focus of the article is using wearable IMUs and ML methods to monitor patients with certain diseases in the process of healthcare, non-directly relevant topics such as the identification of activities of daily living, functional mobility tests, and recognition of rehabilitation exercise were excluded from this review. Moreover, articles where inertial sensors were not used as a dominant part of the analysis were also excluded from this review. Finally, the review resulted in the identification of 81 target studies.

Taxonomy Structure

To better understand how IMUs and ML methods are used in healthcare applications, we provide a taxonomy based on the selected articles to connect the fields of sensing technology, signal processing, and physical medicine. Similar to the categorization of the disorders in [26,27], the articles included in this review can be classified into four main categories based on movement-related medical conditions in regard to specialized areas of rehabilitation: (1) neurological disorders, (2) musculoskeletal disorders, (3) mental health disorders, and (4) other general disorders, as illustrated by the taxonomy shown in Figure 2.
(1)
Neurological disorders, which are the most common disorders that require rehabilitation, arise from people with diseases, injuries, or dysfunctions of the nervous system. Along this line, five kinds of conditions can benefit from neurological rehab: (a) degenerative disorders, such as Parkinson’s disease, multiple sclerosis, and Huntington’s disease, among which, Parkinson’s disease is the most common disorder in all the selected articles; (b) vascular disorder, which is mainly a stroke; (c) neurodevelopmental disorders, which are mainly cerebral palsy; (d) trauma, such as traumatic brain injury, spinal cord injury, and brachial plexus injury; and (e) functional disorders, such as seizure and vestibular system disorders. Additionally, there are other disorders and symptoms presented, and we categorized them as other neurological disorders.
(2)
Musculoskeletal disorders, including impairments or disabilities due to disease, disorders, or injuries to the muscles, tendons, ligaments, or bones. Three representative conditions can benefit from musculoskeletal rehab: (a) arthritis, which is mainly osteoarthritis, (b) back pain, and (c) Total Joint Replacement (TJR), such as total hip arthroplasty and total knee replacement.
(3)
Mental health disorders affect a person’s behaviors, feelings, and overall wellbeing, affecting many aspects of their daily lives. This mainly includes depression; however, illnesses such as bipolar disorder and schizophrenia are also represented in the studies included here.
(4)
Others consist of cardiac disorders, pulmonary disorders, and general rehabilitation, focusing on body parts such as the joints, upper limbs, and lower limbs.
Despite the difference in rehabilitation metrics and targets, IMU- and ML-based methods have been demonstrated to allow for better monitoring and assessment during the whole rehabilitation program. In the following sections, we will discuss these methods in detail.

3. IMUs for Monitoring Body Motion

Traditionally, the assessment of various motion impairment diseases has mainly been done by subjective methods, such as questionnaires and visual observation-based evaluations [28]. The first relies on patients’ memories and perceptions, and the latter is based on clinicians’ experiences, both susceptible to biases and inaccuracies. In addition, tasks such as motor activities recognition, the discrimination of symptoms, and events prediction require the supervision of expert clinicians, bringing inconvenience and high costs to patients. IMU-based movement monitoring can offer a solution to both problems by offering more objective measurements at a much cheaper cost to patients. Inspired by the emerging data-driving solutions that can learn a general motion model from a large amount of inertial data without hand-engineering effort, researchers are aiming to establish a trustworthy assistant for diagnosis and assessment in the setting of rehabilitation. The body parts mentioned in the reviewed articles for sensor placement are labeled as demonstrated in Figure 3. Below, two kinds of methods for analyzing IMU data are explained.

3.1. Numerical Methods

Numerical methods utilize the acceleration and angular velocity measured from an IMU to calculate the orientation, velocity, and position of body parts [29,30,31]. The basic diagram of the motion tracking system is depicted in Figure 4. Among the parameters, the position and orientation of an IMU are of special importance for body segments and joint analysis, but precisely calculating them is a challenge, due to the offset fluctuation and measurement noise-induced integration drift [32]. To obtain the desired accuracy level, the following methods are normally utilized, including bias compensation, distortion rejection, alignment, filtering (e.g., complementary filter (CF) [33] and Kalman filter (KF) [34]), and zero-velocity update (ZUPT) [35].
After obtaining the position and angle information, previously established movement models have been widely used to estimate high-level parameters for comparing between patients and healthy controls [36]. Linear, biomechanical, context-based, and some adaptive models are the major methods for extracting motion signatures and analyzing motion patterns to provide optimized estimations for a given set of measurements. However, such prior knowledge-based modeling processes inevitably introduce inaccuracies, since the manually extracted features are challenging to fully reflect the diversity of each patient’s motion pattern [37,38]. Motion cycle segmentation is another basic component for motion analysis and can be carried out by Finite State Machine (FSM), peak detection, threshold, and dynamic time wrapping (DTW)-based techniques [39,40].

3.2. ML-Based Methods

ML methods have been used to analyze high-volume and complex data for disease diagnosis, symptom recognition, characteristic estimation, and severity assessment. The basic idea is to map the motion data with medical diagnosis outcomes in a framework, as illustrated in Figure 5. As demonstrated in the figure, for traditional ML methods, the features are extracted manually based on human knowledge, such as the statistical magnitude, time domain, frequency domain, and symptom-specific parameters. As for deep learning models, the feature extraction and model building procedures are performed simultaneously by deep neural networks.

3.2.1. Traditional ML Methods

Using traditional ML algorithms, such as artificial neural networks (ANN), decision trees (DT), support vector machines (SVM), and hidden Markov models (HMM), to solve movement detection problems has been developing for more than twenty years [41]. Among different traditional ML classifiers, SVM has proven its popularity and effectiveness by achieving the best classification performance in 20 screened studies and outperforming its counterpart classifiers in which detailed evaluation can be found [42,43,44,45,46]. The Radial Basis Function (RBF) was used as a nonlinear kernel function for SVM to improve the generalization capacity [47,48]. DT is another major approach to efficient classification, and it provides a certain interpretability that is crucial in medical applications. Models such as C4.5 and Random Forest (RF) showed competitive results in activity recognition and severity assessment [49,50,51,52,53]. Linear Discriminant Analysis (LDA), Naïve Bayesian, k-nearest neighbor (k-NN), and shallow ANN are also used as typical ML techniques to build specific classifiers. For supervised regression tasks, such as joint movement tracking or clinical score estimating, Support Vector Regression (SVR) and Gaussian Progress Regression (GPR) models are the most popular choices [54,55,56]. Some articles also used linear regression (LR) to demonstrate the relation of the medical outcomes and handcrafted features [25].
Ensemble learning is a powerful method, since it combines multiple learners through a certain strategy and usually can outperform most individual learners [57]. Besides bagging ensemble methods RF, boosting methods such as Adaboost [58], RUSBoost [59], and XGBoost [60,61] are frequently used for better accuracy and robustness.
The feature extraction methods are vital in traditional ML. For body motion monitoring, besides normal statistical and spatiotemporal features, correlation and entropy features are also used as a supplement. The basic feature groups are listed in Table 1, and the specific features for portraying each disease are introduced in Section 4. To simplify the ML model to prevent a dimension explosion, feature selection or transformation methods is the standard procedure after feature extraction. Feature selection methods can be categorized into three classes as the filter, wrapper, and hybrid methods [62]. To balance the time consumption and optimization of the model, the hybrid method that takes advantage of both the filter and wrapper methods is the most used method. It chooses feature subsets by criterion such as entropy and evaluates the subset performance by applying it to trained models [63]. For feature transformation, the Principal Component Analysis (PCA) uses an orthogonal transformation to convert raw features to compact uncorrelated new features, which is widely used to reduce the dimensions without sacrificing the accuracy [58,64,65,66].

3.2.2. Deep Learning Methods

Developed from ANN, the Deep Neural Network (DNN) is more capable of learning from a large amount of data instead of utilizing handcrafted features. With the help of various network architectures, deep learning models are widely used in computer vision, speech recognition, natural language processing, and human activity recognition. For analyzing motion data captured from the human body, the convolutional neural network (CNN) and recurrent neural network (RNN) are the most used supervised deep models.
Inspired by the neurobiological model of the visual cortex [67], the CNN utilizes a series of weight-shared small filters to perform a convolutional operation over the whole input Signal, which results in two main advantages over other NN models: local dependency and scale invariance [68]. When processing the time series inertial data, local dependency means the nearby signal can be correlated, and scale invariance means the signal of different scales, but the same pattern can be invariant. After CNN, pooling and batch normalization is usually done to prevent overfitting. The output of the CNN model can be versatile to cope with different tasks. Specifically, a multi-task learning model can be built using multiple labels, as demonstrated in [69].
An RNN can be used to process the time series data by utilizing the temporal correlations between neurons. For time-related classification tasks such as the prediction of freezing of gait, RNN can learn the pattern through historical data and analyze the gait through sliding windows in real time [24]. Long Short-Term Memory (LSTM) is an improved version of RNN to conquer the long-time forgetting problem [70].

3.2.3. Unsupervised Learning Methods

The accurate label of data from medicine applications can be hard to collect, as most ML methods need labels for supervised learning. The current unsupervised learning methods are useful for segmentation, clustering, and better feature extraction for further model development. HMM is a well-known directed graphical model commonly used for modeling time series data, especially for automatic gait segmentation. Using the exaptation maximization (EM) clustering algorithm and self-organizing maps (SOM) [71], the input data can be grouped through their own characteristics and provide extra feature information.
Pretrained models are the new trend in ML, and using an autoencoder to learn a latent representation of the input data for advanced feature extraction has proven to be useful and reduce the need for a large number of labeled data [72,73].

4. Results for Different Application Scenarios

The results of the reviewed articles in aspects of application scenarios are thoroughly described in this chapter. Each chapter is complemented with a table that provides a list of application scenarios, implementing details, and major performance (Table 2, Table 3, Table 4 and Table 5).

4.1. Neurological Disorders

4.1.1. Parkinson’s Disease

Parkinson’s disease (PD) is one of the most common neurodegenerative diseases. It mainly causes the dystrophy of the motor system. Tremors, bradykinesia, and postural instability are the primary Parkinsonian motor symptoms, which can be monitored through IMUs attached to various body parts.
Sensors mounted on the upper extremity can be used to detect and assess the severity of tremors and bradykinesia. Dai et al. [76] proposed a method using an inertial sensor attached to the tip of the participant’s forefinger to capture finger motions. The parameters obtained by an electromagnetic tracking system (EMTS) in three tasks are used as the ground truths of the severity score from the Unified Parkinson’s Disease Rating Scale (UPDRS) of both symptoms to train common ML models. SVM achieved the best performance on three tasks and had a better-quantifying performance than neurologists. Similarly, Shawen et al. [75] used a skin-mounted IMU and a commercial smartwatch to regress the clinic-scored severity scale of tremors and bradykinesia. The Area Under the Receiver Operator Characteristic curve was used to evaluate the results, and the multiclass model of both symptoms achieved 0.74 for tremors and 0.65 for bradykinesia in the most efficient feature setting. Furthermore, the CNN was used to classify hand tremors and bradykinesia and achieved a better performance than the traditional ML methods [12,74].
Gait abnormality is another major symptom of PD patients that can be monitored by mounting IMU on the lower extremities, especially on the feet and ankles. Pérez-Ibarra et al. [78] modeled gait as an FSM and adopted an HMM-based adaptive algorithm to predict the transition state. The unsupervised model obtained a high accuracy (F1-score ≧ 0.95) using two force-sensitive resistors (FSRs) on each foot as a reference. To estimate the stride length accurately, Hannink et al. [79] adopted a two-layer CNN model to map stride-specific inertial sensor data to the resulting stride length and train the model using labels acquired from instrumented pressure mat GAITRite [4]. After various gait characteristics have been extracted, it is usually used to comprehensively assess the severity of PD. Through a series of sensitivity analyses on sensor location and feature selection, Caramia et al. [57] identified the most useful features for assessing the PD symptom severity stages per the Hoehn and Yahr (H&Y) scale. Their classification results showed that, first, the meta-classifiers based on the majority of voting achieved the best results and then, the range of motion (RoM) parameters extracted from the knee, which outperformed many spatiotemporal parameters, such as step length and step time. Rastegari et al. [58] searched for the best feature selection methods to assess the movements of PD patients and geriatrics and proved that genetic algorithms, the maximum signal-to-noise ratio with minimum correlation, and a modified version of the maximum information gain with minimum correlation are the best performers.
In advanced stages, PD patients can experience spontaneous episodes of the freezing of gait (FoG), which increases the risk of falling. Several ML strategies are adopted in detecting FoG events, such as SVM with RBF kernel [43,47], CNN [81,83], and RNN [24], all of which require expert clinicians to label using video recordings and supervised training. Compared with the detection of FoG, the prediction of FoG before the occurrence is a much more important and challenging task that requires the model to have a deep understanding of the principles and causes of the disease. Palmerini et al. [86] predicted the FoG by recognizing a degradation of the gait pattern that is significantly different from the normal gait called the pre-FoG phase. Six features were extracted from 2-s windows of the movement signals recorded by inertial sensors mounted on the shins and the lower back, and the three best features were selected to train an LDA classifier to divide the pre-FoG from normal gait.
To build a better and robust PD diagnosis and severity assessment system, movement of both the upper and lower extremities and torso can be monitored altogether using wearable inertial sensors. Using nine DOF IMUs mounted on the hands and feet, Butt et al. [70] built a Bi-LSTM model to classify 64 PD patients and 50 healthy controls, achieving an accuracy of 82.4%. To concur with the requirements of a large amount of training data of deep learning models, Som et al. [72] proposed a novel method of pretraining the model in healthy subjects performing activities of daily living (ADL) dataset to extract the relevant features for PD classification. The results showed that the autoencoder obtained a better performance than hand-engineered features in multiple sensor locations. Motor fluctuations of the PD patients between the ON state (medication working) and OFF state (medication has worn off) can be assessed in their natural environment using two IMUs [44].

4.1.2. Stroke

Stroke is the second leading cause of mortality and a major cause of disability worldwide. Wearable sensor technology and ML have allowed for the seamless and objective study of human motion in the post-stroke rehabilitation progress. Predicting quantitative patient-related outcomes such as National Institutes of Health Stroke Scale (NIHSS) and the Wolf Motor Function Test (WMFT) is a major area of focus and has been covered by many articles [109,110].
Upper Extremity (UE) rehabilitation is the major application area for stroke-related IMU-ML research. Parnandi et al. [90] optimized a sensor-ML approach for clinical implementation by finding the best performance of ML algorithms and sensor configuration for classifying four different hand movement tasks. The results first showed that LDA had the highest performance on the overall positive predictive values (PPV) (92.5%) and AUCs (0.96–0.99), and then, seven IMUs on the paretic arm and trunk led to the highest classification performance.
Using wrist-worn inertial sensors, stroke-related UE motion can be automatically extracted and analyzed for severity assessment, lightening the burden of both patients and their caregivers. Oubre et al. [54] combined the unsupervised clustering algorithm and correlation feature selection (CFS) with the standard SVR, which achieves a high regression performance estimating the Fugl-Meyer Assessment (FMA) scores (normalized root mean square error of 18.2%). Reasonable motion decomposition makes the results more explainable than the other feature extraction methods but also causes a curse of dimensionality that limits deployment and application. The same idea goes when attaching a smartphone to the wrist and performing the same FMA tasks using Gradient Boosting as the classifier [61].
Some special characteristics can be estimated and used for further guidance, such as hand use capacity and arm weakness. By measuring the change in distance of the wrist and finger using IMUs, the amount of hand use can be monitored for clinicians to establish individually tailored therapeutic programs. Through the benchmark measurement of the motion capture system and an SVR-based algorithm, Liu et al. [92] established a new assessment procedure that can reveal the hand use more precisely by regressing the distance change. As for arm muscle weakness evaluation for stroke self-screening, Phienphanich et al. [50] used an RF classifier based on information gain feature selection from handcrafted features from two arm movements of the subjects. The results showed that the curl-up-only feature-based classifier achieved the most efficient results with an average accuracy of 84.1%.
Stroke also affects patients’ functional ability of their lower extremities (LE), causing partial disability and gait disorders. Inspired by deep learning techniques, Wang et al. [69] developed a two-stage DNN model for the detection of stroke gait and classification of four common gait abnormalities, including dropped foot gait, circumduction gait, hip hiking gait, and back knee gait. The developed models achieve an average accuracy of 99.35% in detecting the gait strokes and an average accuracy of 97.31% in classifying the gait abnormality. To determine the best sensor configuration for the LE function ability estimation, Derungs et al. [55] used a biomechanical simulation to synthesize the sensor reading of different positions and regression model output for the Lower-Extremity Fugl-Meyer Assessment (LE-FMA). The results showed that sensors should be preferably placed at the front of the thigh. Lucas et al. [94] proposed a method of extracting the characteristic movement patterns for the long-term monitoring of stroke recovery. The Oxford Grading Motor Scale is used for mapping the limbs acceleration data to the movement ability.

4.1.3. Cerebral Palsy

Cerebral palsy (CP) is the most common physical disability among children. Inadequate physical activity (PA) is a major problem affecting the health and well-being of children with CP. ML-based approaches have the potential to improve the accuracy and versatility of inertial-based assessments of PA. Three studies [51,95,96] accomplished a series of evaluations using ML techniques to classify the PA of children with CP using IMUs mounted on the wrists, hips, and lower extremities. Surprisingly, the RF classifier proved to be effective in all three studies, achieving the best classification accuracy. The results showed that IMU-ML models may provide the accurate recognition of clinically relevant PA behaviors in children and adolescents with CP and can help clinicians monitor walking in both controlled settings and free-living situations. A gait analysis during the CP rehabilitation progress is another focus point. Chakraborty et al. [97] proposed a novel data representation method using discrete wavelet transform to form decomposed signal segments and a multi-channel one-dimensional CNN to classify abnormal gaits, achieving a better performance than the basic CNN model in the CP dataset.

4.1.4. Cerebellar Ataxia

Cerebellar ataxia (CA) is a neurologic phenotype caused by a heterogeneous set of underlying diseases or injuries that affect the function of the cerebellum, causing a movement disorder of the limbs. Through features associated with accelerometric data acquired by 31 sensors located at different parts of the body, Dostal et al. [98] utilized a two-layer neural network to distinguish ataxia patients from normal subjects. The best results were achieved with an accuracy of 98.0% for sensors located in the upper part of the body (shoulders, head, and spine). Ngo et al. [99] proposed an objective framework for the diagnosing and assessment of CA based on motion data. For feature extraction, the Recurrence Quantification Analysis, Multi-Scale Entropy, Noise Effect, and Harmonic Ratio and Index of Harmonic are used to quantify the regularity or complexity in time series data from patients performing three major tests. A thorough comparison was performed over nine feature selection algorithms and 28 ML models, the Gaussian Naive Bayes classifier performed best in diagnosing CA, and the voting regression model exhibited a significant correlation (0.72 Pearson) with The Scale for Assessment and Rating of Ataxia (SARA) scores in the severity assessment in the Romberg’s test. Oubre et al. [100] made a new attempt by mapping the sub-second movement profiles obtained during a reaching task to the Brief Ataxia Rating Scale (BARS) to estimate the overall ataxia severity using GPR. Decomposed wrist movement revealed characteristics, including distance, speed, duration, morphology, and temporal relationships, that can be strongly related to disease severity and disease phenotype.

4.1.5. Others

There are other neurodegenerative disorders, such as Huntington’s disease (HD), Progressive Supranuclear Palsy (PSP), and Multiple Sclerosis (MS), that have benefitted from recent research on ML-based inertial sensors for characteristics extraction, activity monitoring, assistive diagnosis, and objective assessment. Bennasar et al. [101] proposed an accelerometer-based quantitative assessment of upper limb movement impairment for HD patients. An ensemble classifier and a LR model are used to first classify HD patients and healthy participants and then generate a continuous movement impairment score that correlates with the clinical HD rating scale, achieving a 98.78% accuracy in the classification and Pearson correlation coefficient of 0.77, with a p-value < 0.01. For the early and accurate diagnosis of PSP, which may be difficult to distinguish from idiopathic PD, De Vos et al. [102] used the RF classifier and 17 features to discriminate PSP from PD, achieving 86% sensitivity and 90% specificity. Fatigue, the most common symptom in MS, can also be predicted using an ankle-mounted IMU and an RF classifier [64].
Research on the monitoring and rehabilitation of patients who suffered from neurological trauma, such as traumatic brain injury (BI), spinal cord injury (SCI), and brachial plexus injury (BPI), have also produced results. For monitoring the recovery process for stroke and traumatic brain injury survivors, Lee et al. [56] proposed a GPR-based regression model to estimate rehabilitation outcomes using a combination of clinical and wearable inertial sensor data. This approach resulted in a Pearson’s correlation of 0.94 between the estimated and clinician-provided scores. Wearable sensors can also be used to quantify shoulder dysfunction following brachial plexus injury, as shown in [103]. Nazarahari et al. compared the bilateral asymmetry of the six calculated kinematic scores of the affected and controls and used a bagged ensemble of decision trees for classification. The results showed a significant difference in the asymmetry indexes, concluding a promising classification accuracy.
Functional disorders such as seizure and vestibular system disorder and neuromuscular disorders such as peripheral neuropathy can be diagnosed through ML approaches [62,104,105]. Ikizoglu et al. [62] compared two-dimensional reduction techniques, including feature selection and feature transformation for SVM, to identify Vestibular System (VS) disorders. As the most used feature transformation method, kernel-modified PCA achieved the best performance, with a 89.2% classification accuracy. Finally, there are general movement assessment methods such as gait assessment that diagnose symptoms and benefit from multiple neurological disorders [106,107]. Other symptoms observed in neurological impairment patients such as spasticity can also be assessed by estimating clinical scales such as the modified Ashworth scale [108].
Table 3. Musculoskeletal disorders.
Table 3. Musculoskeletal disorders.
DisordersApplicationSensor (n)PlacementModelInput Data/FeaturesMajor PerformanceSubjects/
Dataset
YearRef.
OASDIMU (2)32, 33ANN100 samplesmultiple14 h2020[111]
OASDIMU (1)31LR63 featuresMAE = 29% (left), 36% (right)10 p2020[25]
OACEAccel (1)31RF26 featuresAcc = 76.3%1198 p [112]2021[53]
OACEAccel (3)2, 13, 35SVMtemporal featuresAcc = 97.9% (initial), 90.6% (layer-1 SVM), 92.7%
(layer-2 SVM)
10 h2016[113]
OASDAccel (4)13, 16, 29, 35LDA + PCA38 featuresAcc = 81.7%39 p2017[65]
OAPAIMU (4)23, 24CNN200, 100, 40 ms windowAcc = 85%, 89–97%, 60–67% for 3 tasks18 p2021[114]
LBPDIMU (1)2SVM/MLP16 featuresAcc = 75%94 p2020[115]
LBPDIMU (2)2, 11SVM52 featuresAcc = 96%28 p, 24 h2017[48]
TJRDIMU (7)11, 23, 26, 34SVM2 feature setsAcc = 87.2% (Set 1), 97.0%
(Set 2)
20 p, 24 h2019[46]
TJRPAIMU (4)13, 14, 16, 29DCNN100 samplesAcc = 98%12 p2021[116]
TJR SAAccel (2) IMU (1)6, 11k-meansDifferent for each PROMTSS = 3.86, 3.56, 1.86 for each feature set22 p2019[117]
TJRPAIMU (1)14SOM356 featuresAcc = 85.6–96.92%44 p, 10 h2018[118]

4.2. Musculoskeletal Disorders

4.2.1. Osteoarthritis

Osteoarthritis (OA) is the most common musculoskeletal disease and will be diagnosed in nearly half of all people at some point in their life [65]. Specifically, knee OA (KOA) accounts for more mobility disabilities in people over the age of 65 than any other medical condition. Joint movement measurements, especially knee flexion moments (KFM) and knee adduction moments (KAM), represent an objective parameter of the knee joint load in KOA. Stetter et al. [111] developed an ANN that estimates the formerly mentioned parameters based on time series data obtained by two IMUs located on the right thigh and shank. For all six locomotion tasks, the ANN achieved a high overall concordance in KAM (r = 0.39 ± 0.32, rRSME = 29.9 ± 8.1%) and KFM (r = 0.74 ± 0.36, rRSME = 20.8 ± 5.7%), which is essential for KOA patients to provide valuable biofeedback systems. Joint loading is also valuable for hip OA patients and can be monitored by a mobile phone attached to the patient’s hip. Brabandere et al. [25] proposed an ML pipeline for learning the musculoskeletal modeling to estimate the loading value using only an embedded IMU, and the proposed LR-based pipeline achieves a mean absolute error of 29% for the left hip and 36% for the right hip. Sun et al. [53] proposed an ML model to bridge the motion features and thresholds of KOA patients with longitudinal gait decline to estimate the personal physical capacity and found that the most impactful predicting feature is low minutes during the performance of moderate-vigorous activity. Rehabilitation exercise plays an important role in KOA therapy. Motion segmentation is the main difficulty in rehabilitation monitoring. Chen et al. [113] proposed a multi-layer SVM-based online segmentation model and achieved a segmentation accuracy of 92.7%. To predict a performance improvement in muscle-strengthening exercises, Kobsar et al. [65] established an ML-based grading system that can predict the post-intervention response to an exercise therapy through preintervention multi-sensor accelerometer data. Overall, the best performance of classifying different responders is 81.7% accuracy, which is achieved by sensors mounted on the back, thigh, and shank.

4.2.2. Low Back Pain

Low back pain (LBP) is expected to substantially increase, along with the world’s aging population, due to the normal physiological intervertebral disc and tissue degeneration associated with aging [48]. Using IMU mounted on the sternum of patients, Abdollahi et al. [115] managed to predict LBP by classifying patients into high-risk and low-risk subgroups. Accuracy levels of ~75% and 60% were achieved for the SVM and MLP, respectively. Using a similar sensor configuration, Ashouri et al. [48] proposed an approach for evaluating LBP in various settings. The results showed that, through a low-pass filter, PCA for feature extraction, and SVM for classification, the model can be adequately employed for LBP identification, with an accuracy of 96%.

4.2.3. Total Joint Replacement

Patients after undergoing TJR surgeries suffer from lingering musculoskeletal restrictions. Teufl et al. [46] combined ML approaches with the gait analysis to classify these impairments. Features such as spatiotemporal parameters and joint angles are proposed as the input for a SVM model, achieving an accuracy of 97.0%. DCNN is employed for monitoring the progress of the rehabilitation of hip unilateral arthroplasty surgery by mapping the sensor’s gait cycles data to days after surgery [116]. The proposed DCNN achieved up to 98% classification accuracy for the rehabilitation progress monitoring. Bini et al. [117] used data from three commercially available wearable sensors and an ML algorithm to predict the postoperative clinical outcome scores of TJR patients. The K-means ML algorithm was used to cluster the patients into three groups according to the variables that were more correlated with the clinical outcomes. The quantitative variables (steps taken, heart rate variability, and calories burned) were found to have better predictive power than the qualitative ones (cadence, bounce, and braking) for the Rand 12-item Health Survey scores and qualitative scores for the Hip Disability and Osteoarthritis Outcome Score and Knee Injury and Osteoarthritis Outcome Score surveys.
Table 4. Mental illnesses.
Table 4. Mental illnesses.
DisordersApplicationSensor (n)PlacementModelInput Data/
Features
Major Performance Subjects/
Dataset
YearRef.
DepressionDAccel (1)6RF14 featuresAcc = 89.2%2112 p, 3783 h2019[119]
DepressionDAccel (1), Light6Logistic Regression4 featuresAcc = 91%18 p, 29 h2019[120]
DepressionD, SAAccel (1), Health6XGBoost63 featuresAcc = 76%, correlation coefficient = 0.6145 p, 41 h2020[121]
DepressionDAccel (1)6RF3 featuresMCC= 0.4423 p, 32 h2018[122]
DepressionSAAccel (1)6RF, Adaboost, Theil-Sen3 sets of featuresRMSE = 4.512 p2017[123]
Bipolar, ADHDDAccel (1)11SVM28 featuresAcc = 83.1%92 p, 63 h2016[124]
Internalizing DisordersDIMU (1)11Logistic Regression39 featuresAcc = 81%21 p, 41 h2019[125]

4.3. Mental Illness

Mental Illness is an umbrella term that describes disorders that affect people’s emotions, thoughts, and behaviors. Mental illness is typically diagnosed qualitatively—patients come to psychiatric professionals with symptoms, and the professionals diagnose them using inquiries, tests, and observations of behavior. Then, they start treating the patients with psychotherapy, medication, or both [126]. Monitoring the effectiveness of the treatment is critical in mental illnesses, as adjustments in medication might be necessary along the way. Yet, physicians rely on patients for input in a treatment effectiveness and even waiting and seeing if a particular dose is effective or not [127]. Using wearable sensors that monitor the physiological measures in real time would allow physicians to check up more frequently on their patients and adjust their treatments accordingly.

4.3.1. Depression

Depression symptoms have different categories, such as irregular sleep, change in daily life activities, mood changes, and overeating or not eating enough. Many studies have tracked these symptoms to predict depression outcome scores. IMUs were specifically used to track the activity levels.
Zanella Calzada et al. [119] used motor activity data from a wrist-worn Actigraph to detect depression. The classification of the control and depression according to these selected features was done by using RF. The validation results show that 89.2% of participants that had depression were correctly classified by their algorithm. Kim et al. [120] also used Actigraph to predict depression, this time in older adults. They also compared the performance of four different ML methods: logistic regression, DT, boosted trees, and RF. Among these, logistic regression performed the best, with a 91% accuracy. Tazawa et al. [121] reported lower accuracy levels of the XGBoost technique, 76% percent for identifying depression patients and 61% for predicting depression outcomes. In one study, Garcia-Ceja et al. [122], unlike the other studies presented here, measured the activities of unipolar and bipolar patients directly to detect depression. RF outperformed the DNN in classifying depression with an MCC value of 0.44 compared to 0.39. This group also compiled a dataset [128] of these movement recordings.
Other studies utilized a combination of wearable sensors and smartphones to detect depression. Ghandeharioun et al. [123] used wrist-worn sensors and smartphones to track depression symptom categories to predict the scores for the Hamilton Depression Rating Scale (HDRS). They used a combination of different ML methods such as Adaboost, RF, and Theil-Sen. They managed to achieve a low RMSE rate of 4.5% in predicting HDRS scores.

4.3.2. Other Mental Illness

Although depression studies make up the majority of studies that take advantage of the IMU-ML approach, there are other mental illnesses such as bipolar disorder, attention deficit disorder (ADD), and schizophrenia. Faedda et al. [124] used Actigraph to distinguish two different mental health disorders, bipolar and attention-deficit/hyperactivity disorder (ADHD) in children and adults. Among the five ML methods they tested, SVM had the highest performance, with 83.1% accuracy. McGinnis et al. [125] also used wearable sensors and ML to detect mental illness—in their case, in children. A belt- worn IMU was worn by the children as they underwent a “Snake Task” that elicits fear. The task is made up of three parts: potential threat startle, response modulation, and the researcher reassures the child that the snake is fake. There were 29 features extracted from the IMU for each of the six time series (two for each part of the task). The classification results were validated using three methods: logistic regression with a score threshold for accuracy, specificity, and sensitivity; AUC; and a permutation test to determine the results that were obtained by chance. Among the three parts, the potential threat was found to be the best measure for detecting mental illness in children.
Table 5. Other disorders and general rehabilitation.
Table 5. Other disorders and general rehabilitation.
DisordersApplicationSensor (n)PlacementModelInput Data/
Features
Major PerformanceSubjects/
Dataset
YearRef.
COPDSAAcc (1)-SVM_rbf8 featuresAcc = 99.2%55 p, 11 h2016[129]
COPDCEIMU (3)2, 11, 30PCAQuaternion dataMAE < 2, R > 0.9638 h2019[66]
GeriatricsDIMU (1)31CNN+LSTM500 samplesAcc = 95%20 p2021[130]
GeneralCEIMU (2)13, 35Polynomial RegressionOrientationRMSE = 4.81 (general),14 h2019[131]
GeneralPAIMU (4)4, 5, 6, 7RF2 feature sets4.99 (personal)50 h2020[132]
GeneralPAIMU (1)5RF/SVM237 features, ReliefFAcc = 98.6%44 p, 10 h2019[133]
GeneralPAIMU (3)3, 5, 6Conv+FSMRawAcc = 97.2% (CV), 80.5% (LOSO)35 h2020[134]
GeneralPAIMU (2)5, 6SVM144 features, PCAAcc = 0.8719 p, 9 n2021[135]

4.4. Others

There are other diseases such as pulmonary diseases [129], geriatrics [130], and chronic pain [133] that can benefit from objective assistive monitoring and assessment. Chronic obstructive pulmonary disease (COPD) is a common progressive disease affecting the airways, causing chronic morbidity [129]. Cesareo et al. [66] utilized three IMUs attached to the chest of patients to monitor the breathing frequency, which is a vital sign for the breathing function assessment. PCA fusion of the four quaternion data provided the best performance in terms of the MAE (<two breaths/min).
The monitoring of general human movement, including upper extremity, lower extremity, joint angle, and physical activity during rehabilitation, can be versatile to cope with different disease requirements [131,132,133,134]. Especially, IMUs can provide an accurate and reliable method of a joint angle assessment with the application of ML algorithms. Argent et al. [131] compared four major regression models and utilized an IMU platform placed on the lower extremity and a 3D motion capture system for the gold standard to train the model. The use of an orientation algorithm as a preprocessing step improved the accuracy, and the average RMSE for the best-performing algorithms, orientation polynomial regression (PR), across all exercises was 4.81°.

5. Discussion and Future Directions

Using IMUs to monitor human motions for disease-specific characteristics and biomechanical applications has been around for years and is developing rapidly with the maturity of the sensors and processing units and more and more sophisticated algorithms, especially ML algorithms. Plenty of successful attempts, which allow medical staffs to acquire a patient’s body information remotely, have been observed in IoHT scenarios. Although ML has brought great success to the research in several aspects, there are still challenges for IMU-based body motion monitoring.

5.1. Inertial Sensors and IoT Devices

IMU attached to the human body is expected to generate real-time data that dynamically represent the movements of a human body (or a part of it). However, due to the IMU sensors’ intrinsic design-induced side effects (such as offsets, zero drift, and nonorthogonal error), together with environmental inference (e.g., EMI and thermal noise), the output motion data normally present low SNR values and distortions. Although various calibration techniques have been proposed [20,21,136], obtaining high-quality data is still challenging, which results in insufficient information for ML models to interpret the patients’ motion status. Furthermore, the current IMU modules are bulky, not only affecting the natural movement of users but also limiting the continuous monitoring of daily activities.

5.1.1. Multi-Sensor Fusion

To surpass the limitation of sensors, multi-sensor fusion is the most used method for medical applications. Some variants of IMU, such as MARG (Magnetic, Angular Rate, and Gravity), which incorporates a tri-axis magnetometer, can provide a complete measurement of the orientation relative to the Earth’s magnetic field. To capture the source of motion for humans, a surface electromyography (sEMG) sensor is usually applied as it directly reflects the neural information when flexing the muscles [137]. A mechanomyography (MMG) sensor is frequently used as the “mechanical counterpart” to an EMG and is formed from pressure waves to provide more accurate myographic information [138]. FSRs integrated into shoes and insoles are utilized to measure the force in various applications, such as accurate gait segmentation, Center of Gravity (CoG) estimation, and detailed gait parameter estimations [139].

5.1.2. Self-Calibration

Self-calibration approaches in the inertial sensors have been developed to address the long-term drift problem. There exist many sensing structures or mechanism innovations for in situ self-calibration that can optimize the characteristics of specific inertial sensors [140,141]. For example, continuous calibration can cancel drive-induced errors in gyroscopes without interrupting normal operations and affecting the noise and bandwidth by periodically reversing the polarity of the gyroscope’s forcing voltage [142]. For IMU platforms, self-calibration can be performed by using a more sophisticated error model and a set of motion procedures to capture the correlations between sensors [143,144]. Through the development of the sensor platform and the portrayal of the error model, the sensors can be more accurate and reliable in long-term monitoring.

5.1.3. Consumer Grade IMU Devices

Although IMUs are much more affordable than other motion capture methods, the most commonly used IMUs in research are still inaccessible to the general public. The two most commonly used IMUs in research, Xsens Awinda [145] and Shimmer [146], still cost thousands of dollars and require dedicated training to operate. However, there are many IoT devices that record movements that can be a viable alternative to lab grade equipment. Already, some studies are testing the viability of using consumer products for rehabilitation. Additionally, these consumer grade products will allow for longer monitoring times and even the detection of illnesses beforehand through ML-based prediction methods informing physicians.

5.2. Data Processing Methods

To sort out the context of the reviewed articles based on the two criteria of this review, we summarized the data processing methods and detailed the application scenarios, as shown in Figure 6. The data processing methods were composed of traditional machine learning, deep learning, and unsupervised learning methods, as demonstrated in Section 3.2. Detailed application scenarios were clustered into:
  • Disease Diagnosis, which means classifying patients from healthy controls;
  • Symptom Detection, which means detecting a typical symptom of patients that indicates a detailed disease type and stages, such as the freezing of gait for PD patients;
  • Characteristics Estimations, which means estimating disease-related characteristics such as stride length and joint loading value;
  • Severity Assessment, which means regressing or classifying different severities of patients into certain estimating scales;
  • Physical Activity Recognition for Patients.
The ML methods of the reviewed articles are categorized and shown as bubbles in a given cell of the data processing method (row) and detailed application scenarios (column). Since some articles covered multiple application scenarios, the corresponding methods were counted more than once. The color of each bubble represents the number of reviewed works covering a given cell. In that way, we can locate the commonly used methods and a few optional choices for the target application to accelerate the implementation process.
Although this review has shown a series of reliable IMU-ML systems, there still exists a considerable gap between the technical tools and clinically usable systems, since most of the existing system is built in a lab to collect patients’ data and process them afterward. As urgently needed in many real-time IoHT scenarios, such as telerehabilitation, at-home diagnosis, and biofeedback systems, the deployment of ML algorithms for real-time streaming data in real-world settings is still a pending issue. For building an accurate and robust ML model for diagnosis and assessment, large and comprehensive datasets with accurate labels are needed. Since different diseases could share common characteristics and symptoms, and sometimes a patient may even suffer from multiple diseases, a general model for tracking a multitude of diseases instead of specific models would provide more utility. The model should have the ability to provide and explain useful information to the clinicians, such as the meaning of extracted features, reasoning process, and the most valuable factors to support the output results. However, most of the existing methods use ML models as a black box, lacking explanation, which causes patients and physicians to be doubtful of the reliability of the model.

5.2.1. Online and Edge Implementation

To build a real-time monitoring system, the data processing model has to be deployed online or on an edge platform. Since the model is usually trained offline on a dataset in laboratory settings, and the existence of environmental noise in the real-world, incremental learning can be a useful tool to diminish the distribution shift. For latency-sensitive applications such as urgent medical cases, real-time optimization is needed to keep the balance between accuracy and time cost [6]. There are two approaches to tackle this problem: bringing up the response time as a critical element of model training and reducing the time cost during model predicting by reducing the communication cost between the sensing device and server or enhancing the computing ability of the edge devices.

5.2.2. Open Dataset and Universal Model

Some of the existing works are based on open-source datasets such as Rampp et al.’s [36] dataset for gait assessment, the Cupid dataset [131] for FoG detection, Guerra et al.’s [89] dataset for post-stroke UE assessment, and the Osteoarthritis Initiative dataset [53] for the physical performance estimation. However, most of the previous works have used self-collected data limiting the development of a better and unified model. The open datasets annotated with ground truth need to be established in the field of inertial-based motion monitoring. Unsupervised and weakly supervised learning can mitigate the need for accurate labels. Pretraining and few-shot learning can be the solution by learning the human motion representation from a mass of ADL data and finetune the model using the data collected from patients.

5.2.3. Interpretable Model

Considering the accountability and transparency nature of the medical applications, the interpretability of ML models for assistive diagnoses is crucial. Oubre et al. [100] showed a promising direction by the decomposition of sophisticated motions. The classification results could be explained through the contribution of different feature components that lead to the cause of disease. Morrison et al. [147] utilized visualization to support the decision-making process in a way that allowed clinicians to integrate the algorithm’s result into their decision process. For deep learning models, the explanation can be difficult, since the motion data is fed directly into the model. The development of global explanations, such as kernel-based methods [148] and Local Interpretable Model-agnostic Explanations (LIME) [149], can be useful for explaining deep models. Using the interpretable ML models, a human–AI collaborative decision-making system can be established with better fault tolerance and human rights friendly.

5.2.4. Healthcare Representation and Digital Twin

Through continuous multi-sensor data collected from patients, electronic health records (EHR) can be modeled using graph-based methods and representation learning [150]. Learning meaningful medical ontology representations within the EHR database can alleviate the data insufficiency problem, and the learned embeddings can cluster nicely into particular groups of diseases [151]. With simulation and motion data synthesis, digital twin models can be established for patient performance estimation and rehabilitation program planning to individual needs [152,153]. The twin model can serve as a counterpart of the patients to improve the wearability of sensor systems and transfer detailed human movement characteristics to real-world applications to reduce errors.

Author Contributions

Conceptualization, F.B., M.Y., Y.D., W.W., J.L., B.H. and S.G.; methodology, F.B., M.Y., Y.D., J.L., B.H. and S.G.; software, F.B.; validation, W.W., J.L., B.H. and S.G.; formal analysis, F.B. and M.Y.; investigation, F.B. and M.Y.; resources, F.B. and M.Y.; data curation, F.B.; writing—original draft preparation, F.B., M.Y. and S.G.; writing—review and editing, F.B., M.Y., J.L., B.H. and S.G.; visualization, F.B.; supervision, W.W., J.L., B.H. and S.G.; project administration, W.W., J.L., B.H. and S.G.; and funding acquisition, W.W., J.L. and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by the National Key Research and Development Plan Foundation under grant number 2018YFB2002700, in part by the CAS (Chinese Academy of Sciences) Leading Science and Technology (category A) Project (XDA22020100), in part by the CAS (Chinese Academy of Sciences) STS (Science and Technology Service Network Initiative) Project under grant number 2019T3015, and in part by the National Natural Science Foundation of China under grant numbers 61803017 and 61827802.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Acronyms/Abbreviations.
Table A1. Acronyms/Abbreviations.
3D3-dimensionalFSRForce-Sensitive ResistorOAOsteoarthritis
AccAccuracyGPRGaussian Progress RegressionOFSOptical Fiber Sensors
AccelAccelerometerGyroGyroscopeppatients
ADDAttention Deficit Disorderhhealthy controlsPAPhysical Activity
ADHDAttention-Deficit/Hyperactivity DisorderH&YHoehn and YahrPCAPrincipal Component Analysis
ADLActivities of Daily LivingHDHuntington’s DiseasePDParkinson’s Disease
ANNArtificial Neural NetworksHDEHeuristic Drift EliminationPPVPositive Predictive Values
AUCArea Under CurveHDRSHamilton Depression Rating ScalePRPolynomial Regression
BARSBrief Ataxia Rating ScaleHMMhidden Markov modelsPSPProgressive Supranuclear Palsy
BIBrain InjuryIMUInertial Measurement UnitR Pearson Correlation Coefficient
BPIBrachial Plexus InjuryIoHTInternet of Health ThingsRBFRadial Basis Function
CACerebellar AtaxiaIoTInternet of ThingsRFRandom Forest
CECharacteristics EstimationKAMKnee Adduction MomentsRFIDRadio Frequency Identifications
CFComplementary filterKFKalman filterRMSERoot Mean Square Error
CFSCorrelation Feature SelectionKFMKnee Flexion MomentsRNNRecurrent Neural Network
CNNConvolutional Neural Networkk-NNk-Nearest NeighborRoMRange of Motion
CoGCenter of GravityKOAKnee OsteoarthritisSASeverity Assessment
COPDChronic Obstructive Pulmonary DiseaseLBPLow back painSARAScale for Assessment and Rating of Ataxia
CPCerebral PalsyLDALinear Discriminant AnalysisSCISpinal Cord Injury
CVCoefficient of VariationLELower ExtremitiesSDSymptom Detection
DDiagnosisLIMELocal Interpretable Model-agnostic ExplanationsSenSensitivity
DNNDeep Neural NetworkLOSOLeave-one-subject outSOMSelf-Organizing Maps
DT Decision TreesLRLinear RegressionSpecSpecificity
DTWDynamic Time WrappingLSTMLong Short-Term MemorySVMSupport Vector Machines
EHRElectronic Health RecordsMAEMean Absolute ErrorSVRSupport Vector Regression
EMExaptation MaximizationMARGMagnetic, Angular Rate, and GravityTJRTotal Joint Replacement
EMGElectromyographyMCCMathew’s Correlation CoefficientUEUpper Extremity
EMIElectromagnetic InterferenceMLMachine LearningUPDRSUnified Parkinson’s Disease Rating Scale
EMTSElectromagnetic Tracking SystemMMGMechanomyographyVSVestibular System
FMAFugl-Meyer AssessmentMSMultiple Sclerosis WMFTWolf Motor Function Test
FoGFreezing of GaitMSEMean Square ErrorZARUZero Angular Rate Update
FSMFinite State MachineNIHSSNational Institutes of Health Stroke ScaleZUPTZero-velocity Update

References

  1. Fan, Y.J.; Yin, Y.H.; Da Xu, L.; Zeng, Y.; Wu, F. IoT-Based Smart Rehabilitation System. IEEE Trans. Ind. Inform. 2014, 10, 1568–1577. [Google Scholar]
  2. Camara Gradim, L.C.; Archanjo Jose, M.; Marinho Cezar Da Cruz, D.; De Deus Lopes, R. IoT Services and Applications in Rehabilitation: An Interdisciplinary and Meta-Analysis Review. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 2043–2052. [Google Scholar] [CrossRef]
  3. Life Sciences|Vicon Motion Capture for Biomechanics. Available online: https://www.vicon.com/applications/life-sciences/ (accessed on 27 May 2022).
  4. GAITRite|World Leader in Temporospatial Gait Analysis. Available online: https://www.gaitrite.com/ (accessed on 27 May 2022).
  5. Bhuiyan, M.N.; Rahman, M.M.; Billah, M.M.; Saha, D. Internet of Things (IoT): A Review of Its Enabling Technologies in Healthcare Applications, Standards Protocols, Security, and Market Opportunities. IEEE Internet Things J. 2021, 8, 10474–10498. [Google Scholar] [CrossRef]
  6. Hayyolalam, V.; Aloqaily, M.; Ozkasap, O.; Guizani, M. Edge-Assisted Solutions for IoT-Based Connected Healthcare Systems: A Literature Review. IEEE Internet Things J. 2021, 4662, 9419–9443. [Google Scholar] [CrossRef]
  7. Pasluosta, C.F.; Gassner, H.; Winkler, J.; Klucken, J.; Eskofier, B.M. An Emerging Era in the Management of Parkinson’s Disease: Wearable Technologies and the Internet of Things. IEEE J. Biomed. Health Inform. 2015, 19, 1873–1881. [Google Scholar] [CrossRef]
  8. Habibzadeh, H.; Dinesh, K.; Rajabi Shishvan, O.; Boggio-Dandry, A.; Sharma, G.; Soyata, T. A Survey of Healthcare Internet of Things (HIoT): A Clinical Perspective. IEEE Internet Things J. 2020, 7, 53–71. [Google Scholar] [CrossRef]
  9. Gatouillat, A.; Badr, Y.; Massot, B.; Sejdic, E. Internet of Medical Things: A Review of Recent Contributions Dealing with Cyber-Physical Systems in Medicine. IEEE Internet Things J. 2018, 5, 3810–3822. [Google Scholar] [CrossRef] [Green Version]
  10. Islam, S.M.R.; Kwak, D.; Kabir, M.H.; Hossain, M.; Kwak, K.S. The Internet of Things for Health Care: A Comprehensive Survey. IEEE Access 2015, 3, 678–708. [Google Scholar] [CrossRef]
  11. Dobkin, B.H. A Rehabilitation-Internet-of-Things in the Home to Augment Motor Skills and Exercise Training. Neurorehabilit. Neural Repair 2017, 31, 217–227. [Google Scholar] [CrossRef]
  12. Eskofier, B.M.; Lee, S.I.; Daneault, J.-F.; Golabchi, F.N.; Ferreira-Carvalho, G.; Vergara-Diaz, G.; Sapienza, S.; Costante, G.; Klucken, J.; Kautz, T.; et al. Recent Machine Learning Advancements in Sensor-Based Mobility Analysis: Deep Learning for Parkinson’s Disease Assessment. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 655–658. [Google Scholar]
  13. AbdulGhaffar, A.A.; Mostafa, S.M.; Alsaleh, A.; Sheltami, T.; Shakshuki, E.M. Internet of Things Based Multiple Disease Monitoring and Health Improvement System. J. Ambient. Intell. Humaniz. Comput. 2020, 11, 1021–1029. [Google Scholar] [CrossRef]
  14. Lloyd, D.G.; Besier, T.F. An EMG-Driven Musculoskeletal Model to Estimate Muscle Forces and Knee Joint Moments in Vivo. J. Biomech. 2003, 36, 765–776. [Google Scholar] [CrossRef]
  15. Farina, D.; Jiang, N.; Rehbaum, H.; Holobar, A.; Graimann, B.; Dietl, H.; Aszmann, O.C. The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 797–809. [Google Scholar] [CrossRef]
  16. Leal-Junior, A.G.; Frizera, A.; Avellar, L.M.; Marques, C.; Pontes, M.J. Polymer Optical Fiber for In-Shoe Monitoring of Ground Reaction Forces during the Gait. IEEE Sens. J. 2018, 18, 2362–2368. [Google Scholar] [CrossRef]
  17. Krigslund, R.; Dosen, S.; Popovski, P.; Dideriksen, J.L.; Pedersen, G.F.; Farina, D. A Novel Technology for Motion Capture Using Passive UHF RFID Tags. IEEE Trans. Biomed. Eng. 2013, 60, 1453–1457. [Google Scholar] [CrossRef]
  18. Homayounfar, S.Z.; Andrew, T.L. Wearable Sensors for Monitoring Human Motion: A Review on Mechanisms, Materials, and Challenges. SLAS Technol. 2020, 25, 9–24. [Google Scholar] [CrossRef]
  19. Haid, M.; Breitenbach, J. Low Cost Inertial Orientation Tracking with Kalman Filter. Appl. Math. Comput. 2004, 153, 567–575. [Google Scholar] [CrossRef]
  20. Sabatini, A.M. Quaternion-Based Extended Kalman Filter for Determining Orientation by Inertial and Magnetic Sensing. IEEE Trans. Biomed. Eng. 2006, 53, 1346–1356. [Google Scholar] [CrossRef]
  21. Mahony, R.; Hamel, T.; Morin, P.; Malis, E. Nonlinear Complementary Filters on the Special Linear Group. Int. J. Control 2012, 85, 1557–1573. [Google Scholar] [CrossRef] [Green Version]
  22. Lau, H.; Tong, K.; Zhu, H. Support Vector Machine for Classification of Walking Conditions of Persons after Stroke with Dropped Foot. Hum. Mov. Sci. 2009, 28, 504–514. [Google Scholar] [CrossRef]
  23. Lee, S.I.; Daneault, J.F.; Golabchi, F.N.; Patel, S.; Paganoni, S.; Shih, L.; Bonato, P. A Novel Method for Assessing the Severity of Levodopa-Induced Dyskinesia Using Wearable Sensors. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Milan, Italy, 25–29 August 2015; pp. 8087–8090. [Google Scholar] [CrossRef]
  24. Sigcha, L.; Costa, N.; Pavón, I.; Costa, S.; Arezes, P.; López, J.M.; De Arcas, G. Deep Learning Approaches for Detecting Freezing of Gait in Parkinson’s Disease Patients through On-Body Acceleration Sensors. Sensors 2020, 20, 1895. [Google Scholar] [CrossRef] [Green Version]
  25. De Brabandere, A.; Emmerzaal, J.; Timmermans, A.; Jonkers, I.; Vanwanseele, B.; Davis, J. A Machine Learning Approach to Estimate Hip and Knee Joint Loading Using a Mobile Phone-Embedded IMU. Front. Bioeng. Biotechnol. 2020, 8, 320. [Google Scholar] [CrossRef] [Green Version]
  26. Chen, S.; Lach, J.; Lo, B.; Yang, G.-Z. Toward Pervasive Gait Analysis with Wearable Sensors: A Systematic Review. IEEE J. Biomed. Health Inform. 2016, 20, 1521–1537. [Google Scholar] [CrossRef]
  27. Prasanth, H.; Caban, M.; Keller, U.; Courtine, G.; Ijspeert, A.; Vallery, H.; Von Zitzewitz, J. Wearable Sensor-Based Real-Time Gait Detection: A Systematic Review. Sensors 2021, 21, 2727. [Google Scholar] [CrossRef]
  28. Ainsworth, E.B. How Do I Measure Physical Activity in My Patients? Questionnaires and Objective Methods. Br. J. Sports Med. 2009, 43, 6. [Google Scholar] [CrossRef]
  29. Ahmed, H.; Tahir, M. Improving the Accuracy of Human Body Orientation Estimation with Wearable IMU Sensors. IEEE Trans. Instrum. Meas. 2017, 66, 535–542. [Google Scholar] [CrossRef]
  30. Li, Q.; Young, M.; Naing, V.; Donelan, J.M. Walking Speed Estimation Using a Shank-Mounted Inertial Measurement Unit. J. Biomech. 2010, 43, 1640–1643. [Google Scholar] [CrossRef]
  31. Rebula, J.R.; Ojeda, L.V.; Adamczyk, P.G.; Kuo, A.D. Measurement of Foot Placement and Its Variability with Inertial Sensors. Gait Posture 2013, 38, 974–980. [Google Scholar] [CrossRef] [Green Version]
  32. Zhou, H.; Hu, H. Human Motion Tracking for Rehabilitation-A Survey. Biomed. Signal Process. Control 2008, 3, 1–18. [Google Scholar] [CrossRef]
  33. Madgwick, S.O.H.; Harrison, A.J.L.; Vaidyanathan, R. Estimation of IMU and MARG Orientation Using a Gradient Descent Algorithm. In Proceedings of the IEEE International Conference on Rehabilitation Robotics, Zurich, Switzerland, 29 June–1 July 2011. [Google Scholar] [CrossRef]
  34. Yun, X.; Bachmann, E.R. Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking. IEEE Trans. Robot. 2006, 22, 1216–1227. [Google Scholar] [CrossRef] [Green Version]
  35. Wang, Z.; Zhao, H.; Qiu, S.; Gao, Q. Stance-Phase Detection for ZUPT-Aided Foot-Mounted Pedestrian Navigation System. IEEE/ASME Trans. Mechatron. 2015, 20, 3170–3181. [Google Scholar] [CrossRef]
  36. Rampp, A.; Barth, J.; Schülein, S.; Gaßmann, K.G.; Klucken, J.; Eskofier, B.M. Inertial Sensor-Based Stride Parameter Calculation from Gait Sequences in Geriatric Patients. IEEE Trans. Biomed. Eng. 2015, 62, 1089–1097. [Google Scholar] [CrossRef]
  37. Miyazaki, S. Long-Term Unrestrained Measurement of Stride Length and Walking Velocity Utilizing a Piezoelectric Gyroscope. IEEE Trans. Biomed. Eng. 1997, 44, 753–759. [Google Scholar] [CrossRef]
  38. Shin, S.H.; Park, C.G.; Kim, J.W.; Hong, H.S.; Lee, J.M. Adaptive Step Length Estimation Algorithm Using Low-Cost MEMS Inertial Sensors. In Proceedings of the 2007 IEEE Sensors Applications Symposium SAS, San Diego, CA, USA, 6–8 February 2007; pp. 6–8. [Google Scholar] [CrossRef]
  39. Maqbool, H.F.; Husman, M.A.B.; Awad, M.I.; Abouhossein, A.; Iqbal, N.; Dehghani-Sanij, A.A. A Real-Time Gait Event Detection for Lower Limb Prosthesis Control and Evaluation. IEEE Trans. Neural Syst. Rehabil. Eng. 2016, 25, 1500–1509. [Google Scholar] [CrossRef]
  40. Yao, Y.; Pan, L.; Fen, W.; Xu, X.; Liang, X.; Xu, X. A Robust Step Detection and Stride Length Estimation for Pedestrian Dead Reckoning Using a Smartphone. IEEE Sens. J. 2020, 20, 9685–9697. [Google Scholar] [CrossRef]
  41. Chau, T. A Review of Analytical Techniques for Gait Data. Part 1: Fuzzy, Statistical and Fractal Methods. Gait Posture 2001, 13, 49–66. [Google Scholar] [CrossRef]
  42. Aghanavesi, S.; Westin, J.; Bergquist, F.; Nyholm, D.; Askmark, H.; Aquilonius, S.M.; Constantinescu, R.; Medvedev, A.; Spira, J.; Ohlsson, F.; et al. A Multiple Motion Sensors Index for Motor State Quantification in Parkinson’s Disease. Comput. Methods Programs Biomed. 2020, 189, 105309. [Google Scholar] [CrossRef]
  43. Rodríguez-Martín, D.; Samà, A.; Pérez-López, C.; Català, A.; Moreno Arostegui, J.M.; Cabestany, J.; Bayés, À.; Alcaine, S.; Mestre, B.; Prats, A.; et al. Home Detection of Freezing of Gait Using Support Vector Machines through a Single Waist-Worn Triaxial Accelerometer. PLoS ONE 2017, 12, e0171764. [Google Scholar] [CrossRef]
  44. Ghoraani, B.; Hssayeni, M.D.; Bruack, M.M.; Jimenez-Shahed, J. Multilevel Features for Sensor-Based Assessment of Motor Fluctuation in Parkinson’s Disease Subjects. IEEE J. Biomed. Health Inform. 2020, 24, 1284–1295. [Google Scholar] [CrossRef]
  45. Albert, M.V.; Azeze, Y.; Courtois, M.; Jayaraman, A. In-Lab versus at-Home Activity Recognition in Ambulatory Subjects with Incomplete Spinal Cord Injury. J. NeuroEng. Rehabil. 2017, 14, 10. [Google Scholar] [CrossRef] [Green Version]
  46. Teufl, W.; Taetz, B.; Miezal, M.; Lorenz, M.; Pietschmann, J.; Jöllenbeck, T.; Fröhlich, M.; Bleser, G. Bleser Towards an Inertial Sensor-Based Wearable Feedback System for Patients after Total Hip Arthroplasty: Validity and Applicability for Gait Classification with Gait Kinematics-Based Features. Sensors 2019, 19, 5006. [Google Scholar] [CrossRef] [Green Version]
  47. Reches, T.; Dagan, M.; Herman, T.; Gazit, E.; Gouskova, N.; Giladi, N.; Manor, B.; Hausdorff, J. Using Wearable Sensors and Machine Learning to Automatically Detect Freezing of Gait during a FOG-Provoking Test. Sensors 2020, 20, 4474. [Google Scholar] [CrossRef]
  48. Ashouri, S.; Abedi, M.; Abdollahi, M.; Dehghan Manshadi, F.; Parnianpour, M.; Khalaf, K. A Novel Approach to Spinal 3-D Kinematic Assessment Using Inertial Sensors: Towards Effective Quantitative Evaluation of Low Back Pain in Clinical Settings. Comput. Biol. Med. 2017, 89, 144–149. [Google Scholar] [CrossRef]
  49. Zhang, Y.; Yan, W.; Yao, Y.; Ahmed, J.B.; Tan, Y.; Gu, D. Prediction of Freezing of Gait in Patients with Parkinson’s Disease by Identifying Impaired Gait Patterns. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 591–600. [Google Scholar] [CrossRef]
  50. Phienphanich, P.; Tankongchamruskul, N.; Akarathanawat, W.; Chutinet, A.; Nimnual, R.; Tantibundhit, C.; Suwanwela, N.C. Stroke Screening Feature Selection for Arm Weakness Using a Mobile Application. IEEE Access 2020, 8, 170898–170914. [Google Scholar] [CrossRef]
  51. Goodlich, B.I.; Armstrong, E.L.; Horan, S.A.; Baque, E.; Carty, C.P.; Ahmadi, M.N.; Trost, S.G. Machine Learning to Quantify Habitual Physical Activity in Children with Cerebral Palsy. Dev. Med. Child Neurol. 2020, 62, 1054–1060. [Google Scholar] [CrossRef]
  52. Honoré, H.; Gade, R.; Nielsen, J.F.; Mechlenburg, I. Developing and Validating an Accelerometer-Based Algorithm with Machine Learning to Classify Physical Activity after Acquired Brain Injury. Brain Inj. 2021, 35, 460–467. [Google Scholar] [CrossRef]
  53. Sun, R.; Tomkins-Lane, C.; Muaremi, A.; Kuwabara, A.; Smuck, M. Physical Activity Thresholds for Predicting Longitudinal Gait Decline in Adults with Knee Osteoarthritis. Osteoarthr. Cartil. 2021, 29, 965–972. [Google Scholar] [CrossRef]
  54. Oubre, B.; Daneault, J.-F.; Jung, H.-T.; Whritenour, K.; Miranda, J.G.V.; Park, J.; Ryu, T.; Kim, Y.; Lee, S.I. Estimating Upper-Limb Impairment Level in Stroke Survivors Using Wearable Inertial Sensors and a Minimally-Burdensome Motor Task. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 601–611. [Google Scholar] [CrossRef]
  55. Derungs, A.; Amft, O. Synthesising Motion Sensor Data from Biomechanical Simulations to Investigate Motion Sensor Placement and Orientation Variations. In Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 23–27 July 2019; pp. 6391–6394. [Google Scholar]
  56. Lee, S.I.; Adans-Dester, C.P.; OBrien, A.T.; Vergara-Diaz, G.P.; Black-Schaffer, R.; Zafonte, R.; Dy, J.G.; Bonato, P. Predicting and Monitoring Upper-Limb Rehabilitation Outcomes Using Clinical and Wearable Sensor Data in Brain Injury Survivors. IEEE Trans. Biomed. Eng. 2021, 68, 1871–1881. [Google Scholar] [CrossRef]
  57. Caramia, C.; Torricelli, D.; Schmid, M.; Munoz-Gonzalez, A.; Gonzalez-Vargas, J.; Grandas, F.; Pons, J.L. IMU-Based Classification of Parkinson’s Disease from Gait: A Sensitivity Analysis on Sensor Location and Feature Selection. IEEE J. Biomed. Health Inform. 2018, 22, 1765–1774. [Google Scholar] [CrossRef]
  58. Rastegari, E.; Orn, D.; Ali, H. Smart Computational Approaches with Advanced Feature Selection Algorithms for Optimizing the Classification of Mobility Data in Health Informatics. In Proceedings of the 11th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics, Virtual Event, USA, 21 September 2020; pp. 1–9. [Google Scholar]
  59. Mirelman, A.; Ben Or Frank, M.; Melamed, M.; Granovsky, L.; Nieuwboer, A.; Rochester, L.; Del Din, S.; Avanzino, L.; Pelosin, E.; Bloem, B.R.; et al. Detecting Sensitive Mobility Features for Parkinson’s Disease Stages Via Machine Learning. Mov. Disord. 2021, 36, 2144–2155. [Google Scholar] [CrossRef] [PubMed]
  60. Hssayeni, M.D.; Jimenez-Shahed, J.; Burack, M.A.; Ghoraani, B. Wearable Sensors for Estimation of Parkinsonian Tremor Severity during Free Body Movements. Sensors 2019, 19, 4215. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Sarwat, H.; Sarwat, H.; Awad, M.I.; Maged, S.A. Assessment of Post-Stroke Patients Using Smartphones and Gradient Boosting. In Proceedings of the 2020 15th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt, 15–16 December 2020; pp. 1–6. [Google Scholar]
  62. İkizoğlu, S.; Heydarov, S. Accuracy Comparison of Dimensionality Reduction Techniques to Determine Significant Features from IMU Sensor-Based Data to Diagnose Vestibular System Disorders. Biomed. Signal Process. Control 2020, 61, 101963. [Google Scholar] [CrossRef]
  63. Bennett, T.R.; Wu, J. Inertial Measurement Unit-Based Wearable Computers for Assisted Living Applications. IEEE Signal Process. Mag. 2018, 33, 28–35. [Google Scholar] [CrossRef]
  64. Ibrahim, A.A.; Küderle, A.; Gaßner, H.; Klucken, J.; Eskofier, B.M.; Kluge, F. Inertial Sensor-Based Gait Parameters Reflect Patient-Reported Fatigue in Multiple Sclerosis. J. NeuroEng. Rehabil. 2020, 17, 165. [Google Scholar] [CrossRef]
  65. Kobsar, D.; Osis, S.T.; Boyd, J.E.; Hettinga, B.A.; Ferber, R. Wearable Sensors to Predict Improvement Following an Exercise Intervention in Patients with Knee Osteoarthritis. J. NeuroEng. Rehabil. 2017, 14, 94. [Google Scholar] [CrossRef] [Green Version]
  66. Cesareo, A.; Previtali, Y.; Biffi, E.; Aliverti, A. Assessment of Breathing Parameters Using an Inertial Measurement Unit (IMU)-Based System. Sensors 2018, 19, 88. [Google Scholar] [CrossRef] [Green Version]
  67. Ravi, D.; Wong, C.; Deligianni, F.; Berthelot, M.; Andreu-Perez, J.; Lo, B.; Yang, G.Z. Deep Learning for Health Informatics. IEEE J. Biomed. Health Inform. 2017, 21, 4–21. [Google Scholar] [CrossRef] [Green Version]
  68. Wang, J.; Chen, Y.; Hao, S.; Peng, X.; Hu, L. Deep Learning for Sensor-Based Activity Recognition: A Survey. Pattern Recognit. Lett. 2019, 119, 3–11. [Google Scholar] [CrossRef] [Green Version]
  69. Wang, F.-C.; Chen, S.-F.; Lin, C.-H.; Shih, C.-J.; Lin, A.-C.; Yuan, W.; Li, Y.-C.; Kuo, T.-Y. Detection and Classification of Stroke Gaits by Deep Neural Networks Employing Inertial Measurement Units. Sensors 2021, 21, 1864. [Google Scholar] [CrossRef]
  70. Butt, A.H.; Cavallo, F.; Maremmani, C.; Rovini, E. Biomechanical Parameters Assessment for the Classification of Parkinson Disease Using Bidirectional Long Short-Term Memory. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada, 20–24 July 2020; pp. 5761–5764. [Google Scholar]
  71. Rovini, E.; Fiorini, L.; Esposito, D.; Maremmani, C.; Cavallo, F. Fine Motor Assessment with Unsupervised Learning for Personalized Rehabilitation in Parkinson Disease. In Proceedings of the 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, ON, Canada, 24–28 June 2019; pp. 1167–1172. [Google Scholar]
  72. Som, A.; Krishnamurthi, N.; Buman, M.; Turaga, P. Unsupervised Pre-Trained Models from Healthy ADLs Improve Parkinson’s Disease Classification of Gait Patterns. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada, 20–24 July 2020; pp. 784–788. [Google Scholar]
  73. Mohammadian Rad, N.; van Laarhoven, T.; Furlanello, C.; Marchiori, E. Novelty Detection Using Deep Normative Modeling for IMU-Based Abnormal Movement Monitoring in Parkinson’s Disease and Autism Spectrum Disorders. Sensors 2018, 18, 3533. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. Tong, L.; He, J.; Peng, L. CNN-Based PD Hand Tremor Detection Using Inertial Sensors. IEEE Sens. Lett. 2021, 5, 7002504. [Google Scholar] [CrossRef]
  75. Shawen, N.; O’Brien, M.K.; Venkatesan, S.; Lonini, L.; Simuni, T.; Hamilton, J.L.; Ghaffari, R.; Rogers, J.A.; Jayaraman, A. Role of Data Measurement Characteristics in the Accurate Detection of Parkinson’s Disease Symptoms Using Wearable Sensors. J. Neuroeng. Rehabil. 2020, 17, 52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Dai, H.; Cai, G.; Lin, Z.; Wang, Z.; Ye, Q. Validation of Inertial Sensing-Based Wearable Device for Tremor and Bradykinesia Quantification. IEEE J. Biomed. Health Inform. 2021, 25, 997–1005. [Google Scholar] [CrossRef]
  77. Mileti, I.; Germanotta, M.; Di Sipio, E.; Imbimbo, I.; Pacilli, A.; Erra, C.; Petracca, M.; Rossi, S.; Del Prete, Z.; Bentivoglio, A.; et al. Measuring Gait Quality in Parkinson’s Disease through Real-Time Gait Phase Recognition. Sensors 2018, 18, 919. [Google Scholar] [CrossRef] [Green Version]
  78. Perez-Ibarra, J.C.; Siqueira, A.A.G.; Krebs, H.I. Identification of Gait Events in Healthy Subjects and With Parkinson’s Disease Using Inertial Sensors: An Adaptive Unsupervised Learning Approach. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 2933–2943. [Google Scholar] [CrossRef]
  79. Hannink, J.; Kautz, T.; Pasluosta, C.F.; Barth, J.; Schulein, S.; Gassmann, K.-G.; Klucken, J.; Eskofier, B.M. Mobile Stride Length Estimation with Deep Convolutional Neural Networks. IEEE J. Biomed. Health Inform. 2018, 22, 354–362. [Google Scholar] [CrossRef] [Green Version]
  80. Barth, J.; Oberndorfer, C.; Pasluosta, C.; Schülein, S.; Gassner, H.; Reinfelder, S.; Kugler, P.; Schuldhaus, D.; Winkler, J.; Klucken, J. Stride Segmentation during Free Walk Movements Using Multi-Dimensional Subsequence Dynamic Time Warping on Inertial Sensor Data. Sensors 2015, 15, 6419–6440. [Google Scholar] [CrossRef]
  81. Bernad-Elazari, H.; Herman, T.; Mirelman, A.; Gazit, E.; Giladi, N.; Hausdorff, J.M. Objective Characterization of Daily Living Transitions in Patients with Parkinson’s Disease Using a Single Body-Fixed Sensor. J. Neurol. 2016, 263, 1544–1551. [Google Scholar] [CrossRef]
  82. Shi, B.; Yen, S.C.; Tay, A.; Tan, D.M.L.; Chia, N.S.Y.; Au, W.L. Convolutional Neural Network for Freezing of Gait Detection Leveraging the Continuous Wavelet Transform on Lower Extremities Wearable Sensors Data. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada, 20–24 July 2020; pp. 5410–5415. [Google Scholar]
  83. Bachlin, M.; Plotnik, M.; Roggen, D.; Maidan, I.; Hausdorff, J.M.; Giladi, N.; Troster, G. Wearable Assistant for Parkinson’s Disease Patients with the Freezing of Gait Symptom. IEEE Trans. Inf. Technol. Biomed. 2009, 14, 436–446. [Google Scholar] [CrossRef]
  84. Tautan, A.-M.; Andrei, A.-G.; Ionescu, B. Freezing of Gait Detection for Parkinson’s Disease Patients Using Accelerometer Data: Case Study. In Proceedings of the 2020 International Conference on e-Health and Bioengineering (EHB), Iasi, Romania, 29–30 October 2020; pp. 1–4. [Google Scholar]
  85. Mazilu, S.; Calatroni, A.; Gazit, E.; Mirelman, A.; Hausdorff, J.M.; Tröster, G. Prediction of Freezing of Gait in Parkinson’s from Physiological Wearables: An Exploratory Study. IEEE J. Biomed. Health Inform. 2015, 19, 1843–1854. [Google Scholar] [CrossRef] [PubMed]
  86. Palmerini, L.; Rocchi, L.; Mazilu, S.; Gazit, E.; Hausdorff, J.M.; Chiari, L. Identification of Characteristic Motor Patterns Preceding Freezing of Gait in Parkinson’s Disease Using Wearable Sensors. Front. Neurol. 2017, 8, 394. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. Wang, Q.; Lohit, S.; Toledo, M.J.; Buman, M.P.; Turaga, P. A Statistical Estimation Framework for Energy Expenditure of Physical Activities from a Wrist-Worn Accelerometer. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 2631–2635. [Google Scholar]
  88. Goodwin, M.S.; Haghighi, M.; Tang, Q.; Akcakaya, M.; Erdogmus, D.; Intille, S. Moving towards a Real-Time System for Automatically Recognizing Stereotypical Motor Movements in Individuals on the Autism Spectrum Using Wireless Accelerometry. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA, 13–17 September 2014; pp. 861–872. [Google Scholar]
  89. Guerra, J.; Uddin, J.; Nilsen, D.; Mclnerney, J.; Fadoo, A.; Omofuma, I.B.; Hughes, S.; Agrawal, S.; Allen, P.; Schambra, H.M. Capture, Learning, and Classification of Upper Extremity Movement Primitives in Healthy Controls and Stroke Patients. In Proceedings of the 2017 International Conference on Rehabilitation Robotics (ICORR), London, UK, 17–20 July 2017; pp. 547–554. [Google Scholar]
  90. Parnandi, A.; Uddin, J.; Nilsen, D.M.; Schambra, H.M. The Pragmatic Classification of Upper Extremity Motion in Neurological Patients: A Primer. Front. Neurol. 2019, 10, 996. [Google Scholar] [CrossRef]
  91. He, J.; Chen, S.; Guo, Z.; Pirbhulal, S.; Wu, W.; Feng, J.; Dan, G. A Comparative Study of Motion Recognition Methods for Efficacy Assessment of Upper Limb Function. Int. J. Adapt. Control Signal Process. 2019, 33, 1248–1256. [Google Scholar] [CrossRef]
  92. Liu, X.; Rajan, S.; Ramasarma, N.; Bonato, P.; Lee, S.I. The Use of a Finger-Worn Accelerometer for Monitoring of Hand Use in Ambulatory Settings. IEEE J. Biomed. Health Inform. 2019, 23, 599–606. [Google Scholar] [CrossRef]
  93. Knarr, B.A.; Kesar, T.M.; Reisman, D.S.; Binder-Macleod, S.A.; Higginson, J.S. Changes in the Activation and Function of the Ankle Plantar Flexor Muscles Due to Gait Retraining in Chronic Stroke Survivors. J. Neuroeng. Rehabil. 2013, 10, 1–8. [Google Scholar] [CrossRef] [Green Version]
  94. Lucas, A.; Hermiz, J.; Labuzetta, J.; Arabadzhi, Y.; Karanjia, N.; Gilja, V. Use of Accelerometry for Long Term Monitoring of Stroke Patients. IEEE J. Transl. Eng. Health Med. 2019, 7, 1–10. [Google Scholar] [CrossRef]
  95. Ahmadi, M.N.; O’Neil, M.E.; Baque, E.; Boyd, R.N.; Trost, S.G. Machine Learning to Quantify Physical Activity in Children with Cerebral Palsy: Comparison of Group, Group-Personalized, and Fully-Personalized Activity Classification Models. Sensors 2020, 20, 3976. [Google Scholar] [CrossRef]
  96. Ahmadi, M.; O’Neil, M.; Fragala-Pinkham, M.; Lennon, N.; Trost, S. Machine Learning Algorithms for Activity Recognition in Ambulant Children and Adolescents with Cerebral Palsy. J. NeuroEng. Rehabil. 2018, 15, 105. [Google Scholar] [CrossRef] [Green Version]
  97. Chakraborty, J.; Nandy, A. Discrete Wavelet Transform Based Data Representation in Deep Neural Network for Gait Abnormality Detection. Biomed. Signal Process. Control 2020, 62, 102076. [Google Scholar] [CrossRef]
  98. Dostál, O.; Procházka, A.; Vyšata, O.; Ťupa, O.; Cejnar, P.; Vališ, M. Recognition of Motion Patterns Using Accelerometers for Ataxic Gait Assessment. Neural Comput. Appl. 2021, 33, 2207–2215. [Google Scholar] [CrossRef]
  99. Ngo, T.; Pathirana, P.N.; Horne, M.K.; Power, L.; Szmulewicz, D.J.; Milne, S.C.; Corben, L.A.; Roberts, M.; Delatycki, M.B. Balance Deficits Due to Cerebellar Ataxia: A Machine Learning and Cloud-Based Approach. IEEE Trans. Biomed. Eng. 2021, 68, 1507–1517. [Google Scholar] [CrossRef] [PubMed]
  100. Oubre, B.; Daneault, J.-F.; Whritenour, K.; Khan, N.C.; Stephen, C.D.; Schmahmann, J.D.; Lee, S.I.; Gupta, A.S. Decomposition of Reaching Movements Enables Detection and Measurement of Ataxia. Cerebellum 2021, 20, 811–822. [Google Scholar] [CrossRef]
  101. Bennasar, M.; Hicks, Y.A.; Clinch, S.P.; Jones, P.; Holt, C.; Rosser, A.; Busse, M. Automated Assessment of Movement Impairment in Huntington’s Disease. IEEE Trans. Neural Syst. Rehabil. Eng. 2018, 26, 2062–2069. [Google Scholar] [CrossRef]
  102. De Vos, M.; Prince, J.; Buchanan, T.; FitzGerald, J.J.; Antoniades, C.A. Discriminating Progressive Supranuclear Palsy from Parkinson’s Disease Using Wearable Technology and Machine Learning. Gait Posture 2020, 77, 257–263. [Google Scholar] [CrossRef] [PubMed]
  103. Nazarahari, M.; Chan, K.M.; Rouhani, H. A Novel Instrumented Shoulder Functional Test Using Wearable Sensors in Patients with Brachial Plexus Injury. J. Shoulder Elb. Surg. 2021, 30, e493–e502. [Google Scholar] [CrossRef]
  104. Milošević, M.; Van de Vel, A.; Cuppens, K.; Bonroy, B.; Ceulemans, B.; Lagae, L.; Vanrumste, B.; Van Huffel, S. Feature Selection Methods for Accelerometry-Based Seizure Detection in Children. Med. Biol. Eng. Comput. 2017, 55, 151–165. [Google Scholar] [CrossRef]
  105. Wang, L.; Sun, Y.; Li, Q.; Liu, T.; Yi, J. Two Shank-Mounted IMUs-Based Gait Analysis and Classification for Neurological Disease Patients. IEEE Robot. Autom. Lett. 2020, 5, 1970–1976. [Google Scholar] [CrossRef]
  106. Wang, X.; Ristic-Durrant, D.; Spranger, M.; Graser, A. Gait Assessment System Based on Novel Gait Variability Measures. In Proceedings of the 2017 International Conference on Rehabilitation Robotics (ICORR), London, UK, 17–20 July 2017; pp. 467–472. [Google Scholar]
  107. Lemoyne, R.; Mastroianni, T. Implementation of a Smartphone as a Wearable and Wireless Gyroscope Platform for Machine Learning Classification of Hemiplegic Gait through a Multilayer Perceptron Neural Network. In Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA, 17–20 December 2018; pp. 946–950. [Google Scholar]
  108. Kim, J.-Y.; Park, G.; Lee, S.-A.; Nam, Y. Analysis of Machine Learning-Based Assessment for Elbow Spasticity Using Inertial Sensors. Sensors 2020, 20, 1622. [Google Scholar] [CrossRef] [Green Version]
  109. Kumar, D.; Gubbi, J.; Yan, B.; Palaniswami, M. Motor Recovery Monitoring in Post Acute Stroke Patients Using Wireless Accelerometer and Cross-Correlation. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 6703–6706. [Google Scholar]
  110. Parnandi, A.; Wade, E.; Matarić, M. Motor Function Assessment Using Wearable Inertial Sensors. In Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina, 31 August–4 September 2010; pp. 86–89. [Google Scholar]
  111. Stetter, B.J.; Krafft, F.C.; Ringhof, S.; Stein, T.; Sell, S. A Machine Learning and Wearable Sensor Based Approach to Estimate External Knee Flexion and Adduction Moments during Various Locomotion Tasks. Front. Bioeng. Biotechnol. 2020, 8, 9. [Google Scholar] [CrossRef]
  112. Lee, J.; Song, J.; Hootman, J.M.; Semanik, P.A.; Chang, R.W.; Sharma, L.; Van Horn, L.; Bathon, J.M.; Eaton, C.B.; Hochberg, M.C. Obesity and Other Modifiable Factors for Physical Inactivity Measured by Accelerometer in Adults with Knee Osteoarthritis. Arthritis Care Res. 2013, 65, 53–61. [Google Scholar] [CrossRef]
  113. Chen, H.-P.; Chen, H.-C.; Liu, K.-C.; Chan, C.-T. Online Segmentation with Multi-Layer SVM for Knee Osteoarthritis Rehabilitation Monitoring. In Proceedings of the 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), San Francisco, CA, USA, 14–17 June 2016; pp. 55–60. [Google Scholar]
  114. Tan, J.-S.; Beheshti, B.K.; Binnie, T.; Davey, P.; Caneiro, J.P.; Kent, P.; Smith, A.; O’Sullivan, P.; Campbell, A. Human Activity Recognition for People with Knee Osteoarthritis—A Proof-of-Concept. Sensors 2021, 21, 3381. [Google Scholar] [CrossRef] [PubMed]
  115. Abdollahi, M.; Ashouri, S.; Abedi, M.; Azadeh-Fard, N.; Parnianpour, M.; Khalaf, K.; Rashedi, E. Using a Motion Sensor to Categorize Nonspecific Low Back Pain Patients: A Machine Learning Approach. Sensors 2020, 20, 3600. [Google Scholar] [CrossRef]
  116. Alcaraz, J.C.; Moghaddamnia, S.; Penner, M.; Peissig, J. Monitoring the Rehabilitation Progress Using a DCNN and Kinematic Data for Digital Healthcare. In Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands, 18–21 January 2021; pp. 1333–1337. [Google Scholar]
  117. Bini, S.A.; Shah, R.F.; Bendich, I.; Patterson, J.T.; Hwang, K.M.; Zaid, M.B. Machine Learning Algorithms Can Use Wearable Sensor Data to Accurately Predict Six-Week Patient-Reported Outcome Scores Following Joint Replacement in a Prospective Trial. J. Arthroplast. 2019, 34, 2242–2247. [Google Scholar] [CrossRef] [PubMed]
  118. Bevilacqua, A.; Huang, B.; Argent, R.; Caulfield, B.; Kechadi, T. Automatic Classification of Knee Rehabilitation Exercises Using a Single Inertial Sensor: A Case Study. In Proceedings of the 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Las Vegas, NV, USA, 4–7 March 2018; pp. 21–24. [Google Scholar]
  119. Zanella-Calzada, L.A.; Galván-Tejada, C.E.; Chávez-Lamas, N.M.; Gracia-Cortés, M.; Magallanes-Quintanar, R.; Celaya-Padilla, J.M.; Galván-Tejada, J.I.; Gamboa-Rosales, H. Feature Extraction in Motor Activity Signal: Towards a Depression Episodes Detection in Unipolar and Bipolar Patients. Diagnostics 2019, 9, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  120. Kim, H.; Lee, S.; Lee, S.; Hong, S.; Kang, H.; Kim, N. Depression Prediction by Using Ecological Momentary Assessment, Actiwatch Data, and Machine Learning: Observational Study on Older Adults Living Alone. JMIR mHealth uHealth 2019, 7, e14149. [Google Scholar] [CrossRef] [Green Version]
  121. Tazawa, Y.; Liang, K.; Yoshimura, M.; Kitazawa, M.; Kaise, Y.; Takamiya, A.; Kishi, A.; Horigome, T.; Mitsukura, Y.; Mimura, M. Evaluating Depression with Multimodal Wristband-Type Wearable Device: Screening and Assessing Patient Severity Utilizing Machine-Learning. Heliyon 2020, 6, e03274. [Google Scholar] [CrossRef]
  122. Garcia-Ceja, E.; Riegler, M.; Jakobsen, P.; Torresen, J.; Nordgreen, T.; Oedegaard, K.J.; Fasmer, O.B. Motor Activity Based Classification of Depression in Unipolar and Bipolar Patients. In Proceedings of the 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS), Karlstad, Sweden, 18–21 June 2018; pp. 316–321. [Google Scholar]
  123. Ghandeharioun, A.; Fedor, S.; Sangermano, L.; Ionescu, D.; Alpert, J.; Dale, C.; Sontag, D.; Picard, R. Objective Assessment of Depressive Symptoms with Machine Learning and Wearable Sensors Data. In Proceedings of the 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, TX, USA, 23–26 October 2017; pp. 325–332. [Google Scholar]
  124. Faedda, G.L.; Ohashi, K.; Hernandez, M.; McGreenery, C.E.; Grant, M.C.; Baroni, A.; Polcari, A.; Teicher, M.H. Actigraph Measures Discriminate Pediatric Bipolar Disorder from Attention-deficit/Hyperactivity Disorder and Typically Developing Controls. J. Child Psychol. Psychiatry 2016, 57, 706–716. [Google Scholar] [CrossRef] [Green Version]
  125. McGinnis, R.S.; McGinnis, E.W.; Hruschak, J.; Lopez-Duran, N.L.; Fitzgerald, K.; Rosenblum, K.L.; Muzik, M. Rapid Detection of Internalizing Diagnosis in Young Children Enabled by Wearable Sensors and Machine Learning. PLoS ONE 2019, 14, e0210267. [Google Scholar] [CrossRef]
  126. Clark, L.A.; Cuthbert, B.; Lewis-Fernández, R.; Narrow, W.E.; Reed, G.M. Three Approaches to Understanding and Classifying Mental Disorder: ICD-11, DSM-5, and the National Institute of Mental Health’s Research Domain Criteria (RDoC). Psychol. Sci. Public Interest 2017, 18, 72–145. [Google Scholar] [CrossRef] [Green Version]
  127. Stafford, N.; Colom, F. Purpose and Effectiveness of Psychoeducation in Patients with Bipolar Disorder in a Bipolar Clinic Setting. Acta Psychiatr. Scand. 2013, 127, 11–18. [Google Scholar] [CrossRef] [PubMed]
  128. Garcia-Ceja, E.; Riegler, M.; Jakobsen, P.; Tørresen, J.; Nordgreen, T.; Oedegaard, K.J.; Fasmer, O.B. Depresjon: A Motor Activity Database of Depression Episodes in Unipolar and Bipolar Patients. In Proceedings of the 9th ACM Multimedia Systems Conference, Amsterdam, The Netherlands, 12–15 June 2018; pp. 472–477. [Google Scholar]
  129. Cheng, Q.; Shang, J.; Juen, J.; Han, J.; Schatz, B. Mining Discriminative Patterns to Predict Health Status for Cardiopulmonary Patients. In Proceedings of the 7th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Seattle, WA, USA, 2–5 October 2016; pp. 41–49. [Google Scholar]
  130. Friedrich, B.; Lau, S.; Elgert, L.; Bauer, J.M.; Hein, A. A Deep Learning Approach for TUG and SPPB Score Prediction of (Pre-) Frail Older Adults on Real-Life IMU Data. Healthcare 2021, 9, 149. [Google Scholar] [CrossRef] [PubMed]
  131. Argent, R.; Drummond, S.; Remus, A.; O’Reilly, M.; Caulfield, B. Evaluating the Use of Machine Learning in the Assessment of Joint Angle Using a Single Inertial Sensor. J. Rehabil. Assist. Technol. Eng. 2019, 6, 2055668319868544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  132. Bavan, L.; Surmacz, K.; Beard, D.; Mellon, S.; Rees, J. Adherence Monitoring of Rehabilitation Exercise with Inertial Sensors: A Clinical Validation Study. Gait Posture 2019, 70, 211–217. [Google Scholar] [CrossRef] [PubMed]
  133. Hua, A.; Chaudhari, P.; Johnson, N.; Quinton, J.; Schatz, B.; Buchner, D.; Hernandez, M.E. Evaluation of Machine Learning Models for Classifying Upper Extremity Exercises Using Inertial Measurement Unit-Based Kinematic Data. IEEE J. Biomed. Health Inform. 2020, 24, 2452–2460. [Google Scholar] [CrossRef] [PubMed]
  134. Brennan, L.; Bevilacqua, A.; Kechadi, T.; Caulfield, B. Segmentation of Shoulder Rehabilitation Exercises for Single and Multiple Inertial Sensor Systems. J. Rehabil. Assist. Technol. Eng. 2020, 7, 2055668320915377. [Google Scholar] [CrossRef]
  135. Chang, C.-Y.; Hsieh, C.-Y.; Huang, H.-Y.; Wu, Y.-T.; Chen, L.-C.; Chan, C.-T.; Liu, K.-C. Automatic Functional Shoulder Task Identification and Sub-Task Segmentation Using Wearable Inertial Measurement Units for Frozen Shoulder Assessment. Sensors 2020, 21, 106. [Google Scholar] [CrossRef]
  136. Tedaldi, D.; Pretto, A.; Menegatti, E. A Robust and Easy to Implement Method for IMU Calibration without External Equipments. In Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China, 31 May–7 June 2014; pp. 3042–3049. [Google Scholar]
  137. Milosevic, M.; Van de Vel, A.; Bonroy, B.; Ceulemans, B.; Lagae, L.; Vanrumste, B.; Huffel, S.V. Automated Detection of Tonic–Clonic Seizures Using 3-D Accelerometry and Surface Electromyography in Pediatric Patients. IEEE J. Biomed. Health Inform. 2016, 20, 1333–1341. [Google Scholar] [CrossRef]
  138. Huo, W.; Angeles, P.; Tai, Y.F.; Pavese, N.; Wilson, S.; Hu, M.T.; Vaidyanathan, R. A Heterogeneous Sensing Suite for Multisymptom Quantification of Parkinson’s Disease. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 1397–1406. [Google Scholar] [CrossRef]
  139. Chen, W.; Xu, Y.; Wang, J.; Zhang, J. Kinematic Analysis of Human Gait Based on Wearable Sensor System for Gait Rehabilitation. J. Med. Biol. Eng. 2016, 36, 843–856. [Google Scholar] [CrossRef]
  140. Hwangbo, M.; Kim, J.-S.; Kanade, T. IMU Self-Calibration Using Factorization. IEEE Trans. Robot. 2013, 29, 493–507. [Google Scholar] [CrossRef] [Green Version]
  141. Chen, F.; Wen, Z.; Zhou, W.; Ni, Z.; Li, X. Adaptive On-Line Self-Calibration of Errors in Multi-Stage-Noise-Shaping (MASH) Sigma-Delta Modulator Gyroscope. In Proceedings of the 2020 IEEE 33rd International Conference on Micro Electro Mechanical Systems (MEMS), Vancouver, BC, Canada, 18–22 January 2020; pp. 753–756. [Google Scholar]
  142. Prikhodko, I.P.; Merritt, C.; Gregory, J.A.; Geen, J.A.; Chang, J.; Bergeron, J.; Clark, W.; Judy, M.W. Continuous Self-Calibration Canceling Drive-Induced Errors in MEMS Vibratory Gyroscopes. In Proceedings of the 2015 Transducers-2015 18th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS), Anchorage, AK, USA, 21–25 June 2015; pp. 35–38. [Google Scholar]
  143. Ren, C.; Liu, Q.; Fu, T. A Novel Self-Calibration Method for MIMU. IEEE Sens. J. 2015, 15, 5416–5422. [Google Scholar] [CrossRef]
  144. Dai, M.; Lu, J. A Full-Parameter Self-Calibration Method Based on Inertial Frame Filtering for Triaxis RINS under Swaying Base. IEEE Sens. J. 2018, 19, 2170–2180. [Google Scholar] [CrossRef]
  145. MTw Awinda. Available online: https://www.xsens.com/products/mtw-awinda (accessed on 28 May 2022).
  146. Wearable Sensor Products. Available online: https://shimmersensing.com/wearable-sensor-products/ (accessed on 28 May 2022).
  147. Morrison, C.; Huckvale, K.; Corish, B.; Banks, R.; Grayson, M.; Dorn, J.; Sellen, A.; Lindley, S. Visualizing Ubiquitously Sensed Measures of Motor Ability in Multiple Sclerosis: Reflections on Communicating Machine Learning in Practice. ACM Trans. Interact. Intell. Syst. (TiiS) 2018, 8, 1–28. [Google Scholar] [CrossRef]
  148. Wang, Y.; Su, H.; Zhang, B.; Hu, X. Interpret Neural Networks by Identifying Critical Data Routing Paths. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 8906–8914. [Google Scholar]
  149. Ribeiro, M.T.; Singh, S.; Guestrin, C. “Why Should i Trust You?” Explaining the Predictions of Any Classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 1135–1144. [Google Scholar]
  150. Choi, E.; Bahadori, M.T.; Song, L.; Stewart, W.F.; Sun, J. GRAM: Graph-Based Attention Model for Healthcare Representation Learning. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, 13–17 August 2017; pp. 787–795. [Google Scholar]
  151. Lu, C.; Reddy, C.K.; Ning, Y. Self-Supervised Graph Learning with Hyperbolic Embedding for Temporal Health Event Prediction. IEEE Trans. Cybern. 2021, 1–13. [Google Scholar] [CrossRef]
  152. Tong, L.; Liu, R.; Peng, L. LSTM-Based Lower Limbs Motion Reconstruction Using Low-Dimensional Input of Inertial Motion Capture System. IEEE Sens. J. 2019, 20, 3667–3677. [Google Scholar] [CrossRef]
  153. Karakra, A.; Fontanili, F.; Lamine, E.; Lamothe, J. HospiT’Win: A Predictive Simulation-Based Digital Twin for Patients Pathways in Hospital. In Proceedings of the 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Chicago, IL, USA, 19–22 May 2019; pp. 1–4. [Google Scholar]
Figure 1. Generalized workflow for monitoring human body motions.
Figure 1. Generalized workflow for monitoring human body motions.
Healthcare 10 01210 g001
Figure 2. A taxonomy of the selected works.
Figure 2. A taxonomy of the selected works.
Healthcare 10 01210 g002
Figure 3. Distribution of the sensor locations.
Figure 3. Distribution of the sensor locations.
Healthcare 10 01210 g003
Figure 4. Traditional inertial tracking system. a: acceleration; m: magnetic field; ω: angular rate; p: position; v: velocity; φ: attitude; δX: estimated error. Abbreviations: ZARU: Zero Angular Rate Update; HDE: Heuristic Drift Elimination.
Figure 4. Traditional inertial tracking system. a: acceleration; m: magnetic field; ω: angular rate; p: position; v: velocity; φ: attitude; δX: estimated error. Abbreviations: ZARU: Zero Angular Rate Update; HDE: Heuristic Drift Elimination.
Healthcare 10 01210 g004
Figure 5. Machine learning-based method.
Figure 5. Machine learning-based method.
Healthcare 10 01210 g005
Figure 6. A summary of the reviewed works. The color of each bubble represents the number of reviewed works covering a given data processing method (row) and detailed application scenarios (column).
Figure 6. A summary of the reviewed works. The color of each bubble represents the number of reviewed works covering a given data processing method (row) and detailed application scenarios (column).
Healthcare 10 01210 g006
Table 1. Feature groups for supervised machine learning models.
Table 1. Feature groups for supervised machine learning models.
Feature
Categories
Features
TimeStandard deviation, mean, range, amplitude, root mean square, variance, skewness, kurtosis, coefficient of variation (CV), increment, power, energy, and jerk
Segment time, zero-crossing ratio, number of peaks
DTW coefficient, and autoregression coefficient
FrequencyDominant frequency, power of dominant frequency, amplitude in certain bandwidth, moments of power spectral density, CV of frequency, and relative magnitude
EntropySample entropy, spectral entropy, and approximate entropy
CorrelationCross-correlation (peak and lag); autocorrelation (peaks, number, sum, amplitude, and lag)
High-orderVelocity, stride/step length, left and right asymmetry, range of motions, freezing index, and harmonic ratio
Table 2. Neurological disorders. The numbers in the Placement column are demonstrated in Figure 5. Abbreviations: Accel: Accelerometer; Gyro: Gyroscope; D: Diagnosis; SD: Symptom Detection; SA: Severity Assessment; CE: Characteristics Estimation; PA: Physical Activity; h: healthy controls; p: patients.
Table 2. Neurological disorders. The numbers in the Placement column are demonstrated in Figure 5. Abbreviations: Accel: Accelerometer; Gyro: Gyroscope; D: Diagnosis; SD: Symptom Detection; SA: Severity Assessment; CE: Characteristics Estimation; PA: Physical Activity; h: healthy controls; p: patients.
DisordersApplicationSensor (n)PlacementModelInput Data/FeaturesMajor PerformanceSubjects/
Dataset
YearRef.
PDDIMU (1)6CNN28 samplesAcc = 97.32%5 p, 5 h2021[74]
PDSDIMU (2)19CNN5s windowAcc = 90.9%10 p2016[12]
PDSD, SAIMU (2)6, 7RF74 featuresmultiple13 p2020[75]
PDSAIMU (1)9SVM7 featuresAcc = 96–97.33%45 p, 30 h2021[76]
PDSD, SAIMU (2)6, 15XGBoost78 featuresR = 0.96 (ho), 0.93 (loso)24 p2019[60]
PDCEIMU (2)26HMMrawG < 0.2526 p, 11 h2018[77]
PDCEIMU (2)16, 36HMMrawF1 ≥ 0.957 p, 5 h2020[78]
PDCEIMU (2)16, 36CNN256 samplesacc. ± prec. = 0.01 ± 5.37 cm116 p [36]2018[79]
PDSAIMU (8)2, 23, 24, 26, 30Meta-classifier18 feature setsAcc = 84.00% ± 6.54%25 p2018[57]
PDDIMU (2)25Adaboost21 gait featuresAcc = 85–95%20 p,10 h [80]2020[58]
PDSAIMU (6)6, 8, 9, 10, 26SOM41 featuresAcc = 95% (2 classes), 81.7% (3 classes)30 p2019[71]
PDSAIMU (4)20, 25SVM178 featuresR = 0.93, (0.85 (dys.), 0.84 (brady.), 0.79 (gait))19 p2020[42]
PDSAIMU (5)20, 25, 29RUSBoost134 featuresAUC = 0.76–0.90, Sen = 72–83%, Spec = 69–80%332 p, 100 h2021[59]
PDSAAccel (1)29SVMtemporal featuresAcc = 92.3%, 89.3%, 85.9 for 3 binary classifications99 p, 38 h2016[81]
PDSDIMU (3)24, 29SVM_rbf86 featuresAcc = 85.0%, Sen = 84.1%71 p2020[47]
PDSDIMU (3)25, 27CNN4s windowAcc = 89.2%67 p2020[82]
PDSDAccel (3)14, 15, 31CNN2–5s windowSen = 93.44%, Spec = 87.38%10 p [83]2020[84]
PDSDAccel (1)29SVM55 featuresGM = 76.8%, 84.0%
(personal)
21 p2017[43]
PDSDAccel (1)11CNN + LSTM4 featuresAUC = 0.93621 p [43]2020[24]
PDSDAccel (1)30C4.52 feature setsAcc = 82.7%, 77.9%
(2 modes)
12 p2020[49]
PDSDIMU (3)24, 29LDA8 featuresAUC = 0.76, Sen = 0.8411 p [85]2017[86]
PDDIMU (6)6, 8, 9, 10, 26BiLSTM190 featuresAcc = 82.4%64 p, 50 h2020[70]
PDPAAccel (6)2, 20, 25, 30Autoencoder250 samplesF1 = 73.89 ± 5.6918 p, 16 h [87]2020[72]
PDSDGyro (2)6, 15SVM3 feature setsAcc = 83.56%19 p2020[44]
PDDAccel (3)4, 20Autoencoder1s windowAUC = 0.77[83], 6 p [88]2018[73]
StrokeCEIMU (11)1, 2, 12, 17, 18, 19, 21LDAstatistical featuresAcc ≥ 93%10 h, 6 p [89]2019[90]
StrokeSAIMU (2)2, 6SVR109 featuresRMSE = 18.2%, R = 0.7036 p, 32 h2020[54]
StrokeSAIMU (1)6SVMstatistical featuresAcc = 97.70%20 p2019[91]
StrokeSAIMU (1)6XGBoostSMA featureAcc = 95.56%10 p2020[61]
StrokeCEAccel (4)20, 22SVR271 featuresnRMSE = 0.11, R = 0.7810 p, 10 h2019[92]
StrokeCEIMU (1)7RF3 feature setsAcc = 84.1%, Sen = 94.8%7 p2020[50]
StrokeDIMU (2)25DCNNgait cycleAcc = 99.35% (detection),30 p, 15 h2021[69]
StrokeSAAccel (1)13SVR20 features97.31% (classification)8 p [93]2019[55]
StrokeSAAccel (4)19, 24SVM9 featuresnRMSE = 0.32% (affected), 0.36% (unaffected)18h2019[94]
CPPAAccel (3)6, 15, 31RF15 featuresp < 0.0538 p2020[95]
CPPAAccel (2)6, 31SVM27 featuresAcc = 99.0–99.3%22 p2018[96]
CPPAIMU (3)6, 13, 31RF40 featuresAcc = 82.0–89.0%11 p2020[51]
CPDIMU (2)13, 14CNN120 samplesAcc = 92%9 p, 9 h2020[97]
CADAccel (6)1, 3, 13, 14, 16, 27ANNDFT featuresAUC = 0.9825 p2021[98]
CA / PDSAIMU (2)15, 28Naive Bayes6 feature setsAcc = 77.1%, 78.9%, 89.9%, 98.0%, 98.5% for 5 places62 p, 24 h2021[99]
CASAIMU (1)6GPR + GPC53 featuresAcc = 88.24%88 at, 44 pd, 34 h2021[100]
HDSAAccel (3)2, 20Meta-classifier234 featuresRMSE = 3.6, R = 0.69234 features2018[101]
PSPDIMU (6)2, 20, 26, 30RF17 featuresAcc = 98.78%, R = 0.77,
MAE = 12.41%
21 psp, 20 pd, 39 h2020[102]
MSSAIMU (1)15RF6 gait featuresSen = 86% (PSP/PD),49 p2020[64]
BIPAAccel (1)32RFstatistical features90% (PSP/HC)25 p, 11 h2021[52]
SCIPAAccel (1)11SVMtemporal featuresMAE = 1.3813 p2017[45]
BI/StrokeCEAccel (5)2, 5, 6, 8, 9GPRtemporal featuresSen = 88.3–90.4%44 p2021[56]
BPICEIMU (3)2, 18Ensemble20 featuresAcc = 91.6%, 85.9%
(at home)
15 p, 15 h2021[103]
SeizureDAccel (4)20, 25LS-SVM140 featuresRMSE = 6.9%, R = 0.9451 p2017[104]
VSDIMU (5)11, 23, 26SVM22 featuresAcc = 93%, R = 0.55–0.7616 p, 21 h2020[62]
GeneralDIMU (2)34SVM8 gait featuresmultiple36 p, 13 h2020[105]
GeneralCEIMU (4)23, 24SVM16 gait featuresAcc = 89.2%25 p, 24 h2017[106]
GeneralCEIMU (1)6MLPstatistical featuresAcc = 93.9%10 p2019[107]
SpasticitySAIMU (1)6RF2 feature setsAcc = 91.61%50 p2020[108]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bo, F.; Yerebakan, M.; Dai, Y.; Wang, W.; Li, J.; Hu, B.; Gao, S. IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review. Healthcare 2022, 10, 1210. https://doi.org/10.3390/healthcare10071210

AMA Style

Bo F, Yerebakan M, Dai Y, Wang W, Li J, Hu B, Gao S. IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review. Healthcare. 2022; 10(7):1210. https://doi.org/10.3390/healthcare10071210

Chicago/Turabian Style

Bo, Fan, Mustafa Yerebakan, Yanning Dai, Weibing Wang, Jia Li, Boyi Hu, and Shuo Gao. 2022. "IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review" Healthcare 10, no. 7: 1210. https://doi.org/10.3390/healthcare10071210

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop