Next Article in Journal
A Meta-Analysis of Intracortical Device Stiffness and Its Correlation with Histological Outcomes
Next Article in Special Issue
A ΣΔ Closed-Loop Interface for a MEMS Accelerometer with Digital Built-In Self-Test Function
Previous Article in Journal
Luminescent Properties of Eu3+-Doped Hybrid SiO2-PMMA Material for Photonic Applications
Previous Article in Special Issue
Design of Ensemble Stacked Auto-Encoder for Classification of Horse Gaits with MEMS Inertial Sensor Technology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

MEMS Inertial Sensors Based Gait Analysis for Rehabilitation Assessment via Multi-Sensor Fusion

1
School of Control Science and Engineering, Dalian University of Technology, Dalian 116024, China
2
Dalian Neusoft University of Information, Dalian 116023, China
3
Dalian Medical University, Dalian 116027, China
*
Author to whom correspondence should be addressed.
Micromachines 2018, 9(9), 442; https://doi.org/10.3390/mi9090442
Submission received: 31 July 2018 / Revised: 30 August 2018 / Accepted: 30 August 2018 / Published: 3 September 2018
(This article belongs to the Special Issue MEMS Accelerometers)

Abstract

:
Gait and posture are regular activities which are fully controlled by the sensorimotor cortex. In this study, fluctuations of joint angle and asymmetry of foot elevation in human walking stride records are analyzed to assess gait in healthy adults and patients affected with gait disorders. This paper aims to build a low-cost, intelligent and lightweight wearable gait analysis platform based on the emerging body sensor networks, which can be used for rehabilitation assessment of patients with gait impairments. A calibration method for accelerometer and magnetometer was proposed to deal with ubiquitous orthoronal error and magnetic disturbance. Proportional integral controller based complementary filter and error correction of gait parameters have been defined with a multi-sensor data fusion algorithm. The purpose of the current work is to investigate the effectiveness of obtained gait data in differentiating healthy subjects and patients with gait impairments. Preliminary clinical gait experiments results showed that the proposed system can be effective in auxiliary diagnosis and rehabilitation plan formulation compared to existing methods, which indicated that the proposed method has great potential as an auxiliary for medical rehabilitation assessment.

1. Introduction

Human walking contains important physiology, kinematic and dynamic information. There are many application prospects of human gait analysis in real life, such as monitoring the patient’s recovery progress in clinical practice, the control strategy of bionic robots, etc. For instance, stroke is a common neurodegenerative condition with a principal symptom of progressive limbs movement disorder. The prevalence of this neurological disease has been estimated at 120 affected individuals per 100,000 and 75% of the victims suffer from sequelae (mostly involve gait dysfunction) afterwards according to epidemiological statistics [1,2,3]. An insightful example of gait disorder can be observed in stroke—note that this study is not merely focused on stroke. However, a great majority of subjects who took part in the gait analysis experiment suffer from stroke. Furthermore, stroke patients share most gait symptoms with common neurological disorders in clinical practice. Specifically, stroke is a chronic neurological disorder associated with hemiplegia, lack of balance and abnormal gait. Therefore, objective and accurate inspection of gait parameters (as shown in Table 1) is of great help to a neurologist for appropriate assessment and diagnosis of stroke patients. To this end, the findings of this study could be helpful for revealing the pathogenesis of gait disorders. Stroke normally results in gait asymmetry, which can be reflected in the differences of gait phase partition between two feet due to paresis and imbalance. To sum up, it is crucial to discover the main components of gait disorders. In view of this situation, it is critical to develop an objective and quantitative approach to assess the patients’ physical condition. This paper established a wearable gait analysis platform based on a MEMSsensor and body sensor network. The platform can be used to collect acceleration, angular velocity and the geomagnetic signals in the process of walking movement. Accurate gait parameters can be calculated through a sensor data fusion algorithm and error correction process.
With the rapid development of modern medical technology, the concepts of medical treatment have been gradually changed to “Prevention first”. In this case, it is quite necessary to conduct the acquisition and processing of health information in advance, so that early medical diagnosis and intervention are feasible. Meanwhile, in order to implement ambulatory monitoring without affecting the subjects’ normal physiological activities, the traditional wire communication mode gradually shifts to a wireless mode, which is likely to be more persuasive. Moreover, innovative sensing technology is indispensable for continuous monitoring since the medical monitoring equipment has been developed towards microscale and a long-term span. To this end, the emerging Body Sensor Network (BSN) might serve as a peripheral node of the Internet of Medical Things or even the ubiquitous network.

2. Related Works

Quantitative gait analysis system mainly including a camera system [4,5,6], electromyography measuring system [7] and force platform [8,9]. The camera system consists of multiple high resolution cameras located in an indoor space, the orientation and position information of the target subject can be calculated using attached highlighting reflective spots. The electromyography measuring system detects human lower limb muscle signals by surface electromyography in the waking process; force platform reflects the change of plantar pressure during walking. However, the applications of above gait analysis system are limited in clinical practice, and the main reasons lie in three aspects. Firstly, the systems are expensive, which might be a barrier to routine use. Secondly, the usage of the systems are complex and require special operation, and it usually takes hours to complete the whole gait measurement process. Finally, specific space is normally needed to perform gait analysis using the above systems. In particular, the camera system may need more than 100 hundred square meters [10,11,12,13]. Table 2 lists a brief comparison of mainstream gait analysis methods.
Considerable research has been conducted into the progression of gait dysfunction through the various stages of stroke. Specifically, stroke subjects experience decreased stride length, cadence and walking speed, significant variability in stride length and gait cycle, and Walking imbalances [10,14,15,16]. Chang et al. [17] employed a specialized wearable system and found that stroke subjects demonstrated decreased gait velocity, stride length and prolonged double support phase. They further identified a high correlation between these gait parameters and age of onset. Further investigation into gait impairments in subjects with neurological diseases has also indicated that the degree of gait abnormality and the disease progression. Previous research has highlighted the advantages of quantitative gait analysis in gait diagnosis; however, laboratory-based systems such as optical tracking and plantar pressure measurement are typically expensive and are not available in ordinary clinical settings [18,19,20]. Therefore, significant interests have increased rapidly in the development of alternative gait analysis tools.
With the maturity of microelectromechanical systems and the development of information fusion technologies, the application of inertial motion analysis technology is becoming more and more extensive [8,21,22,23,24,25]. Due to the noticeable advantages of small size and low cost, wearable sensors can be mounted directly on the body segment with no need for specified test environment [24,26,27,28]. Such system may also serve as a good supplement of the gold standard including optical system and plantar pressure monitoring system. In previous studies, we have adopted a wearable inertial sensor in a walking distance calculation and walking pattern classification [29,30,31]. Ambulatory measurement of the participant’s trunk inclination using inertial measurement unit (IMU) was carried out by Farris et al. [3]. Bao et al. [32] developed a smart shoe for gait analysis using force sensitive resistors and IMU sensors. Luinge et al. [33] proposed the estimation of arm orientation by wearable inertial sensors. Dejnabadi et al. [34] introduced an approach to accurate measurement of joint angles based on IMU. However, due to their inability to detect heading reference, inertial based systems generally fail to measure differential orientation, a prerequisite for computing the 3D knee flexion angle recommended by the Internal Society of Biomechanics [35]. Roetenberg et al. [36] developed an ambulatory position and orientation tracking method fusing magnetic and inertial sensing. Since magnetometers measure the strength and direction of the local magnetic field, the geographical north direction can be found. In this case, the initial heading orientation can be obtained with the supplement of a magnetometer. Moreover, the system remains self-contained, which means it does not rely on any external infrastructure [37]. In addition, there are already wireless IMU BSN commercial products such as Trigno Avanti (Delsys Inc., Natick, MA, USA), Mvn Suit (XSens Inc., Enschede, The Netherlands), Perception Neuron (Noitom Inc., Beijing, China) and iSen (STT Systems Inc., San Sebastian, Spain). The current limitations of the state-of-the-art mentioned in the literature are the sensor alignment and integral error. Cost-effectiveness and stability are two other concerns. Moreover, little research about the follow-up monitoring of patients’ lower limbs has been carried out. Therefore, the contributions of this paper include the sensor alignment method and the availability of follow-up monitoring of patients’ key gait parameters.
The rest of this paper is organized as follows: Section 3 describes the structure of the proposed gait analysis system and the methodology used to estimate the gait parameters during walking; experimental results are given in Section 4; and the potential applications of gait analysis are discussed in Section 5, which concludes the paper as well.

3. Materials and Methods

3.1. System Setup

An ambulatory gait analysis system has been developed based on IMU. We have assembled the IMU from accelerometers/gyroscopes chipsets including ST Microelectronics (Geneva, Switzerland) and Analog Devices (Boston, MA, USA). A multi-sensor fusion algorithm is used to estimate gait parameters. The inertial measurement unit (IMU) can be strapped on both feet, shank and thigh via adjustable elastic straps with hook & loop. We chose straps over housing shells due to their flexible structure, strong adaptability, lower cost and good maneuverability. The installation is quite simple, which can be finished in several minutes. We have designed a fastener with which the sensor nodes can be fixed on the specified location firmly, ensuring the estimation accuracy. No special laboratory is needed, and the gait measurement can be performed just in the corridor or in the ward. The patients can even keep follow-up monitoring in the community after they discharged from the hospital. The performance-to-price ratio is relatively high and it is convenient to automatically generate a gait diagnostic report. Moreover, useful contrastive analysis can be made with repeated gait analysis. The principle and structure of the proposed gait analysis system is shown in Figure 1.
The sensor array includes triaxial accelerometers, gyroscope and magnetometer. Sensor performance specification is shown in Table 3. Raw sensor data is logged at 100 Hz and then forwarded to a receiver via a 2.4 GHz wireless network. The actual linear motion acceleration is used to calculate position. Note that the gravity component ( g = [ 0 , 0 , 9.81 ] T m/s 2 ) is normally eliminated from the resultant acceleration signal before estimating the position by integral operation of actual motion acceleration two times.

3.2. Accelerometer Non-Orthogonal Error Estimation

In general, the accelerometer orthogonal error is less than 1 , which is normally indicated in the product technical manual. Orthogonal errors exist in three-axis, as shown in Figure 2, and the non-orthogonal error can be expressed as follows:
E = cos α 0 sin α sin β cos γ cos β cos γ sin γ 0 0 1 .
Formula (1) can be simplified using the approximation of the trigonometric function value and then we have the following equation:
E 1 0 α β 1 γ 0 0 1 .
The accelerometer merely senses gravity under stationary state. A relationship exists between accelerometer observations g s and the true gravitational acceleration ± b g as follows:
± b g = E 1 g s = 1 0 α β 1 α β γ 0 0 1 .
Meanwhile,
g s T E T E g s g s 2 = 1 .
After establishing the non-orthogonal error correction model, the ellipsoid fitting method is introduced to calculate the non-orthogonal error angle. We can get three components of gravity vector ± b g with respect to three sensitive axes as follows:
G g = ± b g [ sin θ , s i n ϕ cos θ , cos ϕ cos θ ] T ,
while the accelerometer observations G s = [ a x , a y , a z ] T should satisfy the following equation theoretically:
G s T G s = ± b g 2 ,
which means the distribution of measured values is a spherical with the radius of g 2 ; however, actually, the accelerometer measurement distribution is an ellipsoid due to the existence of nonorthogonal errors. Set O = [ a , b , c , f , g , h , p , q , r , d ] T and quadric equation can be written as follows:
a x 2 + b y 2 + c z 2 + 2 f y z + 2 g x z + 2 p x + 2 q y + 2 r z + d = 0 .
Then, we can get the coefficient matrix from Equation (4) after ellipsoid fitting,
a d c d b f e f c = E T E g s 2 .
Define A = a + b + c , B = a b + b c + a c f 2 g 2 h 2 , if 4 B A 2 > 0 . Then, Equation (7) is the description of ellipsoid surface. Select n group of accelerometer measurements, [ x i , y i , z i ] , i = 1 , , n , denote C = [ X 1 , X 2 , , X n ] and X i = [ x i 2 , y i 2 , z i 2 , 2 y i z i , 2 x i z i , 2 y i x i , 2 x i , 2 y i , 2 z i , 1 ] T , and then the ellipsoid fitting is converted into the following constraints:
4 B A 2 = 1 , m i n ( O T C T C O ) .
Define the coefficient matrix as follows:
M 0 = 1 1 1 0 0 0 1 1 1 0 0 0 1 1 1 0 0 0 0 0 0 4 0 0 0 0 0 0 4 0 0 0 0 0 0 4 ,
M = M 0 0 6 × 4 ± b 0 4 × 6 ± b 0 4 × 4 .
Lagrangian function can be introduced to convert the constraint problem to the following equation:
O T M O = 1 , C T C O = λ M O .
It has been proved that this constraint problem has a unique solution in the field of mathematics [38]. Therefore, the ellipsoid coefficient vector can be determined, and then the ellipsoid radius and the nonorthogonal error angle can be calculated based on the ellipsoid coefficient. Define the symmetrical coefficient matrix and the translation vector S T = [ 2 p , 2 q , 2 r ] T ,
S = a h g h b f g f c .
Then, the transformation H = N T H + R can convert the quadric equation into a standard ellipsoid equation:
x 2 a 2 + y 2 b 2 + z 2 c 2 = 1 ,
where N is the eigenvector of matrix S, denote D as the main diagonal matrix of S, and then we have S = N D N T and R = ( 2 D ) 1 N T . Ellipsoid radius can be obtained by the following formula:
a = ( N F ) T R ( 2 d ) D ( 1 , 1 ) , b = ( N F ) T R ( 2 d ) D ( 2 , 2 ) , c = ( N F ) T R ( 2 d ) D ( 3 , 3 ) .
After calculating the ellipsoid coefficient, we can calculate the nonorthogonal error angle by the analytic method. Equation (3) can be used to compensate the non-orthogonal error of the accelerometer.

3.3. Stance Phase Detection by Decision Level Data Fusion

Sensor drift is an inherent property that results in linear growing integration errors in attitude and position estimation. In particular, position errors grow proportional to the square of the acceleration error. To this end, the widely used Zero Velocity Updating (ZVU) method is adopted in this paper. Though the valid interval of ZVU algorithm is illustrated in literature [31,39,40,41], the effectiveness of the ZVU technique largely relies on the stance phase detection as shown in Figure 3. This paper takes two criteria to determine stance phase in each gait cycle. These key periods are determined by calculating the squared Euclidean norm of acceleration values, as shown in formula (16):
V = ( a x / g ) 2 + ( a y / g ) 2 + ( a z / g ) 2 ,
where a x , a y and a z represent the triaxial acceleration measurements of foot sensors:
M = 1 N i = j N i = j ( ( S i S ¯ N ) 2 ,
where S ¯ N is the mean of S i over N samples.
Meanwhile, angular rate energy E g y r o is adopted as the other criterion (18). The second moment is used to detect stance phase, which is defined in the following formula [39]:
E = 1 σ ω 2 W i = j j + W 1 ω i 2 ,
R ^ = 1 , V < λ 1 E < λ 2 , 0 , other value ,
where W is the window size selected according to the sensors sampling rate; ω i = [ ω x , i , ω y , i , ω z , i ] T is the triaxial angular velocity vector; and σ ω 2 is the gyroscope noise variance. λ 1 and λ 2 are empirically predefined thresholds. The detection results ( R ^ ) are sequences consisting of “zero” and “one”. The algorithm continually finds the interval when ZVU is valid and updates the corresponding v G ( t ) as [ 0 , 0 , 0 ] T based on the two indicators above.

3.4. Knee Angle Estimation

Knee flexion angle can be calculated by fusing the multi-sensor data. Figure 4a demonstrates the calculation principle and Figure 4b,c show the calculated swing angles and knee flexion based on the gyroscope observations. In addition, the calculation method of knee flexion angle is as follows:
θ k n e e = θ t h i g h θ s h a n k + θ i n i = ( ω t h i g h ω s h a n k ) d t + θ t h i g h 0 θ s h a n k 0 ,
where θ t h i g h 0 and θ s h a n k 0 are initial angles between lower limbs (thigh and shank, respectively) and the gravity direction when the subjects are standing still at ease, which can be calculated by the measurements of the accelerometer as proposed in the previous study [29,30]. ω t h i g h and ω s h a n k are angular velocity values of thigh fixed and shank fixed sensors.

3.5. Attitude Estimation and Quaternion Correction in IMUs via Sensor Fusion

IMUs refer to sensor modules consisting of three-dimensional accelerometers, gyroscopes and magnetometers (in some cases magnetometers are not included). According to physical and dynamical theory, acceleration measurements can be integrated once to acquire linear velocity and twice to obtain relative position change based on the previous observations. Likewise, angular velocity observations from gyroscopes can be integrated once to estimate the attitude change between two consecutive measurements. In practice, inertial sensors are prone to be disturbed by system noises, drift and measurement errors. All these factors would cause significant integration errors when the raw sensor data are used for integration. In some cases, when the subject moves slowly or stays static, one can merely adopt accelerometers or inclinometers to directly determine the 3D attitude with acceptable results, which avoids the integration operation. However, it is inevitable that external acceleration applied to the accelerometers could ruin the attitude detection based on the calculation of gravity vector components in these orthogonal planes. In most cases, multiple sensor data fusion is necessary to determine 3D attitude. Since the collected data are discrete, we need to perform interpolation between q m and q n and the interpolation principle is shown in Figure 5.
q t = q m + ( q n q m ) × t , t [ 0 , 1 ] .
Simple linear interpolation is valid in some cases. However, it can not effectively describe the curve between q m and q n . To ensure that the angle θ between q m and q t is linear, i.e., θ ( t ) = ( 1 t ) θ + t θ , we then choose slerp function s l e r p ( q m , q n , t ) to conduct smooth interpolation of quaternions as follows:
s l e r p ( q m , q n , t ) = sin ( 1 t ) θ sin θ q m + sin t θ sin θ q n .
Normally standardized operation is necessary:
q t = q m + ( q n q m ) × t q m + t ( q n q m ) .
Moreover, the quaternion number can also avoid the singular point problem of Euler angle representation [27,42], when the pitch angle reaches ± 90 . The three-dimensional attitude represented by quaternions are:
ϕ = arctan 2 q 2 q 3 + q 0 q 1 q 0 2 q 1 2 q 2 2 + q 3 2 ,
θ = arcsin 2 q 1 q 3 q 0 q 2 ,
ψ = arctan 2 q 1 q 2 + q 0 q 3 q 0 2 + q 1 2 q 2 2 q 3 2 .
The attitude of the updated sensor can be obtained by solving the differential equation of quaternions. The differential equation of quaternions can be expressed as:
q ˙ 0 q ˙ 1 q ˙ 2 q ˙ 3 = 1 2 0 ω x ω y ω z ω x 0 ω z ω y ω y ω z 0 ω x ω z ω y ω x 0 q 0 q 1 q 2 q 3 .
On the basis of the widely used sensor coordinate transformation, we can get the updated attitude quaternion with inevitable errors. As for a certain vector, its magnitude should be the same though it is expressed in different coordinate frames. The magnitude deviation caused by coordinate transformation can be adopted to adjust the rotation matrix. This paper uses two reference vectors (gravity vector and magnetic vector) to modify the quaternion. In the static state (without linear acceleration), gravity vector [ 0 , 0 , 1 ] T is converted into [ c x , c y , c z ] T after coordinate transformation, while accelerometer observations are [ a x , a y , a z ] T . Then, [ c x , c y , c z ] T and [ a x , a y , a z ] T both represent the gravity vector in the sensor frame. Then, we can obtain error matrix e g s by multiplying both vectors:
e g s = e x e y e z = a x a y a z × c x c y c z = a y c z a z c y a z c z a x c z a x c y a y c x .
The error matrix can be used to correct the attitude quaternion. Proportional-Integral (PI) feedback adjustment is introduced hereby,
ω t = ω t 1 + k p e g s + k i e g s τ ,
where ω t is a three-axis angular velocity component, which can be used to correct quaternions combined with skew symmetric matrix. k p and k i are proportion coefficient and integral coefficient, respectively. Both parameters are ascertained after repeated experiments on different specific groups.
Moreover, in practice, the measurement error of MEMS magnetometer is non-negligible, the magnetometer measurement error mainly includes environmental interference and inherent error [12,37]. Researchers have conducted various calibration methods using high precision instruments and equipments [38,43,44], however, these methods are time-consuming and the calibration effect largely relies on the precision of equipment. This work uses a calibration method which allows non-experts to easily implement the calibration procedure. To calibrate the magnetometer, sensor nodes were rotated along "Figure of eight knot" trajectory for several times before they were mounted on human lower limbs. Then the outputs were wirelessly collected and be used to perform the magnetometer correction. The correction of magnetometer should be performed near the body segment where the sensor was mounted in an indoor experimental scene [45]. In conclusion, the flowchart of the proposed gait parameters estimation approach can be summarized in Figure 6.

4. Experimental Results

The proposed gait analysis system has been adopted to carry out preliminary clinical trials at the Second Affiliated Hospital of Dalian Medical University. Gait data used in this study consist of walking stride time series from 30 healthy adults (22–45 years old), 20 patients with stroke (46–77 years old), and 20 patients with joint disease (30–58 years old). All subjects were instructed to walk continuously on level ground along an obstacle-free corridor for more than 15 m. Note that we have conducted walking trials including U-turns and stair climbing into the evaluation and the proposed method works well. Straight walking is a simplified case suggested by the clinician, and straight walking is mostly adopted in the observational method in clinical practice.
According to the obtained gait parameters in Table 4, the stride lengths, stride speed and feet clearance are relatively low in both neurological and arthropathy patients, which are also consistent with clinical observation. Similarly, mean values of stance time associated with patients are significantly higher than those of healthy subjects. The results from statistical results presented in the table indicate strong evidence of the capability of the typical gait parameters in characterizing the walk of healthy subjects and patients. In this regard, these gait-related symptoms can be explained by clinicians for diagnostic and treatment purposes because the disease progression can be quantificationally monitored via these observations.

4.1. Knee Flexion Monitoring

Table 5 presents the maximum of joint angle during walking. The knee flexion angle is constantly positive; the positive ankle joint angle represents dorsiflexion and a negative value signifies plantarflexion. In the course of stance phase, the knee flexion angle increases; meanwhile, the ankle dorsiflexion turns to plantarflexion; note that the maximum ankle plantarflexion appears in the final stage of stance phase; in the course of swing phase, knee flexion angles reach the maximum while ankle plantarflexion turns to dorsiflexion, followed by the next stance phase.
Knee flexion range of motion (ROM) is often evaluated using a goniometer in rehabilitation clinics or in hospital wards. The more knee ROM regained during the therapeutic process, the better knee recovery would be affirmed and the sooner early discharge could be guaranteed. In this study, we conducted data collection and knee ROM analysis on 30 healthy subjects, 20 neurological patients (mainly stroke patients) and 20 arthropathy patients, respectively. The first data collection is performed before medical treatments, while the remaining data collections occurred at two weeks and six weeks after treatments, respectively. Figure 7 illustrates the knee ROM recovery status of one typical arthropathy patient who received minimally invasive surgery and one typical stroke patient undergoing rehabilitation training, respectively. The results show that both patients recovered significantly in terms of knee ROM after receiving six weeks of medical treatments. By six weeks after minimally invasive surgery, the knee ROM of arthropathy patient almost returns to the normal range and the gait symmetry is much better when the pains were alleviated.
The one-way analysis of variance (ANOVA) results of knee ROM between bilateral lower limbs are shown in Table 6 and Table 7. We can conclude that patients showed large standard deviations in knee ROM, which is a significant feature different from healthy subjects. In this paper, the hypothesis is the symmetrical (balanced) bilateral knee angle ROM, p-value < 0.05 should be interpreted as the hypothesis is true, and the hypothesis is invalid for subjects with p-value > 0.05 . Results showed that, as for arthropathy patients, no significant knee ROM difference exists on bilateral lower limbs after six weeks’ treatment based on the ANOVA analysis results (p-value = 0.0046); however, the stroke patient still has significant knee ROM different on bilateral lower limbs after six weeks of treatment (p-value = 0.8637). In fact, many stroke patients still have obvious asymmetry between bilateral knee ROM even after several months, though the symptoms may be relieved to a great extent.

4.2. Feet Clearance Monitoring

According to Figure 8a, it is observed that there exists foot elevation asymmetry (left foot: ∼15 cm, right foot: ∼5 cm) of a stroke patient with hemiplegia symptoms on the right foot, which is consistent with clinical observation, indicating that the patient loses the ability to keep balance. Figure 8b presents the foot elevation asymmetry of an arthropathy patient, which presents the gait walking disorder from the perspective of feet elevation statistics.

5. Discussion and Conclusions

This paper aims to provide ambulatory and robust measurements of human gait, and we adopted body-worn sensors to estimate gait parameters. Digitalized and objective gait information can act as desirable guidance for making and adjusting rehabilitation plans, and the results of the preliminary clinical gait analysis experiments have also verified the accuracy of this method for human limbs motion capturing. With no pressure sensor for the stance phase detection and no optical device for integral error elimination, the pure ZVU-aided gait analysis system using body-worn IMU can achieve a good auxiliary diagnosis performance.
Experimental studies have been presented for an Magnetic Angular Rate and Gravity (MARG) unit with reference measurements obtained via a precision optical measurement system, i.e., the NDI Polaris Spectra System (Northern Digital Inc., Waterloo, ON, Canada). The proposed gait analysis system accuracy was validated and the three-dimensional position estimation error is less than 0.015 m, as shown in Figure 9. A comparison experiment with an optical system has demonstrated the accuracy and feasibility of the proposed principle of error correction, and the results of the preliminary clinical gait analysis experiments have also verified the accuracy of this method for human limbs motion capturing.
The current work provides new insights to better understand the biomechanics of walking due to neurological diseases. In addition, they appear to be valuable tools that can highlight differences in gait dynamics with respect to stroke patients. In this regard, measurement of gait may possibly afford pertinent clinical information on neuromotor conditions, characterization of some neurological disorders, and rehabilitation. A better understanding of gait differences based on etiology of amputation or fall history may provide useful information to help guide prosthetic prescription or rehabilitation interventions.

Author Contributions

S.Q. drafted the manuscript and performed the experiment and analysis; L.L. was responsible for the design of the experiment, data analysis and interpretation of the results; H.Z. and Z.W. proposed the idea and were responsible for equipment configuration, data visualization, and manuscript revision; Y.J. organized the clinical trials.

Funding

This research was funded by the National Natural Science Foundation of China under Grants 61803072 and 61873044, and the China Postdoctoral Science Foundation under Grant 2017M621132, and the Fundamental Research Funds for the Central Universities under Grant DUT18RC(4)034, and the Liaoning Key R & D Guidance Project under Grant 2017225078.

Acknowledgments

The authors would like to express their thanks to the members of LIS (laboratory of Intelligent system, Dalian University of Technology).

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
MEMSMicro-Electro-Mechanical Sensor
BSNBody Sensor Network
IMUInertial Measurement Unit
MARGMagnetic Angular Rate and Gravity
ZVUZero Velocity Updating

References

  1. Albert, M.V.; Azeze, Y.; Courtois, M.; Jayaraman, A. In-lab versus at-home activity recognition in ambulatory subjects with incomplete spinal cord injury. J. NeuroEng. Rehabil. 2017, 14, 1–6. [Google Scholar] [CrossRef] [PubMed]
  2. Baghdadi, A.; Cavuoto, L.A.; Crassidis, J.L. Hip and Trunk Kinematics Estimation in Gait through Kalman Filter using IMU Data at the Ankle. IEEE Sens. J. 2018, 18, 4253–4260. [Google Scholar] [CrossRef]
  3. Farris, R.J.; Quintero, H.A.; Murray, S.A.; Member, S.; Ha, K.H.; Hartigan, C.; Goldfarb, M. A Preliminary Assessment of Legged Mobility Provided by a Lower Limb Exoskeleton for Persons With Paraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 482–490. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Zhou, H.; Hu, H. Reducing drifts in the inertial measurements of wrist and elbow positions. IEEE Trans. Instrum. Meas. 2010, 59, 575–585. [Google Scholar] [CrossRef]
  5. Prakash, C.; Gupta, K.; Mittal, A.; Kumar, R.; Laxmi, V. Passive marker based optical system for gait kinematics for lower extremity. Procedia Comput. Sci. 2015, 45, 176–185. [Google Scholar] [CrossRef]
  6. Tian, Z.; Fang, X.; Zhou, M.; Li, L. Smartphone-based indoor integrated WiFi/MEMS positioning algorithm in a multi-floor environment. Micromachines 2015, 6, 347–363. [Google Scholar] [CrossRef]
  7. Park, S.Y.; Lee, S.Y.; Kang, H.C.; Kim, S.M. EMG analysis of lower limb muscle activation pattern during pedaling: Experiments and computer simulations. Int. J. Precis. Eng. Manuf. 2012, 13, 601–608. [Google Scholar] [CrossRef]
  8. Qiu, S.; Wang, Z.; Zhao, H.; Liu, L.; Jiang, Y.; Li, J.; Fortino, G. Body Sensor Network based Robust Gait Analysis: Toward Clinical and at Home Use. IEEE Sens. J. 2018, 18, 1–9. [Google Scholar]
  9. Yu, L.; Zheng, J.; Wang, Y.; Song, Z.; Zhan, E. Adaptive method for real-time gait phase detection based on ground contact forces. Gait Posture 2015, 41, 269–275. [Google Scholar] [CrossRef] [PubMed]
  10. Qiu, S.; Wang, Z.; Zhao, H.; Hu, H. Using Distributed Wearable Sensors to Measure and Evaluate Human Lower Limb Motions. IEEE Trans. Instrum. Meas. 2016, 65, 939–950. [Google Scholar] [CrossRef] [Green Version]
  11. Brzostowski, K. Toward the Unaided Estimation of Human Walking Speed Based on Sparse Modeling. IEEE Trans. Instrum. Meas. 2018, 67, 1389–1398. [Google Scholar] [CrossRef]
  12. Qiu, S.; Wang, Z.; Zhao, H.; Liu, L.; Jiang, Y. Using Body-Worn Sensors for Preliminary Rehabilitation Assessment in Stroke Victims with Gait Impairment. IEEE Access 2018, 6, 31249–31258. [Google Scholar] [CrossRef]
  13. Ren, M.; Guo, H.; Shi, J.; Meng, J. Indoor pedestrian navigation based on conditional random field algorithm. Micromachines 2017, 8, 320. [Google Scholar] [CrossRef]
  14. Barth, J.; Oberndorfer, C.; Pasluosta, C.; Schülein, S.; Gassner, H.; Reinfelder, S.; Kugler, P.; Schuldhaus, D.; Winkler, J.; Klucken, J.; Eskofier, B.M. Stride segmentation during free walk movements using multi-dimensional subsequence dynamic time warping on inertial sensor data. Sensors 2015, 15, 6419–6440. [Google Scholar] [CrossRef] [PubMed]
  15. Ahmadi, A.; Destelle, F.; Unzueta, L.; Monaghan, D.S.; Linaza, M.T.; Moran, K.; O’Connor, N.E. 3D human gait reconstruction and monitoring using body-worn inertial sensors and kinematic modeling. IEEE Sens. J. 2016, 16, 8823–8831. [Google Scholar] [CrossRef]
  16. Anwary, A.R.; Yu, H.; Vassallo, M. Optimal Foot Location for Placing Wearable IMU Sensors and Automatic Feature Extraction for Gait Analysis. IEEE Sens. J. 2018, 18, 2555–2567. [Google Scholar] [CrossRef]
  17. Chang, H.C.; Hsu, Y.L.; Yang, S.C.; Lin, J.C.; Wu, Z.H. A Wearable Inertial Measurement System With Complementary Filter for Gait Analysis of Patients With Stroke or Parkinson Disease. IEEE Access 2016, 4, 8442–8453. [Google Scholar] [CrossRef]
  18. Leal-Junior, A.G.; Frizera, A.; Avellar, L.M.; Marques, C.; Pontes, M.J. Polymer Optical Fiber for In-Shoe Monitoring of Ground Reaction Forces during the Gait. IEEE Sens. J. 2018, 18, 2362–2368. [Google Scholar] [CrossRef]
  19. Jiménez Ruiz, A.R.; Seco Granja, F.; Prieto Honorato, J.C.; Guevara Rosas, J.I. Accurate pedestrian indoor navigation by tightly coupling foot-mounted IMU and RFID measurements. IEEE Trans. Instrum. Meas. 2012, 61, 178–189. [Google Scholar] [CrossRef] [Green Version]
  20. Lan, K.C.; Shih, W.Y. Using smart-phones and floor plans for indoor location tracking. IEEE Trans. Hum. Mach. Syst. 2014, 44, 211–221. [Google Scholar]
  21. Fourati, H. Heterogeneous Data Fusion Algorithm for Pedestrian Navigation via Foot-Mounted Inertial Measurement Unit and Complementary Filter. IEEE Trans. Instru. Meas. 2015, 64, 221–229. [Google Scholar] [CrossRef]
  22. Zhao, H.; Wang, Z.; Qiu, S.; Shen, Y.; Zhang, L.; Tang, K. Heading Drift Reduction for Foot-Mounted Inertial Navigation System via Multi-Sensor Fusion and Dual-Gait Analysis. IEEE Sens. J. 2018, 18, 1–8. [Google Scholar]
  23. Wang, Z.L.; Zhao, H.Y.; Qiu, S.; Gao, Q. Stance phase detection for ZUPT-aided foot-mounted pedestrian navigation system. IEEE/ASME Trans. Mechatron. 2015, 20, 3170–3181. [Google Scholar] [CrossRef]
  24. Wu, D.; Wang, Z.; Chen, Y.; Zhao, H. Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset. Neurocomputing 2016, 190, 35–49. [Google Scholar] [CrossRef]
  25. Fortino, G.; Di Fatta, G.; Pathan, M.; Vasilakos, A.V. Cloud-assisted body area networks: State-of-the-art and future challenges. Wirel. Netw. 2014, 20, 1925–1938. [Google Scholar] [CrossRef]
  26. Wang, Z.; Zhao, C.; Qiu, S. A system of human vital signs monitoring and activity recognition based on body sensor network. Sens. Rev. 2014, 34, 42–50. [Google Scholar] [CrossRef] [Green Version]
  27. Qiu, S.; Yang, Y.; Hou, J.; Ji, R. Ambulatory estimation of 3D walking trajectory and knee joint angle using MARG Sensors. In Proceedings of the Fourth International Conference on Innovative Computing Technology (INTECH), London, UK, 13–15 Augsut 2014; pp. 191–196. [Google Scholar]
  28. Gravina, R.; Alinia, P.; Ghasemzadeh, H.; Fortino, G. Multi-Sensor Fusion in Body Sensor Networks: State-of-the-art and research challenges. Inf. Fusion 2016, 35, 68–80. [Google Scholar] [CrossRef]
  29. Wang, Z.; Qiu, S.; Cao, Z.; Jiang, M. Quantitative assessment of dual gait analysis based on inertial sensors with body sensor network. Sens. Rev. 2013, 33, 48–56. [Google Scholar] [CrossRef]
  30. Qiu, S.; Wang, Z.; Zhao, H. Heterogeneous data fusion for three-dimensional gait analysis using wearable MARG sensors. Int. J. Comput. Sci. Eng. 2017, 14, 222–233. [Google Scholar] [CrossRef]
  31. Qiu, S.; Wang, Z.; Zhao, H.; Qin, K.; Li, Z.; Hu, H. Inertial/magnetic sensors based pedestrian dead reckoning by means of multi-sensor fusion. Inf. Fusion 2018, 39, 108–119. [Google Scholar] [CrossRef]
  32. Bao, S.D.; Meng, X.L.; Xiao, W.; Zhang, Z.Q. Fusion of inertial/magnetic sensor measurements and map information for pedestrian tracking. Sensors 2017, 17, 340. [Google Scholar] [CrossRef] [PubMed]
  33. Luinge, H.J.; Veltink, P.H.; Baten, C.T.M. Ambulatory measurement of arm orientation. J. Biomech. 2007, 40, 78–85. [Google Scholar] [CrossRef] [PubMed]
  34. Dejnabadi, H.; Jolles, B.M.; Aminian, K. A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes. IEEE Trans. Biomed. Eng. 2005, 52, 1478–1484. [Google Scholar] [CrossRef] [PubMed]
  35. Favre, J.; Aissaoui, R.; Jolles, B.M.; de Guise, J.A.; Aminian, K. Functional calibration procedure for 3D knee joint angle description using inertial sensors. J. Biomech. 2009, 42, 2330–2335. [Google Scholar] [CrossRef] [PubMed]
  36. Roetenberg, D.; Luinge, H.; Slycke, P. Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors; Xsens Technologies: Enschede, The Netherlands, 2013; pp. 1–9. [Google Scholar]
  37. Wang, Z.; Li, J.; Wang, J.; Zhao, H.; Qiu, S.; Yang, N.; Shi, X. Inertial Sensor-Based Analysis of Equestrian Sports between Beginner and Professional Riders under. IEEE Trans. Instrum. Meas. 2018, 14, 1–13. [Google Scholar]
  38. Gheorghe, M.V.; Member, S.; Bodea, M.C.; Member, L.S. Calibration Optimization Study for Tilt-Compensated Compasses. IEEE Trans. Instrum. Meas. 2018, 67, 1486–1494. [Google Scholar] [CrossRef]
  39. Skog, I.; Händel, P.; Nilsson, J.O.; Rantakokko, J. Zero-velocity detection—An algorithm evaluation. IEEE Trans. Bio-Med. Eng. 2010, 57, 2657–2666. [Google Scholar] [CrossRef] [PubMed]
  40. Bebek, O.; Suster, M.a.; Rajgopal, S.; Fu, M.J.; Huang, X.; Cavusoglu, M.C.; Young, D.J.; Mehregany, M.; Van Den Bogert, A.J.; Mastrangelo, C.H. Personal navigation via shoe mounted inertial measurement units. IEEE Trans. Instrum. Meas. 2010, 59, 3018–3027. [Google Scholar] [CrossRef]
  41. Martinez-Hernandez, U.; Mahmood, I.; Dehghani-Sanij, A.A. Simultaneous Bayesian Recognition of Locomotion and Gait Phases with Wearable Sensors. IEEE Sens. J. 2018, 18, 1282–1290. [Google Scholar] [CrossRef]
  42. Gouwanda, D.; Gopalai, A.A.; Khoo, B.H. A Low Cost Alternative to Monitor Human Gait Temporal Parameters-Wearable Wireless Gyroscope. IEEE Sens. J. 2016, 16, 9029–9035. [Google Scholar] [CrossRef]
  43. Wang, C.; Qu, X.; Zhang, X.; Zhu, W.; Fang, G. A fast calibration method for magnetometer array and the application of ferromagnetic target localization. IEEE Trans. Instrum. Meas. 2017, 66, 1743–1750. [Google Scholar] [CrossRef]
  44. Vargas-Valencia, L.; Elias, A.; Rocon, E.; Bastos-Filho, T.; Frizera, A. An IMU-to-Body Alignment Method Applied to Human Gait Analysis. Sensors 2016, 16, 2090. [Google Scholar] [CrossRef] [PubMed]
  45. Choe, N.; Zhao, H.; Qiu, S.; So, Y. A Sensor-to-Segment Calibration Method for Motion Capture system based on low cost mimu. Measurement 2018. [Google Scholar] [CrossRef]
Figure 1. The principle and structure of the proposed gait analysis system (a) self-made motion tracking sensor nodes; (b) gait analysis scenario.
Figure 1. The principle and structure of the proposed gait analysis system (a) self-made motion tracking sensor nodes; (b) gait analysis scenario.
Micromachines 09 00442 g001
Figure 2. Non-orthogonal angle error of tri-axis accelerometer.
Figure 2. Non-orthogonal angle error of tri-axis accelerometer.
Micromachines 09 00442 g002
Figure 3. Stance phase detection (a) stance phase detection by raw data; (b) close-up view.
Figure 3. Stance phase detection (a) stance phase detection by raw data; (b) close-up view.
Micromachines 09 00442 g003
Figure 4. Knee angle estimation results (a) calculation principle of knee; (b) swing angle of thigh and shank; (c) knee flexion flexion statistics.
Figure 4. Knee angle estimation results (a) calculation principle of knee; (b) swing angle of thigh and shank; (c) knee flexion flexion statistics.
Micromachines 09 00442 g004
Figure 5. Quaternion interpolation.
Figure 5. Quaternion interpolation.
Micromachines 09 00442 g005
Figure 6. Flowchart of the proposed approach.
Figure 6. Flowchart of the proposed approach.
Micromachines 09 00442 g006
Figure 7. Knee range of motion (ROM) recovery history before and after medical treatments for an arthropathy patient and a stroke patient, respectively.
Figure 7. Knee range of motion (ROM) recovery history before and after medical treatments for an arthropathy patient and a stroke patient, respectively.
Micromachines 09 00442 g007
Figure 8. Gait clearance comparison (a) a stroke patient; (b) an arthropathy patient.
Figure 8. Gait clearance comparison (a) a stroke patient; (b) an arthropathy patient.
Micromachines 09 00442 g008
Figure 9. System accuracy validation by an NDI Polaris Spectra System (a) sensor placement and reflection points of optical system; (b) error statistics of a three-dimensional thigh sensor position estimation for random lower limbs’ movement.
Figure 9. System accuracy validation by an NDI Polaris Spectra System (a) sensor placement and reflection points of optical system; (b) error statistics of a three-dimensional thigh sensor position estimation for random lower limbs’ movement.
Micromachines 09 00442 g009
Table 1. Typical spatio-temporal gait parameters.
Table 1. Typical spatio-temporal gait parameters.
Gait ParameterDescription
Stride length (m)Distance between two consecutive footprint of the same foot.
Stride speed (m/s)Stride length divided by walking cycle.
Stride frequencyNumber of steps taken per minute during walking.
Walking cycle (s)Duration of a single stride, inversely proportional to cadence.
Stance time (s)Duration of stance phase when feet contact with the ground, starting with initial-contact (IC) and ending with foot-off (FO) of the same foot.
Swing time (s)Duration of swing phase when feet swing above the ground, starting with FO and ending with IC.
Clearance (m)Foot elevation in swing phase, which reflects the muscular strength of lower limbs and can be diversified as maximum and minimum foot elevation.
Plantar & dorsiflex (degrees)The angle between the dorsum of the foot and the back of the leg.
Knee ROM (degrees)Range of knee flexion during a single stride.
Table 2. Comparison of mainstream gait analysis method.
Table 2. Comparison of mainstream gait analysis method.
ItemsObservation MethodOptical SystemInertial Body Sensor Network (BSN)
Objectivitysubjectiveobjectiveobjective
Robustnesspoorsensitive to occlusionvery stable
Repeatabilitypoorhighhigh
Efficiencymediumlowhigh
Set-up timeseveral minuteshalf-hourseveral minutes
Usabilityhighlowhigh
Visual textnopartialfully
Table 3. Sensor performance specification.
Table 3. Sensor performance specification.
UnitAccelerometerGyroscopeMagnetometer
Dimensions3 axes3 axes3 axes
Dynamic Range ± 50 m/s 2 ± 1200 deg/s ± 750 mGauss
Bandwidth (Hz)304010
Linearity (% of FS)0.20.10.2
Bias stability (unit 1 σ )0.0210.1
Alignment Error (deg)0.10.10.1
Table 4. Gait parameters comparison for healthy subjects and patients. Results are presented as mean (±SD).
Table 4. Gait parameters comparison for healthy subjects and patients. Results are presented as mean (±SD).
ParameterHealthyNeurologicalArthropathy
Stride length (m)1.21 ± 0.13 0.68 ± 0.35 0.73 ± 0.29
Stride speed (m/s)0.94 ± 0.15 0.71 ± 0.26 0.86 ± 0.21
Stride frequency92 ± 9 64 ± 22 72 ± 17
Walking cycle (s)1.32 ± 0.08 1.68 ± 0.13 1.48 ± 0.07
Stance time (s)0.86 ± 0.05 1.14 ± 0.11 0.99 ± 0.08
Swing time (s)0.46 ± 0.03 0.54 ± 0.06 0.49 ± 0.04
Clearance (m)0.22 ± 0.04 0.08 ± 0.07 0.14 ± 0.06
Knee ROM (degrees) 65 ± 9 39 ± 17 46 ± 22
Table 5. Joint angle calculation results of a healthy subject and a typical stroke patient. Results are presented as mean (±SD).
Table 5. Joint angle calculation results of a healthy subject and a typical stroke patient. Results are presented as mean (±SD).
Joint Angle °Heel StrikeFoot FlatHeel OffSwing
Knee joint (Healthy subject) 7.2 ± 3.6 19.9 ± 5.1 39.4 ± 6.1 66.2 ± 5.4
Knee joint (Stroke Patient) 9.8 ± 4.5 14 ± 4.2 22.3 ± 5.8 38.1 ± 7.1
Ankle joint (Healthy subject) 8.7 ± 4.4 15.3 ± 4.3 19.5 ± 6.8 8.3 ± 4.2
Ankle joint (Stroke Patient) 9.3 ± 4.5 11.4 ± 5.1 16.9 ± 5.6 7.2 ± 3.9
Table 6. Analysis of variance (ANOVA) table of bilateral knee range of motion (ROM) for an arthropathy patient (SS: Sum of squares of variance; df: Degree of freedom of variance; MS = SS/df; F: F test statistic).
Table 6. Analysis of variance (ANOVA) table of bilateral knee range of motion (ROM) for an arthropathy patient (SS: Sum of squares of variance; df: Degree of freedom of variance; MS = SS/df; F: F test statistic).
ItemSourceSSdfMSFp-Value
Prior treatmentColumns285.11915.00530.390.9787
Error7782038.9
Total1063.139
Post treatment 2 weeksColumns260.2751913.69871.260.3061
Error217.52010.875
Total477.77539
Post treatment 6 weeksColumns227.2751911.96183.390.0046
Error70.5203.525
Total297.77539
Table 7. Analysis of variance (ANOVA) table of bilateral knee range of motion (ROM) for a stroke patient.
Table 7. Analysis of variance (ANOVA) table of bilateral knee range of motion (ROM) for a stroke patient.
ItemSourceSSdfMSFp-Value
Prior treatmentColumns304.281916.01450.230.9988
Error1385.52069.275
Total1689.7839
Post treatment 2 weeksColumns203.91910.73160.210.9993
Error10062050.3
Total1209.939
Post treatment 6 weeksColumns165.6198.71580.60.8637
Error2902014.5
Total455.639

Share and Cite

MDPI and ACS Style

Qiu, S.; Liu, L.; Zhao, H.; Wang, Z.; Jiang, Y. MEMS Inertial Sensors Based Gait Analysis for Rehabilitation Assessment via Multi-Sensor Fusion. Micromachines 2018, 9, 442. https://doi.org/10.3390/mi9090442

AMA Style

Qiu S, Liu L, Zhao H, Wang Z, Jiang Y. MEMS Inertial Sensors Based Gait Analysis for Rehabilitation Assessment via Multi-Sensor Fusion. Micromachines. 2018; 9(9):442. https://doi.org/10.3390/mi9090442

Chicago/Turabian Style

Qiu, Sen, Long Liu, Hongyu Zhao, Zhelong Wang, and Yongmei Jiang. 2018. "MEMS Inertial Sensors Based Gait Analysis for Rehabilitation Assessment via Multi-Sensor Fusion" Micromachines 9, no. 9: 442. https://doi.org/10.3390/mi9090442

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop