Next Article in Journal
Angular Displacement and Velocity Sensors Based on Coplanar Waveguides (CPWs) Loaded with S-Shaped Split Ring Resonators (S-SRR)
Previous Article in Journal
Enhanced Sensitivity of Gas Sensor Based on Poly(3-hexylthiophene) Thin-Film Transistors for Disease Diagnosis and Environment Monitoring
Previous Article in Special Issue
Piezoelectric Micromachined Ultrasound Transducer (PMUT) Arrays for Integrated Sensing, Actuation and Imaging
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Lower Extremity Joint Angle Tracking with Wireless Ultrasonic Sensors during a Squat Exercise

School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, 639798 Singapore
*
Author to whom correspondence should be addressed.
Sensors 2015, 15(5), 9610-9627; https://doi.org/10.3390/s150509610
Submission received: 12 December 2014 / Revised: 6 April 2015 / Accepted: 16 April 2015 / Published: 23 April 2015

Abstract

: This paper presents an unrestrained measurement system based on a wearable wireless ultrasonic sensor network to track the lower extremity joint and trunk kinematics during a squat exercise with only one ultrasonic sensor attached to the trunk. The system consists of an ultrasound transmitter (mobile) and multiple receivers (anchors) whose positions are known. The proposed system measures the horizontal and vertical displacement, together with known joint constraints, to estimate joint flexion/extension angles using an inverse kinematic model based on the damped least-squares technique. The performance of the proposed ultrasonic measurement system was validated against a camera-based tracking system on eight healthy subjects performing a planar squat exercise. Joint angles estimated from the ultrasonic system showed a root mean square error (RMSE) of 2.85° ± 0.57° with the reference system. Statistical analysis indicated great agreements between these two systems with a Pearson's correlation coefficient (PCC) value larger than 0.99 for all joint angles' estimation. These results show that the proposed ultrasonic measurement system is useful for applications, such as rehabilitation and sports.

1. Introduction

Squat exercise is an effective training exercise for maintaining mobility and improving lower-limb muscle function [1]. Therefore, it has been included as part of athletic training and rehabilitation. Squat exercise can be investigated using a wide variety of measured and estimated parameters. In [2], the hip and knee torques combined with the position of the knee have been used for the assessment of barbell squat. Ankle, knee and hip joint kinematics have been used in [3] to quantitatively evaluate the motion of squat. In many of these applications, it is essential to monitor the squat exercise under a natural environment without hindrance. Therefore, this entails the need for an unrestrained low-cost motion tracking system.

The most accurate measurement system in capturing the squat motion or other lower trunk movement is the camera-based tracking system, which employs one or more cameras to capture the displacement of reflective markers placed at specific anatomical sites on limb segments [4]. However, such a system requires a complex and expensive experimental setup [5]. Furthermore, it is sensitive to changes in lighting, clutter and shadow. However, a recent development in computer gaming technology, the Microsoft Kinect, is inexpensive, portable and does not require markers to determine anatomical landmarks and, consequently, may overcome the limitations associated with laboratory-based movement analysis systems [6,7]. However, the limitation of the Microsoft Kinect system is the inability to assess internal/external joint rotations in the peripheral limbs [7].

The development of microelectromechanical system technology has produced many low -cost and small inertial sensors, which can be used in a human tracking system, such as an accelerometer and a gyroscope [810]. In [11], Brandes et al. use the accelerations measured at the lower trunk to extract spatial-temporal gait parameters with healthy children. Daniel et al. [12] proposed an ambulatory measurement system, using a triaxial accelerometer and a dual-axis gyroscope, to assess the vertical displacement of the foot during walking. Although these inertial sensors overcome the shortcomings of a camera-based tracking system, they require double integration to estimate the position and orientation of human motion [13]. Unfortunately, it is difficult to obtain accurate motion accelerations, because of the presence of sensor bias and measurement noise, thus making the displacement error increase exponentially over integration time [12]. This issue can be mitigated either by applying some techniques to correct it periodically, such as zero velocity update (ZUPT), or by applying a Kalman filter [14], or by combining with other sensors, such as imaging sensors, radio frequency identification (RFID) technology or ultra-wide band (UWB) techniques [1518]. These mentioned hybrid motion tracking systems can improve the tracking accuracy, but with an increased cost, complexity of experiment installation and maintenance.

Since wireless healthcare has received significant interest in recent years, ultra-wideband technology has become a promising technique for general health-monitoring due to its high-temporal resolution and high ranging and positioning accuracy [19]. In [20], wearable UWB transceivers are used to measure some gait parameters (such as the base of support) during the gait. A joint flexion/extension angle measurement system has also been developed in [21,22]. The model is based on providing a high ranging accuracy (intersensor distance) between a pair of UWB transceivers placed on the adjacent segments of the joint center of rotation. The measured distance is then used to compute the joint angles based on the law of cosines. However, in an impulse radio (IR) UWB system, where a sub-nanosecond pulse is used, the required synchronization is extremely challenging. A highly accurate synchronization clock that provides precise timing information is required for tracking, which is difficult to achieve in low-cost systems [23]. Furthermore, it is difficult to sample the received signal in real time with current ADC technology, due to the large bandwidth of the IR-UWB pulse [24].

An alternative method to UWB technology is to use the ultrasound technique due to its low cost, safety, simplicity and high temporal resolution for low range measurement [25]. There are two types of ultrasonic transceivers: one is with an ultrasonic transmitter and receiver on the same circuit board as the one used in [26]. The distance measurement of such an ultrasonic sensor is the returned distance reflected from the ground/surface, and the orientation of the sensor is not taken into consideration. The other type is with an ultrasonic transmitter and receiver on separate boards [27]. However, there are only two receivers used in [27], which only measures one directional displacement.

In this paper, a wireless wearable sensor system based on ultrasound for monitoring squat exercise is proposed. Only one ultrasonic sensor (transmitter) is needed to be attached to the human trunk, which minimizes the discomfort for users and avoids complex calibration procedures and synchronization issues. Several receivers (anchors) with known positions are used to define a coordinate reference system. The system measures propagation delay from anchor to transmitter, thus computing the range in terms of the speed of sound. Then, the range information defines a circle centered at this anchor with a radius equal to the measured distance, and the position of the transmitter should be within the intersection of several such circles. This is called the spherical tracking technique [28]. The proposed approach makes use of the wireless sensor network concept with all of the mobile sensor nodes wirelessly communicating with the coordinator, thus eliminating the usage of wires. In addition, the sensor node attached to the human trunk is light and small. Furthermore, it is low cost compared to the camera system.

The paper is organized as follows: Section 2 gives a brief overview of the configuration of the wireless wearable system. The biomechanical model of the leg, the displacement measurement model and the inverse kinematic model using the damped least-squares technique are given in Section 3. Section 4 investigates the performance of our ultrasonic tracking system by comparing with the camera-based tracking reference system. Finally, the discussion and conclusion are given in Section 5.

2. Materials

Figure 1 shows the general configuration of the proposed system. The ultrasonic measurement system, used in our previous work [29,30], is comprised of one ultrasonic transmitter (mobile) and four ultrasonic receivers (anchors). The mobile node is composed of a circuit board (form factor: 4 cm × 6 cm) with a microcontroller and a radio frequency (RF) module, along with a separate circuit board (form factor: 4 cm × 3 cm × 1.6 cm) with an ultrasound generator. The displacements of the ultrasonic transmitter measured using the spherical tracking technique were expressed in a global coordinate system, which described trunk position relative to the ground. The X-axis was defined as the direction of anterior-posterior direction; the Y-axis was made to be in the vertical direction. The third axis of the coordinate system, the Z-axis, was determined in such a way, so as to form a right-handed coordinate system.

In the proposed system, ultrasonic range measurements are initiated by a periodic trigger input with a pulse duration of 10 μs. Then, the ultrasound transmitter is triggered to produce an ultrasonic burst consisting of 8 pulses with a frequency of 40 kHz. Meanwhile, the RF module on the mobile node is triggered synchronously, thus sending out a data package with the timer starter command (TSC) using the broadcast address to notify the anchors that an ultrasound signal has been transmitted. Once the anchor receives the TSC, it will start its 16-bit counters to record the propagation delay from the mobile to the anchor. The transmission time of the RF signal from the mobile is negligible, since the speed of light is much faster than the speed of ultrasound. The 16-bit counter will stop counting immediately after each of the transmitted bursts is detected by the anchor. Then, the counted steps will be converted to propagation delay by multiplying the time resolution (instruction cycle) of the microcontroller. The device uses the STC12LE5612AD microprocessor with high crystal frequency (Fosc = 22.1184 MHz), which provides high time resolution, resulting in a theoretical resolution of 0.031 mm (340 m/s /(Fosc/2)). From this delay, the distance between the mobile and the anchor can be calculated using:

d = t υ s
where d is the distance in meters, t is the propagation delay in seconds and υs is the speed of ultrasound in air. The ultrasound velocity can be approximated to:
υ s = 331.5 + 0.6 T c
where Tc is air temperature in degrees Celsius. After collecting all four distances from the transmitter to anchors, the coordinator node forwards all of the collected information to a wireless data transmission module, and then, it is transmitted to a personal computer through an RS232 cable for post-processing.

3. Methods

In this section, we discuss our proposed angle tracking algorithm. We first construct the leg kinematic model using a set of links connected by joints. Then, the Denavit-Hartenberg parameters of the leg model are computed. Horizontal and vertical displacement of the ultrasonic sensor are obtained from the data recorded with a single ultrasound transmitter placed at the center line of the torso using an extended Kalman filter. These displacements, together with known joint constraints during squatting, are then used as input to a damped least-squares-based inverse kinematic model, thus allowing the determination of the corresponding ankle, knee and hip joint flexion/extension angles.

3.1. Biomechanics of the Human Body

The commonly-used method for modeling a human rigid body is based on a sequence of links connected by joints. This model could better represent the movement of any parts on the human body [31]. In order to describe the position and orientation between adjacent links, Denavit and Hartenberg (D-H) in 1955 proposed a systematic notation for assigning right-handed orthogonal coordinate frames to each link [32]. The transformations between two adjacent frames can be described by a 4 × 4 homogeneous transformation matrix. Then, the transformation is described by four parameters associated with each link, known as D-H parameters (Lk = (θk, dk, ak, αk)). The first one is the joint angle θk, which is defined as the angle between xk−1 and xk axes about the zk−1 axis. The second parameter is dk, which is the distance between xk−1 and xk axes along the zk−1 axis. The third one is ak, which is defined as the distance between zk−1 and zk axes along the xk axis. The last parameter is αk, which is the twist angle between zk−1 and zk axes about the xk axis.

Figure 2 and Table 1 show the biomechanical model of the human body used in our study and D-H parameters for the leg kinematics, respectively, which correspond to a kinematic chain comprised of three rigid segments (shank (a1), thigh (a2) and torso (a3)).

3.2. Determination of Orientation and Position

Given the D-H model and parameters presented before, we then proceed to investigate the orientation and position of the sensor point, where the ultrasonic sensor will be attached. The orientation R and position p = [x y z]T of the torso (or ultrasonic sensor) can be calculated with respect to the ankle frame as follows:

R = [ C θ 123 S θ 123 0 S θ 123 C θ 123 0 0 0 1 ] p = [ a 3 C θ 123 + a 2 C θ 12 + a 1 C θ 1 a 3 S θ 123 + a 2 S θ 12 + a 1 S θ 1 0 ]
where the orientation angle ϕ = θ123 = θ1 + θ2 + θ3 and θ12 = θ1 + θ2. θ1, θ2 and θ3 are the ankle, knee, and hip joint angles, respectively.

3.3. Determination of the Ultrasonic Sensor Position

In most cases, it is expected to minimize the number of sensors attached to the human body, not only for unrestrained movement or financial cost, but also for simplifying the calibration process and synchronization issues [1,33]. Therefore, only one mobile target is used in our measurement system. As mentioned in Section 2, we assume that the mobile lying on the position p sends out ultrasound signals to the anchors during the discrete sampling time. The positions of the anchors are known to be pi = [xi yi zi]T, respectively After receiving all of the measurements, the coordinator will compute an estimate of the state (position and velocity) of the mobile using extended Kalman filter (EKF) estimation. We will explain the tracking algorithm in more detail later.

3.3.1. Mobile Target Motion Model

We design a state vector with six components, three Cartesian coordinates p = [x y z]T and three velocity components along the three coordinate axes = [ẋ ẏ ż]T, to describe the mobile moving in a 3-dimensional space. In other words, the state of the mobile target on time step k can be expressed as:

x ( k ) = [ x ( k ) y ( k ) z ( k ) x ˙ ( k ) y ˙ ( k ) z ˙ ( k ) ] T

Then, the following model is used to describe the motion of the mobile:

x ( k ) = A x ( k 1 ) + B ω ( k 1 )
where:
A = [ I 3 × 3 T I 3 × 3 O 3 × 3 I 3 × 3 ] , B = [ T 2 2 I 3 × 3 T I 3 × 3 ]
where I3×3 indicates the identity matrix and O3×3 indicates the zero matrix. T is the sampling interval between time step k and k − 1. ω(k − 1) = [ωx ω y ωz]T is a white Gaussian noise with zero mean and covariance matrix Q ω = diag ( q x 2 , q y 2 , q z 2 ). In most cases, qx, qy and qz can be considered as standard deviations of the velocity noise along the x-, y- and z-axes, respectively.

3.3.2. Measurement Model

At time step k, let di(k) denote the absolute distance measured at the i-th anchor using the following equation:

d i = p p i + d ˜ i
where i is the range measurement error and di(k) is simplified to di. Stacking all of the distance information, we have the measurement model expressed as:
D ( k ) = F ( x ( k ) ) x ( k ) + D ˜ ( k )
where:
D ( k ) = [ d 1 d 2 d n ] T F ( x ( k ) ) = [ F 1 F 2 F n ] T F i [ d i x d i y d i z 0 0 0 ] D ˜ ( k ) = [ d ˜ 1 d ˜ 2 d ˜ n ] T
n is the number of anchors, and (k) ∼ N(0,R(k)) are the measurement errors. R ( k ) = diag ( e 1 2 , e 2 2 , , e n 2 ) is the covariance matrix of measurement errors. ei is always considered as the standard deviation of the measurement error of anchor i.

3.3.3. Tracking Using the Extended Kalman Filter

The basic idea of the extended Kalman filter is that the filter uses prior knowledge of all distance information to predict and produce an estimate of the position for where the mobile might be in the next time step. Once the next distance sample arrives, the filter first corrects the state based on the actual distance information [34,35]. In each iteration, the current state x(k − 1) is used to predict the velocity and position at the time step k − 1. The error covariance P̂(k) is also predicted using the state space model in Equation (5). This is followed by the computation of the Kalman filter gain K(k). Once K(k) is computed, the range measurements D(k) are calibrated by the predicted state of the mobile and are used to update the mean and covariance of the state x(k) and P(k), respectively. The standard expression is given below [36]:

  • Prediction:

    x ^ ( k ) = A x ( k 1 ) P ^ ( k ) = A P ( k 1 ) A T + B Q ω B T

  • Update:

    Θ ( k ) = D ( k ) F ( x ^ ( k ) ) x ^ ( k ) S ( k ) = F ( x ^ ( k ) ) P ^ ( k ) F T ( x ^ ( k ) ) + R ( k ) K ( k ) = P ^ ( k ) F T ( x ^ ( k ) ) S ( k ) 1 x ( k ) = x ^ ( k ) + K ( k ) Θ ( k ) P ( k ) = P ^ ( k ) K ( k ) S ( k ) K ( k ) T

Once the state of the mobile x(k) is computed at time step k, the position information is used to obtain the joint angles when subjects are doing the squat exercise. Since the displacement along lateral direction does not change, the squat exercise is always planar. Therefore, in the rest of our paper, only horizontal and vertical displacement (Cartesian coordinates) are considered as input to the inverse kinematic model.

3.4. Inverse Kinematic Model

The direct kinematic mapping of interest for the system is given by:

p = f ( θ ) p ˙ = J ( θ ) θ ˙
where θ = [θ1 θ2 θ3]T, θ̇ and are joint velocities and Cartesian velocities, respectively, f is the nonlinear function described in Equation (3) and J is a Jacobian matrix defined as J ( θ ) = [ f θ 1 f θ 2 f θ 3 ] T. The system under study is kinematically redundant during a planar squat exercise, since there is a 3-degrees-of-freedom (DoF) movement with only 2 displacements known.

A general solution in terms of a generalized inverse of the Jacobian matrix is [37,38]:

θ ˙ = ϝ ( p p ^ e ) + ( I ϝ J ) Φ
where e is the estimated position obtained from the forward kinematic model and p is the Cartesian coordinates (target position) acquired by the ultrasonic sensor using EKF. ϝ is a generalized inverse matrix of the Jacobian matrix, (Iϝ J) is the matrix that projects the vector Φ in the null space of J, J(θ) is simplified to J and:
Φ = ξ 0 ( W ( θ ) θ ) T
where ξ0 > 0 and W(θ) is a scalar (objective) function of joint variables. Since the solution moves along the direction of the gradient of W(θ), it attempts to locally maximize subject to the kinematic constraint. The objective function is based on a limited joint range from lower θmin to upper θmax limits, shown in Table 2 [1]:
W ( θ ) = 1 6 i = 1 3 ( θ i θ ¯ i θ i max θ i min ) 2 θ ¯ i = ( θ i max + θ i min ) 2
where θ̄i is the middle value of the joint range; thus, redundancy is exploited to keep the joint variables θ as close as possible to the center of their ranges [39].

3.5. Damped Least-Squares Scheme

The system is close to a singular point near/at the beginning and ending of the squat cycle, since the Jacobian matrix does not have full rank [40]. The unavoidable measurement errors in displacement estimations using the EKF algorithm will produce some unreachable targets, which leads to oscillations and shaking of the inverse kinematic problem. An alternative solution overcoming the problem of inverting differential kinematics in the neighborhood of a singularity is damped least-squares inverse (DLS):

ϝ = J T ( J J T + κ 2 I ) 1
where κ is a damping factor that ensures continuity and good shaping of the solution near/at singularity and for out-of-reach targets. The damping factor should be critically determined for obtaining good performance over the entire workspace as follows:
κ 2 = { 0 when σ min ε ( 1 ( σ min ε ) 2 ) κ max 2 otherwise
where κmax is used to adjust the solution in the neighborhood of a singularity, σmin is the estimate of the smallest singular value and ε is defined as the size of the singular region [41].

To gain more insight into the features of the DLS, the singular value decomposition [40,41] of the Jacobian matrix is introduced, which is:

J = i = 1 3 σ i u i υ i T
where ui and υi are the output and input singular vectors and σi are the singular values. Thus, the solution of DLS can be expressed in the form of:
F = J T ( J J T + κ 2 I ) 1 = i = 1 3 σ i σ i 2 + κ 2 υ i u i T

From Equation (19), the components for which σiκ are little affected by the damping factor, since for large σi, σ i / ( σ i 2 + κ 2 ) 1 / σ i. On the contrary, when σi is of a similar or even smaller magnitude as κ, then the associated component of the solution is driven to zero by the factor σi/κ2. Therefore, the DLS method tends to effectively smooth out the performance in the neighborhood of singularities.

Once the solution of Equation (13) is found, the joint angles can be initially computed using previous joint angles and the estimated joint velocities:

θ k + 1 = θ k + θ ˙
The above joint angles estimation can be further refined iteratively: For j = 0, 1, ⋯, compute:
p k + 1 j + 1 = f ( θ k + 1 j ) θ ˙ k + 1 j + 1 = ϝ k + 1 j ( p p ^ k + 1 j + 1 ) + ( I ϝ k + 1 j J ) Φ k + 1 j
until:
p p k + 1 j + 1 ξ
and ξ ≥ 0 is a predefined threshold.

3.6. Parameters Identification

3.6.1. Noise Statistics in the Kalman Filter

Using the measurement model in Equation (7), we first conduct a static measurement to estimate the covariance matrix of measurement error, R(k). It is reasonable to assume that all of the sensors have independent distributed noise. We take a sensor and run M tests with different distances between the receiver and transmitter. The actual distance for test i, ri, is known, and there are N measurement samples m i j collected for each ri, where j = 1, ⋯, N.

Therefore, straightforward calculations lead to the estimation of the mean and variance of the measurement errors:

u = 1 M N i = 1 M j = 1 N ( m i j r i ) e 2 = 1 M ( N 1 ) i = 1 M j = 1 N ( m i j u ) 2

3.6.2. Parameter Identification of the Inverse Kinematic Model

The damping factor is computed in (17) with ε = 0.04 and κmax = 0.04. These values were determined by calculating the smallest singular value among all of the near singular Jacobian matrices J, where the subjects under test were close to an upright posture.

4. Experimental Validation

4.1. Experimental Setup

To compare the performance of the proposed measurement system with a conventional measurement system, experiments were conducted in a motion analysis lab with eight high speed cameras in the School of Mechanical and Aerospace Engineering, Nanyang Technological University. Eight healthy subjects (mean age 24.5 ± 1.73 years, mean weight 61.3 ± 6.40 kg, mean height 171.8 ± 5.80 cm) volunteered in the experiments. All subjects were required to wear a ultrasound transmitter on the torso and five reflective markers, as shown in Figure 3, to perform an unrestrained squat exercise at a self-selected speed, keeping their feet flat on the ground. Each subject was asked to repeat the squat exercise five times. The segment length and joint angles with respect to the kinematic model in Figure 2 were calculated using the instantaneous positions of the above-mentioned five reference markers.

There were four anchors used in our experiment with positions (p1 = [0 0 0]T, p2 = [0.324m 0 0]T, p3 = [0.324m 0.230m 0]T, p4 = [0 0.230m 0]T ). In our method, only one ultrasonic sensor (transmitter) is needed, which is to be attached to the foot, which minimizes the discomfort for users and avoids complex calibration procedures and synchronization issues. All of the data transmission between anchors, coordinator and transmitter are done wirelessly through the RF module. Therefore, it does not restrict the movement of the subjects.

The synchronization between the proposed ultrasonic and reference camera measurement system was done by maximizing the correlation between the horizontal displacements of the torso point estimated by both systems. The proposed ultrasonic sensor data were acquired at 50 Hz. Data from the reference system were acquired at 200 Hz. All data were low-pass filtered by a second order low-pass Butterworth filter at 5 Hz. The positions of ankle, knee, hip and torso markers and related joint angles estimated from the motion capture system were considered as reference data and used for the evaluation of the ultrasound-based system.

4.2. Data Analysis

To verify the joint angle estimation accuracy, which is implemented in the hardware platform, as described in Section 2, the mean and standard deviation value of the difference between the parameters extracted with the optical tracking reference system, together with root mean square error (RMSE), were computed. Pearson's correlation coefficient (PCC) is also used in gauging the degree of agreement between these two systems. Furthermore, a statistical method, Bland-Altman analysis [42], for assessing the level of agreement between the proposed and reference systems was applied. The limits of agreement refer to the mean ± 1.96-times the standard deviation of the difference between the two systems.

4.3. Results

In Figure 4, a randomly selected trial for the estimated ankle, knee and hip joint flexion and extension angles during a squat exercise is shown. Figure 4 shows the effect of different damping factors on the joint angle estimation. We compared with the pseudo-inverse method (κ = 0) and DLS method. It is shown clearly that the pseudo-inverse method performs poorly because of instability near singularities (σi approaches zero). However, the DLS method tends to act similarly to the pseudo-inverse method away from singularities and effectively smooths out the performance of the pseudo-inverse method in the neighborhood of singularities. All of the joint angles estimated by the DLS method show a great correspondence with the reference system.

For the clarity of the Bland–Altman plots, we randomly selected 4 trials to draw these figures, as shown in Figure 5. The data plotted in Figure 5I show that all points lie along the line of equality, which means a high degree of agreement between the measurements. The PCC values between the two system are also calculated for the data in Figure 5I. For all of these joint angles, the correlations are all equal to or larger than 0.99 (p < 0.001), where the p-value is the probability that the measurements by the two methods are not linearly related. As the p-value is extremely small, we can safely conclude that the measurements of joint angles by these two methods are significant. Figure 5II shows the Bland-Altman plot for the selected data by plotting the difference between the two systems against the mean values of ankle, knee and hip joint angles. This plot is used to gauge the limits of agreement between the two methods. The 95% confidence intervals were determined to be (−6.48°, 6.56°) for ankle angles, (−5.34°, −0.32°) for knee angles and (−1.42°, 4.7°) for hip angles.

All of the collected data from 8 subjects are used to compute the mean and standard deviation of the difference, RMSE, PCC values and the limits of agreement, which are reported in Table 3. Horizontal displacement was obtained with a difference of 1.08 ± 6.07 mm, an RMSE of 6.50 ± 2.08 mm and a high PCC value of 0.94 ± 0.04. The mean difference and standard deviation of the vertical displacement was 0.75 ± 9.65 mm, which had a high similarity of 0.94 ± 0.06 with the results of the reference system. For all of the collected data, the joint angles of interest were estimated with a mean difference from the reference data of 2.85° (RMSE) and with high similarities greater than 0.99, where all p-values are smaller than (0.001). For all three estimated joint angles, the hip joint has the smallest error, and consequently, tighter lower and upper limits of agreement, closer to zero than the ankle and hip joint. In summary, the great agreement of all joint angles estimated by the two systems is enough for us to be confident that the proposed measurement system can be used for further clinical applications.

5. Discussion and Conclusions

This study has demonstrated that one ultrasound transmitter (attached to the human body) and four receivers can be used to obtain high accuracy ankle, knee, hip joint flexion/extension angles estimates. The extended Kalman filter is applied to estimate the displacements in the vertical and horizontal direction of the ultrasonic sensor, and then, the recorded displacements together with known joint constraints are used to estimate the joint angles of the trunk using the damped least-squares-based technique for the singularity avoidance problem of redundant systems.

The proposed measurement system was compared to a camera-based system, and the results were averaged over eight subjects. These metrics (difference, RMSE, PCC values and limits of agreement) are shown in Table 3 to illustrate the differences between these two systems. The experimental results showed that the horizontal and vertical displacement of the ultrasonic sensor and the joint angles (hip, knee and ankle) can be estimated with relatively small differences. Bland–Altman analysis indicated a great agreement between these two systems, with the PCC value higher than 0.99. The average RMSD of the estimate of the lower extremity joint angles is 2.85° ± 0.57°, which is similar to what has been obtained in other studies using inertial sensors to estimate these joint angles [1,13].

Although the positive results showed the feasibility of applying such a system for in-home monitoring, there is an issue to be addressed in further research, that is how to deal with the multipath propagation. All of the experiments in this study are conducted under the line-of-sight condition, where the ultrasonic transmitter faces all of the receivers without any obstacles between them. Therefore, for 3D displacements, according to the spherical positioning technique, a minimum of four anchors with known positions is required. The method used in our experiment to mitigate the multipath propagation is by setting an inhibition time, i.e., the ultrasound detector will be disabled within the inhibition time to detect an ultrasound signal. Then, it will be enabled after this inhibit duration. Another possible solution is that we can use more receivers, which can not only account for multipath propagation, but also increase the measurement volume and accuracy of the proposed system [19].

A key issue in the system is the determination of the damping factor in Equation (16), since it plays an important role in finding a solution to the inverse kinematic model. Larger κ makes the solution for joint velocities behave well in the neighborhood of a singularity, but results in low tracking accuracy and a low convergence rate. Small values of the damping factor give accurate solutions, but not are robust to the singular or near-singular region. Hence, it is essential to select suitable values for the damping factor.

In summary, this paper presents an unrestrained measurement system based on a wearable wireless ultrasonic sensor network to track the lower limb joint and trunk kinematics during a squat exercise with only one ultrasonic sensor attached to the trunk. The camera-based tracking reference system was used to benchmark the performance of the proposed ultrasonic motion analysis system. It demonstrates acceptable accuracy for further applications. Additionally, the proposed system is easy to wear, to use and much less expensive than current camera systems. It does not restrict the movement of patients or subjects with bulky cables.

Acknowledgements

We thank Qu Xingda from School of Mechanical & Aerospace Engineering for his technical support and all of the subjects who participated in this project.

Author Contributions

The work presented here was carried out in collaboration between all authors. Cheong Boon Soh, Erry Gunawan, and Kay-Soon Low proposed the research theme with regular feedbacks of suggestions/ideas during the weekly research meetings. Yongbin Qi and Cheong Boon Soh co-designed the methods and implementation. Yongbin Qi and Rijil Thomas co-worked on associated data collection and carried out the laboratory experiments. All authors have contributed, reviewed and improved the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bonnet, V.; Mazza, C.; Fraisse, P.; Cappozzo, A. Real-Time Estimate of Body Kinematics during a Planar Squat Task Using a Single Inertial Measurement Unit. IEEE Trans. Biomed. Eng. 2013, 60, 1920–1926. [Google Scholar]
  2. Fry, A.C.; Smith, J.C.; Schilling, B.K. Effect of knee position on hip and knee torques during the barbell squat. J. Strength Cond. Res. 2003, 17, 629–633. [Google Scholar]
  3. Bonnet, V.; Mazza, C.; Fraisse, P.; Cappozzo, A. A least-squares identification algorithm for estimating squat exercise mechanics using a single inertial measurement unit. J. Biomech. 2012, 45, 1472–1477. [Google Scholar]
  4. Cappozzo, A.; Della Croce, U.; Leardini, A.; Chiari, L. Human movement analysis using stereophotogrammetry: Part 1: Theoretical background. Gait Posture 2005, 21, 186–196. [Google Scholar]
  5. Vlasic, D.; Adelsberger, R.; Vannucci, G.; Barnwell, J.; Gross, M.; Matusik, W.; Popović, J. Practical Motion Capture in Everyday Surroundings. In ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2007; ACM: New York, NY, USA, 2007; Volume 26. [Google Scholar]
  6. Lange, B.; Chang, C.Y.; Suma, E.; Newman, B.; Rizzo, A.S.; Bolas, M. Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. IEEE Eng. Med. Biol. Soc. Conf. Proc. 2011, 2011, 1831–1834. [Google Scholar]
  7. Clark, R.A.; Pua, Y.H.; Fortin, K.; Ritchie, C.; Webster, K.E.; Denehy, L.; Bryant, A.L. Validity of the Microsoft Kinect for assessment of postural control. Gait Posture 2012, 36, 372–377. [Google Scholar]
  8. Lee, G.X.; Low, K.S. A Factorized Quaternion Approach to Determine the Arm Motions Using Triaxial Accelerometers with Anatomical and Sensor Constraints. IEEE Trans. Instrum. Meas. 2012, 61, 1793–1802. [Google Scholar]
  9. Brennan, A.; Zhang, J.; Deluzio, K.; Li, Q. Quantification of inertial sensor-based 3D joint angle measurement accuracy using an instrumented gimbal. Gait Posture 2011, 34, 320–323. [Google Scholar]
  10. Picerno, P.; Cereatti, A.; Cappozzo, A. Joint kinematics estimate using wearable inertial and magnetic sensing modules. Gait Posture 2008, 28, 588–595. [Google Scholar]
  11. Brandes, M.; Zijlstra, W.; Heikens, S.; van Lummel, R.; Rosenbaum, D. Accelerometry based assessment of gait parameters in children. Gait Posture 2006, 24, 482–486. [Google Scholar]
  12. Lai, D.; Begg, R.; Charry, E.; Palaniswami, M.; Hill, K. Measuring toe clearance using a wireless inertial sensing device. Proceedings of the International Conference on Intelligent Sensors, Sensor Networks and Information Processing, 2008 (ISSNIP 2008), Sydney, NSW, Austrilia, 15–18 December 2008; pp. 375–380.
  13. McCamley, J.; Donati, M.; Grimpampi, E.; Mazzà, C. An enhanced estimate of initial contact and final contact instants of time using lower trunk inertial sensor data. Gait Posture 2012, 36, 316–318. [Google Scholar]
  14. Petruska, A.J.; Meek, S.G. Non-drifting limb angle measurement relative to the gravitational vector during dynamic motions using accelerometers and rate gyros. Proceedings of the 2011 IEEE/RSJ International Conference on Intellignet Robots and Systems, San Francisco, CA, USA, 25–30 September 2011; pp. 3632–3637.
  15. Panahandeh, G.; Mohammadiha, N.; Leijon, A.; Händel, P. Continuous hidden Markov model for pedestrian activity classification and gait analysis. IEEE Trans. Instrum. Meas. 2013, 62, 1073–1083. [Google Scholar]
  16. Ruiz, A.R.J.; Granja, F.S.; Prieto Honorato, J.C.; Rosas, J.I.G. Accurate pedestrian indoor navigation by tightly coupling foot-mounted IMU and RFID measurements. IEEE Trans. Instrum. Meas. 2012, 61, 178–189. [Google Scholar]
  17. Corrales, J.A.; Candelas, F.; Torres, F. Hybrid tracking of human operators using IMU/UWB data fusion by a Kalman filter. Proceedings of the 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI 2008), Amsterdam, The Netherlands, 12–15 March 2008; pp. 193–200.
  18. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Maskooki, A. Using wearable UWB radios to measure foot clearance during walking. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3–7 July 2013; Osaka, Japan; pp. 5199–5202.
  19. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Maskooki, A. An Accurate 3D UWB Hyperbolic Localization in Indoor Multipath Environment Using Iterative Taylor-Series Estimation. Proceedings of the 2012 IEEE Vehicular Technology Conference (VTC Fall), Quebec City, QC, Canada, 3–6 September 2012.
  20. Shaban, H.; El-Nasr, M.; Buehrer, R. Toward a highly accurate ambulatory system for clinical gait analysis via UWB radios. IEEE Trans. Inf. Technol. Biomed. 2010, 14, 284–291. [Google Scholar]
  21. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Maskooki, A. Measurement of knee flexion/extension angle using wearable UWB radios. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 7213–7216.
  22. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Maskooki, A. A. Novel Approach to Joint Flexion/Extension Angles Measurement Based on Wearable UWB Radios. IEEE J. Biomed. Health Inform. 2013, 18, 300–308. [Google Scholar]
  23. Carbonelli, C.; Mengali, U. Synchronization algorithms for UWB signals. IEEE Trans. Commun. 2006, 54, 329–338. [Google Scholar]
  24. Zhou, Y.; Law, C.; Xia, J. Ultra low-power UWB-RFID system for precise location-aware applications. Proceedings of the 2012 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), Paris, France, 1 April 2012; pp. 154–158.
  25. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S. Ambulatory measurement of foot kinematics using wearable ultrasonic sensors. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Chicago, IL, USA, 26–30 August 2014.
  26. Wahab, Y.; Zayegh, A.; Bakar, N. Foot-to-ground Clearance Measurement: Analysis and Modelling of MEMS Applicability. Int. J. Res. Rev. Signal Acquis. Process. (IJRRSAP) 2012, 2, 154–158. [Google Scholar]
  27. Huitema, R.B.; Hof, A.L.; Postema, K. Ultrasonic motion analysis system—Measurement of temporal and spatial gait parameters. J. Biomech. 2002, 35, 837–842. [Google Scholar]
  28. Zhou, Y.; Law, C.; Guan, Y.; Chin, F. Indoor elliptical localization based on asynchronous UWB range measurement. IEEE Trans. Instrum. Meas. 2011, 60, 248–257. [Google Scholar]
  29. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S. Ambulatory Measurement of 3-Dimensional Foot Displacement during Treadmill Walking Using Wearable Wireless Ultrasonic Sensor Network. IEEE J. Accept. publ. Biomed. Health Inform. 2015, 19, 446–452. [Google Scholar]
  30. Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.S.; Thomas, R. Estimation of Spatial-Temporal Gait Parameters Using a Low-Cost Ultrasonic Motion Analysis System. Sensors 2014, 14, 15434–15457. [Google Scholar]
  31. El-Gohary, M.; McNames, J. Shoulder and Elbow Joint Angle Tracking With Inertial Sensors. IEEE Trans. Biomed. Eng. 2012, 59, 2635–2641. [Google Scholar]
  32. Denavit, J. A kinematic notation for lower-pair mechanisms based on matrices. J. Applied Mech. Trans. ASME 1955, 22, 215–221. [Google Scholar]
  33. Fong, D.T.P.; Chan, Y.Y. The use of wearable inertial motion sensors in human lower limb biomechanics studies: A systematic review. Sensors 2010, 10, 11556–11565. [Google Scholar]
  34. Smith, A.; Balakrishnan, H.; Goraczko, M.; Priyantha, N. Tracking moving devices with the cricket location system. Proceedings of the 2nd International Conference on Mobile Systems, Applications, and Services, Boston, MA, USA, 6–9 June 2004; ACM: New York, NY, USA, 2004; pp. 190–202. [Google Scholar]
  35. Shareef, A.; Zhu, Y. Localization using extended Kalman filters in wireless sensor networks. In Kalman Filter: Recent Advances and Applications; InTechOpen: Rijeka, Croatia, 2009. [Google Scholar]
  36. Hartikainen, J.; Solin, A.; Särkkä, S. Optimal Filtering with Kalman Filters and Smoothers— A Manual for MATLAB Toolbox EKF/UKF; Aalto University School of Science: Espoo, Finland, 2011. [Google Scholar]
  37. Liegeois, A. Automatic supervisory control of the configuration and behavior of multibody mechanisms. IEEE Trans. Syst. Man Cybern. 1977, 7, 868–871. [Google Scholar]
  38. Nenchev, D.N. Redundancy resolution through local optimization: A review. J. Robot. Syst. 1989, 6, 769–798. [Google Scholar]
  39. Sciavicco, L. Modelling and Control of Robot Manipulators; Springer: Berlin, Germany, 2000. [Google Scholar]
  40. Buss, S.R.; Kim, J.S. Selectively damped least squares for inverse kinematics. J. Graph. Gpu Game Tools 2005, 10, 37–49. [Google Scholar]
  41. Chiaverini, S.; Siciliano, B.; Egeland, O. Review of the damped least-squares inverse kinematics with experiments on an industrial robot manipulator. IEEE Trans. Control Syst. Technol. 1994, 2, 123–134. [Google Scholar]
  42. Martin Bland, J.; Altman, D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 327, 307–310. [Google Scholar]
Figure 1. General configuration of the system.
Figure 1. General configuration of the system.
Sensors 15 09610f1 1024
Figure 2. Three degrees-of-freedom kinematic model of the leg.
Figure 2. Three degrees-of-freedom kinematic model of the leg.
Sensors 15 09610f2 1024
Figure 3. Wireless unit with embedded ultrasonic sensor placed on the lateral side of the trunk and five reflective markers fixed on the toe, heel, knee, hip and torso for the optical tracking reference system.
Figure 3. Wireless unit with embedded ultrasonic sensor placed on the lateral side of the trunk and five reflective markers fixed on the toe, heel, knee, hip and torso for the optical tracking reference system.
Sensors 15 09610f3 1024
Figure 4. The joint angles obtained from both ultrasonic and optical tracking system during a 15-s consecutive planar squat exercise. The black line makes use of the pseudo-inverse method, that is κ = 0. The blue line is the damping least-squares method. The red line is a reference result.
Figure 4. The joint angles obtained from both ultrasonic and optical tracking system during a 15-s consecutive planar squat exercise. The black line makes use of the pseudo-inverse method, that is κ = 0. The blue line is the damping least-squares method. The red line is a reference result.
Sensors 15 09610f4 1024
Figure 5. (I) Joint angles estimated by the proposed ultrasonic and reference camera-based measurement system, plotted with the line of equality. (a) Ankle joint angle; (c) knee joint angle and (e) hip joint angle. (II) Bland–Altman plot with the mean and difference between two values estimated by the proposed ultrasonic and reference camera-based measurement system, plotted with the limits of agreement, which are the average difference ± 1.96-times the standard deviation of the difference. (b) Ankle joint angle; (d) knee joint angle and (f) hip joint angle.
Figure 5. (I) Joint angles estimated by the proposed ultrasonic and reference camera-based measurement system, plotted with the line of equality. (a) Ankle joint angle; (c) knee joint angle and (e) hip joint angle. (II) Bland–Altman plot with the mean and difference between two values estimated by the proposed ultrasonic and reference camera-based measurement system, plotted with the limits of agreement, which are the average difference ± 1.96-times the standard deviation of the difference. (b) Ankle joint angle; (d) knee joint angle and (f) hip joint angle.
Sensors 15 09610f5 1024
Table 1. Denavit–Hartenberg parameters of the leg model.
Table 1. Denavit–Hartenberg parameters of the leg model.
Jointθkdkakαk
Ankle (L1)θ10a10
Knee (L2)θ20a20
Hip (L3)θ30a30
Table 2. Range of motion and constraints imposed in the system.
Table 2. Range of motion and constraints imposed in the system.
Upper Limit (deg)Lower Limit (deg)
θ1 ankle joint15080
θ2 knee joint5−120
θ3 hip joint110−15
Table 3. Comparison of errors in measurements for the proposed and reference system. The mean difference and relevant standard deviation (std) together with Pearson's correlation coefficient (PCC) values are shown. Bland–Altman limits of agreement are also reported. HD: Horizontal Displacement; VD: Vertical Displacement.
Table 3. Comparison of errors in measurements for the proposed and reference system. The mean difference and relevant standard deviation (std) together with Pearson's correlation coefficient (PCC) values are shown. Bland–Altman limits of agreement are also reported. HD: Horizontal Displacement; VD: Vertical Displacement.
DifferenceRMSEPCCLimits of Agreement




MeanStdMeanStdMeanStdLowerUpper
HD (mm)1.086.076.502.080.940.04−10.8212.97
VD (mm)0.759.659.904.790.940.06−18.1719.67
ankle (deg)0.573.103.101.100.990.01−6.076.07
knee (deg)−2.461.823.280.391.000.00−6.031.11
hip (deg)1.491.562.180.211.000.00−1.554.54

Share and Cite

MDPI and ACS Style

Qi, Y.; Soh, C.B.; Gunawan, E.; Low, K.-S.; Thomas, R. Lower Extremity Joint Angle Tracking with Wireless Ultrasonic Sensors during a Squat Exercise. Sensors 2015, 15, 9610-9627. https://doi.org/10.3390/s150509610

AMA Style

Qi Y, Soh CB, Gunawan E, Low K-S, Thomas R. Lower Extremity Joint Angle Tracking with Wireless Ultrasonic Sensors during a Squat Exercise. Sensors. 2015; 15(5):9610-9627. https://doi.org/10.3390/s150509610

Chicago/Turabian Style

Qi, Yongbin, Cheong Boon Soh, Erry Gunawan, Kay-Soon Low, and Rijil Thomas. 2015. "Lower Extremity Joint Angle Tracking with Wireless Ultrasonic Sensors during a Squat Exercise" Sensors 15, no. 5: 9610-9627. https://doi.org/10.3390/s150509610

Article Metrics

Back to TopTop