Next Article in Journal
Effects of Magnetostatic Interactions in FeNi-Based Multilayered Magnetoimpedance Elements
Previous Article in Journal
System for the Acquisition and Monitoring of Energy Consumption in the Context of Industry 4.0
Previous Article in Special Issue
Kinematics-Based Predictions of External Loads during Handcycling
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Handrim Reaction Force and Moment Assessment Using a Minimal IMU Configuration and Non-Linear Modeling Approach during Manual Wheelchair Propulsion

by
Rachid Aissaoui
1,2,3,4,*,
Amaury De Lutiis
1,2,
Aiman Feghoul
1,2 and
Félix Chénier
3,4,5
1
Laboratoire de Recherche en Innovation Ouverte en Technologie de la Santé, Centre de Recherche CRCHUM, Montreal, QC H2X 0A9, Canada
2
Département de Génie des Systèmes, École de Technologie Supérieure, Montréal, QC H3C 1K3, Canada
3
Centre de Recherche Interdisciplinaire de Réadaptation de Montréal, Montreal, QC H3S 1M9, Canada
4
Regroupement Scientifique INTER, Technologies Interactives En Réadaptation, Sherbrooke, QC J1K 0A5, Canada
5
Département des Sciences de l’activité Physique, Université du Québec à Montréal, Montréal, QC H2X 1Y4, Canada
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(19), 6307; https://doi.org/10.3390/s24196307 (registering DOI)
Submission received: 30 July 2024 / Revised: 26 September 2024 / Accepted: 27 September 2024 / Published: 29 September 2024
(This article belongs to the Special Issue Human Movement Monitoring Using Wearable Sensor Technology)

Abstract

:
Manual wheelchair propulsion represents a repetitive and constraining task, which leads mainly to the development of joint injury in spinal cord-injured people. One of the main reasons is the load sustained by the shoulder joint during the propulsion cycle. Moreover, the load at the shoulder joint is highly correlated with the force and moment acting at the handrim level. The main objective of this study is related to the estimation of handrim reactions forces and moments during wheelchair propulsion using only a single inertial measurement unit per hand. Two approaches are proposed here: Firstly, a method of identification of a non-linear transfer function based on the Hammerstein–Wiener (HW) modeling approach was used. The latter represents a typical multi-input single output in a system engineering modeling approach. Secondly, a specific variant of recurrent neural network called BiLSTM is proposed to predict the time-series data of force and moments at the handrim level. Eleven subjects participated in this study in a linear propulsion protocol, while the forces and moments were measured by a dynamic platform. The two input signals were the linear acceleration as well the angular velocity of the wrist joint. The horizontal, vertical and sagittal moments were estimated by the two approaches. The mean average error (MAE) shows a value of 6.10 N and 4.30 N for the horizontal force for BiLSTM and HW, respectively. The results for the vertical direction show a MAE of 5.91 N and 7.59 N for BiLSTM and HW, respectively. Finally, the MAE for the sagittal moment varies from 0.96 Nm (BiLSTM) to 1.09 Nm for the HW model. The approaches seem similar with respect to the MAE and can be considered accurate knowing that the order of magnitude of the uncertainties of the dynamic platform was reported to be 2.2 N for the horizontal and vertical forces and 2.24 Nm for the sagittal moments. However, it should be noted that HW necessitates the knowledge of the average force and patterns of each subject, whereas the BiLSTM method do not involve the average patterns, which shows its superiority for time-series data prediction. The results provided in this study show the possibility of measuring dynamic forces acting at the handrim level during wheelchair manual propulsion in ecological environments.

1. Introduction

Manual wheelchair propulsion represents a repetitive and constraining task, which leads to the development of joint injury in spinal cord-injured people. The shoulder joint remains the site where injury and pain are the most prevalent [1]. The net compressive force developed at the shoulder joint is related to a surrogate variable, which is generally represented by the resultant shoulder joint moment [2]. The latter is generally obtained by a recursive inverse dynamic method [3,4]. To be able to estimate the shoulder moment, the forces and the moment reactions at the handrim level should be measured [5]. It has been shown in the past that an increase in the shoulder joint moment is related to the pattern of handrim forces and moment reactions [6,7]. In a laboratory set-up, it is relatively easier to measure handrim reaction forces when using a haptic wheelchair simulator and dynamic force platforms [6]. However, outdoor force measurement remains impossible to estimate when using the patient’s wheelchair, i.e., a non-instrumented wheel. Moreover, even when using instrumented wheels such as the Smartwheel, the inertia characteristic of the wheels as well as their frontal plane orientation modify the intrinsic configuration of the user’s seating. This will influence the handrim reaction forces and moments.
The assessment of ground reaction forces during walking and running gait has been tackled for many years now, using the inertial measurement unit (IMU). In fact, a systematic review has been reported spreading over two decades for the estimation of ground reaction forces [8]. There are two major approaches to the problem: a multibody approach and local segment approach. The multibody approach is generally based on inverse dynamics as applied to the all-body segment, i.e., the Newton–Euler formulation. The total vertical ground reaction forces are equal to the sum of the mass of each segment multiplied by the vertical linear acceleration of the segment minus the gravitation vector. This method is ideal for a perfect multibody model, but not in human model segments. The global approach suffers from three issues: the first one is related to the skin tissue artifact of markers or sensors, the second one is related to the estimation of the location and mass of each segment of the body, and the third one is more complex and related to the smooth transition in the double-support phase. The study conducted by the authors of [9] reported an RMSE of almost 64 N for the vertical direction and 43 N for the horizontal direction, as well as 18 Nm for the sagittal moment during normal walking. Recently, a probabilistic approach based on principal component analysis has been applied to the distribution of ground reaction forces between legs and reduced the error on vertical ground reaction forces to 2.5 N/kg [10]. Moreover, when there is multiple contact, such as in lifting a box, the multi-body approach becomes inefficient and necessitates an optimization approach as well as modeling of the contact between the environment and the human body; the latter can be handled by a complementary approach [11]. The latter estimated the vertical reaction forces with an RMSE of 0.51 N/kg.
The local approach is a method which tries to relate the information localized in one part of the body to the forces acting at the ground level. In [12], one accelerometer was fixed at the hip level, and a logarithmic regression equation was developed to predict peak ground reaction forces. The RMSE was large and almost close to 150 N. Recently, the local approach based on three uniaxial load cells fixed on the shoes and combined with a deep learning method (Long Short-Term Memory) was used to estimate the ground reaction forces [13]. The latter provide an RMSE of 65 N in the vertical direction and 15 N in the horizontal direction. The advantage of the local approach is definitively the number of sensors used. Moreover, it seems that the closer the sensors to the contact zone, the better the estimated GRF.
In the field of manual wheelchair propulsion, few attempts have been made in the past to estimate the handrim reaction forces. A four-bar linkage was developed to model upper-body movement using an optimization approach to minimize the shoulder moment as well as to deduce the magnitude and orientation of sagittal handrim reaction forces [14]. In [14], the relative error in estimating the ground reaction forces varies from 16 to 88% during the push cycle. In [15], a kinematic method was designed to estimate the average global push force using an impulse–momentum equality constraint during the wheelchair propulsion cycle. The authors found a relative error that varies between 31% and 43% at the comfortable and maximum linear velocities [15]. In [16], the authors used 36 feature variables that represent the angular displacement, velocity and acceleration of the shoulder, elbow and wrist joints as well as anthropometric data as an input to a recurrent neural network in order to predict the magnitude and the orientation of the handrim reaction forces. The relative error on magnitude varies during the push cycle from 86% at the beginning of the push cycle to 13% at the peak force level. It should be noted that the two studies use an optoelectronic measurement system to measure the kinematics of the upper body during manual wheelchair propulsion. These methods are considered multibody methods and have two major drawbacks: first, in wheelchairs, multiple contact exists between the user and the seat interface, which precludes any use of a regular Newton law as in gait analysis [17]; secondly, the methods are inapplicable outside the laboratory, since in general they necessitate a stationary ergometer. Moreover, none of these methods estimates the bilateral sagittal handrim moment of propulsion. The purpose of this study is to develop a new ambulatory local approach that uses one inertial measurement unit (IMU) sensor at each wrist level. The IMU can provide two inputs: the 3D linear acceleration and 3D angular velocity vectors. Traditional forecasting of time-series data used a block-oriented identification method such as ARIMA [18], which represents a linear approach and performs poorly when there is a non-linear relationship between input and output time series. A non-linear identification modeling approach such as Hammerstein–Wiener (HW) exists and has been used in the past to forecast time-series data and prove its superiority to ARIMA; however, it has never been used in wheelchair biomechanics [19]. The purpose of this study is to compare two approaches, namely, HW and BiLTSM, in the forecasting of the time series of reaction forces and moments acting at the handrim level during manual wheelchair propulsion.

2. Materials and Methods

2.1. Experimental Set-Up

Eleven healthy young subjects participated in this study. Their mean age, weight and height were equal to 27.3 (4.9) years, 73.0 (13.4) kg and 174.0 (7.3) cm. They were asked to propel a manual wheelchair (Ultralight Action A4, Invacare) at 1 m/s along 20 m in a linear direction towards a hallway (Figure 1). All subjects signed a consent form, which was approved by the ethical committee of the École de technologie supérieure (H20150508).
The wheelchair was equipped with two Smartwheels which measured the handrim reaction forces on the anteroposterior and vertical directions, as well as the moment reaction on the medial–lateral axis. The sampling frequency was fixed at 240 Hz. The Smartwheel software filtered the raw force and moment data with a 2nd-order low-pass Butterworth filter with a cut-off frequency of 30 Hz. During the propulsion, the Xsens System (Mvn Biomech, Xsens Inc., Henderson, NV, USA) was used to model the head, trunk and upper limb of the body, represented by 10 IMU sensors. A calibration procedure in sitting position, i.e., a T-pose, was made for each subject. The IMU data were first processed by the Xsens system (i.e., internal filtering algorithm using Kalman filter). Moreover, gravity was removed by the Xsens system following the estimation of the quaternion of each sensor in the reference system of the Xsens. The Xsens has a biomechanical model which aligns the sensor information with the human body. In this study, we use the only the norm of the linear acceleration and angular velocity vector for the left and right wrist joints. The sampling frequency of the Xsens was set at 120 Hz. A numerical synchronization was established by asking the subject to kick the handrim with their right hand at the beginning and the end of trial. These two events (Tc1 and Tc2) are easily distinguishable in the time series of force and hand acceleration (Figure 2).

2.2. Data Processing

A resampling method using the <resample> time-series function from MATLAB (R2019b) was used to down sample and synchronize the force and moment from the Smartwheel with respect to the IMU data without filtering the data. The sagittal moment Mz of the right and left sides was used to define the push cycle and to normalize the time of propulsion from 0 to 100%. However, for the identification process, a 20% extra signal for each side of the normalized push cycle was also used. In this case, the total length of each cycle was around 140%. For each push cycle, we normalized the magnitude of the moment and forces acting at the handrim, as measured by the Smartwheel, by their respective rms (root mean square) cycle value; this helps to keep the moment Mz fluctuating around an average value of 2.5 during wheelchair propulsion. This normalization technique is more consistent that the one using maximal value in each cycle.

2.3. Non-Linear Hammerstein–Wiener Modeling Approach

In each trial, between 30 and 38 steady-state push cycles were obtained for each subject. The HW model consist of 3 time-series inputs, namely, the norm of the linear acceleration of the wrist joint, the norm of the angular velocity of the wrist joint as well as the average normalized pattern of the force/moment. These 3-time series are considered as an input to the HW approach, whereas the output is the actual measured normalized force or moment. Figure 3 shows a SISO system, which consists of 3 blocs (NLN), i.e., non-linear followed by a linear and followed again by a non-linear bloc. Meanwhile, Figure 4 shows a MISO approach, i.e., a combination of three SISO systems in one MISO system which consists of 4 non-linear blocs and 3 linear blocs. There are a variety of possible non-linear blocs [20,21]. In this study, piece-wise non-linear blocs of the 4th order were chosen. This means that each non-linear bloc has 4 parameters to be determined. The linear blocs consisted of number of poles and zeros which represent the transfer function in the z transform domain. In this study, for each linear bloc we vary the number of poles from 1 to 6 and consequently the numbers of zeros from 1 to n − 1, where n is the number of poles. Fifteen cycles of one subject were used to train and identify the Hammerstein–Wiener model in order to define the best architecture of the linear blocs’ transfer function using the prediction error minimization, and the rest of the cycles (thirty) were used to test the prediction of the model.
For each number of poles varying from n = 6 to 1 there corresponds a number of zeros from n − 1 to 1. In this case, for example, the predicted moment Mz was assessed using 9261 combination models for the identification process. From this, we kept the 111 combination models of poles and zeros that gave the best results. The total number of non-linear parameters is 16 (4 blocs with 4 orders) and the total of number of linear parameters is higher, at 33 (i.e., 3 * (6poles + 5 zeros). Since there was a lot of combination, we repeated this process until we found the best combination for our typical subject. As an example, the following linear transfer function was found for the moment Mz output, where H1(z) (2 zeros, 5 poles) corresponds to the input linear acceleration, H2(z) (5 zeros, 6 poles) corresponds to the angular velocity and H3(z) (2 zeros, 5 poles) corresponds to the generic normalized pattern of Mz:
H 1 z = 0.60 1 0.86 z 1 1 0.86 z 1 1 + 0.83 z 1 1 + 0.22 z 1 1 0.09 z 1 1 1.97 z 1 + 0.97 z 2
H 2 z = 0.11 1 0.98 z 1 1 1.99 z 1 + 0.99 z 2 1 1.83 z 1 + 0.85 z 2 1 0.33 z 1 1 0.15 z 1 1 1.96 z 1 + 0.98 z 2 1 1.99 z 1 + z 2
H 3 z = 0.50 1 1.99 z 1 + 1.00 z 2 1 1.83 z 1 + 0.85 z 2 1 0.36 z 1 1 1.99 z 1 + 0.99 z 2 1 + 0.54 z 1 + 0.63 z 2
Knowing the number of poles and zeros for the best linear combination, this architecture was applied for each subject. Each combination takes 167.64 s to process. It took almost 18 days to process all of the models.

2.4. Neural Network Long-Short Term Memory (LSTM) Approach

After using the H-W model, we decided to compare it with a deep learning method. The recurrent neural network “Long Short-Term Memory”, considered most suited for time-series data, was chosen [22]. The BiLSTM neural network that goes both forward and backward through data gave better result than simple LSTM to predict the handrim moments and forces [23]. The input data consist of only 2 time series, namely, the norm of linear acceleration and the norm of angular acceleration, and the output is the corresponding force or moment measured time series.
In this method, one subject was used as the test subject each time (i.e., leave one out). The rest of the data were separated between training and validation data in an 80% to 20% ratio. This separation was made to maintain maximum peak homogeneity between training and validation. The limited data of 11 subjects made the use of all subjects for the validation of data ineffective in our study. The validation of data was used to make sure the training process was successful by comparing the RMSE and Loss of the training and validation data. Figure 5 shows a successful training with both training and validation data.
When compared to the Hammerstein–Wiener modeling approach, the BiLSTM model did not need any specific pattern as input and used only the norm of the linear acceleration vector and the norm of the angular velocity vector as input. These inputs were normalized with the same RMS method as in the H-W model. Figure 6 shows the complete recurrent neural network model. The “Sequence Input Layer” adapts input data for 3 BiLSTM layers of 400 hidden units followed by a fully connected layer to predict our data.
The training process took almost 16 min with the following computer configuration: an Intel Core vPro i9 processer associated with an Nvidia RTX A4000 GPU graphic card. The process adjusted the layers to have the optimal prediction. The training process had 300 epochs that provided a high performance/speed ratio in training, meaning that the training uses all the data 300 times. This model was trained 13 times, leaving each subject out of training once with the LOSO method. The measured and the predicted outputs were finally compared together in each test.

2.5. Statistical Analysis

To compare the predicted value with respect to the measured one, the RMS value of the predicted and measured variables was assessed. A Bland–Altman graphical figure was computed to assess the limit of agreement between the predicted and the measured variables [24]. Moreover, an analysis of variance (Anova) was conducted on the peak level on the right and left sides for each dependent variable Fx, Fy and Mz to test the statistical difference between the measured and the predicted variables. The MAE and RMSE values were also assessed.

3. Results

3.1. Non-Linear Hammerstein–Wiener Modeling Approach

Figure 7 exhibits typical input time-series data for the linear acceleration and angular velocity of the right hand of a typical subject (S008) during the manual wheelchair propulsion cycle. The timing of Figure 7 represents 38 cycles, and the average value for the linear acceleration of the right hand was equal to 7.89 (+/−5.12) m/s2, whereas the maximal value reached 52.13 m/s2. The mean average angular velocity reaches the value of 2.98 (+/−1.18) rad/s. The maximal value of angular velocity was equal to 9.75 rad/s.
Figure 8 shows the results obtained for a typical subject (S008) for the right and left sides. The predicted and the measured time-series signals follow in general the same pattern using the H-W modeling approach. It is noteworthy that even the 20% periods that precede and follow the push phase have been well predicted.
Table 1 shows the results of the prediction throughout the continuous cycle for the 11 subjects. It shows for each dependent variable the RMSE as well as the MAE for the left and right sides. For the Fx component, the mean RMSE varies from 5.6 to 5.7 N for left and right side, respectively. The mean MAE for FX is lower (4.4 and 4.2 N). The vertical force direction exhibits a slightly higher value for the RMSE (9.4 and 9.7 N), and 7.5 to 7.6 N for the MAE. The sagittal moment exhibits lower value for RMSE and MAE also (1 to 1.1 Nm). In general, the right and left side look similar with regard to the prediction accuracy.
Figure 9 shows the Bland–Altman graph for the peak value in the horizontal force direction. All of the subjects are within the limit of agreement. However, we note a small but a significant difference in bias for the right-hand propulsion.
Figure 10 shows the results of the vertical direction and that all subjects belonged to the interval of the limit of agreement with a non-significant bias.
The Bland–Altman graph in Figure 11 shows that all of the subjects (except one) belonged to the interval of limit of agreement with no significant differences in the bias between the measured and predicted sagittal moments.

3.2. Recurrent Neural Network: Bi-Long Short-Term Memory (BiLSTM) Approach

Figure 12 shows the mean result obtain for the BiLSTM prediction of all subjects on the right and left sides. The pattern of the measured and predicted time series follows the same path. There was even a good prediction before and after the push phase.
Table 2 shows the average value of RMSE and MAE of the BiLSTM prediction for twelve subjects. The average RMSE of the horizontal force on the right side varies from 4.4 N to 14.0 N and the MAE from 3.6 N to 11.2 N. The mean RMSE and MAE are, respectively, 7.4 N and 6.1 N. On the left side, the RMSE varies from 3.7 N to 11.4 N and the MAE from 3.0 N to 10.9 N. The mean RMSE and MAE are, respectively, 7.3 N and 6.1 N. The difference between the mean RMSE and MAE on each side is close zero, so the prediction is evenly effective on the right and left sides. For the vertical force, the average RMSE on the right side varies from 5.1 N to 10.1 N and the MAE from 4.1 N to 8.0 N. The mean RMSE and MAE are 7.5 N and 5.8 N. On the left side, the RMSE varies from 5.4 N to 10.9 N and the MAE from 4.6 N to 8.8 N. The mean RMSE and MAE are, respectively, 7.6 N and 5.9 N. The sagittal moment has an average RMSE value on the right side which varies between 0.9 N.m and 1.6 N.m and the MAE between 0.7 N.m and 1.2 N.m. On the left side, the RMSE varies between 0.9 N.m and 1.5 N.m and the MAE between 0.9 N.m and 1.5 N.m. On both sides, the mean RMSE is 1.2 N.m and the mean MAE is 0.99 N.m. No difference was shown in the mean value errors between sides.
For all forces and moments, the difference in the mean RMSE and MAE on the right and left sides are very close, so the prediction of these forces and moments are evenly effective on each side.

4. Discussion

The purpose of this paper was to predict handrim reaction forces and moments during linear wheelchair propulsion using only one IMU sensor per hand. It is noteworthy to see that there are few studies that concern this issue in comparison to the standard form of gait locomotion. Our results indicate that the methods proposed here, i.e., the identification of the process and the use of BiLSTM, have a high accuracy when compared to earlier studies [9,11]. In fact, the identification method shows a mean average error (MAE) in the horizontal direction of around 4.5 and 5.7 N for left and right handrims, respectively, 0.2 N and 1.7 N smaller than the BiLSTM model. The vertical direction has a slightly higher value, i.e., 9.0 and 9.3 N for left and right sides (identification process). This represents values 3.4 N and 4.2 N higher than the MAE obtained with the BiLSTM model. In terms of the sagittal moment acting at the handrim hub, the MAE was 1.1 and 1.2 N.m for left and right sides, respectively, 0.2 N.m and 0.1 N.m higher than that of the BiLSTM model. However, to the knowledge of the authors, no data have predicted the sagittal moment either in study [14] or study [16]. BiLSTM has better prediction for data with less variability in their pattern, like the sagittal moment and the vertical direction.
The statistical analysis in our studies was based merely on Bland–Altman analysis as well as Anova analysis. For the BiLSTM model, the horizontal direction revealed a significant negative bias at the peak level of 2.2 N (p < 0.01) with respect to the Smartwheel. Meanwhile, for the right side the negative bias of 2.4 N (p > 0.05) was found non-significant. The value of the bias is considered small and negligible in this study since the peak value in the horizontal direction can reach 60 N. The vertical direction reveals some bias of 2.0 N and 0.35 N for the right and the left sides at the peak value level. These two biases, however, were found statistically non-significant. During the linear propulsion, the MAE of the peak moment was found to be 1.1 to 1.2 N.m for the right and left levels. The bias found using the Bland–Altman graph was equal to 0.31 N.m and 0.15 N.m for the right and left sides. These biases were found non-significant. In general, and for all the subjects except one, the results indicate an agreement between the measured and the predicted force and moment, since the limit of agreement is larger and includes all of the data. Our bias is lower than the one found in study [25], in which the agreement between the Smartwheel instrumentation and the instrumented split-belt treadmill was around 0.51 N.m for the average moment and 0.71 N.m for the peak moment.
Our method has the advantages of minimal configuration, i.e., it necessitates only two IMU sensors that can be affixed onto the hand or wrist joint. The fact that the earlier methods were not be able to reach high accuracy resides in the fact that multibody systems with many contacts such as a seat, backrest and legrest are more difficult to model in practice [17]. Our proposal is to be close to the contact level of the handrim, i.e., hand or wrist joint. In this way, the dynamic system of order six was sufficient to find a non-linear transfer function between three inputs, namely, the linear resultant acceleration of the hand, the angular velocity resultant as well as the normalized pattern of the forces or the moment, and the output are the forces and the sagittal moment. The purpose of the normalized generic pattern of the force and the moment is that it has a modulator effect on the actual kinematic input by the subject. Moreover, our method necessitates only 15 push cycles to identify (i.e., to learn) the dynamic process. The linear and non-linear functions found by the H-W approach are actually used a at the right and left sides and for all the subjects. The same transfer function was able to be applied to all subjects. On the other hand, our study also shows that the recurrent neural network BiLSTM is a great alternative to the non-linear transfer function method and does not need the generic normalized pattern to be performed. The method to use can be chosen depending on the variability between the predicted patterns.
This study, however, is limited to straightforward propulsion, i.e., in the linear direction; we did not assess a curvi-linear or slope path. Moreover, the wheel camber in this study was fixed to zero, i.e., the inplane of the smartwheel is the vertical plane. In many wheelchairs, such as those dedicated to spinal cord injury and for sport activity, the camber is important. The subjects that participated in this study were young and healthy, i.e., non-wheelchair users [26]. The generalization of this method to wheelchair users such as those with spinal cord injury should be carried out in a future study. Another aspect about the normalization used in this study is that the rms of the cycle was used as a base and the use of this base explicitly for the HW method is considered a limitation. The generic pattern is also a limitation of the HW method. Future work should be carried out to understand how to deformalize the time-series signal after the prediction process.
In conclusion, this paper presents two methods based on a block-oriented non-linear identification process, namely the Hammerstein–Wiener modeling approach and a recurrent neural network based on the BiLSTM architecture. Both methods provide accurate results; however, the HW method, for instance, necessitates knowledge of the generic pattern.

Author Contributions

Conceptualization, R.A.; methodology, A.D.L. and A.F.; software, A.D.L. and A.F.; validation, R.A. and F.C.; formal analysis, R.A. and F.C.; investigation, R.A.; resources, R.A.; data curation, R.A.; writing—original draft preparation, R.A.; writing—review and editing, R.A., A.D.L., A.F. and F.C.; visualization, A.D.L. and A.F.; supervision, R.A.; project administration, R.A.; funding acquisition, R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by the NSERC (Natural Science & Engineering Council of Canada) (RGPIN/4824-2018).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by Ethics Committee of École de technologie supérieure of Montreal (Canada).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Eriks-Hoogland, I.E.; Hoekstra, T.; de Groot, S.; Stucki, G.; Post, M.W.; van der Woude, L.H. Trajectories of musculoskeletal shoulder pain after spinal cord injury: Identification and predictors. J. Spinal. Cord. Med. 2014, 37, 288–298. [Google Scholar] [CrossRef] [PubMed]
  2. Veeger, H.E.; Rozendaal, L.A.; van der Helm, F.C. Load on the shoulder in low intensity wheelchair propulsion. Clin. Biomech. 2002, 17, 211–218. [Google Scholar] [CrossRef] [PubMed]
  3. van Drongelen, S.; van der Woude, L.H.V.; Veeger, H.E.J. Load on the shoulder complex during wheelchair propulsion and weight relief lifting. Clin. Biomech. 2011, 26, 452–457. [Google Scholar] [CrossRef] [PubMed]
  4. Mercer, J.L.; Boninger, M.L.; Koontz, A.; Ren, D.; Dyson-Hudson, T.; Cooper, R.A. Shoulder joint kinetics and pathology in manual wheelchair users. Clin. Biomech. 2006, 21, 781–789. [Google Scholar] [CrossRef]
  5. Cooper, R.A.; Boninger, M.L.; Shimada, S.D.; Lawrence, B.M. Glenohumeral joint kinematics and kinetics for three coordinate system representations during wheelchair propulsion. Amer. J. Phys. Med. Rehab. 1999, 78, 435–446. [Google Scholar] [CrossRef]
  6. Aissaoui, R.; Gagnon, D. Effect of Haptic Training During Manual Wheelchair Propulsion on Shoulder Joint Reaction Moments. Front. Rehabilit. Sci. 2022, 3, 827534. [Google Scholar] [CrossRef]
  7. Westerhoff, P.; Graichen, F.; Bender, A.; Halder, A.; Beier, A.; Rohlmann, A.; Bergmann, G. Measurement of shoulder joint loads during wheelchair propulsion measured in vivo. Clin. Biomech. 2011, 26, 982–989. [Google Scholar] [CrossRef]
  8. Ancillao, A.; Tedesco, S.; Barton, J.; O’Flynn, B. Indirect measurement of ground reaction forces and moments by means of wearable inertial sensors: A systematic review. Sensors 2018, 18, 2564. [Google Scholar] [CrossRef]
  9. Ren, L.; Jones, R.K.; Howard, D. Whole body inverse dynamics over a complete gait cycle based only on measured kinematics. J. Biomech. 2008, 41, 2750–2759. [Google Scholar] [CrossRef]
  10. Tanghe, K.; Afschrift, M.; Jonkers, I.; De Groote, F.; De Schutter, J.; Aertbeliën, E. A probabilistic method to estimate gait kinetics in the absence of ground reaction force measurements. J. Biomech. 2019, 96, 109327. [Google Scholar] [CrossRef]
  11. Mullera, A.; Pontonnier, C.; Robert-Lachaine, X.; Dumont, G.; Plamondon, A. Motion-based prediction of external forces and moments and back loading during manual material handling tasks. Appl. Ergon. 2020, 82, 102935. [Google Scholar] [CrossRef] [PubMed]
  12. Neugebauer, J.M.; Collins, K.H.; Hawkins, D.A. Ground Reaction Force Estimates from ActiGraph GT3X+ Hip Accelerations. PLoS ONE 2014, 9, e99023. [Google Scholar] [CrossRef] [PubMed]
  13. Kim, J.; Kang, H.; Lee, S.; Choi, J.; Tack, G. A Deep Learning Model for 3D Ground Reaction Force Estimation Using Shoes with Three Uniaxial Load Cells. Sensors 2023, 23, 3428. [Google Scholar] [CrossRef] [PubMed]
  14. Lin, C.J.; Lin, P.C.; Guo, L.Y.; Su, F.C. Prediction of applied forces in handrim wheelchair propulsion. J. Biomech. 2011, 44, 455–460. [Google Scholar] [CrossRef] [PubMed]
  15. Chenier, F.; Aissaoui, R. Predicting the sequence of mean propulsion forces during indoor wheelchair sports: A proof of concept. In Proceedings of the 35th Conference of the International Society of Biomechanics in Sports, Cologne, Germany, 14–18 June 2017; pp. 694–697. [Google Scholar]
  16. Hernandez, V.; Rezzoug, N.; Gorce, P.; Venture, G. Wheelchair propulsion: Force orientation and amplitude prediction with recurrent neural network. J. Biomech. 2018, 78, 166–171. [Google Scholar] [CrossRef] [PubMed]
  17. Pham, T.-H.; Caron, S.; Kheddar, A. Multicontact interaction force sensing from whole-body motion capture. IEEE Trans. Indust. Inform. 2018, 14, 2343–2352. [Google Scholar] [CrossRef]
  18. Siami-Namini, S.; Tavakoli, N.; Siami Namin, A. The Performance of LSTM and BiLSTM in Forecasting Time Series. In Proceedings of the IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 9–12 December 2019; pp. 3285–3292. [Google Scholar]
  19. Zhu, Y. Estimation of an N–L–N Hammerstein–Wiener model. Automatica 2002, 38, 1607–1614. [Google Scholar] [CrossRef]
  20. Shaikh, A.-H.; Barbé, K. Wiener–Hammerstein System Identification: A Fast Approach Through Spearman Correlation. IEEE Trans. Instrum. Meas. 2019, 68, 1628–1636. [Google Scholar] [CrossRef]
  21. Schoukens, M.; Tiels, K. Identification of block-oriented nonlinear systems starting from linear approximations: A survey. Automatica 2017, 85, 272–292. [Google Scholar] [CrossRef]
  22. de Vries, W.H.K.; Amrein, S.; Arnet, U.; Mayrhuber, L.; Ehrmann, C.; Veeger, H.E.J. Classification of Wheelchair Related Shoulder Loading Activities from Wearable Sensor Data: A Machine Learning Approach. Sensors 2002, 19, 7404. [Google Scholar] [CrossRef]
  23. Liu, D.; Jeong, H.; Wei, A.; Kapila, V. Bidirectional LSTM-based Network for Fall Prediction in a Humanoid. In Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Abu Dhabi, United Arab Emirates, 4–6 November 2020; pp. 129–135. [Google Scholar] [CrossRef]
  24. Bland, J.M.; Altman, D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 327, 307–310. [Google Scholar] [CrossRef]
  25. Gagnon, D.H.; Jouval, C.; Chénier, F. Estimating pushrim temporal and kinetic measures using an instrumented treadmill during wheelchair propulsion: A concurrent validity study. J. Biomech. 2016, 49, 1976–1982. [Google Scholar] [CrossRef] [PubMed]
  26. Consortium for Spinal Cord Medicine. Preservation of upper limb function following spinal cord injury: A clinical practice guideline for health-care professionals. J. Spinal. Cord. Med. 2005, 28, 434–470. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Image of real hallway at ÉTS.
Figure 1. Image of real hallway at ÉTS.
Sensors 24 06307 g001
Figure 2. (A) Norm of the vector of reaction forces in (N); (B) norm of the vector of linear hand acceleration in (m/s2) during the 20 m propulsion. Tc1 and Tc2 correspond to the instant where the hand is kicking the handrim of the Smartwheel. These two events correspond to the beginning and the end of each trial.
Figure 2. (A) Norm of the vector of reaction forces in (N); (B) norm of the vector of linear hand acceleration in (m/s2) during the 20 m propulsion. Tc1 and Tc2 correspond to the instant where the hand is kicking the handrim of the Smartwheel. These two events correspond to the beginning and the end of each trial.
Sensors 24 06307 g002
Figure 3. A SISO (single-input, single-output) H-W system which relates the input variable u(t) to the output variable y(t).
Figure 3. A SISO (single-input, single-output) H-W system which relates the input variable u(t) to the output variable y(t).
Sensors 24 06307 g003
Figure 4. A general MISO H-W modeling approach.
Figure 4. A general MISO H-W modeling approach.
Sensors 24 06307 g004
Figure 5. A successful BiLSTM training on MatLab.
Figure 5. A successful BiLSTM training on MatLab.
Sensors 24 06307 g005
Figure 6. Our BiLSTM neural network model. The input corresponds to a vector of linear acceleration (A) and angular velocity vector (W). The output corresponds to the predicted forces (Fx, Fy) as well as the predicted moment (Mz).
Figure 6. Our BiLSTM neural network model. The input corresponds to a vector of linear acceleration (A) and angular velocity vector (W). The output corresponds to the predicted forces (Fx, Fy) as well as the predicted moment (Mz).
Sensors 24 06307 g006
Figure 7. Typical input time-series data of linear acceleration (Top) and angular velocity (Bottom) during manual propulsion. The horizontal bar represents the frame and indicates 38 consecutives cycles of propulsions. The vertical bar indicates the beginning and end of the propulsion cycle period.
Figure 7. Typical input time-series data of linear acceleration (Top) and angular velocity (Bottom) during manual propulsion. The horizontal bar represents the frame and indicates 38 consecutives cycles of propulsions. The vertical bar indicates the beginning and end of the propulsion cycle period.
Sensors 24 06307 g007
Figure 8. Prediction of horizontal forces Fx (Top), vertical forces Fy (middle), and sagittal moment (Bottom). Left column represents the right hand and the right column represents the left hand. Blue line represents the measured signal. Red Line represents predicted signal.
Figure 8. Prediction of horizontal forces Fx (Top), vertical forces Fy (middle), and sagittal moment (Bottom). Left column represents the right hand and the right column represents the left hand. Blue line represents the measured signal. Red Line represents predicted signal.
Sensors 24 06307 g008
Figure 9. Bland–Altman graph of peak value for Fx for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Figure 9. Bland–Altman graph of peak value for Fx for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Sensors 24 06307 g009
Figure 10. Bland–Altman graph of peak value for Fy for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Figure 10. Bland–Altman graph of peak value for Fy for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Sensors 24 06307 g010
Figure 11. Bland–Altman graph of peak value for Mz for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Figure 11. Bland–Altman graph of peak value for Mz for right hand (left column) and left hand (right column). Solid line represents the bias, whereas the dotted line represents the limit of agreement.
Sensors 24 06307 g011
Figure 12. Prediction of horizontal and vertical forces and sagittal moments on the right and left sides using the BiLSTM approach. (The dotted line represents +/− the standard deviation). Blue line represents the measured signal. Red Line represents predicted signal.
Figure 12. Prediction of horizontal and vertical forces and sagittal moments on the right and left sides using the BiLSTM approach. (The dotted line represents +/− the standard deviation). Blue line represents the measured signal. Red Line represents predicted signal.
Sensors 24 06307 g012
Table 1. RMSE and MAE value for the Fx and Fy and Mz values throughout the propulsion cycle for the HW modeling approach.
Table 1. RMSE and MAE value for the Fx and Fy and Mz values throughout the propulsion cycle for the HW modeling approach.
SubjectVariable
Fx (N)Fy (N)Mz (N.m)
RMSEMAERMSEMAERMSEMAE
RightLeftRightLeftRightLeftRightLeftRightLeftRightLeft
14.54.73.53.89.56.87.55.51.20.80.90.7
25.03.74.32.88.98.66.96.71.10.80.80.6
34.43.83.22.97.410.45.88.11.11.00.80.8
45.04.14.13.09.67.77.86.20.81.10.60.9
57.46.95.75.39.511.37.29.11.61.41.41.1
64.76.13.85.010.511.98.58.81.61.41.31.2
73.76.33.01.35.67.94.56.10.91,60.71.3
86.74.35.33.37.26.65.85.41.31.31.01.1
96.17.05.05.410.713.88.610.72.22.71.82.2
107.96.55.95.215.713.712.710.91.71.81.41.5
115.89.74.68.39.48.17.76.51.31.21.00.9
Mean5.65.74.44.29.49.77.57.61.31.31.01.1
Table 2. RMSE and MAE values for the Fx and Fy and Mz values throughout the propulsion cycle for the BiLSTM modeling approach.
Table 2. RMSE and MAE values for the Fx and Fy and Mz values throughout the propulsion cycle for the BiLSTM modeling approach.
SubjectVariable
Fx (N)Fy (N)Mz (N.m)
RMSEMAERMSEMAERMSEMAE
RightLeftRightLeftRightLeftRightLeftRightLeftRightLeft
14.46.13.65.175.85.64.61.210.90.8
264.553.866.44.64.90.90.90.70.7
38.93.77.335.67.14.25.30.910.70.8
45.65.34.84.29.67.77.65.90.910.70.8
512.312.79.710.97.17.25.45.71.61.51.21.2
67.210.35.98.76.99.25.57.41.51.51.21.2
77.36.665.58.29.16.47.21.31.51.11.1
84.85.53.94.65.15.44.14.30.90.90.70.7
9145.711.24.610.110.988.81.41.51.11.2
105.69.14.77.77.86.56.25.21.31.411.1
115.911.44.69.28.88.26.76.41.41.31.11.1
Mean7.47.36.16.17.57.65.85.91.21.20.990.99
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aissaoui, R.; De Lutiis, A.; Feghoul, A.; Chénier, F. Handrim Reaction Force and Moment Assessment Using a Minimal IMU Configuration and Non-Linear Modeling Approach during Manual Wheelchair Propulsion. Sensors 2024, 24, 6307. https://doi.org/10.3390/s24196307

AMA Style

Aissaoui R, De Lutiis A, Feghoul A, Chénier F. Handrim Reaction Force and Moment Assessment Using a Minimal IMU Configuration and Non-Linear Modeling Approach during Manual Wheelchair Propulsion. Sensors. 2024; 24(19):6307. https://doi.org/10.3390/s24196307

Chicago/Turabian Style

Aissaoui, Rachid, Amaury De Lutiis, Aiman Feghoul, and Félix Chénier. 2024. "Handrim Reaction Force and Moment Assessment Using a Minimal IMU Configuration and Non-Linear Modeling Approach during Manual Wheelchair Propulsion" Sensors 24, no. 19: 6307. https://doi.org/10.3390/s24196307

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop