Next Article in Journal
High Sensitivity Refractive Index Sensor Based on the Excitation of Long-Range Surface Plasmon Polaritons in H-Shaped Optical Fiber
Next Article in Special Issue
Wearable Inertial Sensors to Assess Gait during the 6-Minute Walk Test: A Systematic Review
Previous Article in Journal
Influence of Rotor Dynamic Scattering on Helicopter Radar Cross-Section
Previous Article in Special Issue
Racquet Sports Recognition Using a Hybrid Clustering Model Learned from Integrated Wearable Sensor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Canoeing Motion Tracking and Analysis via Multi-Sensors Fusion

1
The Laboratory of Intelligent System, Dalian University of Technology, Dalian 116024, China
2
Department of Electrical & Information Engineering, Dalian Neusoft Institute of Information, Dalian 116023, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(7), 2110; https://doi.org/10.3390/s20072110
Submission received: 18 February 2020 / Revised: 1 April 2020 / Accepted: 6 April 2020 / Published: 8 April 2020
(This article belongs to the Special Issue Human and Animal Motion Tracking Using Inertial Sensors)

Abstract

:
Coaches and athletes are constantly seeking novel training methodologies in an attempt to improve athletic performance. This paper proposes a method of rowing sport capture and analysis based on Inertial Measurement Units (IMUs). A canoeist’s motion was collected by multiple miniature inertial sensor nodes. The gradient descent method was used to fuse data and obtain the canoeist’s attitude information after sensor calibration, and then the motions of canoeist’s actions were reconstructed. Stroke quality was performed based on the estimated joint angles. Machine learning algorithm was used as the classification method to divide the stroke cycle into different phases, including propulsion-phase and recovery-phase, a quantitative kinematic analysis was carried out. Experiments conducted in this paper demonstrated that our method possesses the capacity to reveal the similarities and differences between novice and coach, the whole process of canoeist’s motions can be analyzed with satisfactory accuracy validated by videography method. It can provide quantitative data for coaches or athletes, which can be used to improve the skills of rowers.

1. Introduction

Rowing, combining wonderful spectacle with heated competition, has become a popular international sport. Sport organizations including professional clubs or nation sport institutions have tried to gain the winning edge through incremental improvement by means of effective and scientific auxiliary training methods for athletes. The behavior of athletes in rowing can be influenced by multiple factors including psychological quality and mentality, physical strength or fitness, technique proficiency level, and so on. Among these factors, the competitive level of athletes plays an important role. In rowing training and competition, the athletes’ competitive level is defined as the standardization and repeatability of stroke action, an efficient and consistent stroke is necessary for achieving a good rowing performance. In the rowing sport of single canoe, the stroke quality, including stroke length, stroke rate, stroke rate variance, propulsion/recovery phase ration, and rhythm is the most vital performance indicator of rower skill proficiency. Stroke quality has been extensively studied by scientist to offer advices for the improvement of athletic performance.
Among the methods being used to analyze the rower’s stroke quality, a video-based method has been adopted in the literature [1,2,3]. Motion detection is limited by the installation conditions of the monitoring device. Only through a specific angle and position to shoot video, will there be occlusion of line of sight and limited shooting angle in the motion. Recent technological development has made miniature inertial devices widely available. McDonnell et al. used inertial sensors attached to the kayak and paddle to capture stroke period and specific signal peak values [4]. Gomes et al. used a 9-degrees-of-freedom IMU mounted on the paddle to analyze the inter-stroke intervals of individual kayakers [5]. However, previous studies mainly focused on measuring stroke quality by mean of equipment, and less attention has been paid to the athlete. Rowing is a coordinated action and involves several muscle groups, it occurs mainly by flexion extension movements, with abduction movement for both limbs, paddling movement only results from the combined effect of the above factors [6,7].
The angles of knees, elbows, waists, and necks are the principal kinematic analysis subjects of individual rower, which were widely studied. Llosa, Mpimis et al. used goniometers to measure the rower’s flexion and extension angles of the elbows [8,9], but it is not suitable to describe rotation motion of the athlete’s limbs and trunk. Said et al. used inclinometers and trigonometric calculations to get the rower’s joint angles variation under simulated conditions [10]. However, the scope of human activities is limited, which is constrained within relatively tight bounds. Wang et al. used IMUs mounted on the canoeist body to capture his motion data, only the stroke phases have been studied [11]. Most studies are limited by the fact that the systematic and quantitative analysis of canoeing sport based on joint movement is relatively not sufficient.
To conduct kinematic analysis on canoeing sport, a method of rowing sport capture and analysis based on IMUs is proposed. For our analysis, the body is considered to be a set of rigid body model, including multiple segments with custom lengths, the adjoining segments are connected by frictionless variable degrees of freedom joints. Singularity-free unit quaternion was used to represent each body segment’s orientation, the joint angles of body parts flexion extension movements were obtained by quaternion operation. The main contributions of this work are as follows.
  • Use the gradient descent method to fuse the inertial sensor data, obtain the real-time attitude of rower and capture the motion of athletes with different skill levels under realistic conditions
  • The effectiveness and accuracy of proposed attitude estimation algorithm have been verified through optical motion capture system
  • Kinematic analysis has been applied to the rowers with different skill levels from statistical perspective, and machine learning algorithm is used to discriminate different proficiency level athletes
The article is structured as follows. Section 2 introduces the hardware and software platform. The experimental methodology is described in Section 3. The algorithm verification results are given in Section 4. The discussion of this study is described in Section 5. Finally, conclusions are given in Section 6.

2. System Platform and Data Acquisition

In this article, the motion capturing system is developed by the laboratory of intelligent system of Dalian University of Technology. It consists of several tiny sensor nodes, one transceiver and a set of personal computer (PC) software as shown in Figure 1. Each node contains a MEMS inertial sensor, the device parameters are depicted in Table 1. The new STM32 XL density devices were used as a micro controller chip to receive data from the sensor nodes, and a trans-flash memory card was used to store raw data.
Lora wireless communication is used between slave sensor nodes and the master transceiver. Once the slave nodes receive the start signal from the master unit, they record motion information of rowers and store them into the nonvolatile memory card with the filesystem immediately, the self-made measurement system could be set to high sampling frequency (up to 800 Hz). Figure 2 shows the data-acquisition mode. To validate the proposed algorithm accuracy and check the performance of the self-designed system, simultaneous measurements of joint angle were needed to compare with the high-speed motion camera.
In this study, six participants including two coaches and four novices take part in preliminary studies. They come from the provincial sprint team, and the four novices have more than one year of training experience.They trained for 25 to 30 h a week. They have an average weight of 70 ± 10 kg and height of 1.70 ± 0.10 m. All the participants were fully informed, and consent was obtained. The experimental site was located in the Athletic Training Center, Dalian, Liaoning, China (latitude N 121°25.539′ and longitude E 38°92.963′). During the experiment, miniature sensor nodes were placed on the surface of the canoeist’s body.

3. Methods

3.1. Overall System Architecture

The athlete’s body is defined as rigid structure based on human anatomy theory, the skeletal structure consists of at most seventeen segments as shown in Figure 3a, and the length of every segment can be defined manually with the height of participants. The nine-degrees-of-freedom inertial sensor nodes are placed on the corresponding limb segment, which is used to obtain the raw acceleration, gyroscope and magnetometer information during data acquisition process. The specific locations of the sensor data sampling points are shown in Figure 3b.
As shown in Figure 4a, the whole system contains three coordinate systems, and each three-dimensional coordinate system is based on standard right-handed 3-D Cartesian coordinate system [12]. The details are as follows:
  • Ground Coordinate System (GCS): It is the navigation coordinate system and complies with the laws of east, north and up (ENU). The Y-axis corresponds to North and the X-axis corresponds to East. This makes the scene an “East North Up” (ENU) coordinate system.
  • Sensor Coordinate System (SCS): It is defined as the coordinate of sensor nodes placed on the body.
  • Body Coordinate System (BCS): The X-axis is perpendicular to the body surface, pointing outward, and the Y and Z axes are orthometric to the X-axis. The BCS is based on the right-hand rule.
The skeletal part of our model has 17 rigid links, including trunk (head, arms, and torso) and thigh, shank, and foot of bilateral lower limbs. Elbow, knee, and ankle were allowed free movement. The joint angle definitions are provided in Figure 4b. In this way, the increase of joint angle corresponds to joint flexion, and vice versa. Rowing movement occurs mainly by joint flexion, we defined the joint angles as shoulder flexion angle (SF), elbow flexion angle (EF), knee flexion angle (KF) and foot flexion angle (FF) [12]. In this paper, we mainly focus on the movement of the upper limbs [13].
At the beginning of the motion capturing process, the magnetometer needs to be calibrated because of soft iron distortion and hard iron distortion in the surrounding environment. Hard-iron distortion originates mostly from permanent magnet and magnetized metal, soft-iron distortion is the result of material that influences, or distorts, a magnetic field-but does not necessarily generate a magnetic field itself, and is therefore not additive. Ellipsoid fitting method is adopted in this paper to eliminate ferromagnetic interference, and the soft iron is relatively small and is negligible [14]. The ellipsoidal fitting results are shown in Figure 5.
At the end of sensor signal preprocessing, gradient descent method was used to fuse multi-sensor data. The pelvis was set as a reference point, each segment attitude could be calculated through multiple iterative loop from the initial state based on quaternion rotation and translation. The joint angles (foot, knee, shoulder, elbow) were computed from the elevation angle of adjacent segments. Then we can analyze the canoeist stroke quality under different skill proficiency level and improve their athletic performance via quantitative analysis. A more detailed description of the overall algorithmic steps and their implementation is given in subsequent sections. Figure 6 shows the schematic overview of the proposed method. When only upper or lower limb activities are discussed, the body model and iteration operation can be simplified and it is feasible to merely consider active segments parts.

3.2. Motion State Update Based on Quaternion Method

To avoid gimbal lock, quaternion is used to describe the body segment orientation in this paper, it has the following form as shown below, where i, j, and k are the standard orthonormal basis represented by unit vectors in 3D space.
q = q 0 , q 1 i , q 2 j , q 3 k .
In the initial stage, the canoeists were required to stand with arms down for set interval time, the action duration depended on time-series length used in the initial stage, so the coordinate system BCS is overlapped with the coordinate system GCS. The initial quaternion rotation from SCS to BCS is similar to the quaternion from SCS to GCS. That is, q S , i n i t B q S , i n i t G . The q S , i n i t G can be obtained by magnetometer and accelerometer measurement value according to [15]. Because the sensors were tied on the body surface in a fixed position, q S B is equal to approximately q S , i n i t B . The initial quaternion q B , i n i t G can be obtained from the following formula, where ∗ denotes the conjugate matrix.
q B , i n i t G = q S , i n i t G ( q S B ) * = q S , i n i t G q B S .
During the process of motion capture, if the quaternion of sensor node in GCS is known, the rotation of each limb segment at any given instant could be obtained from the previous time point based on q B G = q S G q B S iteration. In the next step, the reference point is defined at the pelvis, and the length of each segment is predefined according to the participants, so the attitude of each segment in initial state can be obtained through the iteration of the relationship skeletal segment.
The gradient descent algorithm is adopted to update the value of q S G based on quaternion in this paper [16]. The q S G is obtain from Equation (3).
q S G ( t ) = q ^ S G ( t - 1 ) - ξ f ( q ^ S G , p ^ G , p ^ S ) f ( q ^ S G , p ^ G , p ^ S ) .
In this formula, p ^ G = [ 0 , p x G , p y G , p z G ] is the measured direction of the field in the sensor frame, p ^ S = [ 0 , p x S , p y S , p z S ] is the rotation quaternion, the object function f ( x ) between the p ^ G in GCS and p ^ S in SCS is as follows.
f ( q ^ S G , p ^ G , p ^ S ) = ( q ^ S G ) * p ^ G q ^ S G - p ^ S .
Therefore, the gradient of object function is calculated by Equation (5), and the corresponding Jacobian matrix can be obtained.
f ( q ^ S G , p ^ G , p ^ S ) = J T ( q ^ S G , p ^ G ) f ( q ^ S G , p ^ G , p ^ S ) .
When all the segments posture of the rigid body model were obtained from the relative skeletal segment iteration calculation, the vector angle, i.e., the joint angle could also be solved by inverse cosine between two adjacent skeletal segment vectors.

3.3. Experimental Setting between Self-Made and Standard Systems

To verify the reliability of the self-made inertial motion capture system, we compare data from our developed system to standard optical motion capture system. Consider the environmental factors, the contrast experiment was conducted in the indoor scene. The subjects were instructed to wear specific clothing, and the reflective marker and sensor nodes were all placed on the upper limbs. The motion capture processes between self-made and commercial optical system were initiated simultaneously. The optical instrument was treated as golden standard device produced by the Natural Point Company in the United States. The system consists of 12 cameras, 25 makers, and the motion capture software which is called Motive. The 12-camera motion capture system tracked 25-retro-reflective markers placed on the subject’s pelvis, right and left arms, shoulder, and torso. The markers trajectories were measured at 360 Hz during a static trial and movement at a self-selected speed. The arrangement of the field experiment is illustrated in Figure 7.
After the completion of the contrast test, each participant was required to perform the standardized rowing movement for 200 meters race, the inertial data collection was performed in synchronization with the video recording, a high-speed camera (Sony FDR-X3000R) at a sampling rate of 200 Hz was used to track the motion of the canoeist, and video analysis was conducted using open source software Kinova (version 0.8.22). Because action camera is working with a limited frame rate, the systematic error is inevitable, but it is with acceptable limits, so the video samples were served as the benchmark for labeling the inertial joint angle time series.

4. Results

To evaluate the performance of proposed method based on inertial sensor-based motion capture system, the complete protocol consists of the following steps: (1) The accuracy of our self-made motion capture system is verified by means of comparison with the standard optical system; (2) Stroke quality analysis between novice and coach based on joint angles under real water sports conditions. (3) Machine learning algorithms are conducted in the division of different proficiency level athletes.

4.1. Performance Comparison between Self-Made and Standard Systems

During the experiment, the participant was required to move in the visual areas of optical motion capture system, with extension of both upper arms. The coordinate system between optical and inertial capture system is not coincided, so the raw motion data need to be transformed for comparison.
Figure 8 shows the contrast graph of flexion extension angles versus the same joint angle deduced from optical cameras measurements. The specific contents of joint movement included shoulder and elbow joint on both body sides are shown in Figure 4. We defined them as left shoulder flexion (SFl), right shoulder flexion (SFr), left elbow flexion (EFl) and right elbow flexion (EFr) respectively, experimental data associated with them are represented by scattered plot and were fitted by straight lines [17]. The linear fitting slopes of four sets of motion data were 0.910, 0.971, 0.971, and 1.043, respectively. The respective corresponding correlation coefficient were 0.995, 0.990, 0.995, and 0.996, respectively. Bland-Altman analysis is shown in Figure 9. The optical system measurement values were used as the standard reference, and Table 2 summarizes the relative error on the results obtained from self-developed inertial sensor-based capture system. The result illustrates that our developed devices are reliable and measurement errors are well controlled.

4.2. Motion Restruction Based on Proposed Method

The common definition of complete stroke behavior is based on the contact area of the paddle blade relative to the water, a total of four critical positions were chosen and used for separating the stroke phase including catch, immersion, extraction and release [3]. Catch occurred at the first contact between the paddle blade and water. When the paddle blade was fully submerged, it was defined as immersion. When the blade was just emerging from the surface of the water, it was defined as extraction, and release was the last contact between the blade and the surface of the water. The entry, pull, exit, and aerial are the sub-phases, and the first three phases were combined into propulsion phase. The details of the motion phase sequence definition are shown in Figure 10. The athlete motions were recorded at 360 Hz with a sagittal-view video camera from around 10 meters during 200 meters time trials. As can be seen, the motion of canoeist can be tracked and reproduced. Due to space constraints, the motion of canoeists is mainly upper limb movement. Therefore, the flexion-extension of the elbow and shoulder is the key part to reflect the athletic performance, and the variations of SFl, SFr, EFl and EFr are the emphases of our research.

4.3. Stroke Quality Analysis Based on Proposed Method

The most commonly used evaluation criteria of stroke quality in rowing sport are stroke rate (cadence), stroke length, stroke variance, propulsion/recovery phase ratio and stroke force. The four curves of two joints of coach and novice are shown in Figure 11 and Figure 12. From the two graphs, the evaluation parameters of stroke quality can be derived. The top wide blue and red lines are duration of each stroke cycle, which were analyzed by manual annotation using an action camera. The middle wide blue and red lines are the signal periods, which are easily deduced by peak-pick algorithm. Obviously, owing to the inevitable systematic errors in visual method (200 Hz frame rate), the latter performs much more accurate than the former method. The stroke rate (cadence) can also be calculated from the reciprocal of signal period, which was the most frequently extracted metric of rowing performance. The stroke variance can be obtained from the signal period fluctuation. The value of the coach’s stroke cycle period is 1.72 ± 0.05 s. The value of novice’s stroke cycle period is 1.71 ± 0.08 s. The durations of the stroke cycle in 200 meters trip recorded for the coach and novice are presented in Figure 13. It can be seen from the graph that the stroke variability of the coach is relatively stable.
The propulsion/recovery rate is generally used to describe an athlete’s rhythm, which is the most important factor for athletes [18,19]. Deficiencies in the rhythm of rowers significantly decrease the velocity of the canoe. The performance of canoe increasing the propulsion duration while decrease the recovery duration in each stroke cycle. According to [11], we take the following steps to obtain the duration of propulsion and recovery phase. First, The sliding window was used to divide the time series of four joint curves (SFl, SFr, EFl, and EFr) into trials (time series segments), the length of each segments is ten sampling points, and the overlapped field length of sliding window is five sampling points. After window segmentation, video record was used to estimate whether it belong to the propulsion state or recovery state, and determine the true label of each segment; Second, feature extraction was applied to each segmentation record, standard statistics, time-domain and frequency-domain (or spectral-domain) based features were extracted on per overlapping 25 milliseconds windows [20]. After feature extraction, the feature matrix was formed, and each row represented one unique combination of features; Finally, the support vector machine (SVM) was used as the classification algorithm in this paper. The labeled training samples were used as training set, grid-search method was used to find the optimal model parameter. After training, the classification model was obtained, and the remaining samples were used to characterize the accuracy of the selected model. Results of prediction from the trained model are shown in Figure 14. The propulsion/recovery rate of the coach is 1.98 ± 0.26, the propulsion/recovery rate of novice is 2.05 ± 0.51. The predicted results of the proposed method were comparable with the video capture-based method.

4.4. Statistical Analysis of Canoeing Procedure

To further analyze the athlete’s motion characteristics of different skill proficiency level, statistical analysis was performed for both sides upper limbs in both novice and coach groups [21]. Because the body parts accomplished the action were reverse, the curves of joint angle for comparison need to be adjusted, that is the novice’s EFl versus coach’s EFr, novice’s EFr versus coach’s EFl and so on, the details are shown in Figure 15 and Figure 16.
The standard methods recommended for the statistical analysis were used in the present study [22,23,24], the statistical meaning of these parameters is as follows: ROM: range of motion; MAX: maximum value; MIN: minimum value; MEAN: mean value; SD: Standard deviation. To provide an intuitive understanding of the difference between different proficiency level participants. Figure 15 and Figure 16 illustrate the curves of joint angle of elbow and shoulder during a stroke cycle. In these graphs, the red solid lines represent the mean of group time recorded; the black dashed lines represent the maximum and minimum mean values; the light red shaded area indicates the ROM between MAX and Min. In Figure 15 and Figure 16, each stroke was divided into four phases according to Figure 10.
Table 3 shows the calculation outcomes of 372 records, the results were combined with Figure 15 and Figure 16, which produce the following conclusions: Under the premise that participants were instructed to perform as normally and accurately as possible, when we compare data from novice versus coach, it can be found that the standard deviation of the elbow was generally higher than the shoulder. This is because the forearm contacts close to the paddle blade [25]. The contact between the water surface and blade affects wrist movement, which in turn affects forearm and upper arms. When we compare the novice’s EFr and coach’s EFl, the standard deviation of coach is slight smaller than novice’s, it also indicated that the pattern of coach action was more consistent than novice, and with a stable performance. From Table 3, it can be seen that the ROM of the coach is roughly equivalent to novice’s, whether elbow flexion extension or shoulder’s. However, this was not true for the other parameters, the coach’s elbow flexions were higher than novice’s. As for the shoulder joint, the converse was true. These results showed that the upper arm and shoulder were used by novice to complete the rowing action, and it is not suitable for keeping balance, hence the boat speed was affected [26].

4.5. Athlete Recognition of Different Proficiency Level

Sport behavior has always been one of the hot topics in the wearable device application field. To explore the representative athlete’s characteristics of different proficiency level, machine learning algorithms were used to classify coach and novice based on features matrix of four joint angles dataset, and find out the salient features to distinguish coaches from novices.
A total of 33 standard time-domain and frequency-domain features are listed in Table 4. Feature extraction was employed upon each record of four joint angles, including SFr, SFl, EFr, and EFl. The length of each record was determined by the peak-to-peak value of the should flexion-extension curves, which were depicted in Figure 11 and Figure 12. In total, 132 features were extracted for each record. Furthermore, principal component analysis (PCA) was carried out on the feature dataset, Figure 17a demonstrated the two-dimensional representation of conservation features. Most of the variance between records (64.21%) was explained by component1, The overall rate of contribution of the first two primary components is 87.28%. It shows that the coach group can be separated from the novice group based on joint angle-based features.
At first, all of the 132 features were used while training the model. To reduce computational costs and storage requirements, and get a simpler model that is less likely to overfit. Feature selection is adopted to remove features that are redundant or do not carry useful information. It can reduce the size of the model and can be readily applied. Neighborhood component analysis (NCA) is a non-parametric and embedded method for selecting features with the goal of maximizing prediction accuracy of classification algorithms [27]. The relationship between weight and feature index is depicted in Figure 17b. When the feature selection is finished, the 6 features that the weight > 0 . 1 is remained, they are all the autocorrelation features of four joint angles. The results are basically consistent with the previous results [28], and the empirical analysis results in this paper are valid.
The feature dataset is randomly divided into two independent sets. The 75% of the dataset is selected for training classification model. The 25% of remaining dataset is used for testing model. During the training process, a random 10 % data of training dataset was used as validation dataset, the modes was guided by observing the cross-validation accuracy during training and choosing new parameters until no further improvement could be made. This separation was performed at the participant level. This means that all feature dataset from a athlete was included in the same person (training dataset, validation dataset, and testing dataset). All these measures ensured testing dataset contained only information that had not been encountered by the model during training. The four types of machine learning algorithms, including Support Vector Machine (SVM), Logistic Regression, Decision Tree and XGBoost are conducted on the feature dataset for classifications. The grid search method is used to find the optimal parameters of each algorithm. The receiver operating characteristic curve (ROC) could give more informative metric to check the quality of classifiers. The quality of the multiple model was evaluated through its measures of sensitivity and specificity with the establishment of a ROC curve [29]. The area under ROC curve (AUC) was always used to test for sensitivity and specificity of each algorithm. The classify ability of different algorithm comparison are shown in Table 5. The hyperparameters are exploited by a k-fold cross validation procedure for the experiments. All classification problems were performed using Windows 10 LTSC, running python 3.6, and using Scikit-learn library version 0.21.3. It can be found that the overall recognition is satisfactory when four joint angles were dealt with. The XGBoost algorithm reaches the highest recognition accuracy that is 100%, and the performance of SVM algorithm is slightly worse. The recognition accuracy of XGBoost is 98.51% when using the selected features. It can be seen that the method using joint angle based on IMU motion capture technology has advantages in accuracy of the rowers’ proficiency level recognition.

5. Discussion

The wearable inertial sensor network has widely been adopted as a training assistant manner to give useful feedback for coaches during practice, and it can provide quantitative insight into each aspect of rowing activities. The information fusion of multi-sensor can produce insightful metrics, to address this issue, this paper proposes an innovative approach based on data fusion technology to estimate the motion posture of rowers, and provides the detailed kinematic analysis of joint flexion extension from different proficiency level.
The developed system can track the rower’s action accurately compared with the optical motion capture system, and the gradient descent method was used to eliminate the rotation error from sensor coordinate system to navigation coordinate system, and update the real-time attitude of the experimenters. The implementation of rowing motion capture can provide not only stoke quality analysis, but also additional statistical information, more insightful metrics can be obtained by the advanced sensor fusion algorithm, the waveform parameters (MEAN, ROM, MAX, MIN) of joint angles provide a detailed description of the similarities and differences between novice and coach compared with the literature [10]. On the other hand, the sampling rate of inertial system can be set at a higher rate (800 Hz), and it reflects an ability to obtain more actionable information compared with the video movement analysis [3]. Furthermore, multiple machine-learning algorithms were used to distinguish novice from experienced rowers, and satisfactory results have been achieved. In addition, it can tell the novice rower what their exact deficiency in technique is [30].
It should be noted that although the inertial sensor system has advantages of being portable and without space limitations, athletes would feel discomfort after wearing the sensor nodes for more than half an hour [31]. In this case, there is a great need for more comfortable motion-monitoring solution, or fewer miniature sensor nodes were used on the premise that the performance is guaranteed. In addition, video recording was used as a means of determining the true labels of propulsion and recovery phase, the systematic error (e.g., frame rate) was unavoidable, and to accurately determine the touchpoint between paddle blade and water is difficult, therefore, this might lead to inaccurate phase divisions, and it might have influenced the results of our secondary predicted outcomes.

6. Conclusions

In this work, we introduced a rower motion capture and analysis system using an inertial sensor network. The field water sport experiments validated the comprehensive and detailed information that can be obtained from the proposed system. During the development process, a free rigid segment model was proposed and the attitude of each body segment could be obtained by the iteration calculation from the pelvis rotations. In addition, the selection of body segments can be tailored to the application. For practical applications, we demonstrated that our method is able to achieve the comparable accuracy to the standard optical motion capture system.
In future work, we plan to extend our work as follows: a more detailed profile of the sub-phase, including entry, pull, exit and aerial could be studied based on joint angle, and it could promote the effective use of systematic observation strategies for coaches. In the sub-phase, legs performed driving tasks, and deficiencies in leg movement would significantly influence performance of the boat, these factors would be considered in the future. In addition, as the number of sensors bound to the human body is excessive, which made the rowers feel uncomfortable We are currently developing a lightweight and miniature wearable network module, and it can be integrated into electronic products, such as wristband. A more comprehensive water sport athlete monitoring system will be established in the future.

Author Contributions

L.L. drafted the manuscript; S.Q. proofread and revised the manuscript; J.L. and Z.W. performed the experiment and were responsible for equipment configuration; J.L. and L.L. was responsible for data analysis, data visualization; Z.W. and S.Q. was responsible for the interpretation of the results; J.W. and J.L. basically completed the manuscrit revision. All authors have edited, reviewed and improved the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by National Natural Science Foundation of China under Grant No.61473058, No.61873044 and No.61803072, Dalian Science and Technology Innovation fund (2018J12SN077), and China Postdoctoral Science Foundation No.2017M621131 and No.2017M621132, and the Liaoning Key R&D Guidance Project under Grant ZX2018KJ002.

Acknowledgments

The authors would like to express their thanks to the members of laboratory of Intelligent system, Dalian University of Technology.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
IMUsInertial Measurement Units
GCSGround Coordinate System
SCSSensor Coordinate System
BCSBody Coordinate System
SFShoulder Flexion angle
EFElbow Flexion angle
KFknee flexion angle
FFFoot Flexion angle
SFlLeft Shoulder Flexion
SFrRight Shoulder Flexion
EFlLeft Elbow Flexion
EFrRight Elbow Flexion
SVMSupport Vector Machine
ROMRange of Motion
MAXMaximum value
MINMinimum value
MEANMean value
SDStandard Deviation
PCAPrincipal Component Analysis
NCANeighborhood component analysis
ROCReceiver Operating Characteristic
AUCArea Under the Curve

References

  1. Sánchez, M.B.; Loram, I.; Darby, J.; Holmes, P.; Butler, P.B. A video based method to quantify posture of the head and trunk in sitting. Gait Posture 2017, 51, 181–187. [Google Scholar] [CrossRef]
  2. Tay, C.S.; Kong, P.W. Intra-and inter-rater reliability of a video-based method to quantify stroke synchronisation in crew-boat sprint kayaking. ISBS Proc. Arch. 2017, 35, 123. [Google Scholar]
  3. McDonnell, L.K.; Hume, P.A.; Nolte, V. An observational model for biomechanical assessment of sprint kayaking technique. Sports Biomech. 2012, 11, 507–523. [Google Scholar] [CrossRef] [PubMed]
  4. Umek, A.; Kos, A. Wearable sensors and smart equipment for feedback in watersports. Procedia Comput. Sci. 2018, 129, 496–502. [Google Scholar] [CrossRef]
  5. Gomes, B.B.; Ramos, N.V.; Conceição, F.A.; Sanders, R.H.; Vaz, M.A.; Vilas-Boas, J.P. Paddling force profiles at different stroke rates in elite sprint kayaking. J. Appl. Biomech. 2015, 31, 258–263. [Google Scholar] [CrossRef] [PubMed]
  6. Černe, T.; Kamnik, R.; Vesnicer, B.; Gros, J.Ž.; Munih, M. Differences between elite, junior and non-rowers in kinematic and kinetic parameters during ergometer rowing. Hum. Mov. Sci. 2013, 32, 691–707. [Google Scholar] [CrossRef]
  7. Jürimäe, T.; Perez-Turpin, J.A.; Cortell-Tormo, J.M.; Chinchilla-Mira, I.J.; Cejuela-Anta, R.; Mäestu, J.; Purge, P.; Jürimäe, J. Relationship between rowing ergometer performance and physiological responses to upper and lower body exercises in rowers. J. Sci. Med. Sport 2010, 13, 434–437. [Google Scholar] [CrossRef] [PubMed]
  8. Mpimis, A.; Gikas, V. Monitoring and evaluation of rowing performance using mobile mapping data. Archiwum Fotogrametrii, Kartografii i Teledetekcji 2011, 22, 337–349. [Google Scholar]
  9. Llosa, J.; Vilajosana, I.; Vilajosana, X.; Navarro, N.; Surinach, E.; Marquès, J. REMOTE, a wireless sensor network based system to monitor rowing performance. Sensors 2009, 9, 7069–7082. [Google Scholar] [CrossRef] [Green Version]
  10. Said, K.B.S.; Ababou, N.; Ouadahi, N.; Ababou, A. Embedded wireless sensor network for rower motion tracking. In Proceedings of the 8th International Conference on Modelling, Identification and Control (ICMIC), Algiers, Algeria, 15–17 November 2016; pp. 932–937. [Google Scholar]
  11. Wang, Z.; Wang, J.; Zhao, H.; Yang, N.; Fortino, G. CanoeSense: Monitoring canoe sprint motion using wearable sensors. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 9–12 October 2016; pp. 000644–000649. [Google Scholar]
  12. De Vries, W.; Veeger, H.; Cutti, A.; Baten, C.; Van Der Helm, F. Functionally interpretable local coordinate systems for the upper extremity using inertial & magnetic measurement systems. J. Biomech. 2010, 43, 1983–1988. [Google Scholar]
  13. Qiu, S.; Wang, Z.; Zhao, H.; Hu, H. Using Distributed Wearable Sensors to Measure and Evaluate Human Lower Limb Motions. IEEE Trans. Instrum. Meas. 2016, 65, 939–950. [Google Scholar] [CrossRef] [Green Version]
  14. Olivares, A.; Ruiz-Garcia, G.; Olivares, G.; Górriz, J.M.; Ramirez, J. Automatic determination of validity of input data used in ellipsoid fitting MARG calibration algorithms. Sensors 2013, 13, 11797–11817. [Google Scholar] [CrossRef] [Green Version]
  15. Fourati, H. Heterogeneous data fusion algorithm for pedestrian navigation via foot-mounted inertial measurement unit and complementary filter. IEEE Trans. Instrum. Meas. 2014, 64, 221–229. [Google Scholar] [CrossRef]
  16. Madgwick, S.O.; Harrison, A.J.; Vaidyanathan, R. Estimation of IMU and MARG orientation using a gradient descent algorithm. In Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics, Zurich, Switzerland, 29 June–1 July 2011; pp. 1–7. [Google Scholar]
  17. Jacobs, D. Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA, 17–19 June 1997; pp. 206–212. [Google Scholar]
  18. Kleshnev, V. Boat acceleration, temporal structure of the stroke cycle, and effectiveness in rowing. Proc. Inst. Mech. Eng. Part P J. Sport. Eng. Technol. 2010, 224, 63–74. [Google Scholar] [CrossRef]
  19. Schaffert, N.; Mattes, K. Influence of acoustic feedback on boat speed and crew synchronization in elite junior rowing. Int. J. Sports Sci. Coach. 2016, 11, 832–845. [Google Scholar] [CrossRef]
  20. Liu, H.; Motoda, H. Feature Extraction, Construction and Selection: A Data Mining Perspective; Springer Science & Business Media: Osaka, Japan, 1998; Volume 453. [Google Scholar]
  21. MacFarlane, D.; Edmond, I.; Walmsley, A. Instrumentation of an ergometer to monitor the reliability of rowing performance. J. Sports Sci. 1997, 15, 167–173. [Google Scholar] [CrossRef] [PubMed]
  22. Ghasemzadeh, H.; Loseu, V.; Guenterberg, E.; Jafari, R. Sport training using body sensor networks: A statistical approach to measure wrist rotation for golf swing. In Proceedings of the Fourth International Conference on Body Area Networks, Los Angeles, CA, USA, 1–3 April 2009; pp. 1–8. [Google Scholar]
  23. Eckardt, F.; Witte, K. Kinematic analysis of the rider according to different skill levels in sitting trot and canter. J. Equine Vet. Sci. 2016, 39, 51–57. [Google Scholar] [CrossRef]
  24. Wang, Z.; Li, J.; Wang, J.; Zhao, H.; Qiu, S.; Yang, N.; Shi, X. Inertial sensor-based analysis of equestrian sports between beginner and professional riders under different horse gaits. IEEE Trans. Instrum. Meas. 2018, 67, 2692–2704. [Google Scholar] [CrossRef]
  25. Smith, T.B.; Hopkins, W.G. Measures of rowing performance. Sports Med. 2012, 42, 343–358. [Google Scholar] [CrossRef]
  26. Schabort, E.; Hawley, J.; Hopkins, W.; Blum, H. High reliability of performance of well-trained rowers on a rowing ergometer. J. Sports Sci. 1999, 17, 627–632. [Google Scholar] [CrossRef]
  27. Yang, W.; Wang, K.; Zuo, W. Neighborhood Component Feature Selection for High-Dimensional Data. JCP 2012, 7, 161–168. [Google Scholar] [CrossRef]
  28. Nguyen, A.H.; Tran, H.T.; Thang, T.C.; Ro, Y.M. Fast recognition of human actions using autocorrelation sequence. In Proceedings of the 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), Nagoya, Japan, 31 July 2018; pp. 114–115. [Google Scholar]
  29. Bishop, C.M. Pattern Recognition and Machine Learning; Springer: New York, NY, USA, 2006. [Google Scholar]
  30. Bosch, S.; Shoaib, M.; Geerlings, S.; Buit, L.; Meratnia, N.; Havinga, P. Analysis of indoor rowing motion using wearable inertial sensors. In Proceedings of the 10th EAI International Conference on Body Area Networks, Sydney, Australia, 28–30 September 2015; pp. 233–239. [Google Scholar]
  31. Van den Boer, J.; van der Lee, A.; Zhou, L.; Papapanagiotou, V.; Diou, C.; Delopoulos, A.; Mars, M. The SPLENDID eating detection sensor: Development and feasibility study. JMIR mHealth uHealth 2018, 6, e170. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The device appearance and its disassembled prototype of the self-made inertial sensor-based motion capture.
Figure 1. The device appearance and its disassembled prototype of the self-made inertial sensor-based motion capture.
Sensors 20 02110 g001
Figure 2. The block diagram of the experimental system.
Figure 2. The block diagram of the experimental system.
Sensors 20 02110 g002
Figure 3. The human rigid structure model and the device locations. (a) the whole body structure definition with rigid body model. (b) postions of sensor nodes during the experiment.
Figure 3. The human rigid structure model and the device locations. (a) the whole body structure definition with rigid body model. (b) postions of sensor nodes during the experiment.
Sensors 20 02110 g003
Figure 4. The definition of coordinate system and the limb flexion joint angle. (a) the three coordinate systems in self-made inertial motion tracking system. (b) the joint angle definition for the athlete model.
Figure 4. The definition of coordinate system and the limb flexion joint angle. (a) the three coordinate systems in self-made inertial motion tracking system. (b) the joint angle definition for the athlete model.
Sensors 20 02110 g004
Figure 5. The calibration outcome of magnetometer. (a) before fitting. (b) after fitting.
Figure 5. The calibration outcome of magnetometer. (a) before fitting. (b) after fitting.
Sensors 20 02110 g005
Figure 6. The schematic overview of the proposed inertial motion capture method.
Figure 6. The schematic overview of the proposed inertial motion capture method.
Sensors 20 02110 g006
Figure 7. The overview of contrast tests between self-made and standard optical capture system.
Figure 7. The overview of contrast tests between self-made and standard optical capture system.
Sensors 20 02110 g007
Figure 8. Contrast result of elbow and shoulder flexion-extension angle.
Figure 8. Contrast result of elbow and shoulder flexion-extension angle.
Sensors 20 02110 g008
Figure 9. Bland-Altman analysis plot for upper limbs joint angles.
Figure 9. Bland-Altman analysis plot for upper limbs joint angles.
Sensors 20 02110 g009
Figure 10. Phases definition of the canoeing stroke cycle (entry, pull, exit and aerial) separated by paddle positions (catch, immersion, extraction and release)
Figure 10. Phases definition of the canoeing stroke cycle (entry, pull, exit and aerial) separated by paddle positions (catch, immersion, extraction and release)
Sensors 20 02110 g010
Figure 11. The elbow and shoulder flexion joint angle of coach.
Figure 11. The elbow and shoulder flexion joint angle of coach.
Sensors 20 02110 g011
Figure 12. The elbow and shoulder flexion joint angle of novice.
Figure 12. The elbow and shoulder flexion joint angle of novice.
Sensors 20 02110 g012
Figure 13. The duration of each stroke versus the stroke numbes during the rowing movement.
Figure 13. The duration of each stroke versus the stroke numbes during the rowing movement.
Sensors 20 02110 g013
Figure 14. Schematic diagram of propulsion/recovery phase predicted based on joint angle.
Figure 14. Schematic diagram of propulsion/recovery phase predicted based on joint angle.
Sensors 20 02110 g014
Figure 15. The joint flexion angle extension variation of novice on both sides of the body.
Figure 15. The joint flexion angle extension variation of novice on both sides of the body.
Sensors 20 02110 g015
Figure 16. The joint flexion angle extension variation of coach on both sides of the body.
Figure 16. The joint flexion angle extension variation of coach on both sides of the body.
Sensors 20 02110 g016
Figure 17. Principal component analysis (PCA) results and feature selection results. (a) the scatter plot of principal component analysis. (b) a plot of feature selection by Neighborhood component analysis (NCA).
Figure 17. Principal component analysis (PCA) results and feature selection results. (a) the scatter plot of principal component analysis. (b) a plot of feature selection by Neighborhood component analysis (NCA).
Sensors 20 02110 g017
Table 1. The device parameters of the sensor node.
Table 1. The device parameters of the sensor node.
UnitAccelerometerGyroscopeMagnetometer
Dimensions3 axis3 axis3 axis
Sensitivity (/LSB)0.833 mg0.04 deg/s142.9 uguass
Dynamic Range±18 g±1200 deg/s±1.9 gauss
−3 dB Bandwidth (Hz)33033025
Nonlinearity (%FS)0.2±0.10.1
Misalignment (deg)0.20.050.25
Table 2. Joint angle measurement error.
Table 2. Joint angle measurement error.
Joing AngleMean Error (%)SD (%)
SFl3.721.88
SFr2.191.23
EFl1.201.02
EFr2.371.15
Table 3. Evaluation of joint angle parameter.
Table 3. Evaluation of joint angle parameter.
Mean ± SDElbow Flexion Angle (rad)Shoulder Flexion Angle (rad)
ROMMAXMINMEANROMMAXMINMEAN
Coach:Right Side0.61 ± 0.093.06 ± 0.062.45 ± 0.082.83 ± 0.052.05 ± 0.112.81 ± 0.080.75 ± 0.091.57 ± 0.07
Left Side1.06 ± 0.113.04 ± 0.071.97 ± 0.072.55 ± 0.031.59 ± 0.081.64 ± 0.070.04 ± 0.030.85 ± 0.05
Novice:Right Side0.81 ± 0.113.11 ± 0.222.30 ± 0.112.74 ± 0.031.75 ± 0.081.82 ± 0.090.07 ± 0.050.98 ± 0.06
Left Side0.62 ± 0.133.00 ± 0.082.39 ± 0.082.68 ± 0.052.02 ± 0.113.02 ± 0.061.00 ± 0.081.79 ± 0.04
Table 4. List of feature vectors.
Table 4. List of feature vectors.
Feature NameDescriptionNumber
meanMean value1
medianMedian value1
stdStandard deviation1
madMedian absolute value1
quantile (1–2)Signal percentile2
iqrInter quartile range1
skewnessTime signal skewness1
kurtosisTime signal kurtosis1
varTime signal variance1
sigentropySignal entropy value1
sepentropySpectal entropy of the signal1
powersp (1–3)Power spectrum features3
acorr (1–3)Autocorrelation features3
spwf (1–15)Spectral power features15
Table 5. Classification performance and the optimal hyperpapameters of the proposed algorithms.
Table 5. Classification performance and the optimal hyperpapameters of the proposed algorithms.
Before Feature SelectionAfter Feature Selection
AccuracyAUCHyperparameterAccuracyAUCHyperparameter
SVM100%1.00C: 1, gamma: 0.01
kernel: rbf
96.82%0.97C: 2000, gamma: 0.001
kernel: rbf
Logistic Regression98.51%0.98C: 10, multi_class: multinomial
penalty: l2, solver: lbfgs
95.52%0.95C: 50, multi_class: ovr
penalty: l2, solver: lbfgs
Decision Tree94.28%0.93criterion: gini, max_depth: 894.02%0.92criterion: gini, max_depth: 7
XGBoost100%1.00n_estimators: 30
max_depth: 3
learning_rate: 0.25
subsample: 0.8
colsample_bytree: 0.5
min_child_weight:1
98.51%0.99n_estimators: 35
max_depth: 2
learning_rate: 0.25
subsample: 0.7
colsample_bytree: 0.5
min_child_weight: 3

Share and Cite

MDPI and ACS Style

Liu, L.; Qiu, S.; Wang, Z.; Li, J.; Wang, J. Canoeing Motion Tracking and Analysis via Multi-Sensors Fusion. Sensors 2020, 20, 2110. https://doi.org/10.3390/s20072110

AMA Style

Liu L, Qiu S, Wang Z, Li J, Wang J. Canoeing Motion Tracking and Analysis via Multi-Sensors Fusion. Sensors. 2020; 20(7):2110. https://doi.org/10.3390/s20072110

Chicago/Turabian Style

Liu, Long, Sen Qiu, ZheLong Wang, Jie Li, and JiaXin Wang. 2020. "Canoeing Motion Tracking and Analysis via Multi-Sensors Fusion" Sensors 20, no. 7: 2110. https://doi.org/10.3390/s20072110

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop