Next Article in Journal
Thermal Model and Countermeasures for Future Smart Glasses
Previous Article in Journal
An Empirical Study on Transmission Beamforming for Ultrasonic Guided-Wave Based Structural Health Monitoring
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Recognition of Common Non-Normal Walking Actions Based on Relief-F Feature Selection and Relief-Bagging-SVM

College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(5), 1447; https://doi.org/10.3390/s20051447
Submission received: 4 February 2020 / Revised: 21 February 2020 / Accepted: 3 March 2020 / Published: 6 March 2020
(This article belongs to the Section Physical Sensors)

Abstract

:
Action recognition algorithms are widely used in the fields of medical health and pedestrian dead reckoning (PDR). The classification and recognition of non-normal walking actions and normal walking actions are very important for improving the accuracy of medical health indicators and PDR steps. Existing motion recognition algorithms focus on the recognition of normal walking actions, and the recognition of non-normal walking actions common to daily life is incomplete or inaccurate, resulting in a low overall recognition accuracy. This paper proposes a microelectromechanical system (MEMS) action recognition method based on Relief-F feature selection and relief-bagging-support vector machine (SVM). Feature selection using the Relief-F algorithm reduces the dimensions by 16 and reduces the optimization time by an average of 9.55 s. Experiments show that the improved algorithm for identifying non-normal walking actions has an accuracy of 96.63%; compared with Decision Tree (DT), it increased by 11.63%; compared with k-nearest neighbor (KNN), it increased by 26.62%; and compared with random forest (RF), it increased by 11.63%. The average Area Under Curve (AUC) of the improved algorithm improved by 0.1143 compared to KNN, by 0.0235 compared to DT, and by 0.04 compared to RF.

1. Introduction

With the development of microelectromechanical system (MEMS) technology and the popularization of smartphones with integrated acceleration sensors, action recognition is receiving increasing attention. It is widely used in medical health, pedestrian dead reckoning (PDR) and other fields [1,2]. In medical health, it is necessary to accurately measure the amount of exercise to provide more important reference indicators for clinical decision-making. In the PDR field, it is necessary to accurately predict the movement trajectory to determine the accurate position. The implementation of the above technical solutions is based on the accurate measurement of pedestrians. The number of steps is used as a basis. The current mainstream method for measuring the amount of exercise is to detect the number of steps taken by the patient, and the accuracy of the step counting is largely determined by motion recognition. The existing motion recognition algorithms have high accuracy for the detection of common normal steps. A combination of Global Positioning System (GPS) and MEMS technology can be used to identify uncommon movements, but weak indoor GPS signals are recognized facts in the technical field and difficult points to be solved. Therefore, existing methods do not have high accuracy in identifying abnormal walking postures, leading to lower accuracy of motion recognition and affecting the overall step counting accuracy. This article will explore the recognition of abnormal walking movements in depth.
There are two types of mainstream international methods of action recognition. The first category is the recognition and classification of actions based on human action video images. Wang, C. et al. [3] proposed a pose recognition method based on a neural network algorithm. This method uses an improved filtering algorithm to reduce the computational complexity of the scale invariant feature transforms (SIFT) operator and effectively reduce the impact on pose differences and image blur on the recognition rate. However, the recognition categories for non-normal walking actions are not comprehensive enough, resulting in a low overall recognition rate. Ince, O. F. et al. [4] proposed a new type of biometric recognition system for checking human activities in 3D space. The joint angle obtained by RGB depth sensors was used as a feature, and the average algorithm was used to reduce the dimension. This method has more advantages than other machine learning algorithms. The algorithm has a high recognition rate for faces for complex human motion recognition, but the recognition category for non-normal walking actions is not comprehensive enough. Ravbar et al. [5] used visual intuition to design an automatic behavior recognition system to identify behaviors in animals. This method can efficiently and accurately recognize the behavior and posture of various animals. The effect of this system on human motion recognition needs to be verified. Ullah et al. [6] proposed a framework of activity recognition using the surveillance video of industrial systems that used a convolutional neural network (CNN) to select shots based on human salient features and proposed multilayer long and short term memory. The results showed that this method is effective for identifying activities in an industrial environment. However, the incompleteness of common non-normal walking actions identified will have a certain impact on the overall recognition accuracy.
The second category is the recognition and classification of actions based on sensor signals. An et al. [7] proposed a 3D pedestrian position estimation algorithm for an inertial measurement unit (IMU) sensor worn on the waist, using a linear regression algorithm to improve the generalization ability of the classification algorithm for going downstairs and going upstairs. The subject of this article focuses on the study of normal walking movements, without considering the effects of abnormal walking actions such as writing and sleeping. Diete et al. [8] proposed an action recognition algorithm combining inertial sensors and interactive sensors. This algorithm recognized different human actions in different scenes by fusing data such as inertia and video. There is also the problem of insufficient analysis of abnormal walking movements. Kabir et al. [9] proposed a state-space-based linear activity recognition method. The model was very flexible in terms of control and used three real datasets to verify the validity of the model. In work by Kelly et al. [10], an action recognition method based on a genetic algorithm for sensor fusion was proposed. Support vector machines can be used to predict 10 different health indicators, and their errors do not exceed the clinical error benchmark. This article did not explore the impact on non-normal walking actions on health indicators. Lee, J.S et al. [11] used experimental heuristics to perform multi position PDR (mpPDR), which identified six poses and four patterns of carrying smartphones. Although the article explored the posture and position of normal walking movements in depth, the influence of non-normal walking actions on the experimental results was also very significant. Ma et al. [12] proposed an adaptive action recognition algorithm based on a time window, which solved the problem that different types of actions have different durations. Tong et al. [13] proposed a method of PDR using MEMS magnetic, angular velocity, and gravity sensors. This method reduced position drift caused by heading error and fault zero speed measurement. However, this method did not eliminate errors caused by non-normal walking actions.
Unfortunately, the current motion recognition algorithm is not comprehensive and has low recognition accuracy for common non-normal walking actions (such as sleep, irregular actions, writing, etc.), but the recognition of non-normal walking actions is of great significance to improve the reliability of medical and health indicators and the accuracy of PDR positioning. In order to fully and accurately identify non-normal walking actions, this paper proposes an MEMS action recognition method based on Relief-F feature selection and relief-bagging-SVM.

2. Data Acquisition and Preprocessing

This paper uses an independently designed acceleration acquisition platform to obtain acceleration signals under different actions. After preprocessing, feature extraction and selection were performed, and the LG function was used for nonlinear normalization. The improved action recognition algorithm was used for identification and classification. The framework of this paper is shown in Figure 1.

2.1. Acceleration Acquisition Hardware Platform

To obtain the acceleration information about human action accurately in real time, an acceleration signals acquisition device (worn on the wrist) was designed. The hardware design is shown in Figure 2 [14]. Some important parameter settings of the hardware platform are shown in Table 1.

2.2. Acceleration Signal Preprocessing

2.2.1. Acceleration Synthesis

The randomness of the acceleration sensor carried by the human body causes the three-axis acceleration direction to be inconsistent with the direction of the human action. The noise generated by this factor can be partially eliminated by calculating the synthetic acceleration, as shown in Figure 3.
a c o m = a x 2 + a y 2 + a z 2

2.2.2. Four-Point Median Filtering

Median filtering is a low-frequency enhanced spatial domain filtering technique. In this paper, the four-point median filtering principle is used to implement the linear filter [15]. The specific mathematical expression is shown in Equation (2). The processed synthetic acceleration signal is shown in Figure 3.
a a v r = M e d { a i v , , a i 1 , a i + 1 , , a i + v } i N , V = m 1 2 a a v r ( n ) = i = 0 3 a a v r ( n i ) / 4
From the analysis in Figure 3, it can be seen that the acceleration signals of the eight kinds of actions are subjected to acceleration synthesis and four-point median filtering to reduce the number of pseudo waves and glitches, which is more conducive to action recognition and classification.

3. Improvement of the Action Recognition Algorithm

3.1. Feature Extraction and Selection

Human action contains many characteristic parameters. Commonly used types include time-domain features, frequency domain features, wavelet transform features, and frequency domain features. This article uses the mean, standard deviation, variance, average slope, absolute slope, maximum, minimum, kurtosis, skewness, root mean square, interquartile range, correlation coefficient, and maximum in the time domain, fast Fourier transform (FFT) spectrum energy, FFT average power, and FFT median frequency. There are 15 features in total, and the feature vector has 23 dimensions so that the feature information of various actions can be relatively comprehensively extracted. However, these features are directly used for identification and classification. Due to the redundancy between these features and the complexity of the calculation, the final classification effect is not ideal. Therefore, this paper uses the relief algorithm to select features. By selecting features with significant classification weights, it can both improve the classification accuracy and reduce the time complexity of the algorithm. The features extracted in this paper are shown in Table 2.
The relief algorithm is a commonly used filtering feature selection algorithm. This algorithm mainly designs a relevant statistic to measure the importance of features. In this paper, the relevant statistic is defined as the feature classification weight, as shown in Equation (3).
σ k = i d i f f ( x i k , x i , n h k ) 2 + d i f f ( x i k , x i , n m k ) 2
The acceleration signals of eight kinds of actions are extracted from this paper, and the support vector machine with eight classifications is used. Therefore, relief is deformed, and Relief-F is used to solve the eight classification problems in this paper [16,17].
σ k = i d i f f ( x i k , x i , n h k ) 2 + l w   ( p l × d i f f ( x i k , x i , n m k ) 2 )
Among them, x i , n h k in Equations (3) and (4) is “near-hit” and x i , n m k is “near-miss”,   x i k represents the value of sample x i on feature k, and d i f f ( x i k , x i , n h k ) 2 determines the type of feature k. p l is the proportion of type l samples of the dataset.
The feature classification weights map analyzed by relief after feature extraction is shown in Figure 4. After analyzing the observation data onto a large number of experiments, setting the classification weights threshold to 9000 is the best feature selection effect, and continuous fusion of the selected seven-dimensional features is shown in Figure 5 to achieve the best classification effect. The serial number of the seven-dimensional feature is good. The feature names are shown in Table 3.
In this paper, the mainstream feature selection method least absolute shrinkage and selection operator (LASSO) and principal component analysis (PCA) are compared horizontally. The classification effect of (LASSO) is shown in Figure 6. The classification accuracy is shown in Table 4.
After comprehensive analysis of Table 4, Figure 4, Figure 5 and Figure 6, the average accuracy of the Relief-F method is 30.83% higher than the LASSO method, far better than LASSO only methods.

3.2. Design and Optimization of Relief-SVM

SVM is one of the mainstream algorithms for statistical machine learning. SVM has an excellent effect on the classification of small sample data. SVM can map linearly indivisible samples to the hyperplane for classification, and its essence is to solve the smallest problem. The minimum soft interval problem from the support vector to the dividing line is shown in Equation (5). This is a convex quadratic programming problem. In the face of the quadratic programming problem with constraints, this paper uses the Lagrange operator method, which is then transformed into solving the dual problem, as shown in Equation (6) [18,19,20].
m i n w , b 1 2 w 2 + C i = 1 m ι 0 1 ( y ( w T x i + b ) 1 ) .   s 0 1 = { 1 , ( y ( w T x i + b ) 1 ) < 0 0 , ( y ( w T x i + b ) 1 ) 0
m a x α = i m α i 1 2 i m j m α i α j y i y j x i T x j .   s . t .   i m α i y i = 0 , 0 α i C
ι 0 1 in Equation (5) is a loss function. Since the theoretical loss function has noncontinuous and nonconvex mathematical properties that are difficult to solve, a function that is easy to solve is used instead. In Equation (6), C represents a penalty coefficient, which determines the number of support vectors and is one of the key indicators. The complexity of the inner product of x i T x j determines the performance of the SVM to a large extent, so the sample can be mapped to an optimal high-dimensional space by using an appropriate kernel function and gamma value. Therefore, this paper uses the grid optimization method and k-fold cross-validation method to solve the optimal C and gamma, as shown in Figure 7, and the classification kernel to select the most suitable kernel function is shown in Table 5.
It can be seen in Table 5 that the optimal kernel function is a polynomial kernel, and the optimal penalty coefficient C corresponding to the polynomial kernel is 13.9288, and the optimal gamma value is 2.1435.

3.3. Design of Relief-Bagging-SVM

From the analysis in Table 6 and Table 7, it can be seen that although Relief-SVM has excellent performance in time performance and classification accuracy, the classification accuracy in man-made step counting is only 40%. The focus and innovation of this article are on the recognition and classification of abnormal walking actions. Ensemble learning performs well in improving the classification performance of weak learners. Therefore, the bagging algorithm in ensemble learning is used to design a relief-bagging-SVM action recognition algorithm, as shown in Figure 8, to accurately identify man-made step counting and other abnormal walking actions.
The key to the performance of relief-bagging-SVM is to generate “good and different” base learners. In this paper, bootstrap sampling is used to generate different datasets. The bootstrap sampling method is for a dataset that includes M samples. According to the principle of non-replacement extraction, sampling is performed M times to obtain a training set, and according to the analysis of Equation (7), it can be seen that each training set includes only 63.2% of the original data, while the remaining 36.8% of the samples are used as the test set [21].
l i m M ( 1 1 M ) M = 1 e 0.368
1 M in Equation (7) is the probability that each sample is taken.

3.4. Performance Evaluation of SVM Learners

This article uses the Receiver Operating Characteristic curve (ROC) and AUC to evaluate the modeling effect of the SVM learner. The samples are sorted according to the score of the predictor’s prediction result, the samples are predicted as positive examples in this order, the true positive rate (TPR) is calculated each time as Equation (8), and the false positive (false positive rate, FPR) is shown in Equation (9), where TPR is the vertical axis of the ROC curve and FPR is the horizontal axis of the ROC curve.
T P R = T P T P + F N
F P R = F P T N + F P
In Equation (8), TP, FN, FP, and TN in Equation (9) are the true positive examples, false negative examples, false positive examples, and true negative examples in the classification result confusion matrix, respectively.

4. Experiments and Results Analysis

The experimental platform of this article uses Matlab2018a. By observing the daily life of a large number of students and faculty members of Xinjiang University and sampling with a questionnaire survey, we found that the top four most frequent occurrences of non-normal walking actions are: standing (defined as people who have no regular or obvious movements, with a few occasional movements; for example, sitting would be considered a standing posture in this article), writing (defined as the state of a person writing with a pen or chalk), sleeping, and man-made (this action exists more in China, especially in some college students; in order to increase the number of steps in various apps, various devices are used to simulate the movement of the human body to create the number of steps. The acceleration trajectory of such devices is a sine or cosine diagram). These four non-normal walking actions account for more than 90% of all non-normal walking actions, so this article focuses on the four types of non-normal walking actions. The first four occurrences of normal walking actions are: walking, upstairs, downstairs, and running. These four occupy 99% of the normal walking actions of the human body. To reduce the effect of age, height, weight, and gender on the robustness of the algorithm, our experiment object consisted of four men and four women, aged between 19–45 years old, weighing between 45–85 kg with a height between 150–190 cm. The experimental data collect acceleration information of eight kinds of actions in Table 8. For each walking action, 5000 synthetic acceleration information is collected, which takes 50 s and is processed by frame. Each sample generates 50 samples, so the experimental acceleration of the dataset has a total of 400 samples (acceleration information for eight different ages, heights, weights and genders under each action,). After the relief feature selection, the features are serially fused, and the dataset becomes a 400 × 7 feature matrix. The experimental data used a bootstrap sampling method to generate a training set and a test set. Cross-validation was used during the experiment. The 10-fold cross-validation method [22,23] uses the libsvm package to implement SVM multiclassification [24]. From the analysis above, we know that the polynomial kernel is used for experiments. The number of basic learners for integrated learning is five, as shown in Table 6 and Table 7. The average is taken after 10 category experiments. This paper compares the results with mainstream decision tree (DT), k-nearest neighbor (KNN) and random forest (RF). The classification accuracy is shown in Table 6. The time performance is shown in Table 7. DT, RF and KNN parameter adjustments are shown in Table 9.

4.1. Action Classification Accuracy and Time Performance

It can be intuitively seen from Table 6 that the traditional methods for identifying non-normal walking actions are not effective, and the improved algorithm for identifying non-normal walking actions had an accuracy of 96.63%. Compared with DT, it increased by 11.63%; compared with KNN, it increased by 26.62%; and the recognition performance has been greatly improved.
From Table 6 and Table 7, the average classification accuracy of the improved relief-bagging-SVM reached 94.37%. Compared with relief-SVM, the average classification accuracy improved by 2.71% while maintaining time performance. The accuracy of step counting reached 100%, which increased by 60%. Compared with SVM, both the time performance and classification accuracy were comprehensively and greatly improved. The average recognition accuracy of the improved algorithm was 9.37% higher than KNN, 1.87% higher than DT and 1.87% higher than RF.

4.2. ROC Curve of the SVM Model

In Figure 9, the man-made step counting and standing ROC curves of the SVM are both below the random guess curve. The recognition and classification of these two types are worse than the random guess, and the ROC curves of the other six actions are in the random guess model. Above, the properties of the ROC curve are generally average.
In Figure 10, the man-made step counting ROC curve of relief-SVM is much lower than the random guess curve, and its classification recognition effect is not ideal. However, the ROC curves of the other seven categories have good properties, and the classification effect and generalization ability are very strong.
In Figure 11, the properties of the ROC curve of the man-made step counting of relief-bagging-SVM have reached the optimal, and except for the properties of the ROC curve of the upstairs and the downstairs, are worse compared with the relief-SVM.
From Table 10 combined with the analysis of Figure 9, Figure 10 and Figure 11, it can be seen that during abnormal walking actions, the AUC of relief-bagging-SVM improved compared to SVM and relief-SVM. The average AUC of relief-bagging-SVM reached 0.9466, a 0.0325 improvement over the relief-SVM, and a 0.2089 improvement over the SVM. Comprehensive analysis showed that the generalized ability and time performance of the improved relief-bagging-SVM model were the best.
From Table 10 and Figure 12, it can be concluded that the average AUC of the improved algorithm improved by 0.1143 compared to KNN, 0.0235 compared to DT and 0.04 compared to RF.

4.3. Leave-One-Person-Out Cross Validation

We also used Leave-One-Person-Out cross validation (LOPOCV) to evaluate the generalization ability of our model, and the basic situation of eight test subjects is shown in Table 8. The test results are shown in Table 11.
In Table 8, we have listed in detail the personal information of the eight people who participated in the experiment.
We used seven people’s data for training each time, leaving one person’s data for testing. The test results are shown in Table 8. The average accuracy of the eight people was 94.25%, and the variance was 0.62%. The standard deviation was 0.79%.

5. Conclusions

This paper explores common non-normal walking actions recognition problems and solves the problems of incomplete classification and low accuracy of the existing motion recognition algorithms for non-normal walking actions. It uses the relief algorithm for feature selection and the improved relief-bagging-SVM algorithm for action classification. The improved algorithm for identifying non-normal walking actions has an accuracy of 96.63%. Compared with decision tree (DT), it increased by 11.63%; compared with k-nearest neighbor (KNN), it increased by 26.62%, the average AUC of the improved algorithm improved by 0.1143 compared to KNN, improved by 0.0235 compared to DT, improved 0.04 compared to RF. These results are of great practical significance to the accuracy of medical health indicators and the detection of steps in PDR.

Author Contributions

Conceptualization, Y.L.; data curation, W.C. and S.L.; formal analysis, X.L.; methodology, P.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Science Foundation of China (No.61762085) and the National College Student Innovation Training Program (No. 201810755037).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wan, E.S.; Kantorowski, A.; Polak, M.; Kadri, R.; Richardson, C.R.; Gagnon, D.R.; Garshick, E.; Moy, M. Long-term effects of web-based pedometer-mediated intervention on COPD exacerbations. Respir. Med. 2020, 162, 105878. [Google Scholar] [CrossRef]
  2. Ye, H.; Li, Y.X.; Luo, H.; Wang, J.X.; Chen, W.; Zhang, Q. Hybrid Urban Canyon Pedestrian Navigation Scheme Combined PDR, GNSS and Beacon Based on Smartphone. Remote Sens. 2019, 11, 2174. [Google Scholar] [CrossRef] [Green Version]
  3. Wang, C.Y.; Zhang, Z.Y.; Xi, Z. A Human Body Based on Sift-Neural Network Algorithm Attitude Recognition Method. J. Med. Imaging Health Inform. 2020, 10, 129–133. [Google Scholar] [CrossRef]
  4. Ince, O.F.; Ince, I.F.; Yildirim, M.E.; Park, J.S.; Song, J.K.; Yoon, B.W. Human activity recognition with analysis of angles between skeletal joints using a RGB-depth sensor. Etri J. 2020, 42, 78–89. [Google Scholar] [CrossRef]
  5. Ravbar, P.; Branson, K.; Simpson, J.H. An automatic behavior recognition system classifies animal behaviors using actions and their temporal context. J. Neurosci. Methods 2019, 326. [Google Scholar] [CrossRef]
  6. Ullah, A.; Muhammad, K.; Del Ser, J.; Baik, S.W.; de Albuquerque, V.H.C. Activity Recognition Using Temporal Optical Flow Convolutional Features and Multilayer LSTM. IEEE Trans. Ind. Electron. 2019, 66, 9692–9702. [Google Scholar] [CrossRef]
  7. An, J.; Yang, L.; Lee, J. Three-dimensional indoor location estimation using single inertial navigation system with linear regression. Meas. Sci. Technol. 2019, 30. [Google Scholar] [CrossRef]
  8. Diete, A.; Stuckenschmidt, H. Fusing Object Information and Inertial Data for Activity Recognition. Sensors 2019, 19, 4119. [Google Scholar] [CrossRef] [Green Version]
  9. Kabir, M.H.; Thapa, K.; Yang, J.Y.; Yang, S.H. State-Space based Linear Modeling for Human Activity Recognition in Smart Space. Intell. Autom. Soft Comput. 2019, 25, 673–681. [Google Scholar] [CrossRef]
  10. Kelly, D.; Condell, J.; Curran, K.; Caulfield, B. A multimodal smartphone sensor system for behaviour measurement and health status inference. Inf. Fusion 2020, 53, 43–54. [Google Scholar] [CrossRef]
  11. Lee, J.S.; Huang, S.M. An Experimental Heuristic Approach to Multi-Pose PDR without Using Magnetometers for Indoor Localization. IEEE Sens. J. 2019, 19, 9532–9542. [Google Scholar] [CrossRef]
  12. Ma, C.C.; Li, W.F.; Cao, J.J.; Du, J.; Li, Q.M.; Gravina, R. Adaptive sliding window based activity recognition for assisted livings. Inf. Fusion 2020, 53, 55–65. [Google Scholar] [CrossRef]
  13. Tong, X.; Su, Y.; Li, Z.F.; Si, C.W.; Han, G.W.; Ning, J.; Yang, F.H. A Double-Step Unscented Kalman Filter and HMM-Based Zero-Velocity Update for PDR Using MEMS Sensors. IEEE Trans. Ind. Electron. 2020, 67, 581–591. [Google Scholar] [CrossRef]
  14. Huang, P.; Liu, S.; Lu, M.; Liu, Y.; Zhang, L.; Huang, Y.; Zhang, L. Design of STC12 and RFID Bracelet Campus Card System. Microcontrollers Embed. Syst. (Key Mag. China Technol.) 2019, 19, 76–80. [Google Scholar]
  15. Boudet, S.; de l’Aulnoit, A.H.; Demailly, R.; Peyrodie, L.; Beuscart, R.; de l’Aulnoit, D.H. Fetal heart rate baseline computation with a weighted median filter. Comput. Biol. Med. 2019, 114. [Google Scholar] [CrossRef]
  16. Huang, L.S.; Ding, W.J.; Liu, W.J.; Zhao, J.L.; Huang, W.J.; Xu, C.; Liang, D. Identification of wheat powdery mildew using in-situ hyperspectral data and linear regression and support vector machines. J. Plant. Pathol. 2019, 101, 1035–1045. [Google Scholar] [CrossRef]
  17. Li, D.Y.; Wen, G.H.; Hou, Z.; Huan, E.Y.; Hu, Y.; Li, H.H. RTCRelief-F: An effective clustering and ordering-based ensemble pruning algorithm for facial expression recognition. Knowl. Inf. Syst. 2019, 59, 219–250. [Google Scholar] [CrossRef]
  18. Kaur, P.; Pannu, H.S.; Malhi, A.K. Plant disease recognition using fractional-order Zernike moments and SVM classifier. Neural Comput. Appl. 2019, 31, 8749–8768. [Google Scholar] [CrossRef]
  19. Liu, Y.; Zhang, F.F.; Wang, C.K.; Wu, S.W.; Liu, J.; Xu, A.A.; Pan, X.Z. Estimating the soil salinity over partially vegetated surfaces from multispectral remote sensing image using non-negative matrix factorization. Geoderma 2019, 354. [Google Scholar] [CrossRef]
  20. Xiao, R.; Hu, Q.F.; Li, J. Leak detection of gas pipelines using acoustic signals based on wavelet transform and Support Vector Machine. Measurement 2019, 146, 479–489. [Google Scholar] [CrossRef]
  21. Vieira, P.M.; Freitas, N.R.; Valente, J.; Vaz, I.F.; Rolanda, C.; Lima, C.S. Automatic detection of small bowel tumors in wireless capsule endoscopy images using ensemble learning. Med. Phys. 2019, 13. [Google Scholar] [CrossRef] [PubMed]
  22. Lu, H.J.; Zou, N.; Jacobs, R.; Afflerbach, B.; Lu, X.G.; Morgans, D. Error assessment and optimal cross-validation approaches in machine learning applied to impurity diffusion. Comput. Mater. Sci. 2019, 169. [Google Scholar] [CrossRef]
  23. Xiong, Z.; Cui, Y.X.; Liu, Z.H.; Zhao, Y.; Hu, M.; Hu, J.J. Evaluating explorative prediction power of machine learning algorithms for materials discovery using k-fold forward cross-validation. Comput. Mater. Sci. 2020, 171. [Google Scholar] [CrossRef]
  24. Zhang, Y.X.; Zhang, X.; Chen, J.Z.; Yang, J.H. Electro-Mechanical Impedance Based Position Identification of Bolt Loosening Using LibSVM. Intell. Autom. Soft Comput. 2018, 24, 81–87. [Google Scholar] [CrossRef]
Figure 1. Framework of this article. Receiver Operating characteristic (ROC) Curve.
Figure 1. Framework of this article. Receiver Operating characteristic (ROC) Curve.
Sensors 20 01447 g001
Figure 2. Hardware design diagram.
Figure 2. Hardware design diagram.
Sensors 20 01447 g002
Figure 3. Acceleration signal after acceleration synthesis and filtering.
Figure 3. Acceleration signal after acceleration synthesis and filtering.
Sensors 20 01447 g003
Figure 4. Feature classification weight diagram before threshold setting: (a) Upper submap: Feature weight value map; (b) Lower submap: Weight value frequency chart.
Figure 4. Feature classification weight diagram before threshold setting: (a) Upper submap: Feature weight value map; (b) Lower submap: Weight value frequency chart.
Sensors 20 01447 g004
Figure 5. Feature classification weight diagram after threshold setting. (a) Upper submap: Feature weight value map; (b) Lower submap: Weight value frequency chart.
Figure 5. Feature classification weight diagram after threshold setting. (a) Upper submap: Feature weight value map; (b) Lower submap: Weight value frequency chart.
Sensors 20 01447 g005
Figure 6. 10-fold cross-validation of polynomial kernel optimization.
Figure 6. 10-fold cross-validation of polynomial kernel optimization.
Sensors 20 01447 g006
Figure 7. 10-fold cross-validation of polynomial kernel optimization.
Figure 7. 10-fold cross-validation of polynomial kernel optimization.
Sensors 20 01447 g007
Figure 8. Relief-bagging-SVM algorithm flow.
Figure 8. Relief-bagging-SVM algorithm flow.
Sensors 20 01447 g008
Figure 9. SVM ROC curve.
Figure 9. SVM ROC curve.
Sensors 20 01447 g009
Figure 10. Relief-SVM ROC curve.
Figure 10. Relief-SVM ROC curve.
Sensors 20 01447 g010
Figure 11. Relief-bagging-SVM ROC curve.
Figure 11. Relief-bagging-SVM ROC curve.
Sensors 20 01447 g011
Figure 12. ROC curves of SVM, KNN, DT and Relief-Bagging-SVM.
Figure 12. ROC curves of SVM, KNN, DT and Relief-Bagging-SVM.
Sensors 20 01447 g012
Table 1. Some important parameter settings of the hardware platform.
Table 1. Some important parameter settings of the hardware platform.
HardwareParameterValueParameterValue
MPU6050Sampling frequency125 Hzacceleration sensitivity/LSB/g16,384
Sampling range−4 g~4 g--
STC12 MCUx-axis acceleration register0 × 3B, 0 × 3Cy-axis acceleration registers0 × 3D, 0 × 3E
z-axis acceleration registers0 × 3F, 0 × 40--
BLECommunication cycle10 msBaud rate/bps11,520
Way of communicationAsynchronous serial--
Table 2. Feature name and corresponding dimension table. FFT: Fast Fourier transform.
Table 2. Feature name and corresponding dimension table. FFT: Fast Fourier transform.
CategoryFeature NameDimensionFeature NameDimension
mean1absolute slope9
standard deviation1maximum1
Time Domainskewness1root mean square1
correlation coefficient1maximal value1
variance1minimum1
average slope1kurtosis1
FFTspectrum energy1average power1
median frequency1--
Table 3. Feature number and name after Relief-F selection.
Table 3. Feature number and name after Relief-F selection.
NumberFeature NameNumberFeature NameNumberFeature Name
1mean8average slope23median frequency
4root mean square19maximum--
7maximal value21skewness--
Table 4. Classification effect of different feature selection methods (Polynomial). LASSO: least absolute shrinkage and selection operator.
Table 4. Classification effect of different feature selection methods (Polynomial). LASSO: least absolute shrinkage and selection operator.
CategoryLASSO-SVMRelief-F-SVM
Walking (%)80.00100.0
Running (%)93.33100.0
Standing (%)13.33100.0
Writing (%)86.6693.33
Man-made (%)13.3340.00
Sleep (%)93.33100.0
Downstairs (%)40.00100.0
Upstairs (%)66.66100.0
Average accuracy (%)60.8391.66
Table 5. Relief-F-SVM kernel function classification accuracy.
Table 5. Relief-F-SVM kernel function classification accuracy.
CategoryLinearPolynomialGaussSigmoid
Walking (%)100.0100.093.330
Running (%)100.0100.0100.00
Standing (%)93.33100.093.330
Writing (%)93.3393.3393.33100.0
Man-made (%)33.3340.0026.660
Sleep (%)86.67100.086.660
Downstairs (%)93.33100.093.330
Upstairs (%)53.33100.0100.012.50
Average accuracy (%)81.6691.6685.8312.50
Table 6. Action recognition and classification accuracy.
Table 6. Action recognition and classification accuracy.
CategoryKNNRFDTSVMRelief-SVMRelief-Bagging-SVM
Walking (%)100.093.75100.080.00100.0100.0
Running (%)100.0100.0100.093.33100.0100.0
Standing (%)73.3391.67100.013.33100.094.87
Writing (%)86.6638.46100.086.6793.3394.12
Man-made (%)40.00100.040.0013.3340.00100.0
Sleep (%)80.0085.71100.093.33100.097.56
Downstairs (%)100.0100.0100.040.00100.086.84
Upstairs (%)100.094.74100.066.67100.081.58
Normal Actions (%)100.097.12100.070.00100.092.10
Non-normal Actions (%)69.9978.9685.0051.6683.3396.63
Average accuracy (%)85.0088.0492.5060.8391.6694.37
Table 7. Time performance table.
Table 7. Time performance table.
Time/DimensionKNNRFDTSVMRelief-SVMRelief-Bagging-SVM
Feature dimension2323232377
Search time(s)1.360.580.8118.689.139.13
Table 8. Basic table of laboratory personnel.
Table 8. Basic table of laboratory personnel.
People12345678
SexManWomanWomanManWomanManWomanMan
Weight/kg6351458556805570
Height/cm170165157183161191155178
Age2621194542392322
Table 9. Some important parameters of k-Nearest Neighbor (KNN), Decision Tree (DT), Random Forest (RF) and SVM.
Table 9. Some important parameters of k-Nearest Neighbor (KNN), Decision Tree (DT), Random Forest (RF) and SVM.
ClassifierParameterValueParameterValue
DTMaximum number of splits100Surrogate decision splitsoff
Split criterionCini’s diversity indexMaximum surrogates per node10
SVMKernel functionPolynomialKernel scale modeManual
Multiclass methodOne-vs-OneStandardize dataon
RFPruning strategyPost-pruningTree numbers5
Split criterionCini’s diversity indexMax features23
KNNNumber of neighbors1Distance weightEqual
Distance metricEuclideanStandardize dataon
Table 10. AUC table.
Table 10. AUC table.
CategoryRFKNNDTSVMRelief-SVMRelief-Bagging-SVM
Walking---0.932111
Running---0.98220.99751
Standing---0.156211
Writing---0.92830.99940.9953
Man-made---0.33210.31621
Sleep---0.99490.99940.9981
Downstairs---0.831710.8567
Upstairs---0.744110.7231
Average AUC0.90660.83230.92310.73770.91410.9466
Table 11. Leave-One-Person-Out cross validation (LOPO-CV) experiment accuracy table.
Table 11. Leave-One-Person-Out cross validation (LOPO-CV) experiment accuracy table.
Category12345678
Walking (%)100.098.3297.63100.098.66100.097.22100.0
Running (%)100.0100.0100.0100.0100.0100.0100.0100.0
Standing (%)95.8793.6195.1194.3397.6594.1897.5896.33
Writing (%)93.1293.2194.6493.2192.4795.6697.5598.11
Man-made (%)100.096.2193.2294.3192.1095.3393.1194.56
Sleep (%)95.5696.5596.1294.3396.5893.2295.1294.23
Downstairs (%)90.8488.6384.2592.3197.4695.2186.3389.94
Upstairs (%)80.5884.1682.1586.2187.6880.1483.2288.21
Average accuracy (%)94.4993.8392.8994.3395.3294.2193.7695.17

Share and Cite

MDPI and ACS Style

Huang, P.; Li, Y.; Lv, X.; Chen, W.; Liu, S. Recognition of Common Non-Normal Walking Actions Based on Relief-F Feature Selection and Relief-Bagging-SVM. Sensors 2020, 20, 1447. https://doi.org/10.3390/s20051447

AMA Style

Huang P, Li Y, Lv X, Chen W, Liu S. Recognition of Common Non-Normal Walking Actions Based on Relief-F Feature Selection and Relief-Bagging-SVM. Sensors. 2020; 20(5):1447. https://doi.org/10.3390/s20051447

Chicago/Turabian Style

Huang, Pan, Yanping Li, Xiaoyi Lv, Wen Chen, and Shuxian Liu. 2020. "Recognition of Common Non-Normal Walking Actions Based on Relief-F Feature Selection and Relief-Bagging-SVM" Sensors 20, no. 5: 1447. https://doi.org/10.3390/s20051447

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop