Next Article in Journal
Optimized Electrode Locations for Wearable Single-Lead ECG Monitoring Devices: A Case Study Using WFEES Modules Based on the LANS Method
Previous Article in Journal
A Role-Based Access Control Model in Modbus SCADA Systems. A Centralized Model Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy

1
School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
2
Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing 100081, China
3
Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
4
Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing 100081, China
5
School of informatics and Engineering, University of Electro-Communications, Tokyo 163-8001, Japan
*
Authors to whom correspondence should be addressed.
Sensors 2019, 19(20), 4457; https://doi.org/10.3390/s19204457
Submission received: 13 September 2019 / Revised: 8 October 2019 / Accepted: 12 October 2019 / Published: 14 October 2019
(This article belongs to the Section Biomedical Sensors)

Abstract

:
Feature extraction, as an important method for extracting useful information from surface electromyography (SEMG), can significantly improve pattern recognition accuracy. Time and frequency analysis methods have been widely used for feature extraction, but these methods analyze SEMG signals only from the time or frequency domain. Recent studies have shown that feature extraction based on time-frequency analysis methods can extract more useful information from SEMG signals. This paper proposes a novel time-frequency analysis method based on the Stockwell transform (S-transform) to improve hand movement recognition accuracy from forearm SEMG signals. First, the time-frequency analysis method, S-transform, is used for extracting a feature vector from forearm SEMG signals. Second, to reduce the amount of calculations and improve the running speed of the classifier, principal component analysis (PCA) is used for dimensionality reduction of the feature vector. Finally, an artificial neural network (ANN)-based multilayer perceptron (MLP) is used for recognizing hand movements. Experimental results show that the proposed feature extraction based on the S-transform analysis method can improve the class separability and hand movement recognition accuracy compared with wavelet transform and power spectral density methods.

1. Introduction

Electromyography (EMG) signals are divided into two main groups: needle and surface EMG (SEMG) signals. SEMG signals have been widely used in upper-limb prosthesis control because of their advantages of being convenient and noninvasive [1,2,3,4,5]. However, EMG classification is very complex because of its properties of nonlinearity, nonstationarity and subject dependency [6,7]. There are three main steps for EMG classification: preprocessing, feature extraction, and classifier design. The difficulty in EMG signal classification is extracting a feature vector that is able to classify several motions because the EMG signals are subject-dependent and have noise interference. This step is important because the feature vector has a direct impact on the accuracy of the classifier. This research focuses on SEMG feature extraction, which is applicable to hand movement recognition.
Many studies have attempted to extract a feature vector from SEMG signals using time or frequency analysis methods. For example, the EMG amplitude, root mean square, zero-crossing, autoregressive coefficients, Fourier transform coefficients and cepstrum coefficients have been used as components of the feature vector [8,9,10,11,12,13]. Angkoon et al. introduced thirty-seven state-of-the-art EMG feature extraction methods for the time or frequency domain and compared their classification accuracies [14]. These introduced methods, based on time or frequency analysis, have been widely used for prosthetics, but they cannot combine the time and frequency domains; thus, the extracted features contain limited information. Recent studies have shown that time-frequency analysis methods can extract more information about SEMG signals, such as short-time Fourier transform [15], wavelet transform [16], and wavelet packet transform [17], but they yield a high-dimensional feature vector, which increases the learning parameters of a classifier. Feature reduction can increase the calculation speed of the classifier. Several feature reduction methods, such as principal component analysis (PCA) [18], simple Fisher linear discriminant analysis, and fuzzy logic, have been applied to reduce the number of features. Englehart et al. extracted a time-frequency feature vector through a wavelet packet and used PCA to reduce the number of features [19]. However, the short-time Fourier transform has a fixed window width when the window function is selected; thus, it only has a single time-frequency resolution. The wavelet transform can adaptively change the window function, but the signal analysis ability is seriously affected by noise. The Stockwell transform (S-transform) is a time-frequency analysis method, and it is developed from the short-time Fourier transform and wavelet transform. This method can adaptively adjust the window function and avoid the defect of a fixed window width. Furthermore, the S-transform has characteristics that are insensitive to noise. The S-transform has been used in the analysis of EEG and exhibits excellent performance in removing ECG artifacts from EEG data [20,21,22]. To the authors’ knowledge, this technique has not been applied in EMG classification. In this research, the S-transform is used to create a feature vector, aiming to improve the recognition accuracy of the classifier.
The classification maps the feature vectors from extracted features into specific classes of motion. With the development of prosthetic hands with multiple degrees of freedom, it has become more effective to apply pattern-recognition-based control, which consists of feature extraction and classification during signal processing [23]. Support vector machines [24,25], Bayesian classifiers [26], evidence accumulation [27], fuzzy logic [28], Gaussian mixture model classifiers [29], and k-nearest neighbor classifiers [30] are the most common classification techniques. Recently, many studies have shown the success of neural networks and their ability to learn the distinction between different conditions in pattern recognition. In this research, an artificial neural network (ANN)-based multilayer perceptron (MLP) is used as a classifier to recognize hand movements. To evaluate the performance of the S-transform, three different methods are used to extract features, and these methods used the same classifier.
In this research, a novel feature extraction method is proposed to recognize five hand motions plus a rest state. This method is compared with state-of-the-art feature extraction methods, including wavelet transform and power spectral density. An evaluation using statistical criteria and measurement of classification accuracy are proposed to evaluate these three feature extraction methods. This paper proposes using the S-transform method to extract a feature vector and uses the PCA method to reduce the dimension of the feature. An ANN-based MLP is used as a classifier to recognize the hand motions (see Figure 1). This paper is organized as follows. Experiments and data acquisition are presented in Section 2. Section 3 presents a novel feature extraction method and the design of a classifier. The results and discussion are shown in Section 4 and Section 5, and finally, the conclusion is presented in Section 6.

2. SEMG Data Acquisition

In this research, forearm SEMG signals were collected with a BioRadio (wireless physiological collector from Great Lakes NeuroTechnologies company). Eight subjects, consisting of three amputees and five healthy subjects, participated in this experiment (see Figure 2). The basic information of the subjects is shown in Table 1. Two EMG acquisition channels (CH1 and CH2) were used to collect the SEMG signals. The two channels of surface electrodes were placed on the flexor carpi radialis muscle (CH1) and extensor carpi radialis longus muscle (CH2). For the amputees, the two electrode placements are the remnants of the two muscles. Each channel has two pairs of surface electrodes, and each electrode was separated from the other by 2 cm.
Before the data acquisition began, each subject was given a thorough written and oral explanation of the experiment itself, including the associated risks, the subjects would then sign an informed consent form. The experiment was approved by the Local Ethics Committee of Peking University.
Generally, the dominant energy of SEMG is concentrated in the range of 20–500 Hz, and its amplitude is limited to 0–10 mV. Therefore, the sampling frequency was set at 1000 Hz, and a bandpass filter of 20–500 Hz bandwidth was used. Each subject performed six hand motions: wrist flexion, wrist extension, hand open, hand close, key grip and rest state. The amputees imagined performing the same motions with the amputation side as with the sound side. The tests were repeated six times for each subject, resulting in 10 s of EMG signals per subject for each motion. The first three times were used for the learning procedures, and the remaining three times were used for the evaluation of recognition performance. Fatigue of the subjects was avoided with a 2-minute resting period after each exercise. In Figure 3, the raw surface EMG data of six motions in a 256-point window from subject 1 collected by CH1 are shown. The window size of the EMG sample was set to 250 ms (256 samples) for real-time control to guarantee a response time of less than 300 ms, which allows the users to operate the prosthetic hands without perceiving a time delay.

3. Algorithm Description

The classification of hand motions through the SEMG signal includes three main steps: preprocessing, feature extraction and pattern recognition. The preprocessing of SEMG signals was performed using hardware. The novel feature extraction with the S-transform was proposed, and four selected features were proposed for one channel after the S-transform. To speed up the computation, the PCA method was adopted to reduce the dimensions. The details of the design process of the ANN-based MLP were introduced, which include the structure of the ANN model and loss function calculation method.

3.1. Feature Extraction and Reduction

The S-transform is developed from the short-time Fourier transform and wavelet transform, and it was proposed by Stockwell in 1996 [21]. The S-transform adopts a Gaussian window function, and the window width is proportional to the inverse of the frequency, which avoids the defect of a fixed window width. In addition, the extracted feature used in the S-transform method is insensitive to noise. The S-transform of signal h ( t ) is
S ( τ , f ) = h ( t ) f 2 π e ( τ t ) 2 f 2 2 e i 2 π f t d t
where t and f represent the time and the frequency, respectively. i is the imaginary unit, and τ is the center of the Gaussian window function. Equation (1) shows that the width and height of the Gaussian window vary with frequency. Let
a ( t , f ) = h ( τ ) e i 2 π f τ , b ( τ t , f ) = f 2 π e ( τ t ) 2 f 2 2
From Equation (2), the S-transform of signal h ( t ) can also be shown as the following equation:
S ( τ , f ) = a ( t , f ) b ( τ t , f ) d t
C ( α , f ) is a Fourier transform of S ( τ , f ) (from τ to α ), and A ( α , f ) and B ( α , f ) are the Fourier transforms of a ( t , f ) and b ( τ , f ) (from τ to α ), according to the convolution theorem:
C ( α , f ) = A ( α , f ) B ( α , f )
C ( α , f ) = H ( α + f ) e 2 π α 2 f 2
H ( α + f ) is the Fourier transform of a ( t , f ) , the exponential term is the Fourier transform of b ( τ , f ) , and the S-transform can be calculated via inverse Fourier transform by Equation (5) (from α to τ ):
S τ , f = H ( α + f ) e 2 π α 2 f 2 e i 2 π α τ d α
Let f n / N T and τ j T ; the discrete S-transform can be shown as the following equations:
S [ j T , n N T ] = m = 0 N 1 H [ m + n N T ] e 2 π 2 m 2 n 2 e i 2 π m j N , n 0 S [ j T , 0 ] = 1 N m = 0 N 1 h ( m N T ) , n = 0
H [ k ] = 1 N m = 1 N 1 h ( m ) e i 2 π k m N
where j, m, and n = 0 , 1 , , N 1 . As shown in Equation (8), the H [ k ] is discrete transform of time series h ( m ) . From Equation (7), the results of the discrete S-transform is a two-dimensional matrix, which is named the S-matrix. The raw elements of the S-matrix represent the frequency, and the column elements represent the sampling time. The S-matrix can be calculated according to Equation (7) using the fast Fourier transform and the inverse Fourier transform.
The raw signals were segmented into a 256-point window, and a signal with 256 points was defined as a segmented signal. Therefore, a matrix of segmented signals (2 × 256 matrix) can be one input for the control system of the prosthetic hand. The raw EMG signal can be collected as a two-dimensional matrix of time amplitude, and the S-transform can transform it into a three-dimensional matrix of time-frequency-amplitude.
The calculations of four features extracted from the S-matrix are studied in this research: (1) Maximum frequency in one segment signal (256 points) F 1 ; (2) The amplitude of the maximum frequency in one segment signal (256 points) F 2 ; (3) The median frequency in one segment signal F 3 ; (4) The energy of one segment signal F 4 . The other channel of the feature vector is defined as F ( F 5 , F 6 , F 7 , F 8 ) . Due to the two channels of EMG signals, the feature vector becomes eight dimensional (see Figure 4).
Next, the PCA method is used for feature reduction, which can improve the speed of the classifier. As shown in Figure 4, PCA preforms dimensionality reduction for two channel features, and after reduction by PCA, the number of features is reduced from eight to three. PCA has the advantage of automatically ranking the importance of features in the projection space. Then, the three features were used as an input vector for pattern recognition.

3.2. Classification

Finally, an ANN is used as the classifier. The ANN has one hidden layer with 10 neurons (see Figure 5). The network structure was determined by trial and error. The forward-propagating order is: linear function, ReLU function, linear function and softmax function. This process can be represented by the following equations:
z [ 1 ] ( i ) = W [ 1 ] x ( i ) + b [ 1 ] ( i )
a [ 1 ] ( i ) = r e l u ( z [ 1 ] ( i ) )
z [ 2 ] ( i ) = W [ 2 ] a [ 1 ] ( i ) + b [ 2 ] ( i )
y a = σ ( z [ 2 ] ( i ) ) = e Z [ 2 ] ( i ) K = 1 K e Z k
where x ( i ) is the input vector, W ( 1 ) and W ( 2 ) are weight parameters, and b [ 1 ] ( i ) and b [ 2 ] [ i ] are bias parameters. σ represents the softmax regression function, and k represents the labels. i = 0 , 1 , , 10 , k = 0 , 1 , , 6 . y a represents the probability of the kth motion. The cost function J can be computed as follows:
J = y ^ b I n y b
where y ^ b is the truth value of the ith category and y b is the prediction results of the output. The advanced optimization method is used for the backpropagation of the neural network, and our final target is minimizing the cost function L. The PCA-reduced feature vector is used as the input vector, and after training the neural network, the optimized parameter can be determined. Each label maps one hand motion, and the labels turn to one-hot encoding for the data processing (see Figure 5). This classifier uses the adaptive moment estimation (Adam) optimization method, which is an adaptive learning rate method. This method can be described by the following equations for l = 1 , , L :
v d W [ l ] = β 1 v d W [ l ] + ( 1 β 1 ) J W [ l ] v d W [ l ] c o r r e c t e d = v d W [ l ] 1 ( β 1 ) t s d W [ l ] = β 2 s d W [ l ] + ( 1 β 2 ) ( J W [ l ] ) 2 s d W [ l ] c o r r e c t e d = s d W [ l ] 1 ( β 1 ) t W [ l ] = W [ l ] α v d W [ l ] c o r r e c t e d s d W [ l ] c o r r e c t e d + ε
It calculates an exponentially weighted average of past gradients and stores it in variables v and v c o r r e c t e d . Variables s and s c o r r e c t e d were used to store the average weights of the squares of past gradients. Here,
  • t counts the number of steps taken by the Adam optimizer
  • L is the number of layers
  • β 1 and β 2 are hyperparameters that control the two exponentially weighted averages; generally, β 1 = 0.9, and β 2 = 0.999
  • α is the learning rate
  • ε is a very small number to avoid dividing by zero; generally, ε = 10E 8
The ANN model parameters were determined by the training data when the cost function J reached the minimum value, and the accuracy of the classifier in the test set was obtained, which can evaluate the performance of feature extraction methods.

4. Results

This research compared three feature extraction methods: power spectral density, wavelet packet transform and the proposed S-transform. Power spectral density and wavelet packet transform are popular advanced methods in EMG feature extraction. From the statistical criterion method and classifier measurement, the best feature selection method can be obtained.
Power spectral density is a frequency-domain analysis method. The mean frequency, median frequency and peak frequency are selected as features via the power spectral density. Each feature was calculated by 256 points. The mean frequency F a , median frequency F b , and peak frequency F c are shown as the following equations:
F a = j = 1 M f j P j / j = 1 M P j
j = 1 F b P j = j = F b M P j = 1 2 j = 1 M P j
F c = max ( P j ) , j = 1 , , M
where f j is the frequency of the spectrum at frequency bin j, P j is the EMG power spectrum at frequency bin j, and M is the length of the frequency bin. After the PCA method, the six features from the two channels are reduced to three. The PCA-reduced features are used as an input vector for the ANN-based MLP.
The wavelet packet transform is a time-frequency analysis method. Englehart. K. used the symmlet mother wavelet of order five as the wavelet packet basis function, and the results showed that it has a good effect on the EMG signal process [19]. Three levels of wavelet decomposition and symmlet mother wavelet of order five were adopted in this research. The original signal is S, and a decomposition of S into binary-tree-structured subspaces using the wavelet packet transform is shown in Figure 6. In this study, the maximum wavelet packet coefficient was chosen as the EMG feature. This was explained by the following equation:
F = { max S i , i = 1 , , 2 l e v e l }
where S i are wavelet coefficients after the decomposition, level = 3, and F represents the feature vector. Finally, the features were reduced by the PCA method in the same manner as the S-transform.

4.1. Evaluation of the S-transform Method

To evaluate the classification performance, the scatter plots of EMG features using the S-transform method are shown in Figure 7a, which are compared with the scatter plots of EMG features using the wavelet transform (see Figure 7b) and power spectral density (see Figure 7c). There are three features after feature reduction. The scatter plots of each of the two features are shown from six movements in three methods. Each movement uses a specific symbol and color with 100 sample points. Class separability can evaluate the performance of EMG features. The good quality in class separability indicates that the highest separation between classes is obtained. Generally, the statistical criterion method was used to evaluate the distance between two scatter groups and directly address the variation of features in the same group.
The RES index [31] uses the Euclidean distance as a distance function and the standard deviation as a dispersion measure. Euclidean distance is calculated as the root of square differences between coordinates of a pair of objects, and standard distance is the most robust and widely used measure of the variability. The best extraction performance is obtained when the Euclidean distance value is high and the standard deviation value is low.
The RES index uses the Euclidean distance as the numerator and the standard deviation as the denominator. Thus, a larger RES index signifies a higher class separation of each class. The R E S ( p , q ) index of two motions (p and q) can be expressed as
E D ( p , q ) = ( p 1 q 1 ) 2 + ( p 2 q 2 ) 2
σ = w = 1 N w ( r w μ ) 2 N W
R E S ( p , q ) = E D ( p , q ) σ ¯
F n o r m = r + min ( r ) max ( r + min ( r ) s
where p and q are the feature means of two motions from six hand motions with two channels. r is the feature of the w t h (w = 100) window of N w , and σ is the feature mean of all windows. σ ¯ is the average between the standard deviation of two motions (p and q) with two channels. In addition, the EMG features are normalized before calculating the RES index. The normalization of features F n o r m is performed, which can be expressed as Equation (22).
The average of R E S ( p , q ) from fifteen possible combinations of six hand movements was defined as the RES index. From the results, the RES indices of features using the proposed S-transform method are 9.14, 6.98, and 7.16, which are higher than the RES indices using wavelet transform and power spectral density, which means that the S-transform has the best quality of class separability. The results of the evaluation indicate that the S-transform is an effective feature extraction method.

4.2. Results of the Classifier

With the training data, the parameters of the ANN-based MLP were determined in the learning procedure. The recognition accuracies of the classifier using different feature extraction methods with test data are shown in Figure 8. The S-transform features provide 97.46%, 97.63%, 97.98%, 98.83%, 98.65%, 98.21%, 98.3%, and 97.91% mean accuracy in each subject. The wavelet packet transform provides 96.82%, 97.32%, 97.45%, 98.21%, 97.96%, 97.88%, 97.76%, and 97.44% mean accuracy, and the power spectral density provides 93.62%, 94.23%, 94.86%, 96.71%, 96.9%, 96.88%, 97.11%, and 97.21% mean accuracy in each subject. The results that used the proposed feature extraction method with four subjects showed higher accuracy than the wavelet transform method and power spectral density method.
In Figure 9, the red line represents the S-transform, the blue line represents the wavelet packet transform, and the green line represents the power spectral density. The average accuracy was improved by increasing the number of features with the three methods. When the number of features is equal to three, the speed of the increase becomes very slow. Comprehensively considering the performance and application, the three features will be more effective for the EMG classification method. With different numbers of features, the S-transform is superior to the wavelet transform and power spectral density. Thus, the S-transform can improve the class separability and classification accuracy.

5. Discussion

In this paper, the authors have proposed the S-transform as an efficient method for SEMG feature extraction. To the authors’ knowledge, this is the first study in which this algorithm has applied for hand movement recognition. Feature extraction is an important step in myoelectric pattern recognition, and the proposed method shows excellent performance in extracting features and classifying the SEMG data for different hand movements compared with other methods.
Previous studies have shown method based on the wavelet transform and the power spectral density have achieved competitive accuracy for classifying hand gestures compared with other existing methods [3,14]. Although its performance appeared to be increased by only a few percent (see Figure 8), the S-transform method was superior to the wavelet transform and power spectral density methods under the controlled conditions of this study, as proven using statistical methods. In many studies, the number of electrodes is increased to improve the classification accuracy [32,33,34]. However, the usage of multiple EMG sensors on a prosthetic hand is not practical. First, the weight of the socket will increase, causing an amputee to feel discomfort when wearing the SEMG sensor array. Second, as the number of electrodes increases, more dimensions of data must be processed, and the amount of computation will also increase. Thus, commercial advanced prosthetics typically have only one or two electrodes [35]. This paper therefore considers two channels, consistent with typical prosthetic hand applications.
Many studies have identified more than 10 distinct hand movements and have achieved up to 80–90% accuracy. In this paper, the authors use 2 electrodes to distinguish 6 hand movements with up to 95–98% under controlled conditions. The ability to recognize 6 hand movements for a prosthetic hand is superior to the capabilities of current commercial intelligent prostheses. Recognizing a larger number of hand movements would hinder practical application due to issues related to computational complexity and practicality.
In this paper, a three-layer ANN algorithm has been adopted as the classifier to evaluate the quality achieved with different numbers of features. In designing the classifier, a linear softmax model is used here to learn a good distribution of factorized features. Although a convolutional neural network (CNN) could offer improved accuracy for hand movement classification [36], a large amount of data would be required for pretraining. Because a CNN has many layers, its calculation time is long. Therefore, an ANN was instead adopted in this paper to evaluate the proposed feature extraction method. The proposed time-frequency method requires feature reduction due to the high dimensionality of the data; therefore, choosing an optimal number of features is very important. As seen from Figure 8, there are considerable changes after dimensionality reduction to between 1 dimension and three dimensions, whereas the change in accuracy with more than three dimensions is stable. Therefore, 3-dimensional features are chosen in this paper.
After more than 70 years of development of EMG signal control methods, the main approaches are still dominated by threshold control. The main reason is that EMG signals are nonlinear and random, making it very difficult to extract characteristic quantities. The superiority of the S-transform has been verified offline in this paper. In the future, this method could be used to control various movements of prosthetic limbs in an online manner. In practical applications, the characteristics of different movements may change with muscle fatigue; in such a case, the parameters of the neural network will need to be relearned to adjust to these changes. If the classifier can learn autonomously, then the algorithm proposed in this paper, combined with an artificial intelligence algorithm, will be very effective in clinical application.

6. Conclusions

A method was proposed to extract forearm EMG signal features in the time-frequency domain using the S-transform. The dimension of the S-transform features was then reduced by PCA. Subsequently, an ANN-based MLP was proposed to classify the six hand motions. According to the results of the RES index, the proposed method has the best overall performance compared with current popular feature extraction methods. The experimental results show that the S-transform can offer more information about the EMG signal, which can improve the class separability and classification accuracy. In future work, this method could be used for prosthetic hand control, which could improve the accuracy of hand motion classification.

Author Contributions

Conceptualization and methodology, H.S.; Data curation, J.Z.; Writing–original draft, Y.T.; Experiment design, Y.W.; Writing–review & editing, H.Y. and Q.H.

Funding

This work was supported by the Beijing Advanced Innovation Center of Intelligent Robots and Systems under Grant 2016IRS23.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EMGElectromyography
SEMGsurface Electromyography
S-transformStockwell transform
PCAprincipal component analysis
ANNartificial neural network
MLPmultilayer perceptron
Adamadaptive moment estimation
CNNconvolutional neural network

References

  1. Chu, J.U.; Moon, I.; Mun, M.S. A real-time EMG pattern recognition system based on linear-nonlinear feature projection for a multifunction myoelectric hand. IEEE Trans. Biomed. Eng. 2006, 53, 2232–2239. [Google Scholar] [PubMed]
  2. Geethanjali, P. Myoelectric control of prosthetic hands: State-of-the-art review. Med. Devices 2016, 9, 247–255. [Google Scholar] [CrossRef] [PubMed]
  3. Canal, M.R. Comparison of wavelet and short time Fourier transform methods in the analysis of EMG signals. J. Med. Syst. 2010, 34, 91–94. [Google Scholar] [CrossRef] [PubMed]
  4. Young, A.J.; Smith, L.H.; Rouse, E.J.; Hargrove, L.J. Classification of simultaneous movements using surface EMG pattern recognition. IEEE Trans. Biomed. Eng. 2012, 60, 1250–1258. [Google Scholar] [CrossRef] [PubMed]
  5. Tavakoli, M.; Benussi, C.; Lourenco, J.L. Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach. Expert Syst. Appl. 2017, 79, 322–332. [Google Scholar] [CrossRef]
  6. Chowdhury, R.; Reaz, M.; Ali, M. Surface electromyography signal processing and classification techniques. Sensors 2013, 13, 12431–12466. [Google Scholar] [CrossRef] [PubMed]
  7. Phinyomark, A.; Quaine, F.; Charbonnier, S.; Serviere, C.; Tarpin, B.F. EMG feature evaluation for improving myoelectric pattern recognition robustness. Expert Syst. Appl. 2013, 40, 4832–4840. [Google Scholar] [CrossRef]
  8. Farina, D.; Jiang, N.; Rehbaum, H. The extraction of neural information from the surface EMG for the control of upper-limb prostheses: Emerging avenues and challenges. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 797–809. [Google Scholar] [CrossRef]
  9. Brunelli, D.; Tadesse, A.M.; Vodermayer, B. Low-cost wearable multichannel surface EMG acquisition for prosthetic hand control. In Proceedings of the International Workshop on Advances in Sensors and Interfaces, Gallipoli, Italy, 18–19 June 2015; pp. 94–99. [Google Scholar]
  10. Zhai, X.; Jelfs, B.; Chan, R.H.M. Short latency hand movement classification based on surface EMG spectrogram with PCA. In Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 327–330. [Google Scholar]
  11. Spiewak, C.; Islam, M.R.; Zaman, M.A.U. A Comprehensive Study on EMG Feature Extraction and Classifiers. Open Access J. Biomed. Eng. Biosci. 2018, 1, 17–26. [Google Scholar] [CrossRef]
  12. Mallik, S.; Dutta, M. A Study on Control of Myoelectric Prosthetic Hand Based on Surface EMG Pattern Recognition. Int. J. Adv. Res. Sci. Eng. 2017, 6, 635–646. [Google Scholar]
  13. Altin, C.; Er, O. Comparison of different time and frequency domain feature extraction methods on elbow gesture’s EMG. Eur. J. Interdiscip. Stud. 2016, 2, 35–44. [Google Scholar] [CrossRef]
  14. Phinyomark, A.; Phukpattaranont, P.; Limsakul, P.C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  15. Veer, K.; Agarwal, R. Wavelet and short-time Fourier transform comparison-based analysis of myoelectric signals. J. Appl. Stat. 2015, 42, 1591–1601. [Google Scholar] [CrossRef]
  16. Englehart, K.; Hudgins, B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. 2003, 50, 848–854. [Google Scholar] [CrossRef]
  17. Li, D.; Pedrycz, W.; Pizzi, N.J. Fuzzy wavelet packet based feature extraction method and its application to biomedical signal classification. IEEE Trans. Biomed. Eng. 2005, 52, 1132–1139. [Google Scholar] [CrossRef]
  18. Smith, R.J.; Tenore, F.; Huberdeau, D. Continuous decoding of finger position from surface EMG signals for the control of powered prostheses. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008; pp. 197–200. [Google Scholar]
  19. Englehart, K.; Hudgins, B.; Parker, P.A. A wavelet-based continuous classification scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. 2001, 48, 302–311. [Google Scholar] [CrossRef]
  20. Fedele, T.; Scheer, H.J.; Waterstraat, G.; Telenczuk, B.; Burghoff, M.; Curio, G. Towards non-invasive multi-unit spike recordings: Mapping 1 kHz EEG signals over human somatosensory cortex. Clin. Neurophysiol. 2012, 123, 2370–2376. [Google Scholar] [CrossRef]
  21. Pinnegar, C.R.; Khosravani, H.; Federico, P. Time-frequency phase analysis of Ictal EEG recordings with the S-transform. IEEE Trans. Biomed. Eng. 2009, 56, 2583–2593. [Google Scholar] [CrossRef]
  22. Stockwell, R.G.; Mansinha, L.; Lowe, R.P. Localization of the complex spectrum: The S transform. IEEE Trans. Signal Process. 1996, 44, 998–1001. [Google Scholar] [CrossRef]
  23. Veer, K.; Sharma, T. A novel feature extraction for robust EMG pattern recognition. J. Med. Eng. Technol. 2016, 40, 149–154. [Google Scholar] [CrossRef]
  24. Zhi, L.; Jian, G. Using singular eigenvalues of wavelet coefficient as the input of SVM to recognize motion patterns of the hand. In Proceedings of the International Conference on Neural Networks and Brain, Beijing, China, 13–15 October 2005; pp. 1477–1481. [Google Scholar]
  25. Geethanjali, P.; Ray, K.K. A low-cost real-time research platform for EMG pattern recognition-based prosthetic hand. IEEE/ASME Trans. Mechatron. 2014, 20, 1948–1955. [Google Scholar] [CrossRef]
  26. Baldacchino, T.; Jacobs, W.R.; Anderson, S.R. Simultaneous force regression and movement classification of fingers via surface EMG within a unified Bayesian framework. Front. Bioeng. Biotechnol. 2018. [Google Scholar] [CrossRef] [PubMed]
  27. Lee, P.S.; Park, S.H.; Kim, J.S.; Kim, I.J. EMG pattern recognition based on evidence accumulation for prosthesis control. In Proceedings of the 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Amsterdam, The Netherlands, 31 October–3 November 1996; pp. 1481–1483. [Google Scholar]
  28. Ajiboye, A.B.; Weir, R.F. A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 280–291. [Google Scholar] [CrossRef] [PubMed]
  29. Chu, J.U.; Moon, I.; Lee, Y.J.; Kim, S.K.; Mun, M.S. A supervised feature-projection-based real-time EMG pattern recognition for multifunction myoelectric hand control. IEEE/ASME Trans. Mechatron. 2007, 12, 282–290. [Google Scholar] [CrossRef]
  30. Pan, S.; Jie, J.; Liu, K. Classification Methods of sEMG Through Weighted Representation-Based K-Nearest Neighbor. In Proceedings of the International Conference on Intelligent Robotics and Applications, Shenyang, China, 8–11 August 2019; pp. 456–466. [Google Scholar]
  31. Phinyomark, A.; Hirunviriya, S.; Limsakul, C. Evaluation of EMG feature extraction for hand movement recognition based on Euclidean distance and standard deviation. In Proceedings of the 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Chiang Mai, Thailand, 19–21 May 2010; pp. 856–860. [Google Scholar]
  32. Naik, G.R.; Al-Timemy, A.H.; Nguyen, H.T. Transradial amputee gesture classification using an optimal number of sEMG sensors: An approach using ICA clustering. IEEE Trans. Neural Syst. Rehabil. Eng. 2015, 24, 837–846. [Google Scholar] [CrossRef]
  33. Yoo, H.J.; Park, H.; Lee, B. Myoelectric Signal Classification of Targeted Muscles Using Dictionary Learning. Sensors 2019, 19, 2370. [Google Scholar] [CrossRef]
  34. Atzori, M.; Gijsberts, A.; Castellini, C. Electromyography data for non-invasive naturally-controlled robotic hand prostheses. Sci. Data 2014. [Google Scholar] [CrossRef]
  35. Belter, J.T.; Segil, J.L.; Dollar, A.M.; Weir, R.F. Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. J. Rehabil. Res. Dev. 2013, 50, 599–618. [Google Scholar] [CrossRef]
  36. Atzori, M.; Cognolato, M.; Muller, H. Deep learning with convolutional neural networks applied to electromyography data: A resource for the classification of movements for prosthetic hands. Front. Neurorobotics 2016. [Google Scholar] [CrossRef]
Figure 1. Block diagram for EMG pattern recognition.
Figure 1. Block diagram for EMG pattern recognition.
Sensors 19 04457 g001
Figure 2. EMG data acquisition from some of the subjects.
Figure 2. EMG data acquisition from some of the subjects.
Sensors 19 04457 g002
Figure 3. Raw EMG in 256-point window of one subject performing six motions by CH1.
Figure 3. Raw EMG in 256-point window of one subject performing six motions by CH1.
Sensors 19 04457 g003
Figure 4. Feature extraction algorithm.
Figure 4. Feature extraction algorithm.
Sensors 19 04457 g004
Figure 5. ANN-based multi-layer perceptron.
Figure 5. ANN-based multi-layer perceptron.
Sensors 19 04457 g005
Figure 6. Wavelet transform decomposition tree from decomposition level 3.
Figure 6. Wavelet transform decomposition tree from decomposition level 3.
Sensors 19 04457 g006
Figure 7. (a) Scatter plot of six different movement features extracted using the S-transform. (b) Scatter plot of six different movement features extracted using the wavelet transform. (c) Scatter plot of six different movement features extracted using the power spectral density.
Figure 7. (a) Scatter plot of six different movement features extracted using the S-transform. (b) Scatter plot of six different movement features extracted using the wavelet transform. (c) Scatter plot of six different movement features extracted using the power spectral density.
Sensors 19 04457 g007
Figure 8. Classification accuracies for different feature methods.
Figure 8. Classification accuracies for different feature methods.
Sensors 19 04457 g008
Figure 9. Average classification accuracies for Stockwell transform, wavelet transform features and power spectral density.
Figure 9. Average classification accuracies for Stockwell transform, wavelet transform features and power spectral density.
Sensors 19 04457 g009
Table 1. The basic information of the subjects.
Table 1. The basic information of the subjects.
SubjectGenderStateAge (Years)The Time of Amputation (Years)
1maleamputee582
2maleamputee5630
3femaleamputee5535
4malehealthy29/
5malehealthy32/
6femalehealthy27/
7malehealthy33/
8malehealthy35/

Share and Cite

MDPI and ACS Style

She, H.; Zhu, J.; Tian, Y.; Wang, Y.; Yokoi, H.; Huang, Q. SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors 2019, 19, 4457. https://doi.org/10.3390/s19204457

AMA Style

She H, Zhu J, Tian Y, Wang Y, Yokoi H, Huang Q. SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors. 2019; 19(20):4457. https://doi.org/10.3390/s19204457

Chicago/Turabian Style

She, Haotian, Jinying Zhu, Ye Tian, Yanchao Wang, Hiroshi Yokoi, and Qiang Huang. 2019. "SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy" Sensors 19, no. 20: 4457. https://doi.org/10.3390/s19204457

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop