SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy
Abstract
:1. Introduction
2. SEMG Data Acquisition
3. Algorithm Description
3.1. Feature Extraction and Reduction
3.2. Classification
- t counts the number of steps taken by the Adam optimizer
- L is the number of layers
- and are hyperparameters that control the two exponentially weighted averages; generally, = 0.9, and = 0.999
- is the learning rate
- is a very small number to avoid dividing by zero; generally, = 10E
4. Results
4.1. Evaluation of the S-transform Method
4.2. Results of the Classifier
5. Discussion
6. Conclusions
Author Contributions
Funding
Conflicts of Interest
Abbreviations
EMG | Electromyography |
SEMG | surface Electromyography |
S-transform | Stockwell transform |
PCA | principal component analysis |
ANN | artificial neural network |
MLP | multilayer perceptron |
Adam | adaptive moment estimation |
CNN | convolutional neural network |
References
- Chu, J.U.; Moon, I.; Mun, M.S. A real-time EMG pattern recognition system based on linear-nonlinear feature projection for a multifunction myoelectric hand. IEEE Trans. Biomed. Eng. 2006, 53, 2232–2239. [Google Scholar] [PubMed]
- Geethanjali, P. Myoelectric control of prosthetic hands: State-of-the-art review. Med. Devices 2016, 9, 247–255. [Google Scholar] [CrossRef] [PubMed]
- Canal, M.R. Comparison of wavelet and short time Fourier transform methods in the analysis of EMG signals. J. Med. Syst. 2010, 34, 91–94. [Google Scholar] [CrossRef] [PubMed]
- Young, A.J.; Smith, L.H.; Rouse, E.J.; Hargrove, L.J. Classification of simultaneous movements using surface EMG pattern recognition. IEEE Trans. Biomed. Eng. 2012, 60, 1250–1258. [Google Scholar] [CrossRef] [PubMed]
- Tavakoli, M.; Benussi, C.; Lourenco, J.L. Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach. Expert Syst. Appl. 2017, 79, 322–332. [Google Scholar] [CrossRef]
- Chowdhury, R.; Reaz, M.; Ali, M. Surface electromyography signal processing and classification techniques. Sensors 2013, 13, 12431–12466. [Google Scholar] [CrossRef] [PubMed]
- Phinyomark, A.; Quaine, F.; Charbonnier, S.; Serviere, C.; Tarpin, B.F. EMG feature evaluation for improving myoelectric pattern recognition robustness. Expert Syst. Appl. 2013, 40, 4832–4840. [Google Scholar] [CrossRef]
- Farina, D.; Jiang, N.; Rehbaum, H. The extraction of neural information from the surface EMG for the control of upper-limb prostheses: Emerging avenues and challenges. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 797–809. [Google Scholar] [CrossRef]
- Brunelli, D.; Tadesse, A.M.; Vodermayer, B. Low-cost wearable multichannel surface EMG acquisition for prosthetic hand control. In Proceedings of the International Workshop on Advances in Sensors and Interfaces, Gallipoli, Italy, 18–19 June 2015; pp. 94–99. [Google Scholar]
- Zhai, X.; Jelfs, B.; Chan, R.H.M. Short latency hand movement classification based on surface EMG spectrogram with PCA. In Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 327–330. [Google Scholar]
- Spiewak, C.; Islam, M.R.; Zaman, M.A.U. A Comprehensive Study on EMG Feature Extraction and Classifiers. Open Access J. Biomed. Eng. Biosci. 2018, 1, 17–26. [Google Scholar] [CrossRef]
- Mallik, S.; Dutta, M. A Study on Control of Myoelectric Prosthetic Hand Based on Surface EMG Pattern Recognition. Int. J. Adv. Res. Sci. Eng. 2017, 6, 635–646. [Google Scholar]
- Altin, C.; Er, O. Comparison of different time and frequency domain feature extraction methods on elbow gesture’s EMG. Eur. J. Interdiscip. Stud. 2016, 2, 35–44. [Google Scholar] [CrossRef]
- Phinyomark, A.; Phukpattaranont, P.; Limsakul, P.C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
- Veer, K.; Agarwal, R. Wavelet and short-time Fourier transform comparison-based analysis of myoelectric signals. J. Appl. Stat. 2015, 42, 1591–1601. [Google Scholar] [CrossRef]
- Englehart, K.; Hudgins, B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. 2003, 50, 848–854. [Google Scholar] [CrossRef]
- Li, D.; Pedrycz, W.; Pizzi, N.J. Fuzzy wavelet packet based feature extraction method and its application to biomedical signal classification. IEEE Trans. Biomed. Eng. 2005, 52, 1132–1139. [Google Scholar] [CrossRef]
- Smith, R.J.; Tenore, F.; Huberdeau, D. Continuous decoding of finger position from surface EMG signals for the control of powered prostheses. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008; pp. 197–200. [Google Scholar]
- Englehart, K.; Hudgins, B.; Parker, P.A. A wavelet-based continuous classification scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. 2001, 48, 302–311. [Google Scholar] [CrossRef]
- Fedele, T.; Scheer, H.J.; Waterstraat, G.; Telenczuk, B.; Burghoff, M.; Curio, G. Towards non-invasive multi-unit spike recordings: Mapping 1 kHz EEG signals over human somatosensory cortex. Clin. Neurophysiol. 2012, 123, 2370–2376. [Google Scholar] [CrossRef]
- Pinnegar, C.R.; Khosravani, H.; Federico, P. Time-frequency phase analysis of Ictal EEG recordings with the S-transform. IEEE Trans. Biomed. Eng. 2009, 56, 2583–2593. [Google Scholar] [CrossRef]
- Stockwell, R.G.; Mansinha, L.; Lowe, R.P. Localization of the complex spectrum: The S transform. IEEE Trans. Signal Process. 1996, 44, 998–1001. [Google Scholar] [CrossRef]
- Veer, K.; Sharma, T. A novel feature extraction for robust EMG pattern recognition. J. Med. Eng. Technol. 2016, 40, 149–154. [Google Scholar] [CrossRef]
- Zhi, L.; Jian, G. Using singular eigenvalues of wavelet coefficient as the input of SVM to recognize motion patterns of the hand. In Proceedings of the International Conference on Neural Networks and Brain, Beijing, China, 13–15 October 2005; pp. 1477–1481. [Google Scholar]
- Geethanjali, P.; Ray, K.K. A low-cost real-time research platform for EMG pattern recognition-based prosthetic hand. IEEE/ASME Trans. Mechatron. 2014, 20, 1948–1955. [Google Scholar] [CrossRef]
- Baldacchino, T.; Jacobs, W.R.; Anderson, S.R. Simultaneous force regression and movement classification of fingers via surface EMG within a unified Bayesian framework. Front. Bioeng. Biotechnol. 2018. [Google Scholar] [CrossRef] [PubMed]
- Lee, P.S.; Park, S.H.; Kim, J.S.; Kim, I.J. EMG pattern recognition based on evidence accumulation for prosthesis control. In Proceedings of the 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Amsterdam, The Netherlands, 31 October–3 November 1996; pp. 1481–1483. [Google Scholar]
- Ajiboye, A.B.; Weir, R.F. A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 280–291. [Google Scholar] [CrossRef] [PubMed]
- Chu, J.U.; Moon, I.; Lee, Y.J.; Kim, S.K.; Mun, M.S. A supervised feature-projection-based real-time EMG pattern recognition for multifunction myoelectric hand control. IEEE/ASME Trans. Mechatron. 2007, 12, 282–290. [Google Scholar] [CrossRef]
- Pan, S.; Jie, J.; Liu, K. Classification Methods of sEMG Through Weighted Representation-Based K-Nearest Neighbor. In Proceedings of the International Conference on Intelligent Robotics and Applications, Shenyang, China, 8–11 August 2019; pp. 456–466. [Google Scholar]
- Phinyomark, A.; Hirunviriya, S.; Limsakul, C. Evaluation of EMG feature extraction for hand movement recognition based on Euclidean distance and standard deviation. In Proceedings of the 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Chiang Mai, Thailand, 19–21 May 2010; pp. 856–860. [Google Scholar]
- Naik, G.R.; Al-Timemy, A.H.; Nguyen, H.T. Transradial amputee gesture classification using an optimal number of sEMG sensors: An approach using ICA clustering. IEEE Trans. Neural Syst. Rehabil. Eng. 2015, 24, 837–846. [Google Scholar] [CrossRef]
- Yoo, H.J.; Park, H.; Lee, B. Myoelectric Signal Classification of Targeted Muscles Using Dictionary Learning. Sensors 2019, 19, 2370. [Google Scholar] [CrossRef]
- Atzori, M.; Gijsberts, A.; Castellini, C. Electromyography data for non-invasive naturally-controlled robotic hand prostheses. Sci. Data 2014. [Google Scholar] [CrossRef]
- Belter, J.T.; Segil, J.L.; Dollar, A.M.; Weir, R.F. Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. J. Rehabil. Res. Dev. 2013, 50, 599–618. [Google Scholar] [CrossRef]
- Atzori, M.; Cognolato, M.; Muller, H. Deep learning with convolutional neural networks applied to electromyography data: A resource for the classification of movements for prosthetic hands. Front. Neurorobotics 2016. [Google Scholar] [CrossRef]
Subject | Gender | State | Age (Years) | The Time of Amputation (Years) |
---|---|---|---|---|
1 | male | amputee | 58 | 2 |
2 | male | amputee | 56 | 30 |
3 | female | amputee | 55 | 35 |
4 | male | healthy | 29 | / |
5 | male | healthy | 32 | / |
6 | female | healthy | 27 | / |
7 | male | healthy | 33 | / |
8 | male | healthy | 35 | / |
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
She, H.; Zhu, J.; Tian, Y.; Wang, Y.; Yokoi, H.; Huang, Q. SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors 2019, 19, 4457. https://doi.org/10.3390/s19204457
She H, Zhu J, Tian Y, Wang Y, Yokoi H, Huang Q. SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors. 2019; 19(20):4457. https://doi.org/10.3390/s19204457
Chicago/Turabian StyleShe, Haotian, Jinying Zhu, Ye Tian, Yanchao Wang, Hiroshi Yokoi, and Qiang Huang. 2019. "SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy" Sensors 19, no. 20: 4457. https://doi.org/10.3390/s19204457
APA StyleShe, H., Zhu, J., Tian, Y., Wang, Y., Yokoi, H., & Huang, Q. (2019). SEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors, 19(20), 4457. https://doi.org/10.3390/s19204457