Next Article in Journal
Procedure Proposal for Minimising the Dynamic Error of Second-Order Sensors
Previous Article in Journal
Connecting Text Classification with Image Classification: A New Preprocessing Method for Implicit Sentiment Text Classification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Proposed Fatigue Index for the Objective Detection of Muscle Fatigue Using Surface Electromyography and a Double-Step Binary Classifier

by
Hassan M. Qassim
1,2,
Wan Zuha Wan Hasan
1,*,
Hafiz R. Ramli
1,
Hazreen Haizi Harith
3,
Liyana Najwa Inche Mat
4 and
Luthffi Idzhar Ismail
1
1
Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang 43400, Selangor, Malaysia
2
Department of Medical Instrumentation Engineering, Technical Engineering College of Mosul, Northern Technical University, Mosul 41001, Iraq
3
Department of Biological and Agricultural Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang 43400, Selangor, Malaysia
4
Department of Neurology, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Serdang 43400, Selangor, Malaysia
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(5), 1900; https://doi.org/10.3390/s22051900
Submission received: 25 January 2022 / Revised: 18 February 2022 / Accepted: 25 February 2022 / Published: 28 February 2022
(This article belongs to the Section Biomedical Sensors)

Abstract

:
The objective detection of muscle fatigue reports the moment at which a muscle fails to sustain the required force. Such a detection prevents any further injury to the muscle following fatigue. However, the objective detection of muscle fatigue still requires further investigation. This paper presents an algorithm that employs a new fatigue index for the objective detection of muscle fatigue using a double-step binary classifier. The proposed algorithm involves analyzing the acquired sEMG signals in both the time and frequency domains in a double-step investigation. The first step involves calculating the value of the integrated EMG (IEMG) to determine the continuous contraction of the muscle being investigated. It was found that the IEMG value continued to increase with prolonged muscle contraction and progressive fatigue. The second step involves differentiating between the high-frequency components (HFC) and low-frequency components (LFC) of the EMG, and calculating the fatigue index. Basically, the segmented EMG signal was filtered by two band-pass filters separately to produce two sub-signals, namely, a high-frequency sub-signal (HFSS) and a low-frequency sub-signal (LFSS). Then, the instantaneous mean amplitude (IMA) was calculated for the two sub-signals. The proposed algorithm indicates that the IMA of the HFSS tends to decrease during muscle fatigue, while the IMA of the LFSS tends to increase. The fatigue index represents the difference between the IMA values of the LFSS and HFSS, respectively. Muscle fatigue was found to be present and was objectively detected when the value of the proposed fatigue index was equal to or greater than zero. The proposed algorithm was tested on 75 EMG signals that were extracted from 75 middle deltoid muscles. The results show that the proposed algorithm had an accuracy of 94.66% in distinguishing between conditions of muscle fatigue and non-fatigue.

1. Introduction

Fatigue is defined as the inability of the respective muscles to contract and perform a specific procedure over a long period of time [1,2]. This inability happens because of the reduction of the central motor drive of the muscle, which reduces the amount of force being produced, and consequently results in the experience of pain and fatigue [3].
Despite the fact that the assessment of muscle fatigue based on an analysis of the surface electromyography (sEMG) signal has been intensively discussed and understood [4], the objective detection of muscle fatigue still requires further investigation [5]. In medical terms, muscle fatigue is detected either subjectively or objectively [6]. The subjective detection of muscle fatigue is reported by the individuals themselves, when no type of measurement is applied [6]. However, the objective detection of muscle fatigue requires the application of a specific type of measurement to detect the fatigue, which, in the case of this study, involves an analysis of the sEMG signals [7]. Consequently, the objective detection of muscle fatigue disregards any subjective reports by individuals [7], and, furthermore, it identifies the level of exhaustion of the muscle [8]. Hence, the objective detection of muscle fatigue is able to prevent post-fatigue injuries caused by over-training by athletes and rehabilitation exercises for stroke patients [9,10].
In surface electromyography (sEMG), electrical signals from a muscle are captured by electrodes attached directly to the surface of the skin. The acquired sEMG signal must be accurately processed and analyzed to interpret the information contained within. The method of processing and analyzing is determined based on the dedicated purpose of the extracted sEMG signal [11]. Currently, EMG is analyzed either in a time domain or frequency domain. An analysis of the EMG in a time domain involves extracting several amplitude-time dependent features, such as the root mean square (RMS) [12], integrated EMG (IEMG) [13], absolute rectified value (ARV) [14], log detector (LOG) [15], waveform length (WL) [16], zero crossing (ZC) [17], slope sign change (SSC), etc. [18]. Time domain features are mostly employed to provide fine controls for prostheses and rehabilitation robots [19,20,21]. However, analyzing in a frequency domain involves extracting power-frequency dependent features, such as the mean frequency (MNF), median frequency (MDF) [18], total power (TTP) [13], etc. [16]. Frequency domain features are mostly dedicated to the assessment of muscle fatigue [4]. The analysis of the EMG in both domains for the purpose of controlling and assessing fatigue has been well studied, and several papers have been published on the subject [5,11,22].
For an EMG-based fatigue analysis, static and dynamic exercises are usually performed to activate the skeletal muscles of the body and force them to reach fatigue levels. For example, a dumbbell curl exercise is performed to activate the biceps and triceps [8]. Dumbbells of various weights, such as 5 kg, 6 kg, and 8 kg, are used to accelerate the progress of fatigue. It has been suggested that fatigue occurs once the subject can no longer perform the dumbbell curl activity [8,23]. Moreover, a hand muscle developer can be used to activate the forearm muscles [24], while the scapular plane is considered as an efficient posture for activating the middle deltoid muscle [25]. To conclude, whether static or dynamic exercises are performed, fatigue occurs once the muscle can no longer perform the activity. The next section reviews the literature and the related algorithms that were suggested for the objective detection of muscle fatigue.

Literature Review and Motivation

Only a few types of research were suggested for the objective detection of muscle fatigue. Karthick and his colleagues [26] used the support vector machine classifier to classify fatigue and non-fatigue conditions, where an accuracy of 91% was achieved. The aforementioned study proposed the use of the extended modified B-distribution method of analysis to extract four features, namely, the singular value decomposition (SVD)-based entropy, kurtosis, mean frequency, and median frequency.
Fernando proposed an algorithm that combines two EMG features, namely, the mean frequency (MNF) and absolute rectified value (ARV), to objectively detect fatigue in the biceps muscle [23]. The MNF/ARV ratio is calculated and regarded as an index of muscle fatigue, where the aforementioned ratio gradually decreases as fatigue progresses [23]. Fatigue exists once the ratio reaches a specific baseline, which is defined as the inverse value of the MNF/ARV. As reported by the authors, the initial values of the MNF and ARV are taken as the reference values for the baseline to eliminate individual differences. Kiryu and his colleagues also used the MNF and ARV features to objectively detect fatigue [27]. The correlation coefficient between MNF and ARV is taken as an index of fatigue. The conversion of the correlation coefficient from positive to negative is regarded as a sign of muscle fatigue. The aforementioned algorithms have their own drawbacks that are either related to the computation time or to individual differences.
The mean power frequency (MNP) was proposed as a muscle fatigue index by [2,8]. The study suggested that a high-frequency spectrum tends to transform to a low-frequency spectrum with the progression of fatigue. The opposite behavior takes place when the muscle recovers, where the low-frequency spectrum tends to transform to a high-frequency spectrum. This study, however, only showed how to assess fatigue, which is widely identified by further frequency domain features, such as the MNF and MDF [16].
However, refs. [28,29] followed a different technique to detect muscle fatigue. They suggested that the frequency spectrum of the EMG can be classified into three regions, namely, low-frequency components (LFC) (20–45 Hz), intermediate-frequency components (IFC) (46–80 Hz), and high-frequency components (HFC) (81–350 Hz). The power spectrum of each component is calculated and their behavior is monitored. It was suggested that during fatigue, the power of the LFC increases, while that of the HFC decreases [30]. Fatigue occurs when the power of the LFC is equal to the power of the HFC [23]. However, such a classification of EMG frequency bands has its own drawbacks. For instance, the LFC could have a higher power than the HFC without there being any progress in fatigue. Furthermore, fatigued and non-fatigued muscles cannot be differentiated based on the aforementioned study [23].
In terms of classifying the EMG frequency bands, refs. [31,32] suggested that the frequency spectrum of the EMG can be classified into two regions, namely, low-frequency components (LFC) (20–46.7 Hz) and high-frequency components (HFC) (150–350 Hz), where the amplitude of the LFC tends to increase during fatigue, while the amplitude of the HFC tends to decrease. Similarly, ref. [13] further classified the frequency spectrum into four regions that lie within the following bands, namely, 24–56 Hz, 63–96 Hz, 104–136 Hz, and 144–800 Hz. However, an accurate identification of the muscle fatigue index was not explained in the aforementioned studies.
The rest of the paper is arranged as follows: Section 2 explains the materials and method in detail, including the proposed fatigue index; Section 3 discusses the results; while Section 4 concludes the study.

2. Materials and Method

This section explains the identification of the sample size, the appropriate muscle that was subjected to fatigue, and how fatigue was induced. Furthermore, the experimental setup, signal processing, the proposed classifier and the fatigue index will also be clarified. The following subsections explain the study in detail.

2.1. Sample Size

Identifying the optimum sample size is considered as an important step in testing the efficiency of any proposed algorithm. Ref. [33] Proposed an equation to calculate the required sample size. This equation is mathematically represented as follows:
N = 4   ( Z c r i t ) 2 ρ 1 ρ D 2
where N is the number of required samples (sample size), and Zcrit is the significance criterion representing the value at which the difference is considered to be statistically significant. The Zcrit was identified by [33] and set to a value of 1.96. Finally, ρ is the proportional estimate of the preliminary studies. Therefore, the mean accuracy of the preliminary studies was first calculated (Table 1).
Considering that 95% was the chosen confidence interval with an interval of ±10%, hence D was equal to 0.2. Consequently, the sample size was calculated as follows:
N = 4   ( 1.96 ) 2   0.89 1 0.89 0.2 2
N = 37.6 ≈ 38 (number of required samples).

2.2. Choosing the Appropriate Muscle and Fatigue Classification

The deltoid muscles are the large muscles covering the shoulder, and their functions are to abduct, adduct, flex, and extend the upper extremities [25,40]. The deltoid muscles consist of three main muscles, namely, the anterior deltoid, middle deltoid, and posterior deltoid [40]. However, the middle deltoid muscle contributes to most of the movements in the upper limbs, and is responsible for elevating the upper limbs, which makes it susceptible to rapid fatigue [41]. Therefore, the middle deltoid muscle was chosen to evaluate the proposed algorithm for the objective detection of muscle fatigue. Localized muscle fatigue has been classified into four grades of fatigues [42] as follows:
I.
Slight muscle cramp or tightening.
II.
Sustained muscle cramp with a sort of painful feeling.
III.
A continuous feeling of burning pain.
IV.
Further painful feeling and lack of ability to maintain the activity.
Hence, a specific protocol was proposed to ensure that the middle deltoid muscle reached fatigue level, where the subject could no longer maintain the protocol. It should be noted that muscle pain and localized muscle fatigue are all alternatives to muscle fatigue [32].

2.3. Preparation of Subjects and Protocol Performance

As explained in the section on sample size, 38 subjects were selected for participation in this study. Their right and left middle deltoid muscles were tested with the proposed algorithm. The mean age of the participants was 34.2 ± 8.5 years. At the start of the study, the participants reported no injuries or pain in their middle deltoid muscle. However, the third subject reported moderate pain in her right middle deltoid, and, hence, was excluded from the experiment. Ultimately, 75 sEMG samples extracted from 75 middle deltoid muscles were included in this study.
The experimental protocol involved requesting all subjects to sit on a chair and perform two types of movements in relation to the middle deltoid muscle as follows:
I.
Muscle in Non-fatigue Condition: The subjects were asked to relax their middle deltoid muscles by performing no action (Figure 1A) and, simultaneously, the sEMG signal was recorded. This procedure was aimed at evaluating the performance of the proposed algorithm in detecting the non-fatigued muscle. Despite that the subjects performed no action in this posture, the middle deltoid muscle still played an important role in stabilizing the shoulder joint [40,43]. Eventually, the middle deltoid was not fully relaxed and exhibited a sort of sEMG signal.
II.
Muscle in Fatigue Condition: The subjects were asked to elevate their upper limbs and keep them in the scapula plane with a 2 kg weight clutched on their forearms (Figure 1B). The subjects were encouraged to perform this activity until they could no longer maintain this posture, whereby the muscle was considered to have reached fatigue level. It should be noted that the weight was added to accelerate the generation of fatigue. This procedure was aimed at evaluating the performance of the proposed algorithm with regard to the objective detection of muscle fatigue.
The subjects were allowed to rest for five minutes in between sessions to relax their middle deltoid muscles [25,44]. Moreover, the scapula plane was chosen because of its efficiency in activating the middle deltoid muscle [25,42]. The aforementioned protocol was approved by the Ethics Committee of Universiti Putra Malaysia, Selangor, Malaysia with reference number (JKEUPM-2021-263).

2.4. Acquisition of the sEMG and Hardware Setup

A Myoware muscle sensor was placed on the middle deltoid muscle and used to collect the sEMG signals. The Myoware sensor was previously investigated and displayed its ability to convert the electrical activity in the muscle to an analogue signal [45]. Table 2 summarizes the parameters of the chosen sensor.
This chosen sensor is characterized by its three bio-potential pins, two of which are differential pins and one a reference pin. The three pins were connected to Covidien disposable electrodes (H124SG) for better acquisition of the sEMG signals [46]. As shown in Figure 1, the two differential electrodes of the sensor were attached in a straight line over the belly of the middle deltoid [47,48]. However, the reference electrode was attached to a different tissue, which was the anterior deltoid muscle in the case of this study [45]. Furthermore, the skin was first shaved and cleaned with alcohol prior to the application of the Covidien electrodes [49], while a tie was used to ensure that the electrode attachments were fixed on the muscle [24]. The guidelines of the International Society of Electrophysiology and Kinesiology (ISEK) [50] and those of the European Recommendations for Surface Electromyography (SENIAM) [51] were followed for better acquisition of the sEMG signals.
The analogue signal that was obtained was then digitized using the Data Acquisition system (USB6001 DAQ system) produced by National Instruments. The digitized signal was sent to a PC for further analysis. The USB6001 DAQ system is characterized by a resolution of 14 bits and sampling frequency of 20,000 samples/s. However, the acquired analogue signal was sampled at a frequency of 2000 Hz, which ultimately prevented Nyquist aliasing and reduced the computation time. The experimental setup and configuration are shown in Figure 2.

2.5. Pre-Processing of sEMG Signal

The digitized sEMG signal was recorded using an analogue input recorder application provided by Matlab (2018). The recorded sEMG signal was processed and filtered as follows:
I.
The DC offset was first eliminated. Matlab provides an efficient function for removing the DC level that the raw EMG data is mounted on [52].
II.
A nonzero-lag second order Butterworth IIR band-pass filter with a cut-off frequency of 25–350 Hz was applied to extract the beneficial EMG frequencies [20,31,44]. A Butterworth filter was selected as it provides a maximum flat response among the cut-off frequencies [52].
III.
A nonzero-lag second order Butterworth IIR band-stop filter, with a cut-off frequency of 47–53 Hz, was also applied to eliminate the 50 Hz power line frequency.
Figure 3 shows the steps for the processing and filtering of the raw EMG signal.
Next, a proper segmentation was applied to the processed and filtered EMG signal prior to the application of the proposed algorithm. The segmentation process was an important step to show how the fatigue progressed with time. A rectangular window of 3 s and an overlap of 1.5 s were used to segment the recorded raw EMG data. In other words, the entire EMG signal that was recorded was segmented into 3 s windows, after which the proposed algorithm was applied to these segments. Such a segmentation was chosen to provide real-time monitoring of muscle fatigue [53].

2.6. Double-Step Binary Classifier and Fatigue Index

The proposed algorithm involved analyzing the acquired sEMG signal in the time and frequency domains, respectively. The first step in analyzing the sEMG in the time domain using the proposed classifier involved the extraction of a time-domain feature, specifically the integrated EMG (IEMG). The IEMG is characterized by a low computation time, and can be represented as follows:
I E M G i = n = 0 N 1 | E M G n   |
where i denotes the number of segments, and N represents the length of the segment.
It was previously proven that the IEMG gradually increases with the progress of muscle fatigue [54,55]. Therefore, the IEMG value was used to detect the progress of fatigue by comparing its current value with its initial value. The initial value of the IEMG (IEMGinitial) was the IEMG value of the first segment, whereas the current value of the IEMG (IEMGcurrent) referred to the IEMG value of the subsequent segments. Once the IEMGcurrent exceeded the IEMGinitial, the second step of the classifier was performed.
The second step involved analyzing the acquired sEMG signal in the frequency domain to differentiate between the high-frequency and low-frequency components of the EMG signal. Basically, the segmented EMG signal was filtered by two band-pass filters separately to produce two sub-signals, namely, a high-frequency sub-signal (HFSS) and a low-frequency sub-signal (LFSS). Then, the instantaneous mean amplitude (IMA) was calculated for the two sub-signals to ultimately obtain the fatigue index, which represents the difference between the IMA values of the LFSS and HFSS, respectively.
The boundaries of the high-frequency components (HFC) and low-frequency components (LFC) of the EMG had to be identified first for the accurate extraction of the HFSS and LFSS. The high-frequency components of the EMG had been previously identified to be in the range of 80–350 Hz [29]. Consequently, the LFC lay in the range of 25–79 Hz, which was also in agreement with the literature [13]. Furthermore, the mean frequency (MNF) and median frequency (MDF) were calculated to ensure an accurate identification of the frequency bands of the EMG. The MNF and MDF were chosen for their property in identifying the central frequency [16,56]. For instance, the MNF is the sum of the product of the EMG power spectrum and the frequency divided by the total sum of the power spectrum. In addition, the MDF is the frequency that divides the spectrum of the EMG into two regions with equal amplitudes [16]. The MNF and MDF are mathematically represented as follows:
M N F i = k = 1 n f k P k   /   k = 1 n P k
k = 1 m P k = m n P k = 1 2 k = 1 n P k
M D F i = f m
where n denotes the length of the segment, P k denotes the power spectrum value at bin, k , m denotes the frequency associated with the median frequency (fm), and i the number of segments [16,57].
Therefore, the mean frequency (MNF) and the median frequency (MDF) of the first EMG segment in fatigue condition for all the subjects were calculated (Table 3). This shows that MNF and MDF values mostly fell within the 75–85 Hz range, which confirmed that 80 Hz could be used as the frequency of separation between the HFC and LFC.
Once the frequency ranges for the LFC and HFC had been identified, each segment of the segmented EMG was filtered by two nonzero-lag fourth-order Butterworth band-pass filters. The first band-pass filter had a cut-off frequency of 25–79 Hz, and was used to extract the LFSS, while the second band-pass filter had a cut-off frequency of 80–350 Hz, and was used to extract the HFSS.
At this stage, each segment was filtered, and the LFSS and HFSS were successfully extracted. Then, the fast Fourier transform (FFT) was applied to these sub-signals to produce the LFSSf and HFSSf, respectively [58].
On applying the FFT to the LFSS and HFSS, which had been previously extracted from the original acquired EMG, a complex point was produced. Each complex point embraced real and imaginary parts. Then, the proposed algorithm calculated the instantaneous mean amplitude (IMA), as shown in Equations (6) and (7).
I M A L F S S f i =   n = 0 N 1 L F S S f i n     N
I M A H F S S f i =   n = 0 N 1 H F S S f i n     N
Eventually, the fatigue index, representing the IMA of the LFSS minus the IMA of the HFSS, was calculated using Equation (8) below:
F a t i g u e _ I n d e x = I M A L F S S f i I M A H F S S f i
where N denotes the length of the segment, and i denotes the current segment.
Then, a decision was made based on the values of the F a t i g u e _ i n d e x as follows:
F a t i g u e _ I n d e x = 0   f a t i g u e   l e v e l   r e a c h e d   < 0   O t h e r w i s e  
Equation (8) shows that the objective detection of muscle fatigue was determined by the value of the fatigue index. Figure 4 summaries the steps of the proposed algorithm. A fatigue report counter was added at the end of the algorithm to record the fatigue indices of the analyzed EMG segments, and to assign them as fatigue or non-fatigue segments throughout the session, as shown in the next section.
The proposed algorithm indicated that the IMA of the LFSS started at its minimum value in the first segment and tended to increase with the progression of fatigue. In contrast, the IMA of the HFSS started at its maximum value in the first segment and tended to decrease with the progression of fatigue. Therefore, the fatigue index was transformed from a negative value to a positive value throughout the fatigue progression. Muscle fatigue was found to have occurred and was objectively detected when the value of the proposed fatigue index was equal to or greater than zero. In other words, fatigue was reached when the IMA of the LFSS was equal to or greater than the IMA of the HFSS. Furthermore, the increase in the fatigue index was a clear indication of progressive fatigue. Moreover, if there was no change in the fatigue index, this would indicate that the muscle was relatively not experiencing progressive fatigue.
Consequently, the accuracy of the proposed algorithm was evaluated based on its ability to produce a zero or positive fatigue index once the subjects reported fatigue. As the sEMG signal was segmented prior to the calculation of the fatigue index, the algorithm was therefore said to be accurate if it was able to produce a zero or positive fatigue index in the last segment, when the individual reported fatigue. Furthermore, the first segments should produce a negative fatigue index and be assigned as non-fatigue. Thus, the analyzed data that were extracted from the fatigue condition were used to evaluate the accuracy of the algorithm, and this will be explained in the next section.

3. Results and Discussion

A representation of the non-fatigued and fatigued filtered sEMG signal is shown in Figure 5. The variations between the non-fatigued and fatigued sEMG signals depend on the physiological parameters of the muscle, including the motor unit recruitment, fiber firing rate, fiber type, and the conduction velocity. The amplitude and frequency of the acquired sEMG signal were the main EMG characteristics that were affected by the aforementioned parameters [26].
As the proposed algorithm involved the extraction of time and frequency features from the acquired sEMG signal, the analyses in the time and frequency domains were therefore shown, respectively. First, the double-step binary classifier calculated the value of the integrated EMG (IEMG) to detect the initial contraction of the investigated muscle. The linear regression technique was used to identify the slope behavior of the IEMG throughout the progression of fatigue. Table 4 shows the slope values of the IEMG for the non-fatigue and fatigue conditions of all the subjects. It was clearly shown that the IEMG exhibited a positive slope in muscle fatigue condition.
The paired two-tail t-test was applied to identify the statistical difference between the IEMG slopes for both the fatigue and non-fatigue conditions of all subjects. At a confidence interval of 95%, the null hypothesis was rejected if the p-value was less than 0.05. Hence, the p-value was calculated and found to be 0.035, which indicated that there was a statistical difference between the two conditions in terms of the IEMG values. Furthermore, Figure 6 shows the behavior of the IEMG value while the deltoid muscle was in the non-fatigue and fatigue condition.
Second, the double-step binary classifier calculates the fatigue index based on the values of the instantaneous mean amplitude (IMA) of high-frequency and low-frequency sub-signals (HFSS and LFSS). Therefore, it was better to show how the IMA of the HFSS and LFSS behaved during the two muscle fatigue conditions (non-fatigue and fatigue). Figure 7 shows the IMA of both the HFSS and LFSS when the middle deltoid was in non-fatigue and fatigue conditions. In the non-fatigue condition, it was clearly shown that the IMA values of both the HFSS and LFSS were totally separated and the fatigue index exhibited a negative value. Hence, the fatigue did not progress. As mentioned in the previous section, even though the subjects performed no action while in the non-fatigue state, the middle deltoid muscle still played an important role in the stabilization of the shoulder joint, and ultimately produced a sort of sEMG signal.
When in a fatigue state, Figure 7 shows that the magnitude of the IMA for both the HFSS and LFSS started to change and intersected at some point, which indicated the presence of fatigue. In other words, the fatigue index was transformed from a negative to a positive value because of the rapid decrease in the IMA of the HFSS and an increase in the IMA of the LFSS. The transformation in the fatigue index indicated the objective detection of muscle fatigue.
Furthermore, Figure 7 shows that the right middle deltoid required a longer time than the left middle deltoid to experience fatigue for the same subject. Despite the fact that the left deltoid muscle experienced fatigue at 50 s, the IMA values of both the HFSS and LFSS continued to change, where the IMA of the HFSS continued to decrease while the IMA of the LFSS continued to increase after the onset of fatigue. This was attributed to the ability of the subject to resist fatigue for a further period after the onset of fatigue.
Figure 7 shows that the scapular plane of the upper limb accelerated the progress of muscle fatigue. Moreover, adding weights to the forearm substantially affected the IMA of both the HFSS and LFSS.
In terms of numbers, the fatigue indices in fatigue condition for each subject in the first and last segments (when their muscles had reached the fatigue level) are shown in Table 5.
Table 5 emphasizes that the fatigue index of all the subjects started with a negative value at the beginning of the session and was transformed to a positive value at the end of the session, when the fatigue level was reached. Although subjects 8, 12, 16, 22, and 32 reported the presence of fatigue in their middle deltoid muscles at the end of the session, their fatigue index was not transformed to a positive value. Thus, the behavior of the IMA of both the LFSS and HFSS for the aforementioned subjects was investigated. Figure 8 shows that the IMA values of both the HFSS and LFSS of subject 8 started to change, but had yet to intersect. In other words, the fatigue index started with a negative value and continued to increase throughout the session; however, it was not transformed to zero or to a positive value.
Table 5 also shows that the participants exhibited different timelines prior to the onset of fatigue. In other words, the participants varied in their ability to withstand fatigue throughout the session. Consequently, the proposed algorithm was able to objectively detect the fatigue despite individual variations.
For the purpose of an accurate evaluation and in considering each sEMG signal as having segments of length N, the fatigue indices of the first and last three sEMG segments of all the subjects in fatigue condition were calculated. A fatigue index with a negative value was an indication of non-fatigue, while a zero or positive value was an indication of fatigue, as shown in Table 6.
Table 6 shows that the first segments produced a negative fatigue index, thereby indicating that no fatigue had occurred yet. However, most of the last segments produced a positive fatigue index, and ultimately fatigue was reached. The results of the last two segments, either fatigue or non-fatigue, were considered for the mathematical calculation of the sensitivity, specificity, positive predictive value, and accuracy of the algorithm. The non-fatigue state at the (N − 1) segment represents a true negative (TN) classification of the proposed algorithm, while the fatigue state at the (N) segment represents a true positive (TP) classification. Consequently, the fatigue and the non-fatigue states in the (N − 1) and (N) segments represent the false positive (FP) and false negative, respectively. As shown in Table 6, the last two segment embrace a total of 70 TP, 72 TN, 3 FP, and 5 FN. The following are the mathematical representations of the aforementioned characteristics:
S e n s i t i v i t y =   TP   TP + FN = 0.9333     93 %
S p e c i f i c t y =   TN   TN + FP = 0.96 = 96 %
P o s i t i v e   P r e d i c t i v e   V a l u e =   TP   TP + FP = 0.9589     96 %
A c c u r a c y =   TN + TP   TN + TP + FN + FP = 0.9466     95 %
As mentioned in the earlier section on the literature review, various classifiers were used in an attempt to objectively detect fatigue. Thus, Table 7 shows a comparison between the proposed algorithm and other algorithms to emphasize the differences in terms of the employed classifier, and the accuracy obtained.
As shown in Table 7, the proposed algorithm showed the highest accuracy in comparison to previous studies. It should be noted that non-adult individuals were excluded from the study as the skeletal muscles of adults and non-adults may respond differently [62]. For instance, the small-sized muscles of non-adults could result in less accurate EMG signals. Moreover, the ability of non-adults to withstand the fatigue in comparison to adults [62].
The calculation of the IEMG value as the first step in the proposed algorithm was considered as an important procedure to accurately identify the fatigue condition. The importance of this step came from its ability to distinguish between relaxed and contracted muscles. Relaxed muscles exhibit no significant EMG and have a different power spectrum than contracted muscles [11,63]. This could ultimately affect the second step (fatigue index calculation) of the proposed classifier. More specifically, the first step of the proposed algorithm was fully aimed at ensuring that only the EMG signals that were extracted from the contracted muscles were analyzed by the second step of the proposed classifier. Applying only the second step on signal acquired from relaxed muscle could produce false positive fatigue index. In this study, however, the middle deltoid muscle was investigated, which exhibits a sort of contraction in both non-fatigue and fatigue conditions that helps in stabilizing the shoulder joint [40].
Consequently, the second step of the proposed algorithm was applied on a relaxed muscle’s signal to practically approve the necessity of the first step. Ref. [64] have clarified that biceps are virtually silent and eventually can be considered relaxed when the elbow is extended. Hence, the bicep signals at the relaxed state of eight subjects (Figure 9) were acquired and analyzed only by the second step of the proposed algorithm. Figure 10 shows how the IMA values of HFSS and LFSS fluctuate and intersect, which ultimately produces a false positive fatigue index throughout the session.
Several factors were precisely considered to ensure that the results obtained were reliable. First, the weight was clutched on the forearm instead of being held by the hand to avoid fatigue in the hand muscles prior to fatigue in the deltoid muscles. Holding the weight by the hand would incline the subject to report an uncomfortable feeling caused by fatigue in the hand muscles.
Second, special attention was also given to the Myoware muscle sensor to ensure that the sEMG signal acquired would be accurate. For instance, the two main electrodes of the sensor were placed on the belly of the muscle and in a straight position, while the reference electrode was placed on the bony or different tissue [47,48]. The wrong attachment of the sensor could substantially affect the accuracy and strength of the acquired signal.
Third, it was reported that the loose attachment between the sensor and the muscle could dramatically affect the acquired signal because of any sudden movement of the loosened sensor [46]. Therefore, a tie was applied to prevent the sensor from being loosely attached to the muscle.
Finally, the sampling frequency was another issue that had to be accurately identified prior to the processing of the acquired signal [65]. The highest frequency of the EMG was identified and found to be 400 Hz. Hence, the minimum sampling frequency had to be no less than 800 Hz to prevent Nyquist aliasing. Despite the fact that increasing the sampling frequency above the Nyquist rate could provide more information about the acquired signal, a higher sampling frequency would compromise the real-time processing [66].

4. Conclusions

An algorithm employing a new fatigue index was proposed for the objective detection of muscle fatigue. The proposed algorithm analyzed the acquired sEMG signal in the time and frequency domains to extract the IEMG and IMA features, respectively to ultimately identify the fatigue index. It was found that a gradual increase in the IEMG value was a clear indication of muscle contraction. Furthermore, the instantaneous mean amplitude (IMA) of the high-frequency sub-signal (HFSS) and low-frequency sub-signal followed different behaviors. The IMA of the HFSS tended to decrease during the progression of fatigue, while the IMA of the LFSS tended to increase. Thus, the fatigue index was identified as the difference between the IMA values of the LFSS and HFSS, respectively. Muscle fatigue was found to be present and was objectively detected when the value of the proposed fatigue index was equal to or greater than zero.

Author Contributions

Conceptualization, H.M.Q., W.Z.W.H. and L.N.I.M.; Methodology, H.M.Q., W.Z.W.H., L.N.I.M. and H.H.H.; Software, H.M.Q., H.R.R. and L.I.I.; Validation, W.Z.W.H., H.R.R., H.H.H., L.N.I.M. and L.I.I.; formal analysis, H.M.Q., W.Z.W.H. and L.N.I.M.; Investigation, H.M.Q., W.Z.W.H. and L.N.I.M.; Resources, H.M.Q., W.Z.W.H., H.R.R., H.H.H., L.N.I.M. and L.I.I.; Data curation, H.M.Q. and L.I.I.; Writing—original draft preparation, H.M.Q. and W.Z.W.H.; Writing—review and editing, H.M.Q., W.Z.W.H., W.Z.W.H., H.R.R., H.H.H., L.N.I.M. and L.I.I.; Supervision, W.Z.W.H., H.R.R., H.H.H., L.N.I.M. and L.I.I.; Project administration, W.Z.W.H.; Funding, W.Z.W.H., H.R.R., H.M.Q., W.Z.W.H., H.R.R., H.H.H., L.N.I.M. and L.I.I. All authors have read and agreed to the published version of the manuscript.

Funding

This research was fully funded by a Universiti Putra Malaysia (UPM) Research Grant (Putra Grant UPM, GP-GPB/2021/9699100).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by Ethics Committee for Research Involve Human Subjects, Universiti Putra Malaysia (JKEUPM-2021-263, 7 August 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publically available due to privacy concerns.

Acknowledgments

The authors would like to thank the Universiti Putra Malaysia for supporting this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rampichini, S.; Vieira, T.M.; Castiglioni, P.; Merati, G. Complexity analysis of surface electromyography for assessing the myoelectric manifestation of muscle fatigue: A review. Entropy 2020, 22, 529. [Google Scholar] [CrossRef] [PubMed]
  2. Basmajian, J.V.; De Luca, C.J. Chapter 8. Muscle Fatigue and Time-Dependent Parameters of the Surface EMG Signal. In Muscles Alive: Their Functions Revealed by Electromyography; Williams & Wilkins: Baltimore, MD, USA, 1985; pp. 201–222. ISBN 0471675806. [Google Scholar]
  3. Mastaglia, F.L. The relationship between muscle pain and fatigue. Neuromuscul. Disord. 2012, 22, S178–S180. [Google Scholar] [CrossRef] [PubMed]
  4. Shair, E.F.; Ahmad, S.A.; Marhaban, M.H.; Tamrin, S.B.M.; Abdullah, A.R. EMG processing based measures of fatigue assessment during manual lifting. BioMed Res. Int. 2017, 2017, 3937254. [Google Scholar] [CrossRef] [PubMed]
  5. Hussain, J.; Sundaraj, K.; Low, Y.F.; Lam, C.K.; Sundaraj, S.; Ali, M.A. A systematic review on fatigue analysis in triceps brachii using surface electromyography. Biomed. Signal Process. Control 2018, 40, 396–414. [Google Scholar] [CrossRef]
  6. Mátrai, K.N.Z. Subjective and objective indicators in the research on health status. J. Hum. Sport Exerc. 2016, 11, S207–S217. [Google Scholar] [CrossRef] [Green Version]
  7. Al-Mulla, M.R.; Sepulveda, F.; Colley, M. sEMG Techniques to Detect and Predict Localised Muscle Fatigue. In EMG Methods for Evaluating Muscle and Nerve Function; InTech: Rijeka, Croatia, 2012. [Google Scholar] [CrossRef] [Green Version]
  8. Sakurai, T.; Toda, M.; Sakurazawa, S.; Akita, J.; Kondo, K.; Nakamura, Y. Detection of muscle fatigue by the surface electromyogram and its application. In Proceedings of the 2010 IEEE/ACIS 9th International Conference on Computer and Information Science, Yamagata, Japan, 18–20 August 2010; pp. 43–47. [Google Scholar] [CrossRef] [Green Version]
  9. Elshafei, M.; Shihab, E. Towards detecting biceps muscle fatigue in gym activity using wearables. Sensors 2021, 21, 759. [Google Scholar] [CrossRef]
  10. Shindo, N. Electrical Stimulation. Physiotherapy 1988, 74, 74. [Google Scholar] [CrossRef]
  11. Nazmi, N.; Rahman, M.A.A.; Yamamoto, S.I.; Ahmad, S.A.; Zamzuri, H.; Mazlan, S.A. A review of classification techniques of EMG signals during isotonic and isometric contractions. Sensors 2016, 16, 1304. [Google Scholar] [CrossRef] [Green Version]
  12. Candotti, C.T.; Loss, J.F.; La Torre, M.; Melo, M.O.; Araújo, L.D.; Marcks, V.V. Use of electromyography to assess pain in the upper trapezius and lower back muscles within a fatigue protocol. Rev. Bras. Fisioter. 2009, 13, 144–151. [Google Scholar] [CrossRef] [Green Version]
  13. Viitasalo, J.H.T.; Komi, P.V. Signal characteristics of EMG during fatigue. Eur. J. Appl. Physiol. Occup. Physiol. 1977, 37, 111–121. [Google Scholar] [CrossRef] [PubMed]
  14. Cifrek, M.; Medved, V.; Tonković, S.; Ostojić, S. Surface EMG based muscle fatigue evaluation in biomechanics. Clin. Biomech. 2009, 24, 327–340. [Google Scholar] [CrossRef] [PubMed]
  15. Too, J.; Abdullah, A.R.; Saad, N.M. Classification of Hand movements based on discrete wavelet transform and enhanced feature extraction. Int. J. Adv. Comput. Sci. Appl. 2019, 10, 83–89. [Google Scholar] [CrossRef]
  16. Phinyomark, A.; Thongpanja, S.; Hu, H.; Phukpattaranont, P.; Limsakul, C. The Usefulness of Mean and Median Frequencies in Electromyography Analysis. Comput. Intell. Electromyogr. Anal. A Perspect. Curr. Appl. Future Chall. 2012, 195–220. [Google Scholar] [CrossRef] [Green Version]
  17. Hameed, H.K.; Hasan, W.Z.W.; Shafie, S.; Ahmad, S.A.; Jaafar, H. An amplitude independent muscle activity detection algorithm based on adaptive zero crossing technique and mean instantaneous frequency of the sEMG signal. In Proceedings of the 2017 IEEE Regional Symposium on Micro and Nanoelectronics (RSM), Penang, Malaysia, 23–25 August 2017; pp. 183–186. [Google Scholar] [CrossRef]
  18. Tsai, A.C.; Hsieh, T.H.; Luh, J.J.; Lin, T. Te A comparison of upper-limb motion pattern recognition using EMG signals during dynamic and isometric muscle contractions. Biomed. Signal Process. Control 2014, 11, 17–26. [Google Scholar] [CrossRef]
  19. Qassim, H.M.; Wan Hassan, W.Z. A Review on Upper Limb Rehabilitation Robots Hassan. Appl. Sci. 2020, 10, 6976. [Google Scholar] [CrossRef]
  20. Han, J.; Song, W.; Kim, J. New EMG Pattern Recognition based on Soft Computing Techniques and Its Application to Control of a Rehabilitation Robotic Arm. In Proceedings of the 6th International Conference on Soft Computing (IIZUKA2000), Fukuoka, Japan, 1–4 October 2000. [Google Scholar]
  21. Asghari Oskoei, M.; Hu, H. Myoelectric control systems—A survey. Biomed. Signal Process. Control 2007, 2, 275–294. [Google Scholar] [CrossRef]
  22. Phinyomark, A.; Phukpattaranont, P.; Limsakul, C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  23. Fernando, J.B.; Yoshioka, M.; Ozawa, J. Estimation of muscle fatigue by ratio of mean frequency to average rectified value from surface electromyography. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 5303–5306. [Google Scholar] [CrossRef]
  24. Wang, J.; Pang, M.; Yu, P.; Tang, B.; Xiang, K.; Ju, Z. Effect of Muscle Fatigue on Surface Electromyography-Based Hand Grasp Force Estimation. Appl. Bionics Biomech. 2021, 2021, 8817480. [Google Scholar] [CrossRef]
  25. Minning, S.; Eliot, C.A.; Uhl, T.L.; Malone, T.R. EMG analysis of shoulder muscle fatigue during resisted isometric shoulder elevation. J. Electromyogr. Kinesiol. 2007, 17, 153–159. [Google Scholar] [CrossRef] [PubMed]
  26. Karthick, P.A.; Ghosh, D.M.; Ramakrishnan, S. Surface electromyography based muscle fatigue detection using high-resolution time-frequency methods and machine learning algorithms. Comput. Methods Programs Biomed. 2018, 154, 45–56. [Google Scholar] [CrossRef] [PubMed]
  27. Kiryu, T.; Sasaki, I.; Shibai, K.; Tanaka, K. Providing appropriate exercise levels for the elderly. IEEE Eng. Med. Biol. Mag. 2001, 20, 116–124. [Google Scholar] [CrossRef] [PubMed]
  28. Sato, K.M.T.; Iwashita, A.; Sato, T.; Yoshida, M. Estimation of muscle activity by EMG frequency analysis during exercise on a cycle ergometer. IEICE Tech. Rep. ME Bio Cybern. 2010, 110, 7–11. [Google Scholar]
  29. Kushida, A.K.D.; Aoki, T. Estimation of muscle fatigue based on the frequency analysis of EMG. In Proceedings of the Life Engineering Symposium, Yokohama, Japan, 12 September 2013; pp. 281–284. [Google Scholar]
  30. Karthick, P.A.; Ramakrishnan, S. Muscle fatigue analysis using surface EMG signals and time–frequency based medium-to-low band power ratio. Electron. Lett. 2016, 52, 185–186. [Google Scholar] [CrossRef]
  31. Gross, D.; Grassino, A.; Ross, W.R.D. Macklem Electromyogram pattern of diaphragmatic fatigue. J. Appl. Physiol. Respir. Environ. Exerc. Physiol. 1979, 46, 1–7. [Google Scholar] [CrossRef] [PubMed]
  32. De Luca, C.J. Use of the surface EMG signal for performance evaluation of back muscles. Muscle Nerve 1993, 16, 210–216. [Google Scholar] [CrossRef]
  33. Eng, J. Sample size estimation: How many individuals should be studied? Radiology 2003, 227, 309–313. [Google Scholar] [CrossRef] [Green Version]
  34. Ahsan, M.R.; Ibrahimy, M.I.; Khalifa, O.O. The use of artificial neural network in the classification of EMG signals. In Proceedings of the 2012 Third FTRA International Conference on Mobile, Ubiquitous, and Intelligent Computing, Washington, DC, USA, 26–28 June 2012; pp. 225–229. [Google Scholar] [CrossRef]
  35. Arjunan, S.P.; Kumar, D.K. Decoding subtle forearm flexions using fractal features of surface electromyogram from single and multiple sensors. J. Neuroeng. Rehabil. 2010, 7, 53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Tavakoli, M.; Benussi, C.; Lourenco, J.L. Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach. Expert Syst. Appl. 2017, 79, 322–332. [Google Scholar] [CrossRef]
  37. Mane, S.M.; Kambli, R.A.; Kazi, F.S.; Singh, N.M. Hand motion recognition from single channel surface EMG using wavelet & artificial neural network. Procedia Comput. Sci. 2015, 49, 58–65. [Google Scholar] [CrossRef] [Green Version]
  38. Kim, J.; Mastnik, S.; André, E. EMG-based hand gesture recognition for realtime biosignal interfacing. In Proceedings of the 13th International Conference on Intelligent User Interfaces, Canaria, Spain, 13–16 January 2008; pp. 30–39. [Google Scholar] [CrossRef]
  39. Wu, Y.; Liang, S.; Zhang, L.; Chai, Z.; Cao, C.; Wang, S. Gesture recognition method based on a single-channel semg envelope signal. EURASIP J. Wirel. Commun. Netw. 2018, 2018, 35. [Google Scholar] [CrossRef] [Green Version]
  40. Miniato, M.A.; Caire, M.J. Anatomy, Shoulder and Upper Limb, Shoulder; StatPearls: Treasure Island, FL, USA, 2018. [Google Scholar]
  41. Gopura, R.A.R.C.; Bandara, D.S.V.; Kiguchi, K.; Mann, G.K.I. Understanding the response of the shoulder complex to the demands of repetitive work. Rob. Auton. Syst. 2016, 75, 203–220. [Google Scholar] [CrossRef]
  42. Öberg, T.; Sandsjö, L.; Kadefors, R. Subjective and objective evaluation of shoulder muscle fatigue. Ergonomics 1994, 37, 1323–1333. [Google Scholar] [CrossRef] [PubMed]
  43. Dohle, C.I.; Rykman, A.; Chang, J.; Volpe, B.T. Pilot study of a robotic protocol to treat shoulder subluxation in patients with chronic stroke. J. Neuroeng. Rehabil. 2013, 10, 88. [Google Scholar] [CrossRef] [Green Version]
  44. Troiano, A.; Naddeo, F.; Sosso, E.; Camarota, G.; Merletti, R.; Mesin, L. Assessment of force and fatigue in isometric contractions of the upper trapezius muscle by surface EMG signal and perceived exertion scale. Gait Posture 2008, 28, 179–186. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Del Toro, S.F.; Santos-Cuadros, S.; Olmeda, E.; Álvarez-Caldas, C.; Díaz, V.; San Román, J.L. Is the Use of a Low-Cost sEMG Sensor Valid to Measure Muscle Fatigue? Sensors 2019, 19, 3204. [Google Scholar] [CrossRef] [Green Version]
  46. Omama, Y.; Haddad, C.; MacHaalany, M.; Hamoudi, A.; Hajj-Hassan, M.; Ali, M.A.; Hamawy, L. Surface EMG Classification of Basic Hand Movement. In Proceedings of the 2019 Fifth International Conference on Advances in Biomedical Engineering (ICABME), Tripoli, Lebanon, 17–19 October 2019; pp. 1–4. [Google Scholar] [CrossRef]
  47. Ahamed, N.U.; Sundaraj, K.; Ahmad, R.B.; Rahman, M.; Islam, M.A. Analysis of right arm biceps brachii muscle activity with varying the electrode placement on three male age groups during isometric contractions using a wireless EMG sensor. Procedia Eng. 2012, 41, 61–67. [Google Scholar] [CrossRef] [Green Version]
  48. Myoware. 3-Lead Muscle/Electromyography Sensor for Microcontroller Applications. Available online: https://cdn.sparkfun.com/assets/a/3/a/f/a/AT-04-001.pdf (accessed on 24 January 2022).
  49. Fuentes Del Toro, S.; Wei, Y.; Olmeda, E.; Ren, L.; Guowu, W.; Díaz, V. Validation of a Low-Cost Electromyography (EMG) System via a Commercial and Accurate EMG Device: Pilot Study. Sensors 2019, 19, 5214. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Me, R. Standards for Reporting EMG Data. J. Electromyogr. Kinesiol. 2018, 42, I–II. [Google Scholar] [CrossRef]
  51. Hermens, H.J.; Freriks, B.; Merletti, R.; Stegeman, D.; Blok, J.; Rau, G.; Disselhorst-Klug, C.; Hägg, G. European Recommendations for Surface ElectroMyoGraphy. Roessingh Res. Dev. 1999, 8, 13–54. [Google Scholar]
  52. Sarmiento, D.L.R. Digital Processing of Electromyographic Signals for Control. Available online: https://www.mathworks.com/matlabcentral/fileexchange/68245-digital-processing-of-electromyographic-signals-for-control (accessed on 24 January 2022).
  53. Liu, S.H.; Lin, C.B.; Chen, Y.; Chen, W.; Huang, T.S.; Hsu, C.Y. An EMG patch for the real-time monitoring of muscle-fatigue conditions during exercise. Sensors 2019, 19, 3108. [Google Scholar] [CrossRef] [Green Version]
  54. Venugopal, G.; Navaneethakrishna, M.; Ramakrishnan, S. Extraction and analysis of multiple time window features associated with muscle fatigue conditions using sEMG signals. Expert Syst. Appl. 2014, 41, 2652–2659. [Google Scholar] [CrossRef]
  55. Kumar, P.; Sebastian, A.; Potluri, C.; Yihun, Y.; Anugolu, M.; Creelman, J.; Urfer, A.; Naidu, D.S.; Schoen, M.P. Spectral analysis of sEMG signals to investigate skeletal muscle fatigue. In Proceedings of the 2011 50th IEEE Conference on Decision and Control and European Control Conference, Orlando, FL, USA, 12–15 December 2011; pp. 47–52. [Google Scholar] [CrossRef]
  56. Sadoyama, T.; Miyano, H. Frequency analysis of surface EMG to evaluation of muscle fatigue. Eur. J. Appl. Physiol. Occup. Physiol. 1981, 47, 239–246. [Google Scholar] [CrossRef] [PubMed]
  57. Karthick, P.A.; Ramakrishnan, S. Surface electromyography based muscle fatigue progression analysis using modified B distribution time-frequency features. Biomed. Signal Process. Control 2016, 26, 42–51. [Google Scholar] [CrossRef]
  58. Naik, G.R. Applications, Challenges, and Advancements in Electromyography Signal Processing; IGI Global: Hershey, PA, USA, 2014. [Google Scholar] [CrossRef] [Green Version]
  59. Liu, Q.; Liu, Y.; Zhang, C.; Ruan, Z.; Meng, W.; Cai, Y.; Ai, Q. sEMG-Based Dynamic Muscle Fatigue Classification Using SVM with Improved Whale Optimization Algorithm. IEEE Internet Things J. 2021, 8, 16835–16844. [Google Scholar] [CrossRef]
  60. Edward Jeroa, S.; Divya Bharathia, K.; Karthickb, P.A.; Ramakrishnana, S. Muscle fatigue analysis in isometric contractions using geometric features of surface electromyography signals. Biomed. Signal Process. Control 2021, 68, 102603. [Google Scholar] [CrossRef]
  61. Al-Mulla, M.R.; Sepulveda, F.; Colley, M. Evolved pseudo-wavelet function to optimally decompose sEMG for automated classification of localized muscle fatigue. Med. Eng. Phys. 2011, 33, 411–417. [Google Scholar] [CrossRef] [PubMed]
  62. Dotan, R.; Mitchell, C.; Cohen, R.; Klentrou, P.; Gabriel, D.; Falk, B. Child-adult differences in muscle activation—A review. Pediatr. Exerc. Sci. 2012, 24, 2–21. [Google Scholar] [CrossRef] [Green Version]
  63. Konrad, P. The ABC of EMG, A Practical Introduction to Kinesiological Electromyography; Noraxon Inc.: Scottsdale, AZ, USA, 2005; ISBN 0977162214. [Google Scholar]
  64. Chaytor, C.P.; Forman, D.; Byrne, J.; Loucks-Atkinson, A.; Power, K.E. Changes in muscle activity during the flexion and extension phases of arm cycling as an effect of power output are muscle-specific. PeerJ 2020, 8, e9759. [Google Scholar] [CrossRef]
  65. Chen, H.; Zhang, Y.; Zhang, Z.; Fang, Y.; Liu, H.; Yao, C. Exploring the relation between EMG sampling frequency and hand motion recognition accuracy. In Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada, 5–8 October 2017; pp. 1139–1144. [Google Scholar] [CrossRef] [Green Version]
  66. Cavallaro, E.E.; Rosen, J.; Perry, J.C.; Burns, S. Real-time myoprocessors for a neural controlled powered exoskeleton arm. IEEE Trans. Biomed. Eng. 2006, 53, 2387–2396. [Google Scholar] [CrossRef]
Figure 1. Protocol for performing the two muscle states: (A) non-fatigued muscle, and (B) fatigued muscle.
Figure 1. Protocol for performing the two muscle states: (A) non-fatigued muscle, and (B) fatigued muscle.
Sensors 22 01900 g001
Figure 2. Experiment Setup and Configuration.
Figure 2. Experiment Setup and Configuration.
Sensors 22 01900 g002
Figure 3. Steps for the processing and filtering of the raw EMG signal.
Figure 3. Steps for the processing and filtering of the raw EMG signal.
Sensors 22 01900 g003
Figure 4. Flow chart of the proposed algorithm.
Figure 4. Flow chart of the proposed algorithm.
Sensors 22 01900 g004
Figure 5. Non-fatigue and fatigue filtered sEMG signal.
Figure 5. Non-fatigue and fatigue filtered sEMG signal.
Sensors 22 01900 g005
Figure 6. IEMG behavior of the deltoid muscle in non-fatigue and fatigue states.
Figure 6. IEMG behavior of the deltoid muscle in non-fatigue and fatigue states.
Sensors 22 01900 g006
Figure 7. The IMA of the HFSS (red line) and LFSS (blue Line) of the middle deltoid muscle in non-fatigue condition (top) and in fatigue condition (bottom).
Figure 7. The IMA of the HFSS (red line) and LFSS (blue Line) of the middle deltoid muscle in non-fatigue condition (top) and in fatigue condition (bottom).
Sensors 22 01900 g007
Figure 8. Behavior of IMA of the HFSS (red line) and LFSS (blue line) of the left middle deltoid muscle of subject 8 in fatigue condition.
Figure 8. Behavior of IMA of the HFSS (red line) and LFSS (blue line) of the left middle deltoid muscle of subject 8 in fatigue condition.
Sensors 22 01900 g008
Figure 9. Acquiring the signal from the bicep muscle at relaxed state.
Figure 9. Acquiring the signal from the bicep muscle at relaxed state.
Sensors 22 01900 g009
Figure 10. Behavior of IMA of the HFSS (red line) and LFSS (blue line) of the biceps at relaxed state.
Figure 10. Behavior of IMA of the HFSS (red line) and LFSS (blue line) of the biceps at relaxed state.
Sensors 22 01900 g010
Table 1. Mean accuracy of the reviewed preliminary EMG studies.
Table 1. Mean accuracy of the reviewed preliminary EMG studies.
RefAccuracy %
[34]88.4
[35]90
[36]90
[37]93.5
[38]94
[39]79.4
Mean (μ) = 89.21
Table 2. Parameters of the Myoware muscle sensor.
Table 2. Parameters of the Myoware muscle sensor.
ParameterDetail
Input Impedance110 GΩ
Supply Voltage3.3 V
Common Mode Rejection Ratio (CMRR)110
GainAdjustable
Table 3. MNF and MDF values for deltoid muscle in fatigue condition.
Table 3. MNF and MDF values for deltoid muscle in fatigue condition.
ReferenceMiddle Deltoid MuscleMean
Frequency
(MNF) Hz
Median
Frequency
(MDF) Hz
ReferenceMiddle Deltoid MuscleMean
Frequency
(MNF) Hz
Median
Frequency
(MDF) Hz
Subject 1Left muscle8573Subject 20Left muscle7972
Right muscle8476Right muscle8576
Subject 2Left muscle8377Subject 21Left muscle7870
Right muscle9890Right muscle8478
Subject 3Left muscle8880Subject 22Left muscle8476
Right muscleNot-ExaminedNot-ExaminedRight muscle8678
Subject 4Left muscle8570Subject 23Left muscle8375
Right muscle8473Right muscle7974
Subject 5Left muscle8879Subject 24Left muscle8779
Right muscle8980Right muscle7268
Subject 6Left muscle7772Subject 25Left muscle7570
Right muscle8984Right muscle8575
Subject 7Left muscle6967Subject 26Left muscle8680
Right muscle6563Right muscle8375
Subject 8Left muscle8980Subject 27Left muscle9386
Right muscle8377Right muscle8375
Subject 9Left muscle8673Subject 28Left muscle8977
Right muscle9689Right muscle8376
Subject 10Left muscle8981Subject 29Left muscle7773
Right muscle9083Right muscle8678
Subject 11Left muscle8675Subject 30Left muscle8580
Right muscle9285Right muscle9080
Subject 12Left muscle8780Subject 31Left muscle8982
Right muscle8982Right muscle8475
Subject 13Left muscle8878Subject 32Left muscle8274
Right muscle9384Right muscle8476
Subject 14Left muscle8374Subject 33Left muscle8175
Right muscle8173Right muscle8574
Subject 15Left muscle8274Subject 34Left muscle8674
Right muscle8479Right muscle8376
Subject 16Left muscle8675Subject 35Left muscle8578
Right muscle8576Right muscle8376
Subject 17Left muscle8274Subject 36Left muscle9388
Right muscle8777Right muscle7973
Subject 18Left muscle8174Subject 37Left muscle8982
Right muscle9286Right muscle8072
Subject 19Left muscle8072Subject 38Left muscle8776
Right muscle8781Right muscle8476
Table 4. Slopes of IEMG for fatigue and non-fatigue conditions.
Table 4. Slopes of IEMG for fatigue and non-fatigue conditions.
ReferenceMiddle
Deltoid Muscle
Slope’s Value Non-FatigueSlope’s Value FatigueReferenceMiddle Deltoid MuscleSlope’s Value Non-FatigueSlope’s Value Fatigue
Subject 1Left muscle−0.00180.038Subject 20Left muscle−0.000110.037
Right muscle−0.00380.4Right muscle−0.000040.045
Subject 2Left muscle−0.000160.14Subject 21Left muscle−0.00020.203
Right muscle−0.00021.4Right muscle−0.002340.038
Subject 3Left muscle−0.000810.15Subject 22Left muscle−0.00180.04
Right muscleNot-ExaminedNot-ExaminedRight muscle−0.00070.8
Subject 4Left muscle−0.00210.057Subject 23Left muscle−0.000160.16
Right muscle−0.00160.074Right muscle−0.00021.8
Subject 5Left muscle−0.000210.0014Subject 24Left muscle−0.000090.6
Right muscle−0.000010.014Right muscle−0.00210.1
Subject 6Left muscle−0.000150.33Subject 25Left muscle0.00080.08
Right muscle−0.000080.28Right muscle−0.000210.002
Subject 7Left muscle−0.00170.15Subject 26Left muscle−0.00560.023
Right muscle−0.00140.098Right muscle−0.000780.23
Subject 8Left muscle−0.00460.048Subject 27Left muscle−0.00670.28
Right muscle−0.00430.053Right muscle−0.00670.18
Subject 9Left muscle−0.00130.27Subject 28Left muscle−0.0090.1
Right muscle−0.000080.09Right muscle−0.00670.05
Subject 10Left muscle−0.0050.087Subject 29Left muscle−0.00210.06
Right muscle−0.00730.09Right muscle0.00340.15
Subject 11Left muscle−0.00020.024Subject 30Left muscle−0.000760.1
Right muscle−0.000230.059Right muscle−0.00990.02
Subject 12Left muscle−0.00440.027Subject 31Left muscle−0.000450.96
Right muscle−0.0000130.0044Right muscle−0.00020.024
Subject 13Left muscle−0.000670.036Subject 32Left muscle−0.00450.033
Right muscle−0.00260.21Right muscle−0.00450.03
Subject 14Left muscle−0.000010.039Subject 33Left muscle−0.3440.005
Right muscle−0.0000050.022Right muscle−0.000670.068
Subject 15Left muscle−0.0000070.045Subject 34Left muscle−0.000450.2
Right muscle−0.000570.024Right muscle−0.000010.04
Subject 16Left muscle−0.000230.02Subject 35Left muscle−0.0040.05
Right muscle−0.000120.019Right muscle−0.00670.05
Subject 17Left muscle−0.00090.047Subject 36Left muscle−0.000570.033
Right muscle−0.00220.019Right muscle−0.000230.02
Subject 18Left muscle−0.00330.085Subject 37Left muscle−0.00670.03
Right muscle−0.000670.011Right muscle−0.00060.06
Subject 19Left muscle−0.00060.05Subject 38Left muscle−0.0000460.035
Right muscle−0.00030.05Right muscle−0.00000780.019
Table 5. Fatigue indices in fatigue condition.
Table 5. Fatigue indices in fatigue condition.
ReferenceMiddle Deltoid MuscleFatigue Index ValueTime Consumed
(s)
ReferenceMiddle Deltoid MuscleFatigue Index ValueTime Consumed (s)
First Segment
(No Fatigue)
Last Segment
(Fatigue Reached)
First Segment
(No Fatigue)
Last Segment
(Fatigue Reached)
Subject 1Left muscle−0.6820.06325Subject 20Left muscle−0.4380.06841
Right muscle−0.6480.07231Right muscle−0.3980.04556
Subject 2Left muscle−0.4680.00633Subject 21Left muscle−0.4250.04144
Right muscle−0.2480.00360Right muscle−0.4380.00968
Subject 3Left muscle−0.3140.01070Subject 22Left muscle−0.1450.01994
Right muscleNot-ExaminedNot-ExaminedNot-ExaminedRight muscle−0.2450.067100
Subject 4Left muscle−0.1220.02194Subject 23Left muscle−0.4880.01767
Right muscle−0.1420.096100Right muscle−0.1340.00383
Subject 5Left muscle−0.3000.02051Subject 24Left muscle−0.2570.00185
Right muscle−0.2660.004113Right muscle−0.4900.01195
Subject 6Left muscle−0.2390.002109Subject 25Left muscle−0.1300.02353
Right muscle−0.5580.001115Right muscle−0.290−0.02334
Subject 7Left muscle−0.1260.03367Subject 26Left muscle−0.2900.02742
Right muscle−0.2530.05075Right muscle−0.3090.01254
Subject 8Left muscle−0.203−0.05312Subject 27Left muscle−0.4630.01880
Right muscle−0.3260.02220Right muscle−0.5230.01785
Subject 9Left muscle−0.3630.02785Subject 28Left muscle−0.2850.00849
Right muscle−0.4500.01292Right muscle−0.1370.06276
Subject 10Left muscle−0.4310.00545Subject 29Left muscle−0.3890.01070
Right muscle−0.4280.07183Right muscle−0.6520.02376
Subject 11Left muscle−0.3580.02073Subject 30Left muscle−0.3980.02381
Right muscle−0.4540.00375Right muscle−0.3780.03489
Subject 12Left muscle−0.424−0.01265Subject 31Left muscle−0.2890.02859
Right muscle−0.4730.02366Right muscle−0.4780.03569
Subject 13Left muscle−0.4790.03761Subject 32Left muscle−0.1450.01265
Right muscle−0.5180.01274Right muscle−0.537−0.05959
Subject 14Left muscle−0.3960.01956Subject 33Left muscle−0.4050.04760
Right muscle−0.4390.03367Right muscle−0.4070.06372
Subject 15Left muscle−0.4270.00958Subject 34Left muscle−0.5370.05959
Right muscle−0.3630.04564Right muscle−0.4690.03385
Subject 16Left muscle−0.415−0.07952Subject 35Left muscle−0.4250.00663
Right muscle−0.3400.02392Right muscle−0.5260.03278
Subject 17Left muscle−0.3520.01652Subject 36Left muscle−0.3970.04849
Right muscle−0.5230.00278Right muscle−0.4650.06365
Subject 18Left muscle−0.3920.09852Subject 37Left muscle−0.3240.05559
Right muscle−0.5600.00369Right muscle−0.3720.03473
Subject 19Left muscle−0.5210.00449Subject 38Left muscle−0.4260.05664
Right muscle−0.4820.02265Right muscle−0.2930.03670
Table 6. Accuracy of the proposed algorithm.
Table 6. Accuracy of the proposed algorithm.
ReferenceMiddle
Deltoid
Muscle
Segments Fatigue Classification
1st Seg.2nd Seg.3rd Seg.(N−2)th Seg.(N−1)th Seg.Nth Seg.
Subject 1Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 2Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigueFatigue
Subject 3Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNot-ExaminedNot-ExaminedNot-ExaminedNot-ExaminedNot-ExaminedNot-Examined
Subject 4Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 5Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 6Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 7Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 8Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 9Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 10Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 11Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 12Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 13Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 14Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 15Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 16Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 17Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 18Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 19Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 20Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 21Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 22Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 23Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 24Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 25Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigue
Subject 26Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 27Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 28Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 29Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 30Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 31Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 32Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigue
Subject 33Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 34Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 35Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 36Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Subject 37Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigueFatigue
Subject 38Left muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Right muscleNon-fatigueNon-fatigueNon-fatigueNon-fatigueNon-fatigueFatigue
Table 7. Comparison between the proposed algorithm and three available algorithms.
Table 7. Comparison between the proposed algorithm and three available algorithms.
ReferenceType of Employed ClassifierObtained Accuracy
[59]Support Vector Machine (SVM)85.5%
[60]Multilayer Perceptron (MLP)86%
[26]Support Vector Machine (SVM)91.39%
[61]Linear Discriminant Analysis (LDA)88.41%
Our workDouble-Step Binary Classifier94.66%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Qassim, H.M.; Hasan, W.Z.W.; Ramli, H.R.; Harith, H.H.; Mat, L.N.I.; Ismail, L.I. Proposed Fatigue Index for the Objective Detection of Muscle Fatigue Using Surface Electromyography and a Double-Step Binary Classifier. Sensors 2022, 22, 1900. https://doi.org/10.3390/s22051900

AMA Style

Qassim HM, Hasan WZW, Ramli HR, Harith HH, Mat LNI, Ismail LI. Proposed Fatigue Index for the Objective Detection of Muscle Fatigue Using Surface Electromyography and a Double-Step Binary Classifier. Sensors. 2022; 22(5):1900. https://doi.org/10.3390/s22051900

Chicago/Turabian Style

Qassim, Hassan M., Wan Zuha Wan Hasan, Hafiz R. Ramli, Hazreen Haizi Harith, Liyana Najwa Inche Mat, and Luthffi Idzhar Ismail. 2022. "Proposed Fatigue Index for the Objective Detection of Muscle Fatigue Using Surface Electromyography and a Double-Step Binary Classifier" Sensors 22, no. 5: 1900. https://doi.org/10.3390/s22051900

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop