Next Article in Journal
Towards High-Performance Pockels Effect-Based Modulators: Review and Projections
Previous Article in Journal
Real-Time Plasmonic Strain Sensors Based on Surface Relief Diffraction Gratings
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Morse Code Recognition Based on a Flexible Tactile Sensor with Carbon Nanotube/Polyurethane Sponge Material by the Long Short-Term Memory Model

1
School of Electronic and Information Engineering, Anhui Jianzhu University, Hefei 230601, China
2
Key Laboratory of Building Information Acquisition and Measurement Control Technology, Anhui Jianzhu University, Hefei 230601, China
*
Author to whom correspondence should be addressed.
Micromachines 2024, 15(7), 864; https://doi.org/10.3390/mi15070864
Submission received: 9 May 2024 / Revised: 20 June 2024 / Accepted: 28 June 2024 / Published: 30 June 2024
(This article belongs to the Section E:Engineering and Technology)

Abstract

:
Morse code recognition plays a very important role in the application of human–machine interaction. In this paper, based on the carbon nanotube (CNT) and polyurethane sponge (PUS) composite material, a flexible tactile CNT/PUS sensor with great piezoresistive characteristic is developed for detecting Morse code precisely. Thirty-six types of Morse code, including 26 letters (A–Z) and 10 numbers (0–9), are applied to the sensor. Each Morse code was repeated 60 times, and 2160 (36 × 60) groups of voltage time-sequential signals were collected to construct the dataset. Then, smoothing and normalization methods are used to preprocess and optimize the raw data. Based on that, the long short-term memory (LSTM) model with excellent feature extraction and self-adaptive ability is constructed to precisely recognize different types of Morse code detected by the sensor. The recognition accuracies of the 10-number Morse code, the 26-letter Morse code, and the whole 36-type Morse code are 99.17%, 95.37%, and 93.98%, respectively. Meanwhile, the Gated Recurrent Unit (GRU), Support Vector Machine (SVM), Multi-Layer Perceptron (MLP), and Random Forest (RF) models are built to distinguish the 36-type Morse code (letters of A–Z and numbers of 0–9) based on the same dataset and achieve the accuracies of 91.37%, 88.88%, 87.04%, and 90.97%, respectively, which are all lower than the accuracy of 93.98% based on the LSTM model. All the experimental results show that the CNT/PUS sensor can detect the Morse code’s tactile feature precisely, and the LSTM model has a very efficient property in recognizing Morse code detected by the CNT/PUS sensor.

1. Introduction

Flexible tactile sensors can achieve highly sensitive and precise recognition of tactile information, such as force, pressure, and shape changes, enabling machines to perceive and understand the external environment more intelligently [1]. In recent years, researchers have been attempting to use flexible sensors to acquire external information. They have designed flexible tactile sensors with different structures and materials to achieve high-sensitivity detection of various forces [2,3], enabling texture recognition [4,5] and temperature sensing [6]. Inspired by the fingerprints and epidermal structures of the skin, researchers have created stress sensors with porous structures or microstructures to further broaden the range of perceptual forces, increase sensitivity, and further enhance the performance of the sensors [7,8]. In addition, flexible sensors can sense the shape and type of the object, and real-time monitoring and recognition of the shape of an object can be realized by arranging flexible sensors on the surface of an object [9,10]. In the field of medical devices, sports monitoring, etc., human physiological signals can be monitored by flexible sensors [11,12,13]. With the rapid development of wearable device technology, flexible tactile sensors, as an important sensing technology, have attracted widespread attention in the field of wearable devices. Arranging tactile sensors on the hand or arm is used to validate the ability of tactile sensors to detect joint flexion, and in many works [14,15,16,17], the task of hand pose recognition is accomplished by supervised learning using tactile gloves. At the same time, tactile sensors can be used to sense hand-contact patterns, e.g., to categorize touch patterns [18], to recognize grasping objects [19], and to differentiate scratching behavior [20].
It is increasingly important to promote the application and development of flexible tactile sensor technology in the field of wearable devices. Song et al. [21] integrated six flexible pressure-sensor units into a wristband and achieved recognition of seven wrist gestures, five letter gestures, and eight sign language gestures with accuracies of 99.40%, 95%, and 98.44%, respectively. Gao et al. [22] integrated piezoresistive sensors and piezoelectric sensors into tactile gloves to realize the recognition of shape, size, and surface morphology of objects, and the recognition accuracy was 84%. Mekruksavanich et al. [23] used Inertial and Stretch sensors, combined with deep-learning techniques, to realize the recognition of human activity with a 97.68% recognition accuracy. Yu et al. [24] used MWCNTs/PDMS to achieve recognition of the four states (sitting, standing, walking, and running) with a recognition accuracy of 94%. For the research of flexible tactile sensor application processes, researchers try to use the flexible sensor on the recognition of Morse code. Adepu et al. [25] used two TeNWs/Ti3C2Tx nanohybrid-based sensors representing dot and dash signals, respectively, to achieve a wireless transmission of Morse code. Sadiq et al. [26] based their research on PDMS-CNTs film by detecting different human movements and recognizing Morse code and words.
In this paper, a flexible piezoresistive tactile sensor is designed and prepared based on the carbon nanotube (CNT) and polyurethane sponge (PUS) composite material to perceive 36 types of Morse code action precisely. To improve identification accuracy, the smoothing and normalization methods are applied to preprocess the raw time-sequential voltage signals collected from the CNT/PUS sensor for different Morse code. After that, the long short-term memory (LSTM) model with high feature-extraction property is constructed to recognize different Morse code signals, and excellent identification results are obtained. All the experiment results demonstrate that the CNT/PUS sensor can distinguish the Morse code feature signal precisely, and the LSTM model has a very efficient ability in recognizing the voltage time-sequential signals for the Morse code from the sensor.

2. Design and Preparation

2.1. Structure Design of the CNT/PUS Sensor

Based on the piezoresistive effect, a flexible tactile sensor consisting of five layers is designed, as shown in Figure 1. The sensitive layer is the core part of the tactile sensor, which is very sensitive to tactile pressure, and it is composed of the CNT/PUS composite with significant piezoresistive properties; the upper and lower electrode layers are made of copper foil with excellent conductivity and ductility; and the two encapsulation layers are made of polyimide tape with high-temperature resistance, corrosion resistance, and flexibility, which are used to protect the sensitive layer from being worn.

2.2. Preparation of the CNT/PUS Sensor

The key component of the flexible sensor is the pressure-sensitive layer, which is mainly composed of the CNT/PUS composite. In this paper, CNT material with excellent conductivity and stability is selected as the pressure-sensitive material of the flexible piezoresistive sensor. The performance parameters of the CNT solution used to make the CNT/PUS sensor are shown in Table 1.
The PUS is chosen as the flexible substrate material for the CNT/PUS composite in the sensitive layer, which is provided by Fushun Polyurethane Products Co., Ltd. (Yantai, China). The uniformly distributed porous structure of PUS makes it lightweight and highly elastic, making it the ideal material for CNT deposition.
The preparation process of the CNT/PUS sensor is shown in Figure 2. Firstly, the polyurethane sponge is cut into a size of 30 mm × 10 mm × 5 mm and washed with deionized water for 5 min to remove surface impurities, resulting in a clean polyurethane sponge. Then, the cleaned polyurethane sponge is placed in a drying oven set at 90 °C for 1.5 h to remove the residual moisture inside the sponge, resulting in a dried polyurethane sponge, as shown in Figure 2b. The dried polyurethane sponge is immersed in a carbon nanotube solution, as shown in Figure 2c, for 1 h to ensure uniform adsorption of carbon nanotube on the skeleton of the polyurethane sponge pores. After immersion, the carbon nanotube/polyurethane sponge is taken out and placed in a drying oven set at 90 °C for 2 h to remove the residual moisture in the sponge pore structure. Through the above steps, the carbon nanotube/polyurethane sponge shown in Figure 2d is obtained, which is used as the pressure-sensitive layer of the flexible tactile sensor. Attach copper foil to both ends of the carbon nanotube/polyurethane sponge and lead out the wires, fix them firmly with polyimide tape, and, finally, obtain the CNT/PUS sensor.
Before the encapsulation process, the copper foil and polyimide tape were accurately cut to ensure their dimensions matched the carbon nanotube/polyurethane sponge’s size of 30 mm × 10 mm. Paste the cut copper foil and polyimide tape on the upper and lower surfaces of the CNT/PUS, and at the same time, lead the wires at the junction of the copper foil and the PU sponge, and press the whole sensor with a finger to make it stick firmly. The specific installation process is shown in Figure 3.

2.3. Performance Testing of the CNT/PUS Sensor

Based on our previous work [27], the CNT/PUS sensor had high sensitivity (2.7% kPa−1), prompt response (response/recovery time is 60/100 ms), and remarkable long-term stability (with the range of 0−100 kPa at 0.1 Hz for a period of 18,000 s). To verify the superior performance of the CNT/PUS sensor, a performance comparison of the sensor with the existing sensors in terms of material, preparation method, and sensor performance (sensitivity, response/recovery time, repeatability, and pressure range) has been done, as shown in Table 2. From the comparison in Table 2, it can be seen that the CNT/PUS sensor has better piezoresistive performance than the others.
To verify the deviation of the CNT/PUS sensor, deviation measurements were conducted on the prepared sensors. The specific equation is as follows:
δ L = L m a x Y F S × 100 %
where δ L represents the value of deviation in the sensor response, L m a x is the maximum deviation of the sensor’s output response, and Y F S is the maximum range of the sensor’s output response.
Five CNT/PUS sensors were obtained according to the same preparation process and encapsulation process. A pressure of 1 N was applied to each sensor for the same time and then withdrawn, and the voltage of the sensor outputs during this time period was recorded at all times. The voltage was recorded for the five sensor samples at 50, 150, 250, 350, and 450 frames, and the response curves are shown in Figure 4. Then, the sample standard deviation of the response time of the sample five sensors at 50, 150, 250, 350, and 450 frames was calculated, and the sample standard deviation was used to measure the degree of dispersion of each sample point with the following equation:
S = 1 N 1 I = 1 N ( X i X ¯ ) 2
where X ¯ is the sample mean, S is the sample standard deviation, and N is the number of samples.
According to Equation (2), the sample standard deviations for the five sensors at 50, 150, 250, 350, and 450 frames were calculated as 0.038 V, 0.075 V, 0.026 V, 0.011 V, and 0.0277 V, respectively. The maximum voltage output of the sensor was 1.06 V, the maximum deviation of the sensor’s output response L m a x was 0.075 V, and the maximum range of the sensor’s output response Y F S was 1.06 V. Therefore, according to Equation (1), the maximum deviation rate of the sensor samples δ L was calculated to be 7.08%.
In summary, the CNT/PUS sensor prepared in this study exhibits excellent piezoresistive performance and low deviation, making it well-suited for the perception and detection of tactile signals. Based on the superior performance of this sensor, further research can be conducted on the high-precision detection of Morse code.

2.4. Sensing Mechanism of the Flexible Tactile Sensor

In this paper, a flexible tactile CNT/PUS sensor was prepared, and its performance has been analyzed. The aim of this paper is to investigate the sensing mechanism of the prepared CNT/PUS sensor.
At the microscopic level, when an external force is applied to the CNT/PUS sensor, the structure of the sensor’s flexible substrate undergoes compression. This compression changes the number of conductive pathways in the internal structure, leading to a significant change in the sensor’s resistance, as shown in Figure 5a.
At the macroscopic level, assuming the total resistance of the CNT/PUS sensor is R a . This total resistance is the sum of three components: the electrode layer resistance R e , the piezoresistive layer resistance R s , and the contact resistance R C . Therefore, the total resistance of the sensor in its initial state can be represented by Equation (3):
R a = R e + R s + R C
When the pressure was applied on the sensor, the electrode layer resistance Re remained almost unchanged due to the stability of its structure. However, the piezoresistive layer undergoes compression under pressure due to its porous structure, leading to a significant decrease in both the piezoresistive layer resistance Rs and the contact resistance Rc, as shown in Figure 5b. By analyzing the sensing mechanism of the CNT/PUS sensor, it is found that the change in sensor resistance is caused by the piezoresistive effect. This process converts mechanical pressure signals into electrical signals, which is of great significance for developing highly sensitive flexible tactile sensors.
The results indicate that the flexible tactile sensor, CNT/PUS sensor, prepared in this study is based on the piezoresistive effect. The performance of this sensor is closely related to its materials and structural design. These factors provide important bases for improving its performance and expanding the sensor’s application.

3. Data Acquisition for Morse Code Expression

This work aims to prepare a piezoresistive flexible tactile sensor for Morse code recognition. Tactile signals generated when expressing Morse code were captured using the CNT/PUS sensor, achieving accurate recognition of Morse code.

3.1. The Expression of Morse Code

In the Morse code system, a character is composed of short signals (dot signal “●”) and long signals (dash signal “-”), with different arrangements of signals representing different English letters, numbers, and punctuation marks. Specifically, the duration of a dot signal is one unit length, and the duration of a dash signal is three units in length. The interval between each signal is one unit in length, and the interval between each character is seven units in length. Different combinations of dot and dash signals form the basic symbol set of Morse code, as shown in Figure 6.
There are various forms of Morse code, including those based on light signals [32], electrical signals [33], and electrochromic signals [34], etc., and each form has its unique advantages and application scenarios as shown in Table 3. By comparing gesture coding with other forms of Morse code, the low cost and high flexibility of gesture coding have a unique advantage in the case of limited resources or restricted environments. In this paper, we use gesture coding to simulate Morse code signals.
This work proposes the use of index finger gestures to express the dot, dash, and interval signals of Morse code. Specifically, a dot signal is simulated by quickly tapping the index finger, a dash signal is simulated by sliding the index finger continuously in the air, and an interval signal is simulated by briefly pausing the index finger in the air. This gesture-based method of expression not only helps people communicate when electronic devices are unavailable but also serves as an effective method in sign language and other auxiliary communication techniques.

3.2. Data Collection for Morse Code from the CNT/PUS Sensor

During the data-collection process, experimenters performed gestures for 36 types (letters of A–Z and numbers of 0–9) of Morse code. Each Morse code gesture was repeated 20 times, and only 15 high-quality tactile data points were retained for each Morse code type. This strategy is used to prevent muscle fatigue and other incidental factors that could lead to erroneous data due to long-term repetitive operations by experimenters. By removing five low-quality Morse code tactile data points, a higher-quality Morse code dataset was created.
When simulating Morse code using gesture movements, the proximal interphalangeal (PIP) joint of the index finger (as shown in Figure 7) can effectively express Morse code information. During data collection, experimenters wear nitrile gloves, fix the CNT/PUS sensor at the PIP joint of the index finger, and perform the prescribed Morse code gestures, as shown in Figure 8. They also collect the timing voltage information output by the CNT/PUS sensor at the PIP joint of the index finger of nitrile gloves, and they simulate Morse code meanings through index finger gestures, as shown in Table 4.
The Arduino Mega 2560 board (Arduino Co., Ivrea, Italy) is used to collect the time-sequential voltage data output in real time from the CNT/PUS sensor for Morse code. Based on the dynamic response characteristics of the CNT/PUS sensor, the sensor sampling frequency is set to 180 Hz to capture rapidly changing tactile information. In this paper, we specify that each dot signal is expressed for 0.5 s, each dash signal is expressed for 1.5 s, and each interval signal is expressed for 0.5 s when expressing 36 types of Morse code characters using gesture action simulation. Specifically, the shortest expression time is for the letter E (“●”) at 0.5 s (including one dot signal), and the longest expression time is for the number 0 (“-----”) at 9.5 s (including five dash signals and four interval signals). To reduce errors caused by different expression times for individual letters or numbers and to improve Morse code encoding efficiency [35,36], the sampling time for each type of Morse code character (number/letter) tactile data sample is fixed at 10 s. The letter E (“●”) has an expression time of 0.5 s followed by a 9.5-s interval, and the number 0 (“-----”) has an expression time of 9.5 s followed by a 0.5-s interval. This configuration setting not only ensures sufficient tactile information is collected but also avoids data redundancy due to excessive time. Therefore, the collected time-sequential voltage data of Morse code is one-dimensional; it contains 1800 frames (or 1800 features).
To increase the diversity and robustness of Morse code tactile data samples, four experimenters (two males and two females, all with normal activity of the index finger joints) participated in the collection of Morse code tactile data. Before the experiment, all participants received standardized training to familiarize themselves with the operation methods of simulating Morse code expressions using the CNT/PUS sensor. The training content included an introduction to the basics of Morse code and gesture simulation experiments. During the experiment, each participant continuously completed the expression of 36 Morse code characters within the specified time, followed by a 30-s rest. This process was repeated 15 times until each of the four participants completed 15 rounds of high-quality data collection. The time-sequential voltage signals output by the sensor were recorded in real time. After completing the Morse code tactile data-collection experiment, a total of 2160 Morse code data samples were obtained (four experimenters × 15 valid repetitions for each Morse code × 36 Morse code).

4. Data Preprocessing

During the process of collecting Morse code data, there are various interfering factors. For instance, the CNT/PUS sensor may experience output fluctuations due to mechanical fatigue from prolonged operation. Additionally, issues such as data loss during transmission can also affect the integrity of the original time-sequential voltage information. Under the influence of these interference factors, the data may exhibit frequent and slight fluctuations and may show pulse signals in some data frames. To improve data quality and ensure that the collected data more accurately reflect the characteristics of Morse code, the original data will be subjected to data smoothing and normalization. This aims to reduce the impact of noise and outliers, making the Morse code tactile data more stable and reliable.

4.1. Data Smoothing for the Morse Code from the Sensor

The collected Morse code time-sequential voltage data are processed for smoothing, aiming to reduce the fluctuations caused by noise in the original sequential information. The Simple Moving Average (SMA) algorithm is used to preprocess and smooth the data in this work. The principle of the algorithm is to use the average of multiple samples within the window to represent the value of the current sample so as to reduce the impact of random noise on the signal. The specific equation is as follows:
y k = x k + x k 1 + x k 2 + x ( k M + 1 ) M
where y k represents the moving average value at time k , x k represents the data point at time k , and M is the window size.
The unprocessed raw data are compared to the smoothed data in Figure 9. The enlarged portion of the black curve in the figure reflects the excessive response of the sensor due to its own hysteresis effect. This response does not represent meaningful signals but rather errors caused by the sensor’s structure. The red curve in the figure presents the waveform of the data after smoothing, which reduces the noise level and smoothens the transitions in Morse code tactile data, enhancing the stability of the data. This preprocessing step lays a solid foundation for subsequent data analysis and Morse code recognition.

4.2. Normalization for the Morse Code from the Sensor

Normalization can prevent many problems such as slow training speed, gradient disappearance, or explosion in the training process of deep-learning models. Therefore, it is necessary to normalize the data after the data-smoothing process is completed. This Min–Max Normalization method is utilized to normalize the raw data in our work, which can reduce errors caused by differences in magnitude. The specific equation is as follows:
X n o r m = X X m i n X m a x X m i n
where X n o r m is the normalized value, X is the original data, X m i n is the minimum value in the original data, and X m a x is the maximum value in the original data.
As shown in Figure 10, the normalized data are mapped to the [0, 1] interval. This process not only enhances the data stability of the model training process but also helps accelerate the convergence speed of the model, effectively preventing overfitting during model training, thereby improving the performance of the model.
Through the completion of smoothing and normalization preprocessing on the tactile information of Morse code, the noise and outliers in the data have been effectively reduced, improving the data quality. As a result, the classification accuracy and processing efficiency of the Morse code recognition model are expected to be enhanced.

5. Morse Code Recognition Based on the LSTM Model

Through the tactile data-collection experiment of Morse code, we obtained the time-sequential voltage information under Morse code gestures. The Long Short-Term Memory (LSTM) model has shown excellent performance in handling sequence data with long-term dependencies. Considering the characteristics of the time-sequential voltage information of Morse code, this paper chooses to use the LSTM model for the recognition of Morse code.

5.1. Principle of the LSTM Network

The LSTM network captures long-term dependencies in sequential data through the use of carefully designed internal states and gate mechanisms, enabling the effective learning of lengthy sequences [37]. At the core of the LSTM network is its unique memory unit, referred to as a cell, along with three crucial gate mechanisms: the forget gate, input gate, and output gate. These components work together to ensure the effective flow of time-sequential information and the retention of long-term memory, as illustrated in Figure 11. Within the LSTM unit, the information flow is primarily divided into two parts: one responsible for updating the cell state based on the control of the forget gate and input gate, and the other part performing autoregressive output computation under the control of the output gate.
The forget gate determines which information should be forgotten or discarded from the current cell state. Its calculation method, as shown in Equation (6), involves multiplying the input X t by its weight matrix W x f , adding it to the previous time step’s hidden state H t 1 multiplied by its weight matrix W h f , then adding the bias vector b f . Finally, the result is passed through the activation function σ x as shown in Equation (7), yielding a value between 0 and 1. Here, the value 0 represents complete abandonment of the corresponding information in the old cell state, while the value 1 represents complete retention of this information.
F t = σ ( X t W x f + H t 1 W h f + b f )
σ x = 1 1 + exp ( x )
The input gate determines which new information will be stored in the cell state. Firstly, by multiplying the input X t by its weight matrix W x i , adding it to the previous time step’s hidden state H t 1 multiplied by its weight matrix W h i , then adding the bias vector b i , we obtain a value between 0 and 1 through the activation function σ x , as shown in Equation (8). At the same time, by multiplying the input X t by its weight matrix W x c , adding it to the previous time step’s hidden state H t 1 , multiplied by its weight matrix W h c , then adding the bias vector b c , we obtain a new candidate memory cell C ~ t through the activation function t a n h ( x ) , which represents the new information to be updated, as shown in Equation (9).
I t = σ ( X t W x i + H t 1 W h i + b i )
C ~ t = t a n h ( X t W x c + H t 1 W h c + b c )
The output of the input gate I t is multiplied by C ~ t to control how much of the new data from the candidate memory cell should be used. Then, the output of the forget gate F t is multiplied by C t 1 to control the retention of information from the past memory cell. Finally, the two results are added together to obtain the updated cell state C t as shown in Equation (10). This design effectively alleviates the vanishing gradient problem and better captures the long-term dependencies present in sequences.
C t = F t C t 1 + I t C ~ t
The output gate controls how much information from the cell state C t will be used to generate the current hidden state H t . Its calculation method is as follows: by multiplying the input X t by its weight matrix W x o , adding it to the previous time step’s hidden state H t 1 multiplied by its weight matrix W h o , then adding the bias vector b o , and, finally, passing the result through the activation function σ x to obtain a value between 0 and 1, as shown in Equation (11). Next, this value is multiplied by the updated value of the cell state t a n h ( C t ) to obtain the final hidden state H t , as shown in Equation (12).
O t = σ ( X t W x o + H t 1 W h o + b o )
H t = O t tanh ( C t )
Therefore, in performing the Morse code recognition task, the LSTM network, with its unique design structure, can effectively capture the long-term dependencies present in time-sequential tactile data, which is crucial for accurately recognizing the Morse code. This study chose the LSTM network model for Morse code recognition, aiming to fully leverage its advantages in handling time-sequential data, to achieve better classification accuracy and model generalization ability.

5.2. Construction of the LSTM Model for the Preprocessed Tactile Data

In the paper, the time-sequential voltage information of simulated Morse code was collected using the CNT/PUS sensor, and the LSTM model was constructed to classify Morse code. The specific recognition process is shown in Figure 12.
The LSTM model constructed in this paper is shown in Figure 13, which consists of two LSTM layers for feature extraction and a dense layer. The model takes input data from the tactile data-collection experiment of Morse code, including 36 types (letters of A–Z and numbers of 0–9) of Morse code, with each Morse code category providing 60 samples, totaling 2160 samples. Each tactile data sample is a piece of one-dimensional, time-sequential voltage information with 1800 features, which reflects the simulated Morse code information of the CNT/PUS sensor.
In the constructed LSTM model, LSTM network layers (each with 100 LSTM units) are used to extract and abstract deep features, which are then passed to the dense layer (with 36 neuron nodes) for further processing until the final Morse code classification task is completed. In this structure, the dense layer performs rich nonlinear transformations on the features extracted by the LSTM layer, enabling the model to capture more complex patterns in the tactile information. Through this multi-layered architecture, the LSTM model can effectively capture the long-term dependencies present in the tactile information of Morse code, providing an efficient and feasible solution for Morse code classification tasks.

5.3. Evaluation Metrics

In the multi-classification task of Morse code recognition, accuracy can only provide an overall overview of the classification performance cannot reflect specific information about false positives and false negatives, and it cannot provide detailed data on misclassifications. This work employs multiple evaluation metrics to comprehensively assess the performance of the LSTM model. Various evaluation metrics are used in this paper, including accuracy, precision, recall, and F1 score.
Accuracy refers to the proportion of correctly predicted samples to all samples by the model; precision refers to the proportion of samples predicted as the positive class by the model that are actually positive; recall refers to the proportion of actual positive samples that are correctly predicted as positive by the model; the F1 score is the mean of precision and recall, aiming to balance the relationship between these two metrics. The formulas for the selected evaluation metrics are as follows:
A c c u r a c y = T P + T N T P + T N + F P + F N
P r e c i s i o n = T P T P + F P
R e c a l l = T P T P + F N
F 1 - s c o r e = 2 × P r e c i s i o n × R e c a l l P r e c i s i o n + R e c a l l
where T P represents the number of samples that are truly positive and are predicted by the model as positive; F P represents the number of samples that are truly negative but are predicted by the model as positive; F N represents the number of samples that are truly positive but are predicted by the model as negative; T N represents the number of samples that are truly negative and are predicted by the model as negative.

5.4. Analysis of Recognition Results

5.4.1. Recognition Results for Morse Code Based on the LSTM Model

The collected Morse code dataset is divided into 6:2:2 for training, validation, and testing sets. The LSTM model is used to perform Morse code classification on datasets with 10 types (Morse code numbers of 0–9), 26 types (Morse code letters of A–Z), and 36 types (Morse code numbers of 0–9 and letters of A–Z). For convenience, these three datasets are shortened as Morse_10, Morse_26, and Morse_36, respectively. Meanwhile, to illustrate the importance of the preprocessing process (smoothing and normalization), therefore, LSTM was used to recognize the preprocessed and unprocessed Morse code datasets (Morse_10, Morse_26, Morse_36), respectively, and the experimental results are shown in Table 5.
From the results in Table 5, comparing the results after data preprocessing and unprocessed data, it is found that the evaluation metrics of the results of unprocessed LSTM data for recognizing Morse_10, Morse_26, and Morse_36 are all lower than those after data preprocessing, thus indicating that the preprocessed data can improve the classification accuracy and generalization ability of the LSTM model, which proves the necessity of data preprocessing. From the results of the LSTM recognizing preprocessed data, it can be seen that the LSTM model achieved classification accuracies of 99.17%, 95.37%, and 93.98% on the testing sets of Morse_10, Morse_26, and Morse_36, respectively. Meanwhile, the LSTM model achieved a precision, recall, and F1 score of 94.32%, 93.98%, and 94.15% for Morse_36, which indicates that LSTM performs excellently in recognizing Morse code.
To further analyze the performance of the LSTM model in Morse code recognition, the preprocessed Morse_36 is recognized using the LSTM model, the evaluation metrics of accuracy, precision, and recall are discussed in detail, and the classification results are as follows:
From the results in Figure 14, the overall accuracy of the LSTM model in recognizing Morse code (letters of A–Z and numbers of 0–9) is 93.98%. The accuracy of classification is generally higher than that of letter classification. This is because Morse code letters have higher morphological similarity, which increases the difficulty of differentiation and thus the difficulty of model classification.
From the precision results in Figure 15, the LSTM model achieves an average precision of over 85% for all 36 Morse code classes. Among them, 18 classes have a precision of 100%, but the precision for Morse code “K” and “O” is 81.82% and 83.33%, respectively. This indicates that the LSTM model has achieved excellent overall results in the Morse code recognition task (36 types), but there are certain shortcomings in the performance for certain types.
From the results in Figure 16 regarding recall, the LSTM model achieves an average recall of 93.98% for the 36 Morse code classes. Specifically, the recall for 27 Morse code classes exceeds 90%, with 20 types having a recall of 100%. Compared to precision, more Morse code classes have lower recall values. This is because recall is less important than precision in the Morse code classification problem.
In summary, the LSTM model achieved an accuracy of 93.98%, a precision of 94.32%, a recall of 93.98%, and an F1 score of 94.15% in the classification of Morse code (36 types). Therefore, the LSTM model has achieved excellent classification results in the Morse code recognition task.

5.4.2. Comparison Based on Different Models for Morse Code Recognition

Comparing the classification performance of different models on the same dataset can help reveal the strengths and limitations of each model, thereby providing a basis for selecting the most suitable model for a specific classification task. Based on the same preprocessed Morse code dataset (36 types), the classification performance of the Gated Recurrent Unit (GRU) model, Multi-Layer Perceptron (MLP) model, k-Nearest Neighbor (k-NN) model, Random Forest (RF) model, and Support Vector Machine (SVM) model were compared. The classification accuracy of each model on the testing set is shown in Figure 17.
From Figure 17, it can be seen that the LSTM model achieved the highest accuracy in Morse code classification, reaching 93.98% (as shown in the red text color in Figure 17), and the k-NN model has the lowest recognition accuracy at 76.85%. In our study, the data acquisition from the CNT/PUS sensor, although stable, may generate noise or errors under certain conditions, which may affect the recognition performance of some models. In particular, for models such as k-NN, which may rely more on the accuracy and consistency of the data, small fluctuations in the sensor may lead to a decrease in the recognition rate. The LSTM model has a stronger capability for handling time-series data, allowing it to better capture the sequential features in Morse code input. This enables LSTM to maintain a high recognition rate even in noisy conditions. Additionally, the LSTM model exhibits strong robustness to data fluctuations, effectively managing the uncertainties introduced by the sensor. A comparison was conducted between the CNT/PUS sensor and existing sensors in terms of model algorithms and accuracy. The results demonstrated that the sensor utilized in this study, when combined with the LSTM model, exhibited a high level of accuracy in recognizing Morse code, as shown in Table 6.
In order to better illustrate the effectiveness of using the LSTM model to recognize Morse code, the GRU, SVM, MLP, and RF models are established to recognize the three Morse code datasets Morse_10, Morse_26, and Morse_36 after data preprocessing, and the recognition results are shown in Table 7.
As shown in Table 7, the five different models have average accuracy rates for recognizing Morse code datasets (Morse_10, Morse_26, and Morse_36) in the following order: LSTM, GRU, RF, SVM, and MLP, with accuracies of 93.98%, 91.37%, 90.97%, 88.88%, and 87.04%, respectively. Comparing the evaluation metrics precision, recall, and F1 score, the scores from highest to lowest are LSTM, GRU, RF, SVM, and MLP. Through comparison, it is found that the LSTM model has the highest scores for the evaluation metrics, accuracy, precision, recall, and F1 score in recognizing the Morse_10, Morse_26, and Morse_36 datasets. From the Morse code dataset, including Morse_10, Morse_26, and Morse_36, it is found that all the models achieve the highest accuracy in recognizing Morse_10 and the lowest accuracy in recognizing Morse_36, and the models show consistency in recognizing the dataset. Through comparison, it is found that the LSTM model has better performance in recognizing Morse code classifications.
In summary, by comparing the models in Morse code recognition, the LSTM model shows higher recognition accuracy and stability, indicating its superior performance in Morse code recognition.

6. Conclusions

This study develops a flexible tactile sensor for recognizing Morse code. Initially, the CNT/PUS sensor is designed and prepared to express 36 types (letters of A–Z and numbers of 0–9) of Morse code gestures through different bending actions of the index finger. By collecting 2160 sets of Morse code gesture sequential voltage signals and combining them with the LSTM classification model, Morse code-recognition tasks are achieved. The results show that the LSTM model achieved a classification accuracy of 93.98% for 36 types of Morse code, with an average precision of 94.32%, an average recall of 93.98%, and an average F1 score of 94.15%. In conclusion, the LSTM model can effectively recognize tactile information outputs by the CNT/PUS sensor, enabling Morse code recognition. The innovation of this study lies in the material and structural design of the sensor, as well as the selection and application of the algorithm. By combining the CNT/PUS flexible tactile sensor with the LSTM algorithm model, the accuracy of Morse code recognition is not only improved but also demonstrates the potential of this method in the fields of flexible electronics and human–computer interaction.

Author Contributions

Conceptualization, Y.S. and A.H.; methodology, F.W. and W.Z.; software, F.W. and W.Z.; validation, A.H. and Y.S.; formal analysis, Y.S. and A.H.; investigation, A.H. and W.Z.; resources, F.W. and W.Z.; data curation, A.H. and W.Z.; writing—original draft preparation, F.W., A.H. and W.Z.; writing—review and editing, F.W., A.H., W.Z. and Y.S.; visualization, W.Z., M.L. and J.Z.; supervision, Y.S. and F.W.; project administration, Y.S.; funding acquisition, Y.S. and F.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Nature Science Research Key Project for Universities in Anhui Province (2023AH050180), the Anhui Province Housing Urban and Rural Construction Science and Technology Project (2021-YF24, 2022-YF168), the New Era Quality Project for Post-graduate Education (2022qyw/sysfkc029, 2023szsfkc091, 2023xscx103), and the Quality Engineering Project of Anhui Jianzhu University (2023jy15).

Data Availability Statement

The data used to support the study are available upon request to the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, X.; Li, N.; Wang, G.; Zhang, C.; Zhang, Y.; Zeng, F.; Liu, H.; Yi, G.; Wang, Z. Research status of polysiloxane-based piezoresistive flexible human electronic sensors. RSC Adv. 2023, 13, 16693–16711. [Google Scholar] [CrossRef] [PubMed]
  2. Song, Y.; Li, M.; Wang, F.; Lv, S. Contact Pattern Recognition of a Flexible Tactile Sensor Based on the CNN-LSTM Fusion Algorithm. Micromachines 2022, 13, 1053. [Google Scholar] [CrossRef] [PubMed]
  3. Song, Y.; Lv, S.; Wang, F.; Li, M. Hardness-and-Type Recognition of Different Objects Based on a Novel Porous Graphene Flexible Tactile Sensor Array. Micromachines 2023, 14, 217. [Google Scholar] [CrossRef]
  4. Cao, Y.; Li, T.; Gu, Y.; Luo, H.; Wang, S.; Zhang, T. Fingerprint-Inspired Flexible Tactile Sensor for Accurately Discerning Surface Texture. Small 2018, 14, 1703902. [Google Scholar] [CrossRef] [PubMed]
  5. Wang, Y.; Chen, J.; Mei, D. Recognition of surface texture with wearable tactile sensor array: A pilot Study. Sens. Actuators A Phys. 2020, 307, 111972. [Google Scholar] [CrossRef]
  6. Su, Y.; Ma, C.; Chen, J.; Wu, H.; Luo, W.; Peng, Y.; Luo, Z.; Li, L.; Tan, Y.; Omisore, O.M.; et al. Printable, Highly Sensitive Flexible Temperature Sensors for Human Body Temperature Monitoring: A Review. Nanoscale Res. Lett. 2020, 15, 200. [Google Scholar] [CrossRef]
  7. Li, W.; Jin, X.; Han, X.; Li, Y.; Wang, W.; Lin, T.; Zhu, Z. Synergy of porous structure and microstructure in piezoresistive material for high-performance and flexible pressure sensors. ACS Appl. Mater. Interfaces 2021, 13, 19211–19220. [Google Scholar] [CrossRef]
  8. Liu, J.; Liu, N.; Hashimoto, K.; Meng, C.; Guo, S. Touch position identification based on a flexible array-less supercapacitive tactile sensor. AIP Adv. 2019, 9, 015026. [Google Scholar] [CrossRef]
  9. Drimus, A.; Kootstra, G.; Bilberg, A.; Kragic, D. Design of a flexible tactile sensor for classification of rigid and deformable objects. Robot. Auton. Syst. 2014, 62, 3–15. [Google Scholar] [CrossRef]
  10. Luo, Y.; Xiao, X.; Chen, J.; Li, Q.; Fu, H. Machine-Learning-Assisted Recognition on Bioinspired Soft Sensor Arrays. ACS Nano 2022, 16, 6734–6743. [Google Scholar] [CrossRef]
  11. Mao, R.; Yao, W.; Qadir, A.; Chen, W.; Gao, W.; Xu, Y.; Hu, H. 3-D graphene aerogel sphere-based flexible sensors for healthcare applications. Sens. Actuators A Phys. 2020, 312, 112144. [Google Scholar] [CrossRef]
  12. Gao, W.; Emaminejad, S.; Nyein, H.Y.Y.; Challa, S.; Chen, K.; Peck, A.; Fahad, H.M.; Ota, H.; Shiraki, H.; Kiriya, D.; et al. Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 2016, 529, 509–514. [Google Scholar] [CrossRef]
  13. Su, Y.; Zheng, L.; Yao, D.; Zhang, X.; Chen, H.; Xu, H. Robust physiological signal monitoring by a flexible piezoresistive sensor microstructured with filamentating laser pulses. Sens. Actuators A Phys. 2021, 331, 112907. [Google Scholar] [CrossRef]
  14. Wen, F.; Zhang, Z.; He, T.; Lee, C. AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove. Nat. Commun. 2021, 12, 5378. [Google Scholar] [CrossRef] [PubMed]
  15. Sundaram, S.; Kellnhofer, P.; Li, Y.; Zhu, J.-Y.; Torralba, A.; Matusik, W. Learning the signatures of the human grasp using a scalable tactile glove. Nature 2019, 569, 698–702. [Google Scholar] [CrossRef] [PubMed]
  16. Niu, H.; Li, H.; Gao, S.; Li, Y.; Wei, X.; Chen, Y.; Yue, W.; Zhou, W.; Shen, G. Perception-to-cognition tactile sensing based on artificial-intelligence-motivated human full-skin bionic electronic skin. Adv. Mater. 2022, 34, 2202622. [Google Scholar] [CrossRef] [PubMed]
  17. Zhou, Z.; Chen, K.; Li, X.; Zhang, S.; Wu, Y.; Zhou, Y.; Meng, K.; Sun, C.; He, Q.; Fan, W. Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays. Nat. Electron. 2020, 3, 571–578. [Google Scholar] [CrossRef]
  18. Wan, C.; Chen, G.; Fu, Y.; Wang, M.; Matsuhisa, N.; Pan, S.; Pan, L.; Yang, H.; Wan, Q.; Zhu, L. An artificial sensory neuron with tactile perceptual learning. Adv. Mater. 2018, 30, 1801291. [Google Scholar] [CrossRef]
  19. Zhu, M.; Sun, Z.; Zhang, Z.; Shi, Q.; He, T.; Liu, H.; Chen, T.; Lee, C. Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications. Sci. Adv. 2020, 6, eaaz8693. [Google Scholar] [CrossRef] [PubMed]
  20. Chun, K.S.; Kang, Y.J.; Lee, J.Y.; Nguyen, M.; Lee, B.; Lee, R.; Jo, H.H.; Allen, E.; Chen, H.; Kim, J. A skin-conformable wireless sensor to objectively quantify symptoms of pruritus. Sci. Adv. 2021, 7, eabf9405. [Google Scholar] [CrossRef]
  21. Song, Y.; Liu, M.; Wang, F.; Zhu, J.; Hu, A.; Sun, N. Gesture Recognition Based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory Network for a Wearable Wrist Sensor with Multi-Walled Carbon Nanotube/Cotton Fabric Material. Micromachines 2024, 15, 185. [Google Scholar] [CrossRef] [PubMed]
  22. Gao, Z.; Ren, B.; Fang, Z.; Kang, H.; Han, J.; Li, J. Accurate recognition of object contour based on flexible piezoelectric and piezoresistive dual mode strain sensors. Sens. Actuators A Phys. 2021, 332, 113121. [Google Scholar] [CrossRef]
  23. Mekruksavanich, S.; Jitpattanakul, A. A Deep Learning Network with Aggregation Residual Transformation for Human Activity Recognition Using Inertial and Stretch Sensors. Computers 2023, 12, 141. [Google Scholar] [CrossRef]
  24. Yu, Q.; Zhang, P.; Chen, Y. Human Motion State Recognition Based on Flexible, Wearable Capacitive Pressure Sensors. Micromachines 2021, 12, 1219. [Google Scholar] [CrossRef]
  25. Adepu, V.; Tathacharya, M.; Cs, R.; Mattela, V.; Sahatiya, P. TeNWs/Ti3C2Tx Nanohybrid-Based Flexible Pressure Sensors for Personal Safety Applications Using Morse Code. ACS Appl. Nano Mater. 2022, 5, 18209–18219. [Google Scholar] [CrossRef]
  26. Sadiq, H.; Hui, H.; Huang, S.; Mahmood, K.; Sharif, M.H.; Ali, I. A Flexible Pressure Sensor Based on PDMS-CNTs Film for Multiple Applications. IEEE Sens. J. 2022, 22, 3033–3039. [Google Scholar] [CrossRef]
  27. Wang, F.; Zhang, W.; Song, Y.; Jiang, X.; Sun, N. Wearable and Cost-Effective Pressure Sensor Based on a Carbon Nanotube/Polyurethane Sponge for Motion Detection and Gesture Recognition. ACS Appl. Electron. Mater. 2023, 5, 6704–6715. [Google Scholar] [CrossRef]
  28. Zhao, X.; Mei, D.; Tang, G.; Zhao, C.; Wang, J.; Luo, M.; Li, L.; Wang, Y. Strain and Pressure Sensors Based on MWCNT/PDMS for Human Motion/Perception Detection. Polymers 2023, 15, 1386. [Google Scholar] [CrossRef] [PubMed]
  29. Qiu, J.; Guo, X.; Chu, R.; Wang, S.; Zeng, W.; Qu, L.; Zhao, Y.; Yan, F.; Xing, G. Rapid-Response, Low Detection Limit, and High-Sensitivity Capacitive Flexible Tactile Sensor Based on Three-Dimensional Porous Dielectric Layer for Wearable Electronic Skin. ACS Appl. Mater. Interfaces 2019, 11, 40716–40725. [Google Scholar] [CrossRef]
  30. Chen, X.; Zhang, D.; Luan, H.; Yang, C.; Yan, W.; Liu, W. Flexible Pressure Sensors Based on Molybdenum Disulfide/Hydroxyethyl Cellulose/Polyurethane Sponge for Motion Detection and Speech Recognition Using Machine Learning. ACS Appl. Mater. Interfaces 2022, 15, 2043–2053. [Google Scholar] [CrossRef] [PubMed]
  31. Xiong, Y.; Zhu, Y.; Liu, X.; Zhu, P.; Hu, Y.; Sun, R.; Wong, C.-P. A flexible pressure sensor based on melamine foam capped by copper nanowires and reduced graphene oxide. Mater. Today Commun. 2020, 24, 100970. [Google Scholar] [CrossRef]
  32. Ni, Y.; Feng, J.; Liu, J.; Yu, H.; Wei, H.; Du, Y.; Liu, L.; Sun, L.; Zhou, J.; Xu, W. An Artificial Nerve Capable of UV-Perception, NIR–Vis Switchable Plasticity Modulation, and Motion State Monitoring. Adv. Sci. 2021, 9, 2102036. [Google Scholar] [CrossRef] [PubMed]
  33. Ni, Y.; Yang, L.; Feng, J.; Liu, J.; Sun, L.; Xu, W. Flexible optoelectronic neural transistors with broadband spectrum sensing and instant electrical processing for multimodal neuromorphic computing. SmartMat 2022, 4, e1154. [Google Scholar] [CrossRef]
  34. Ni, Y.; Liu, J.; Han, H.; Yu, Q.; Yang, L.; Xu, Z.; Jiang, C.; Liu, L.; Xu, W. Visualized in-sensor computing. Nat. Commun. 2024, 15, 3454. [Google Scholar] [CrossRef] [PubMed]
  35. Yu, F.; Cai, J.C.; Zhu, L.Q.; Sheikhi, M.; Zeng, Y.H.; Guo, W.; Ren, Z.Y.; Xiao, H.; Ye, J.C.; Lin, C.-H.; et al. Artificial Tactile Perceptual Neuron with Nociceptive and Pressure Decoding Abilities. ACS Appl. Mater. Interfaces 2020, 12, 26258–26266. [Google Scholar] [CrossRef] [PubMed]
  36. Wang, X.; Li, E.; Liu, Y.; Lan, S.; Yang, H.; Yan, Y.; Shan, L.; Lin, Z.; Chen, H.; Guo, T. Stretchable vertical organic transistors and their applications in neurologically systems. Nano Energy 2021, 90, 106497. [Google Scholar] [CrossRef]
  37. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [PubMed]
  38. Abdullah, A.H.; Ismail, Z. Butterfly pea flower as a stabilizer for shear exfoliated graphene: Green material for motion monitoring and Morse code sensor. Appl. Nanosci. 2022, 13, 4593–4603. [Google Scholar] [CrossRef]
  39. Peng, Y.; Wang, J.; Pang, K.; Liu, W.; Meng, J.; Li, B. A Physiology-Based Flexible Strap Sensor for Gesture Recognition by Sensing Tendon Deformation. IEEE Sens. J. 2021, 21, 9449–9456. [Google Scholar] [CrossRef]
  40. Al-Handarish, Y.; Omisore, O.M.; Chen, J.; Cao, X.; Akinyemi, T.O.; Yan, Y.; Wang, L. A Hybrid Microstructure Piezoresistive Sensor with Machine Learning Approach for Gesture Recognition. Appl. Sci. 2021, 11, 7264. [Google Scholar] [CrossRef]
  41. Wei, Z.; Li, Z.; Han, S. YFDM: YOLO for detecting Morse code. Sci. Rep. 2023, 13, 20614. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic of the CNT/PUS sensor structure.
Figure 1. Schematic of the CNT/PUS sensor structure.
Micromachines 15 00864 g001
Figure 2. Preparation process of the CNT/PUS sensor. (a) The preparation of the CNT/PUS sensor: (b) polyurethane sponge; (c) carbon nanotube solution; (d) the carbon nanotube/polyurethane sponge.
Figure 2. Preparation process of the CNT/PUS sensor. (a) The preparation of the CNT/PUS sensor: (b) polyurethane sponge; (c) carbon nanotube solution; (d) the carbon nanotube/polyurethane sponge.
Micromachines 15 00864 g002
Figure 3. Encapsulation process of the CNT/PUS sensor.
Figure 3. Encapsulation process of the CNT/PUS sensor.
Micromachines 15 00864 g003
Figure 4. Response characteristic curve of the CNT/PUS sensor.
Figure 4. Response characteristic curve of the CNT/PUS sensor.
Micromachines 15 00864 g004
Figure 5. Mechanism of the CNT/PUS sensor: (a) microscopic mechanism; (b) macroscopic mechanism.
Figure 5. Mechanism of the CNT/PUS sensor: (a) microscopic mechanism; (b) macroscopic mechanism.
Micromachines 15 00864 g005
Figure 6. Morse code for letters of A–Z and numbers of 0–9.
Figure 6. Morse code for letters of A–Z and numbers of 0–9.
Micromachines 15 00864 g006
Figure 7. Illustration of the distribution of the joints in the index finger.
Figure 7. Illustration of the distribution of the joints in the index finger.
Micromachines 15 00864 g007
Figure 8. Simulating Morse code with the CNT/PUS sensor: (a) short taps motion; (b) long sliding motion; (c) short pause motion.
Figure 8. Simulating Morse code with the CNT/PUS sensor: (a) short taps motion; (b) long sliding motion; (c) short pause motion.
Micromachines 15 00864 g008
Figure 9. Raw data curve and data—smoothing curve.
Figure 9. Raw data curve and data—smoothing curve.
Micromachines 15 00864 g009
Figure 10. Data-smoothing curve and data-normalization curve.
Figure 10. Data-smoothing curve and data-normalization curve.
Micromachines 15 00864 g010
Figure 11. Schematic of the LSTM structure.
Figure 11. Schematic of the LSTM structure.
Micromachines 15 00864 g011
Figure 12. Flowchart of the training process based on the LSTM model.
Figure 12. Flowchart of the training process based on the LSTM model.
Micromachines 15 00864 g012
Figure 13. Flowchart of the LSTM model to recognize Morse code.
Figure 13. Flowchart of the LSTM model to recognize Morse code.
Micromachines 15 00864 g013
Figure 14. Confusion matrix for Morse code (36 types) recognition results.
Figure 14. Confusion matrix for Morse code (36 types) recognition results.
Micromachines 15 00864 g014
Figure 15. Precision of Morse code (36 types) recognition results.
Figure 15. Precision of Morse code (36 types) recognition results.
Micromachines 15 00864 g015
Figure 16. Recall of Morse code (36 types) recognition results.
Figure 16. Recall of Morse code (36 types) recognition results.
Micromachines 15 00864 g016
Figure 17. The accuracy of different models on the Morse code data-testing set.
Figure 17. The accuracy of different models on the Morse code data-testing set.
Micromachines 15 00864 g017
Table 1. The performance parameters of the CNT solution.
Table 1. The performance parameters of the CNT solution.
PropertiesValueUnit
quality score2%
purity>98%
length10~30 μ m
diameter5~15 n m
Table 2. Performance comparison between the recently reported pressure sensors and this work.
Table 2. Performance comparison between the recently reported pressure sensors and this work.
Ref.MaterialsPreparation
Method
Sensitivity
(k·Pa−1)
Response/
Recovery
Time (ms)
Repeatability
(cycles)
Pressure Range
(k·Pa)
This workCNT/PUSsoaking-drying0.02760/10018,0000~100
[28]MWCNT/PDMSscraping-coating0.026320/17020000~31.83
[29]GNPs/MWCNTs/SRdipping-coating0.06245/8320000~4.5
[30]MoS2/HEC/PUSsoaking-drying0.746120/12020000~250
[31]CuRGOMFdipping-drying0.088300/NA *50000~18
* Where “NA” is not mentioned in the paper.
Table 3. Advantages and disadvantages of different forms of Morse code.
Table 3. Advantages and disadvantages of different forms of Morse code.
Ref.PrincipleAdvantagesDisadvantages
This workGesture-basedHigh flexibility High complexity of recognition
[32]Light-basedLong-distance transmission
High-speed transmission
Environment-dependent
High visualization requirements
[33]ElectricalHigh stability
Easy to implement
Limited distance
Energy-consuming
[34]ElectrochromicLow energy consumption
Visually intuitive
Slow response speed
Material limitations
Table 4. The meaning of Morse code simulated by index finger gestures.
Table 4. The meaning of Morse code simulated by index finger gestures.
Index Finger BehaviorMorse Code Meaning
Short taps motionDot signal
Long sliding motionDash signal
Short pause motionInterval signal
Table 5. The recognition results for Morse code based on the LSTM model.
Table 5. The recognition results for Morse code based on the LSTM model.
Dataset StatusDatasetAccuracyPrecisionRecallF1-Score
UnprocessedMorse_1090.74%91.90%90.74%91.32%
Morse_2685.07%86.12%85.07%85.59%
Morse_3682.18%83.37%82.18%82.77%
PreprocessedMorse_1099.17%99.70%99.17%99.43%
Morse_2695.37%95.71%95.37%95.54%
Morse_3693.98%94.32%93.98%94.15%
Table 6. Comparison of model algorithms and recognition accuracy between this work and others.
Table 6. Comparison of model algorithms and recognition accuracy between this work and others.
Ref.SensorModelApplicationAccuracy
This workCNT/PUSLSTMMorse code recognition93.98%
[38] Graphene/NylonMachine learningMorse code recognition>90%
[39]Graphene aerogelMachine learningGestures recognition84.7%
[40]CB/PDMSLSTM + DenseGestures recognition87.38%
[41]CMOS sensorYFDMMorse code recognition91%
Table 7. Recognizing Morse code with different models.
Table 7. Recognizing Morse code with different models.
ModelDatasetAccuracyPrecisionRecallF1-Score
LSTMMorse_1099.17%99.70%99.17%99.43%
Morse_2695.37%95.71%95.37%95.54%
Morse_3693.98%94.32%93.98%94.15%
GRUMorse_1098.33%98.57%98.33%98.45%
Morse_2694.22%94.61%94.22%94.41%
Morse_3691.37%92.46%91.37%91.91%
SVMMorse_1094.17%95.19%94.17%94.68%
Morse_2691.35%92.29%91.35%91.82%
Morse_3688.88%89.44%88.88%89.16%
MLPMorse_1092.50%93.76%92.50%93.13%
Morse_2689.42%90.42%89.42%89.92%
Morse_3687.04%89.10%87.04%88.06%
RFMorse_1097.50%98.00%97.50%97.75%
Morse_2694.87%95.29%94.87%95.08%
Morse_3690.97%91.68%90.97%91.32%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, F.; Hu, A.; Song, Y.; Zhang, W.; Zhu, J.; Liu, M. Morse Code Recognition Based on a Flexible Tactile Sensor with Carbon Nanotube/Polyurethane Sponge Material by the Long Short-Term Memory Model. Micromachines 2024, 15, 864. https://doi.org/10.3390/mi15070864

AMA Style

Wang F, Hu A, Song Y, Zhang W, Zhu J, Liu M. Morse Code Recognition Based on a Flexible Tactile Sensor with Carbon Nanotube/Polyurethane Sponge Material by the Long Short-Term Memory Model. Micromachines. 2024; 15(7):864. https://doi.org/10.3390/mi15070864

Chicago/Turabian Style

Wang, Feilu, Anyang Hu, Yang Song, Wangyong Zhang, Jinggen Zhu, and Mengru Liu. 2024. "Morse Code Recognition Based on a Flexible Tactile Sensor with Carbon Nanotube/Polyurethane Sponge Material by the Long Short-Term Memory Model" Micromachines 15, no. 7: 864. https://doi.org/10.3390/mi15070864

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop