Next Article in Journal
Study on the Mechanical Properties of Monocrystalline Germanium Crystal Planes Based on Molecular Dynamics
Next Article in Special Issue
Progress of Research on the Application of Nanoelectronic Smelling in the Field of Food
Previous Article in Journal
Fractional Bandwidth up to 24% and Spurious Free SAW Filters on Bulk 15°YX-LiNbO3 Substrates Using Thickness-Modulated IDT Structures
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fine Texture Detection Based on a Solid–Liquid Composite Flexible Tactile Sensor Array

State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310007, China
*
Author to whom correspondence should be addressed.
Micromachines 2022, 13(3), 440; https://doi.org/10.3390/mi13030440
Submission received: 11 January 2022 / Revised: 28 February 2022 / Accepted: 8 March 2022 / Published: 14 March 2022
(This article belongs to the Special Issue Tactile Sensing Technology and Systems, Volume II)

Abstract

:
Surface texture information plays an important role in the cognition and manipulation of an object. Vision and touch are the two main methods for extracting an object’s surface texture information. However, vision is often limited since the viewing angle is uncertain during manipulation. In this article, we propose a fine surface texture detection method based on a stochastic resonance algorithm through a novel solid–liquid composite flexible tactile sensor array. A thin flexible layer and solid–liquid composite conduction structure on the sensor effectively reduce the attenuation of the contact force and enhance the sensitivity of the sensor. A series of ridge texture samples with different heights (0.9, 4, 10 μm), different widths (0.3, 0.5, 0.7, 1 mm), but the same spatial period (2 mm) of ridges were used in the experiment. The experimental results prove that the stochastic resonance algorithm can significantly improve the signal characteristic of the output signal of the sensor. The sensor has the capability to detect fine ridge texture information. The mean relative error of the estimation for the spatial period was 1.085%, and the ridge width and ridge height, respectively, have a monotonic mapping relationship with the corresponding model output parameters. The sensing capability to sense a fine texture of tactile senor surpasses the limit of human fingers.

1. Introduction

The tactile sensor can provide useful contact information for robot feedback and control to better complete manipulation tasks in a complex environment. Existing research on tactile sensors has achieved monitoring of static contact information, such as temperature, curvature, and contact force [1,2,3], but the research on the acquisition of dynamic contact information is not thorough enough. Surface texture information, that is, the height, width, spatial period, and other texture shape information of the contacted object, is an important part of the dynamic contact information. It has been proved that the tactile sensing detection of the surface texture information of the object is helpful for dexterous manipulation [4,5] and minimally invasive surgery [6,7]. Vision is also an effective method to obtain surface texture information [8], but due to the uncertainty of the viewing angle during operation, the visual perception is often limited. In addition, it is noteworthy that the sensing process of the tactile sensor is the exploratory movement of the sensor sliding on the surface to obtain texture information, such as vibration information [9]. In other words, as long as the sensor has sufficient performance and can touch well the object, the surface texture information of the object can be obtained even under complex manipulation conditions.
Some existing researches use multi-array tactile sensors and fast Fourier transform (FFT, hereafter) technology to obtain characteristic signals and estimate the surface texture information of objects, which had certain limitations. In 2011, C.M. Oddo et al. [10,11] developed a 2 × 2 MEMS piezoresistive tactile sensor array with high spatial resolution and sensitivity and integrated it on the fingertips of humanoid robot fingers with bionic fingerprints. When actively touching, it could quantitatively evaluate the ridge texture with a spatial period difference as low as 40 μm (400, 440, 480 μm spatial periods, 1 mm ridge height). H.B. Muhammad et al. [12] proposed a capacitive tactile sensor array based on silicon MEMS, which resolved forces in the sub-mN range and successfully distinguished fine ridge textures with ridge heights of 200 μm and spatial periods as low as 200 μm. However, the research mentioned above on object surface information detection mainly focused on the estimation of the spatial period of ridge textures in the micron range and did not reach the capability to detect fine textures with ridge heights of several microns, such as human fingers [13,14]. In order to eliminate the influence of the difference between the mechanical properties of structural materials such as friction and frequency characteristics and human fingers on the sliding tactile signal, in 2019, Yasutoshi Takekawa et al. [15,16,17] developed a wearable skin vibration sensor to detect the skin-propagated vibration caused by finger rubbing an object surface, and successfully identified the spatial period and ridge height information of the fine ridge texture by calculating the power spectral density of the sensor output signal. The minimum ridge height of the fine texture exceeded the limitation to 25 μm, but in this situation, the characteristic of the signal was already very weak, and the detectable performance of the signal was limited.
Another commonly used method is using the tactile signal obtained by the designed tactile sensor for machine learning to classify and identify the surface texture of the object. In 2012, in order to achieve the ability of human fingertips to detect texture, Jeremy A. Fishel et al. [18,19] proposed Bio-Tac, a tactile finger with a solid–liquid composite structure, which could transmit the vibration of the skin through an incompressible liquid. The tactile finger could detect continuous vibrations as small as a few nanometers at 330 Hz and very small transient events that occurred when small particles fell on the finger, which was beyond human fingers’ capabilities. The Bayesian exploration method was used to classify 16 natural textures with an accuracy of 99.6%. In 2017, Udaya B. Rongala et al. [20,21] imported the output signal of the 2 × 2 piezoresistive tactile sensor array into the lzhikevich neuron model to enable neuromorphic artificial touch and simulate the firing pattern of mechanoreceptors in the skin. The generated neural spike pattern was used to perform neural network learning and classification of 10 natural textures, including glass materials with a grain size of less than 90 nm. In 2019, Sriramana Sankar et al. [5,22] designed a flexible bionic finger integrated with a 3 × 3 tactile sensor array. When the finger touched seven different texture samples (flat, ridges, bumps), the corresponding tactile response also transformed into a neural spike pattern with different characteristics that simulated the firing pattern of mechanoreceptors, and the support vector machine classifier was used to learn and classify with an accuracy of 99.21%. The above research revealed the capability of simulating human tactile behavior and accurately classifying different texture information, including fine textures, but the detailed texture information is still insufficient, and the complex structure encapsulation and machine learning algorithms limit their applications.
To sum up, research on texture detection needs more extensive and systematic investigations. FFT processing directly on the tactile signals can quickly and easily obtain texture feature information, such as the spatial period and ridge height of the ridge texture. However, due to the limited performance of most simple-structured tactile sensors to discern the tiny structural variation, FFT processing does not perform well in situations of fine texture detection. Thus, a tactile sensor with a higher sensitivity is needed. However, the capability of the existing simple tactile sensor to detect weak force changes is still far behind that of humans [23]. Another common processing method is the machine learning method. The tactile signals are used to train the models to accurately classify different textures, but that needs to go through a complicated learning process, and detailed feature information of the surface textures cannot be detected. Therefore, a universal, real-time method based on a tactile sensor with a simple structure for fine texture detection is extremely needed.
In the process of detecting fine textures, the signals generated by the tactile sensor are weak and may even be submerged in system noise, such as touch action noise, circuit noise, etc., resulting in its characteristics being difficult to detect. The stochastic resonance algorithm (SR, hereafter) is a commonly used weak signal detecting method, which adds random noise to the weak signal to improve the detectability of the target signal or enhance the accuracy of information interpretation [24]. Through a series of psychophysical experiments, Kadir Beceren et al. [25,26] proved that SR could affect the difference threshold of human tactile sensation, and appropriate noise can enhance the accuracy of tactile sensing. Yuichi Kurita et al. [27] used the SR to develop surgical forceps with sensorimotor-enhancing capabilities and verified its texture detection capability, which was of great help to surgeons in laparoscopic surgery. To this end, we have introduced the SR into our tactile sensor system to enhance the capability of our tactile sensor for fine textures detection.
In this article, we use a 2 × 2 solid–liquid composite flexible tactile sensor array to obtain tactile information. A method of fine texture detection based on SR is put forward. By adding random noise to the output signal of the tactile sensor and inputting the mixed signal to a bistable SR model, we obtain tactile signals with strong signal characteristics and figure out the corresponding texture information through numerical analysis. The presence of the flexible layer will lead to a decrease in the transmission efficiency of the contact force, and the thicker the flexible layer, the greater the attenuation of the contact force [28,29]. It is meaningful to use a solid–liquid composite conduction structure to reduce the attenuation of the contact force through a flexible layer. Most of the existing tactile texture detection methods are aimed at the detection of micron-level fine texture or can only classify a limited number of textures. The method proposed in this article has the potential to detect sub-micron fine ridge texture. In addition, the authors estimate the texture features of the fine ridge texture, such as the spatial period, ridge height, and ridge width. At last, the authors present the signal characteristic change of the output tactile signal and the error of the texture characteristic value.
The rest of this article is organized as follows. The tactile sensor device is presented in Section 2, followed by the introduction of the tactile signal processing methodology based on SR in Section 3. Detailed experiments and experimental results are presented in Section 4. Subsequently, the results are commented on in Section 5. Finally, the conclusion and prospect are discussed in Section 6.

2. Tactile Senor Device

In this article, we propose a 2 × 2 piezoresistive solid–liquid composite flexible sensor array to detect fine texture based on previous research in the laboratory [30]. Piezoresistive sensors are small in size, have a good frequency response, and are especially sensitive to small pressure differences, which are easier to meet our requirements for tactile sensor arrays. The structure of the sensor is a thin flexible layer encapsulating the fluid and the silicon-sensing elements inside. We replaced some parts of the traditional single flexible layer with incompressible liquids to utilize the characteristics of high hydraulic transmission efficiency to reduce the attenuation of the contact force. Different from traditional hydraulic devices, the fluid chamber of this sensor cell is made of soft material, and there is a coupling effect between its deformation and the encapsulated liquid compression. Therefore, when the flexible layer is deformed by external pressure and compresses the liquid inside, the encapsulated liquid will generate pressure to act on the sensing elements, causing it to produce a corresponding output. After the output signal is conditioned by the NSA2860 chip, the encapsulated sensing cell has good sensing performances, with a sensitivity of 3.46 mV/mN, linearity of 0.996, repeatability error of 1.2%, and hysteresis error of 1.5%. The force sensing range is from 1 mN to 1.5 N.
The structure of the sensing cell is shown in Figure 1a. The sensor array mainly consists of four parts: flexible printed circuit board (FPCB, hereafter) base, silicon pressure sensing die, silicone oil liquid layer, and polydimethylsiloxane (PDMS, hereafter) layer. The overall size is 12 mm × 12 mm × 2.5 mm, including four sensor cells in a 2 × 2 layout, with the spacing of sensor cells of 5.6 mm. The thickness of the PDMS flexible layer is 0.6 mm. The selected piezoresistive sensor element was a cubic silicon pressure sensor die (Silicon Microstructures, Inc., SM5108C-060, Milpitas, CA, USA). The silicone oil liquid layer was filled with 50cSt silicone oil (Dow Corning Inc. pmx-200, Midland, MI, USA). The silicone oil liquid not only acts as a transferring medium of pressure conduction but also effectively protects the silicon-based sensing element. The schematic diagram of the sensor array is shown in Figure 1b. To sum up, the whole sensor has a size similar to a human fingertip and is made of flexible material, which is easy to integrate on the prosthetic fingertip with various curves on its surface.
The sensor fabrication process is shown in Figure 1c. Firstly, paste the sensing element on the FPCB base and connect the four pads on the sensing element and the corresponding pads on the FPCB base with gold wires, respectively; secondly, design the mold and obtain the shaped PDMS layer through casting and curing, then paste it on the FPCB base to form the liquid cavity; thirdly, evacuate the air in the liquid cavity and fill it with silicone oil in the vacuum box; fourthly, take the sensor out and seal the structure with sealant; finally, integrate the prepared sensor array on the fingertip of the prosthesis.

3. Methodology

3.1. Texture Detection

The following is the sensing method for texture detection based on the designed tactile sensor. As shown in Figure 2, the feature information required to describe the ridge texture of a sample includes the spatial period sp, the ridge height rh, and the ridge width rw. The tactile sensor array with sensing cell spaced d is integrated on the prosthetic fingertip and slides horizontally across the surface of the texture sample at a certain speed v from left to right. The two adjacent sensing cells successively contact the ridge of the sample and are both affected by normal force F so that the sensing element inside them generate corresponding voltage signals. Since the ridges are uniformly distributed on the sample surface, these signals have a period of T; in other words, they have a principal frequency of fprin. Moreover, the two adjacent sensing cells will successively generate the same signal for the same ridge. The time interval between the two signals is ∆t. It can be easily figured out that the spatial period sp and the ridge width rw are related to the characteristic parameter fprin × ∆t, which is
sp = d f prin   ×   t ,   rw = n   ×   sp
where n is the ratio of the ridge width to the spatial period in the ridge texture, which can be obtained from the time domain information of the signal. The ridge height rh is related to the amplitude information A of the principal frequency of the signal [30].
This article focuses on the detection capability of the tactile sensor array for fine ridge textures whose ridge height rh less than 10 μm (this height is close to the detection limit of a human finger). The signal generated when the tactile sensor array slides over the ridge texture surface is mainly composed of two-state voltage signals, which correspond to the positions of the ridges and grooves, respectively. However, because the height difference between ridges and grooves is small and the detection capability of the tactile sensor array is limited by its sensitivity, the difference between the two signal states is not obvious, and the signals may even be submerged by system noise. Therefore, this article mainly discussed a method to enhance signal characteristics of weak bistable signals to improve the detection capability of the tactile sensor array.

3.2. Stochastic Resonance Method

The bistable system stochastic resonance method is chosen to enhance the signal characteristic of the tactile signals. When the tactile sensor array slides over the surface of the object, it will sense the surface texture information of the object and transmit signals in time through a limited number of sensing cells. Especially in the process of fine texture detection, the generated tactile signals have two states, and its characteristic is weak. The bistable system stochastic resonance method can effectively enhance some deterministic characteristics of weak tactile signals, which is suitable for the investigation of fine texture information detection.
As mentioned in Section 3.1, the experimental samples in this article are fine textures with ridge heights less than 10 μm, which makes the signal characteristic of the two-state signals generated by the tactile sensor weak. When the prepared tactile sensor slides across the ridge texture with a right height rh of 0.9 μm at a certain speed v, the time-domain signal generated has a weak periodicity, as shown in Figure 3a. After FFT processing, its frequency-domain signal has a prominent amplitude at its principal frequency, as shown in Figure 3b. However, it is difficult to obtain detailed texture information such as ridge width due to the excessive system noise mixed in the time-domain signal. Therefore, we first established a suitable bistable system stochastic resonance model to enhance the signal characteristic of weak tactile signals. Then, the output signal is processed by FFT to obtain relevant information, such as the principal frequency and the amplitude of the principal frequency, so as to obtain more feature information of the fine ridge texture.
In this article, a bistable system stochastic resonance model based on the Langevin equation is established, which is
{ x   ˙ = V ( x )   +   K ( s ( t )   +   Γ ( t ) ) < Γ ( t ) > = 0 ,   < Γ ( t ) , Γ ( 0 )   >   = 2 D δ ( t )
where V(x) is the nonlinear bistable potential function, and
V   ( x ) = a 2 x 2 + b 4 x 4     a   >   0 ,   b   >   0
s(t) is the periodic tactile signal; Γ(t) is the input Gaussian white noise with intensity D and 0 mean value. K is the normalized transformation factor of the input mixed signal. By comparing the frequency range of the generated tactile signal and the intensity ( D = 0.3 mV) of input Gaussian white noise with standard system parameters, we determine the system parameter (a = b = 16, K = 130,000). The determined bistable system is shown in Figure 4. The system will appear stochastic resonance effect under the common drive of the input weak periodic tactile signal and Gaussian white noise so that the system state jumps between the two steady states. The output is a bistable signal with characteristic information of the original signal.

4. Experiment

4.1. Experiment Platform

The experimental loading platform for the object surface texture detection experiment is shown in Figure 5. The prosthetic fingertip integrated with the tactile sensor array was mounted on a motion platform under position/velocity control. The motion platform is composed of a three-axis precision linear platform (M-VP-25XL-XYZ, Newport Corporation, Irvine, CA, USA) having travel of 25 mm along each axis and a long-travel linear motor stage (M-IMS600LM, Newport Corporation, Irvine, CA, USA) having a maximum speed of 500 mm/s with a minimum incremental motion of 20 nm. Thus, the prosthetic fingertips on the motion platform can touch the texture samples with different forces and scan across the surface texture sample with various velocities. The ridge texture sample was mounted on a fixed stage by a designed clamp. The output voltage generated by the piezoresistive die in the tactile sensor array is conditioned by the NSA2860 chip and then are collected by a NI-DAQ device (USB-6212, National Instruments Corporation, Austen, TX, USA). The ridge texture samples are a series of silicon wafers with different ridge heights and ridge widths, which are produced by exposure, development, and etching using a photolithography method, as shown in Figure 5b,c. A total of 12 texture samples are presented, and detailed parameters of them are shown in Table 1.

4.2. Experiment Detail

The main experimental process is as follows. As shown in Figure 6, the sensing cells are distributed on the surface of the tactile sensor in a 2 × 2 array, numbered 1#, 2#, 3#, 4#, respectively, and the distance of two adjacent sensing cells along the x-axis and y-axis are equal. When the tactile sensor starts from the initial position and slides across the sample surface along the x-axis direction that is perpendicular to the ridge texture at a certain speed, we can obtain the time interval ∆t of the signals generated by adjacent sensing cells for the same ridge. The positive x-axis is selected previously as the sliding direction of the tactile sensor; thus, the signals generated by the sensing cells 1#, 3# and 2#, 4# form a signal group with time-domain correlation, respectively and the two signal groups are in a control relationship with each other. Selected the signal group (1#, 3#) as the experimental result to validate the method proposed in this article.
The processing flow of the raw output signal of sensing cell 3# is shown in Figure 7. The sample used is the S31 sample with a ridge height of 0.9 μm, a ridge width of 300 μm, and a spatial period of 2000 μm. Due to the inevitable irregular jitter of the linear stage during the sliding experiment, the signal exhibited a baseline drift phenomenon, as shown in Figure 7a. The signal passed through a high-pass filter with a cut-off frequency of 1 Hz to remove low-frequency interference, and we obtained the original signal with a baseline at 0, as shown in Figure 7b. After inputting the original signal and the Gaussian white noise with a certain noise intensity into the bistable system stochastic resonance model based on the Langevin equation, the first-order ordinary differential Equations (2) and (3) are solved by the fourth-order Runge–Kutta algorithm. The proper noise intensity of Gaussian white noise can make the output signals have a larger signal-to-noise ratio (SNR, hereafter), but because the amplitude difference of the input signals is small and the optimal SNR of output is not the goal, we selected the same noise intensity through prior experiments and generated the noise signal with the Matlab function. The signal processed by SR is shown in Figure 7c, and its signal characteristic has been significantly enhanced. Since the signals have obvious characteristics, the time interval Δt can be easily obtained through correlation analysis with the processing result of the signal generated by sensing cell 1#. The frequency-domain signal obtained by FFT processing contains the principal frequency information fprin and its amplitude information A. The difference between the two states of the time-domain signal is obvious, but there is still a certain amount of noise that interferes with the acquisition of texture information. Passed the randomly intercepted signal segment through a software-designed threshold comparator with a threshold of 1 V to obtain a state-unified signal, as shown in Figure 7d. The ratio of the high-level state of the signal segment to the level period is calculated and mapped to the ratio n of the ridge width to the spatial period in the ridge texture. The texture feature information of the corresponding sample can be figured out by combining the parameter results obtained above.

4.3. Experiment Result

Signals processed by SR exhibit a stronger signal characteristic in both time and frequency domains. Figure 8 shows the output voltages (i.e., 1# and 3#) of two piezoresistive die located at two adjacent tactile sensing cells. These signals have been previously processed in advance with a high-pass filter to remove low-frequency interference. As shown in Figure 8a, it is observed that the output original signal has strong random noise, especially, there is only slight periodic vibration when the tactile fingertip slides over the fine texture sample. Meanwhile, the time interval, as described in Section 3.1, is difficult to be measured from the two original outputs. By comparing Figure 8a,b, we can find that after the original signal is processed by the bistable system stochastic resonance model, the signal characteristic of the signal is significantly enhanced. The two states of the SR-processed signal have an obvious difference and have a large noise tolerance. Moreover, the dynamic part is mainly composed of periodic signals, which correspond to the stage of the sensor sliding over the surface ridge texture. Others parts are the static parts that are caused by the bistable system stochastic resonance model driven by random noise. The signal state carried out transition switching according to the Kramers transition rate rk, which depends on the noise distribution and intensity. Therefore, we can easily obtain the time interval through correlation analysis. Comparing Figure 8c,d, it can be found that the stochastic resonance method does not affect the principal frequency of the original periodic signal and makes its amplitude more prominent than other frequencies, which is recognized as noise. The difference between the amplitude of the principal frequency corresponding to the two sensing cells is caused by the difference in the structure during manufacturing.
Combining the information obtained above, we can figure out the spatial period and ridge height information of the texture according to the method proposed in Section 3.1. The calculation result of the space period of each sample is shown in Figure 9a. The average estimation error of the space period is 0.0217 mm, the average relative estimation error is 1.085%, and the maximum estimation error is 0.0465 mm. The largest estimation error occurs in the experiment of the texture sample with the smallest ridge height. The finer the texture, the more seriously the signal generated by the tactile sensor is affected by noise. The SR method plays an auxiliary role in noise reduction. Figure 9b shows the relationship between the principal frequency amplitude of the signal output by sensing cell 3# for each sample and the corresponding ridge height. It is observed that the principal frequency amplitude is positively correlated with the ridge height. The output signal amplitude of the same ridge height experiment fluctuates to a certain extent because there are manufacturing height errors in the silicon wafer sample, and the fluctuation of the static part also affects the result. However, their influence will decrease with the increase in the data volume of the dynamic part. At this end, we can establish the mapping relationship between the ridge height and amplitude to detect the ridge height of the texture.
The ridge height detection experiment of the texture samples is as follows. From the SR-processed signal output by tactile cell 3#, as shown in Figure 8b, five cycles of signals are arbitrarily intercepted and processed by a threshold comparator. The output result is shown in Figure 10a. This result removes the unstable part of the SR-processed signal and preserves the high-level part, which corresponds to the ridge in the texture sample to the greatest extent. The ratio of the high level to the total signal length in the processing result of the output signal for each sample generated by sensing cell 3# is calculated, and the relationship between the result and n is shown in Figure 10b. Theoretically, the calculated ratio should be equal to n. However, because the SR method has certain randomness, the high-level part of the signal cannot accurately represent the ridge width, and the errors of the calculated ratio are large. However, it can be seen from Figure 10b that when the intervals between the ridge widths are large, there is an obvious mapping relationship between the average ratio and n. Thus, the ridge width of the ridge texture sample can be obtained from the output signal.

5. Discussion

In the existing research on fine texture detection using tactile technology, HB Muhammad et al. [12] successfully distinguished ridge texture samples with a ridge height of 200 μm and a spatial period as low as 200 μm. Yasutoshi Takekawa et al. [17] succeeded in obtaining the spatial period and ridge height information of ridge texture samples with ridge heights as low as 25 μm. In this article, we tested fine ridge texture samples with different ridge heights (0.9, 4, 10 μm) and different ridge widths (0.3, 0.5, 0.7, 1 mm) but with the same spatial period (2 mm). The mean relative error of the estimation of the space period was 1.085%. The ridge width and ridge height had a mapping relationship with their corresponding parameters, respectively, and the error tolerances are acceptable. Under more systematic experiments, the feature information of the fine texture with a ridge height as low as 0.9 μm can be detected, which indicated that our tactile sensor coupled with the SR method has the potential to achieve the detection of texture with a sub-micron or lower ridge height.
More strikingly, we have completed the detection task of fine textures with fewer data sets based on a sensor array with a simple structure and a simple method. In 2012, Jeremy A. Fishel et al. [19] achieved the classification of 16 natural textures through simple tactile fingers supplemented by Bayesian exploration methods, with an accuracy of 99.6%. In 2017, Udaya B. Rongala et al. [21] used neural network methods to identify 10 natural textures, including glass materials with a grain size of less than 90 nm. The aforementioned methods all require a large number of data sets and a complex learning and training process and neglect the detailed information of the texture, but just judge the texture category of a given sample. The SR method we chose can detect weak periodic signals under the condition of a shorter data set, and the output results have obvious signal characteristics for subsequent calculations. This method generally has an effect on low-frequency signals, but the frequency of periodic signals for texture detection may be as high as 300 Hz. Thus, when the frequency of the periodic signal to be detected is high, the frequency detection range can be increased by performing a normalized scale transformation on the bistable system.
In more detail, the noticeable difference in mind caused by external stimulus difference in human finger touches can be used to evaluate the fine texture detection capability of the sensor. In 2012, Kadir Beceren et al. [25] validated the enhancement effect of SR on human dynamic tactile through a series of psychophysical experiments. The smallest noticeable difference is 1.6 μm under the condition of no noise input but reached 0.93 μm after adding the appropriate noise, which is similar to the detection capability of our tactile sensor after SR enhancement.

6. Conclusions and Outlook

In this article, a flexible solid–liquid composite tactile sensor array developed by our laboratory was used to systematically investigate the performance of tactile sensors in fine ridge texture detection through a bistable system stochastic resonance model, including estimation of the spatial period and recognition of ridge height and ridge width. Our experiment used several fine ridge texture samples to provide a weak periodic stimulus to validate the detection capability of the tactile sensor array. The results show that this method can significantly improve the signal characteristic of the output signal. Regarding the detection of texture information, the results show that the mean relative error of the estimation for the spatial period is 1.085%, and the ridge width and ridge height, respectively, have a monotonic mapping relationship with the corresponding model output parameters. Compared with the human finger experiment, the tactile sensor has a similar capability to sensing fine textures, which shows that the sensor designed in the laboratory has a very promising application prospect.
In future work, the following aspect can be improved and expanded on the work of this article: explore the accurate estimation method of ridge width and ridge height, consider the self-adaptability of the model parameters of the stochastic resonance bistable system, and extend the fine texture detection method to non-periodic ridge texture.

Author Contributions

Conceptualization, W.L.; data curation, G.Z. and B.Z.; formal analysis, G.Z.; funding acquisition, W.L., T.L. and L.H.; methodology, B.Z.; supervision, T.L.; validation, B.Z.; writing—original draft, G.Z.; writing—review and editing, W.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partly supported by the National Natural Science Foundation of China (grant number 51875506) and the Science Fund for Creative Research Groups of the National Natural Science Foundation of China (Grant No. 51821093).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Truby, R.L.; Wehner, M.; Grosskopf, A.K. Soft Somatosensitive Actuators via Embedded 3D Printing. Adv. Mater. 2018, 30, 1706383. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Vogt, D.; Park, Y.-L.; Wood, R.J. A soft multi-axis force sensor. In Proceedings of the 2012 IEEE Sensors, Taipei, Taiwan, 28–31 October 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 1–4. [Google Scholar]
  3. Low, J.H.; Lee, W.W.; Khin, P.M.; Thakor, N.V.; Kukreja, S.L.; Ren, H.L.; Yeow, C.H. Hybrid Tele-Manipulation System Using a Sensorized 3-D-Printed Soft Robotic Gripper and a Soft Fabric-Based Haptic Glove. IEEE Robot. Autom. Lett. 2017, 2, 880–887. [Google Scholar] [CrossRef]
  4. Balamurugan, D.; Nakagawa-Silva, A.; Nguyen, H. Texture Discrimination using a Soft Biomimetic Finger for Prosthetic Ap-plications. In Proceedings of the 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, ON, Canada, 24–28 June 2019; pp. 380–385. [Google Scholar]
  5. Sankar, S.; Brown, A.; Balamurugan, D. Texture discrimination using a flexible tactile sensor array on a soft biomimetic finger. In Proceedings of the 2019 IEEE SENSORS, Montreal, QC, Canada, 27–30 October 2019; pp. 1–4. [Google Scholar]
  6. Bholat, O.S.; Haluck, R.S.; Kutz, R.H.; Gorman, P.J.; Krummel, T.M. Defining the Role of Haptic Feedback in Minimally Invasive Surgery. Stud. Health Technol. Inform. 1999, 62, 62–66. [Google Scholar] [PubMed]
  7. Ong, R.; Glisson, C.L.; Burgner-Kahrs, J.; Simpson, A.L.; Danilchenko, A.; Lathrop, R.A.; Herrell, S.D.; Webster, R.J.; Miga, M.I.; Galloway, R.L. A novel method for texture-mapping conoscopic surfaces for minimally invasive image-guided kidney surgery. Int. J. Comput. Assist. Radiol. Surg. 2016, 11, 1515–1526. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Abdulhafez, A.; Chari, V. Reliable 2D Tracking using good texture and edge features for Robotic Vision. Control Eng. Appl. Inform. 2018, 20, 15–24. [Google Scholar]
  9. Asano, S.; Okamoto, S.; Matsuura, Y. Toward quality texture display: Vibrotactile stimuli to modify material roughness sensa-tions. Adv. Robot. 2014, 28, 1079–1089. [Google Scholar] [CrossRef]
  10. Oddo, C.M.; Beccai, L.; Felder, M.; Giovacchini, F.; Carrozza, M.C. Artificial Roughness Encoding with a Bio-inspired MEMS-based Tactile Sensor Array. Sensors 2009, 9, 3161–3183. [Google Scholar] [CrossRef] [Green Version]
  11. Oddo, C.M.; Controzzi, M.; Beccai, L.; Cipriani, C.; Carrozza, M.C. Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch. IEEE Trans. Robot. 2011, 27, 522–533. [Google Scholar] [CrossRef]
  12. Muhammad, H.; Recchiuto, C.; Oddo, C.; Beccai, L.; Anthony, C.; Adams, M.; Carrozza, M.; Ward, M. A capacitive tactile sensor array for surface texture discrimination. Microelectron. Eng. 2011, 88, 1811–1813. [Google Scholar] [CrossRef]
  13. Miyaoka, T. Tactile Information Processing Mechanisms of Fine Surface Texture Discrimination in Humans: A Study with Ridge Height Discrimination Tasks. In Proceedings of the International Ergonomics Association Triennial Congress of the IEA, Tampere, Finland, 29 June–4 July 1997. [Google Scholar]
  14. Miyaoka, T.; Mano, T.; Ohka, M. Mechanisms of fine-surface-texture discrimination in human tactile sensation. J. Acoust. Soc. Am. 1999, 105, 2485–2492. [Google Scholar] [CrossRef]
  15. Natsume, M.; Tanaka, Y.; Sano, A. Skin-Propagated Vibration for Roughness and Textures; IEEE: Piscataway, NJ, USA, 2016; pp. 1–6. [Google Scholar]
  16. Takekawa, Y.; Hasegawa, T.; Tanaka, Y.; Minamizawa, K.; Sano, A. Tactile Display Based on Skin-Propagated Vibration. In Lecture Notes in Electrical Engineering; Springer Science and Business Media LLC.: Berlin/Heidelberg, Germany, 2017; Volume 432, pp. 121–123. [Google Scholar]
  17. Tanaka, Y.; Hasegawa, T.; Hashimoto, M.; Igarashi, T. Artificial Fingers Wearing Skin Vibration Sensor for Evaluating Tactile Sensations. In Proceedings of the 2019 IEEE World Haptics Conference (WHC), Tokyo, Japan, 9–12 July 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 377–382. [Google Scholar]
  18. Fishel, J.A.; Loeb, G.E. Sensing tactile microvibrations with the BioTac Comparison with human sensitivity. In Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy, 24–27 June 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 1122–1127. [Google Scholar]
  19. Fishel, J.A.; Loeb, G.E. Bayesian Exploration for Intelligent Identification of Textures. Front. Neurorobotics 2012, 6, 4. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Rongala, U.B.; Mazzoni, A.; Oddo, C.M. Neuromorphic Artificial Touch for Categorization of Naturalistic Textures. IEEE Trans. Neural Netw. Learn. Syst. 2015, 28, 819–829. [Google Scholar] [CrossRef] [PubMed]
  21. Rongala, U.B.; Mazzoni, A.; Spanne, A.; Jörntell, H.; Oddo, C.M. Cuneate spiking neural network learning to classify naturalistic texture stimuli under varying sensing conditions. Neural Netw. 2019, 123, 273–287. [Google Scholar] [CrossRef] [PubMed]
  22. Sankar, S.; Balamurugan, D.; Brown, A. Texture Discrimination with a Soft Biomimetic Finger Using a Flexible Neuromor-phic Tactile Sensor Array That Provides Sensory Feedback. Soft Robot. 2021, 8, 577–587. [Google Scholar] [CrossRef] [PubMed]
  23. Gescheider, G.A. Psychophysics: The Fundamentals; Psychology Press: Hove, East Sussex, UK, 1997. [Google Scholar]
  24. Luca, G.; Peter, H.; Peter, J. Stochastic Resonance. Rev. Mod. Phys. Am. 1998, 70, 223. [Google Scholar]
  25. Beceren, K.; Ohka, M.; Jin, T.; Miyaoka, T.; Yussof, H. Optimization of Human Tactile Sensation Using Stochastic Resonance. Procedia Eng. 2012, 41, 792–797. [Google Scholar] [CrossRef] [Green Version]
  26. Beceren, K.; Ohka, M.; Jin, T.; Miyaoka, T.; Yussof, H. Human Tactile Stochastic Resonance Affected by Stimulus Direction. Int. J. Adv. Robot. Syst. 2013, 10, 178. [Google Scholar] [CrossRef]
  27. Kurita, Y.; Sueda, Y.; Ishikawa, T. Surgical Grasping Forceps with Enhanced Sensorimotor Capability via the Stochastic Res-onance Effect. IEEE/ASME Tran. Mechatron. 2016, 21, 2624–2634. [Google Scholar] [CrossRef]
  28. Vásárhelyi, G.; Ádám, M.; Vázsonyi, É.; Bársony, I.; Dücső, C. Effects of the elastic cover on tactile sensor arrays. Sens. Actuators A Phys. 2006, 132, 245–251. [Google Scholar] [CrossRef]
  29. Liu, W.; Gu, C.; Zeng, R.; Yu, P.; Fu, X. A Novel Inverse Solution of Contact Force Based on a Sparse Tactile Sensor Array. Sensors 2018, 18, 351. [Google Scholar] [CrossRef] [Green Version]
  30. Liu, W.; Ping, Y.; Gu, C. Fingertip Piezoelectric Tactile Sensor Array for Roughness Encoding under Varying Scanning Velocity. IEEE Sens. J. 2017, 21, 6867–6879. [Google Scholar] [CrossRef]
Figure 1. Schematic diagram of sloid–liquid composite tactile sensor array structure: (a) cross-section diagram of the sensing cell structure; (b) diagram of the whole tactile sensor array; (c) flow diagram of sensor fabrication process.
Figure 1. Schematic diagram of sloid–liquid composite tactile sensor array structure: (a) cross-section diagram of the sensing cell structure; (b) diagram of the whole tactile sensor array; (c) flow diagram of sensor fabrication process.
Micromachines 13 00440 g001
Figure 2. Schematic diagram of texture detection of tactile sensor array: (a) cross-section diagram of the ridge texture sample; (b) fingertip integrated with tactile sensor array starting to slide; (c) ridge of texture compressing the sensing cell.
Figure 2. Schematic diagram of texture detection of tactile sensor array: (a) cross-section diagram of the ridge texture sample; (b) fingertip integrated with tactile sensor array starting to slide; (c) ridge of texture compressing the sensing cell.
Micromachines 13 00440 g002
Figure 3. Diagram of tactile signal containing texture information: (a) time-domain signal of scanning result; (b) frequency-domain signal of scanning result.
Figure 3. Diagram of tactile signal containing texture information: (a) time-domain signal of scanning result; (b) frequency-domain signal of scanning result.
Micromachines 13 00440 g003
Figure 4. Diagram of stochastic resonance effect of bistable system.
Figure 4. Diagram of stochastic resonance effect of bistable system.
Micromachines 13 00440 g004
Figure 5. Experimental loading platform for texture detection: (a) ① prosthetic fingertip integrated with tactile sensor array, ② conditioning circuit, ③ NI-DAQ device, ④ texture sample, ⑤ fixed stage, ⑥ three-axis precision linear stage, ⑦ long-travel linear motor stage, ⑧ clamp; (b) silicon wafer with ridge texture; (c) SEM image of the micro-structure of the silicon wafer.
Figure 5. Experimental loading platform for texture detection: (a) ① prosthetic fingertip integrated with tactile sensor array, ② conditioning circuit, ③ NI-DAQ device, ④ texture sample, ⑤ fixed stage, ⑥ three-axis precision linear stage, ⑦ long-travel linear motor stage, ⑧ clamp; (b) silicon wafer with ridge texture; (c) SEM image of the micro-structure of the silicon wafer.
Micromachines 13 00440 g005
Figure 6. Tactile sensor sliding across the ridge texture sample.
Figure 6. Tactile sensor sliding across the ridge texture sample.
Micromachines 13 00440 g006
Figure 7. Diagram of tactile signal processing flow: (a) diagram of row output signal; (b) original signal processed by de-baseline method; (c) signal processed by SR model; (d) signal segment passed through software-designed threshold comparator.
Figure 7. Diagram of tactile signal processing flow: (a) diagram of row output signal; (b) original signal processed by de-baseline method; (c) signal processed by SR model; (d) signal segment passed through software-designed threshold comparator.
Micromachines 13 00440 g007
Figure 8. Diagram of output signal for sample S31 (v = 2 mm/s): (a) original signal processed by de-baseline method; (b) signal processed by SR model; (c) original frequency-domain signal; (d) SR-processed frequency-domain signal.
Figure 8. Diagram of output signal for sample S31 (v = 2 mm/s): (a) original signal processed by de-baseline method; (b) signal processed by SR model; (c) original frequency-domain signal; (d) SR-processed frequency-domain signal.
Micromachines 13 00440 g008aMicromachines 13 00440 g008b
Figure 9. Experimental result of texture detection: (a) the result of spatial period estimation; (b) the result of ridge height recognition.
Figure 9. Experimental result of texture detection: (a) the result of spatial period estimation; (b) the result of ridge height recognition.
Micromachines 13 00440 g009aMicromachines 13 00440 g009b
Figure 10. Experimental result of texture sample ridge width detection: (a) signal segment passed through threshold comparator; (b) result of ridge width recognition.
Figure 10. Experimental result of texture sample ridge width detection: (a) signal segment passed through threshold comparator; (b) result of ridge width recognition.
Micromachines 13 00440 g010
Table 1. Parameters of ridge texture sample.
Table 1. Parameters of ridge texture sample.
NUMBERRIDGE HEIGHT
RH (μM)
RIDGE WIDTH
RW (μM)
SPATIAL PERIOD
SP (μM)
S11103002000
S12500
S13700
S141000
S214300
S22500
S23700
S241000
S310.9300
S32500
S33700
S341000
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, W.; Zhang, G.; Zhan, B.; Hu, L.; Liu, T. Fine Texture Detection Based on a Solid–Liquid Composite Flexible Tactile Sensor Array. Micromachines 2022, 13, 440. https://doi.org/10.3390/mi13030440

AMA Style

Liu W, Zhang G, Zhan B, Hu L, Liu T. Fine Texture Detection Based on a Solid–Liquid Composite Flexible Tactile Sensor Array. Micromachines. 2022; 13(3):440. https://doi.org/10.3390/mi13030440

Chicago/Turabian Style

Liu, Weiting, Guoshi Zhang, Binpeng Zhan, Liang Hu, and Tao Liu. 2022. "Fine Texture Detection Based on a Solid–Liquid Composite Flexible Tactile Sensor Array" Micromachines 13, no. 3: 440. https://doi.org/10.3390/mi13030440

APA Style

Liu, W., Zhang, G., Zhan, B., Hu, L., & Liu, T. (2022). Fine Texture Detection Based on a Solid–Liquid Composite Flexible Tactile Sensor Array. Micromachines, 13(3), 440. https://doi.org/10.3390/mi13030440

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop