Next Article in Journal
Enhanced Data-Processing Algorithms for Dispersive Interferometry Using a Femtosecond Laser
Previous Article in Journal
Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions
Previous Article in Special Issue
Terahertz Attenuated Total Reflection Spectral Response and Signal Enhancement via Plasmonic Enhanced Sensor for Eye Drop Detection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Data-Driven Contact-Based Thermosensation for Enhanced Tactile Recognition

Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(2), 369; https://doi.org/10.3390/s24020369
Submission received: 14 December 2023 / Revised: 2 January 2024 / Accepted: 5 January 2024 / Published: 8 January 2024
(This article belongs to the Special Issue The Advanced Flexible Electronic Devices)

Abstract

:
Thermal feedback plays an important role in tactile perception, greatly influencing fields such as autonomous robot systems and virtual reality. The further development of intelligent systems demands enhanced thermosensation, such as the measurement of thermal properties of objects to aid in more accurate system perception. However, this continues to present certain challenges in contact-based scenarios. For this reason, this study innovates by using the concept of semi-infinite equivalence to design a thermosensation system. A discrete transient heat transfer model was established. Subsequently, a data-driven method was introduced, integrating the developed model with a back propagation (BP) neural network containing dual hidden layers, to facilitate accurate calculation for contact materials. The network was trained using the thermophysical data of 67 types of materials generated by the heat transfer model. An experimental setup, employing flexible thin-film devices, was constructed to measure three solid materials under various heating conditions. Results indicated that measurement errors stayed within 10% for thermal conductivity and 20% for thermal diffusion. This approach not only enables quick, quantitative calculation and identification of contact materials but also simplifies the measurement process by eliminating the need for initial temperature adjustments, and minimizing errors due to model complexity.

1. Introduction

High-precision tactile sensing is key for robotic systems to perform complex operations. Tactile signals comprise various signals, including force perception [1], sliding detection [2], thermosensation [3,4], comfort evaluation [5], and humidity detection [6]. Among these, thermal feedback is a crucial component and plays a significant role in autonomous control systems [7], virtual reality [8], and other fields [9].
Thermal conductivity and diffusivity coefficients are key parameters in thermal sensation. Various methods for measuring the thermal properties of solid and thin film materials have been developed and widely applied [10]. For solid materials, common techniques include the absolute method [11], comparative method [12], and parallel heat conduction method [13]. These steady-state methods accurately calculate thermal properties by precisely measuring the heat flux applied to the sample and the corresponding temperature difference. Compared to steady-state methods, transient methods can obtain thermal properties more quickly, typically relying on real-time temperature data and heat transfer models, such as the hot-wire method [14], laser flash method [15], and transient plane source method [16]. These methods offer high precision and stability but are often limited by the measurement mode, and have specific requirements for instruments and samples, rendering them unsuitable for real-time contact measurement applications in robotic systems.
In robotics and control systems, thermosensation increasingly focuses on miniaturization and flexibility. Traditional MEMS temperature sensors are known for precise design and packaging, effective in accurate temperature sensing; for example, the integrated temperature and pressure silicon chips for invasive endoscopic surgeries [17], the Schottky diode chip for temperature compensation [18], and thermistor chips in cyber-physical systems [19]. However, these silicon-based chips are typically unsuitable for irregular or dynamic surfaces and lack the conformability necessary for in-situ, human-like tactile sensing. Conversely, flexible devices can be attached to surfaces for in-situ thermosensation and researchers have extensively explored this area. For example, Zhao et al. [20] developed an intelligent finger integrated with a thermal sensor capable of measuring the thermal conductivity of objects upon contact, accurately distinguishing materials within 0.3 s. Li et al. [21] introduced a tactile sensor with a multi-layer structure; combined with machine learning algorithms, a robotic hand with ten sensors achieved a 94% recognition rate in waste sorting tasks. Yang et al. [22] proposed multi-layer tactile sensors integrated on a soft robotic hand, utilizing artificial neural networks to accurately identify 13 different materials under high contact pressures of 1.3–1.9 kPa. Lee et al. [23] developed an intelligent thermo-calorimeter (TCM) as a thermal sensing unit, successfully distinguishing various materials, especially metals, with high precision. Wu et al. [24] established a theoretical model based on the heat absorption process, allowing each material to be identified by a unique characteristic value.
The above methods achieve recognition through the extraction of temperature characteristics. Another approach involves using heat transfer models, and intelligent algorithms to directly calculate thermal properties. For example, Zhang et al. [25] employed an artificial neural network (ANN) to establish a correlation between thermal conductivity and its influencing factors, which is used to calculate the thermal conductivity of unsaturated soil. Fidan et al. [26] utilized neural networks with different neurons and activation functions to establish the relationship between the mechanical properties of concrete and its thermal properties. A coefficient of determination of 0.983 of thermal conductivity was achieved. Pan et al. [27] designed a thermosensation sensor and developed a heat transfer model for a robotic finger. Operating at room temperature (20 °C~32 °C), the system used an 8 mA current to generate Joule heat, accurately calculating the material’s thermal properties with a relative error within 10%. However, the heat transfer model is quite complex, and there is currently limited research on its quantitative thermosensation.
In this work, a novel contact-based thermosensation measurement method using different flexible thin-film thermal devices was designed to measure material’s heat flux and temperature. A data-driven algorithm, incorporating a discrete transient heat transfer model and a BP neural network, is proposed for processing measured signals and calculating thermal properties. The method’s accuracy and efficiency were experimentally validated, and it showed potential in material quantitative thermosensation and intelligent robot haptics.

2. Contact-Based Thermosensation Design

2.1. Design of the Measurement System Structure

Figure 1 presents a schematic diagram of the measurement system, which consisted of the test object, a sensing layer, a heating layer, and a substrate. The heater was designed to generate heat through Joule heating from an electrical current. A heat flux sensor, located in the center of the sensing layer and closely attached to the material’s surface, measured the heat flow across the material’s boundary. The sensor’s area was significantly smaller than the heating zone, and based on the semi-infinite assumption, it was considered that the heat would be transferred perpendicular to the object’s surface within a short time of the heater being activated. Temperature sensors were placed near the heat flux sensor to directly measure the surface temperature of the object.
The temperature of the tested material was influenced by both internal and external factors. Internal factors included the material’s thermal properties, while external factors mainly involved heat exchange between the system and the material. Consequently, modeling the sensing system was essential to establish how the temperature changes in different materials related to the heating power and the boundary heat flux.

2.2. Discrete Transient Heat Transfer Model

The heat flux signal, influenced by the heat source, cannot be expressed by a function, because the function fitting approach presents two significant challenges: first, the heat flux exhibits significant nonlinearity due to external excitation control, posing challenges to function fitting. Second, minor inaccuracies in the flux tend to accumulate progressively, resulting in cumulative errors over time.
Therefore, this study utilized a discrete approach to model heat transfer, aiming to minimize errors. The system was established to treat the object as semi-infinite, focusing on heat transfer perpendicular to the object’s surface and the transient process. Consequently, the model incorporated a non-stationary term and discretized both time and space simultaneously. In addition, this study explored the relationship between temperature, heat flux, source power, and thermal properties, simplifying the substrate to insulation boundary. For the heating layer’s upper boundary discretization unit, the discretization equation was as follows:
[ k h T 1 ( i ) T 2 ( i ) Δ x ] Δ τ + q v Δ x 2 Δ τ = ρ h c h Δ x 2 [ T 1 ( i + 1 ) T 1 ( i ) ]
where T n i denotes the temperature of the n-th discrete unit at time I; Δx denotes the length of the discrete unit; Δτ denotes the discrete time interval; kh is the thermal conductivity of the heater; qv is the power density of the heating unit; and ρh and ch are the density and heat capacity of the heater, respectively.
The initial state of the system was steady state with temperature T0, denoted as follows:
T n ( 1 ) = T 0 n = 1 , 2 , , N .
Here, N denotes the total number of discrete units. Similarly, the sensing layer’s discrete control equation was formulated as follows:
k s T n + 1 ( i ) T n ( i ) Δ x + k s T n 1 ( i ) T n ( i ) Δ x = c s ρ s Δ x T n ( i + 1 ) T n ( i ) Δ τ n = 2 , 3 , , N 1
where ks, ρs and cs represent the thermal conductivity, density, and heat capacity of the sensing layer, respectively. N1 indicates the number of discrete units at the boundary beneath the sensing layer. For the boundary unit between the measured material and the sensing layer, the discrete equation was formulated as follows:
[ k s T ( n 1 ) ( i ) T ( n ) ( i ) Δ x / 2 + k o T ( n + 1 ) ( i ) T ( n ) ( i ) Δ x / 2 ] Δ τ = ρ o c o Δ x × [ T ( n ) ( i + 1 ) T ( n ) ( i ) ] n = N 1 + 1
where ko, ρo and co represent the thermal conductivity, density, and heat capacity of the measured material. Subsequently, in accordance with the principle of energy conservation, the internal unit equation for the measured object was expressed as follows:
k o T n + 1 ( i ) T n ( i ) Δ x + k o T n 1 ( i ) T n ( i ) Δ x = c o ρ o Δ x T n ( i + 1 ) T n ( i ) Δ τ n = N 1 + 2 , N 1 + 3 , , N 1
Arranging the above equations resulted in a series of explicit iterative equations for the system:
{ T n ( i + 1 ) = 2 Δ τ ρ h c h Δ x [ k h Δ x ( T 2 ( i ) T 1 ( i ) ) + q v Δ x 2 ] + T n ( i ) n = 1 T n ( i + 1 ) = α s Δ τ Δ x 2 [ T n + 1 ( i ) + T n 1 ( i ) ] + ( 1 2 α s Δ τ Δ x 2 ) T n ( i ) n = 2 , 3 , , N 1 T ( n ) ( i + 1 ) = 1 ρ o c o Δ x [ k s T ( n 1 ) ( i ) T ( n ) ( i ) Δ x / 2 + k o T ( n + 1 ) ( i ) T ( n ) ( i ) Δ x / 2 ] Δ τ + T ( n ) ( i ) n = N 1 + 1 T n ( i + 1 ) = α o Δ τ Δ x 2 [ T n + 1 ( i ) + T n 1 ( i ) ] + ( 1 2 α o Δ τ Δ x 2 ) T n ( i ) n = N 1 + 2 , , N 1 T n ( i ) = T 0 n = N
where αs and αo denote the thermal diffusion of the sensing layer and the tested material, respectively. The equation system was presented in an explicit differential format, allowing the computation of the temperature at each node for the moment directly subsequent from the initial temperature, thus eliminating the need for solving coupled equations. Programming the model in MATLAB facilitated the calculation of physical quantities.

2.3. Finite Element Simulation

COMSOL 6.0 was employed for a comparative analysis to validate the model. Given the structural features of the sensing system, rotationally symmetric modeling was adopted. A model representing one-sixth of the structure is depicted in Figure 2.
The simulation’s settings aligned with those in the MATLAB program. These included the geometric dimensions, with the radius of the heating layer, sensing layer, and the object set at 40 mm. The heat flux sensing area’s radius was 5 mm, the heater layer’s thickness was 20 μm, the sensing layer’s thickness was 0.4 mm, and the test material’s thickness was 40 mm. Additionally, the system’s initial temperature was set at 25 °C, and the heating power density of the heater was set at 7.70 × 107 W∙m−3. Furthermore, the mesh was partitioned into highly refined triangular elements.
The thermal properties, as outlined in Table 1, were applied, setting the discrete unit spacing to 40 μm. Over a 2 s (experimentally chosen) duration, the solid’s heat transfer was calculated. Temperature and heat flux data from the sensing layer’s center, where it contacts the object, were used for comparison. Figure 2 displays the temperature distribution at time = 1.95 s, using “material III”. Figure 3 presents the results. The results indicated that the error between the model’s numerical calculations and the simulation is within 0.05 °C for temperature and within 30 W/m2 for heat flux, affirming the model’s effectiveness.

3. Data-Driven Algorithm

3.1. BP Neural Network

In machine learning, back propagation neural networks (BP NN) excel at learning and simulating relationships from the simple to the highly complex, rendering them ideal for various complex modeling and prediction tasks [28]. BP neural networks are not only fault-tolerant but also easier to implement compared to other machine learning methods, leading to their widespread application [29].
Serving as the core learning mechanism in multilayer feed-forward neural networks, the BP algorithm focuses on optimizing network weights via supervised learning. Essentially, the BP neural network is a multilayer nonlinear mapping structure, comprising neurons with varied connectivity weights. These neurons transform input data using activation functions, as depicted in Figure 4.
The error E, between the neural network’s actual output yi, and the expected output Y, was expressed as follows:
E = 1 2 i ( y i Y i ) 2
Error propagated backward through the network, employing the gradient descent method to minimize the loss function and optimize network weights [30]. The fundamental weight update formula was:
w i j n = Δ w i j + w i j
Here, wij and wijn represents the neuron’s current and updated weights, respectively, while Δwij denotes the change value, with its updated formula being as follows:
Δ w i j = η E w i j
Here, η represents the learning rate, which determines the rate of weight adjustment. The essence of the BP algorithm is its utilization of the chain rule and gradient descent strategy to incrementally adjust the network, thereby aligning the network’s output more closely with actual observations. This iterative process continues until the output error becomes sufficiently small. Meanwhile, the loss function serves as a crucial tool for assessing the learning effect, quantifying the deviation between predicted and actual values, and acting as a key reference in the optimization process.

3.2. Data Set and NN Training

To accurately calculate thermal conductivities during testing, a mapping relationship between the material’s thermal conductivity, temperature, and heat flux was first established using a BP neural network. Using the proposed theoretical heat transfer model, the system’s heating power density (qv) was inputted to calculate the material’s boundary temperature (Tf) and heat flux (qf) over a given time period, expressed as follows:
( T f , q f ) = f h ( k o , α o , t , q v )
where t represents time, ko and αo are the thermal conductivity and thermal diffusivity of the tested material, and fh denotes the theoretical heat transfer model. In this study, 67 different types of metals and non-metals were selected [22,31,32], with thermal conductivity ranging from 0.06 to 405.5 W∙m−1∙K−1, covering the parameter range of common materials, as shown in Figure 5. The thermal properties of these 67 standard materials were inputted into the theoretical model program fh for calculation. The study focused on transient heat transfer over a period of 1.95 s, with a set power density range of 4.0 × 107 W∙m−3 to 1.4 × 108 W∙m−3, resulting in 1407 sets of time series data.
To enhance the training efficiency of the BP neural network, feature selection and data preprocessing were conducted on the training dataset. The specific steps were as follows:
  • Feature extraction. To fully describe the characteristics of heat flux and temperature signals, the linear fitting slope of the heat flux relative to its initial value and the linear fitting slope of the temperature series were calculated, denoted as u1 and u2, respectively. The average heat flux and average temperature were calculated as u3 and u4. The final time’s excess temperature; the midpoint’s excess temperature; the temperature difference between the midpoint and final time; and the difference in heat flux are also calculated, respectively noted as u5, u6, u7, and u8.
  • Normalization. The dataset covered materials ranging from low to high thermal conductivity, with corresponding heat flux and temperature data showing significant variations. Therefore, the data features were first natural log-transformed, then normalized and denoted as X = norm(ln(u)), resulting in X = [x1, x2, x3, x4, x5, x6, x7, x8].
  • Principal component analysis (PCA). PCA is a data analysis technique that can retain as much of the original features as possible while reducing data dimensions [33,34]. By processing data with PCA dimensionality reduction, the principal components obtained were denoted as p1 to p8. The contribution rates of p1 and p2 exceeded 95%, indicating that p1 and p2 can explain over 95% of the variance in the original data, thus effectively representing the original feature. The relationship between p1, p2, and the original features is as follows:
    { p 1 = 0.1961 x 1 + 0.4242 x 2 0.1974 x 3 + 0.4242 x 4 + 0.4244 x 5    + 0.4240 x 6 + 0.4247 x 7 0.1499 x 8 p 2 = 0.5393 x 1 + 0.1403 x 2 + 0.5384 x 3 + 0.1408 x 4 + 0.1395 x 5    + 0.1417 x 6 + 0.1378 x 7 + 0.5669 x 8
  • With p1 and p2 as inputs and the thermal conductivity ko as output, a double hidden layer nonlinear mapping network was trained using a BP neural network. In this network, the number of neurons in the input layer was 2, the first hidden layer contained 100 neurons, the second hidden layer contained 20 neurons, and the output layer contained one neuron. The tansig function was used as the activation function for the hidden layers.

3.3. BP NN with Heat Transfer Model

Based on the measured heat flux, temperature, and trained BP NN, the thermal conductivity of materials could be predicted. Furthermore, the calculation of thermal diffusivity could be studied. Taking the material under test as the subject of analysis, with heat flux as the input, and discretizing the object into N elements, the theoretical heat transfer model could be transformed into:
{ T 1 ( i + 1 ) = 2 Δ τ α o k o Δ x [ k o Δ x ( T 2 ( i ) T 1 ( i ) ) + q f ] + T 1 ( i ) T N ( i ) = T 0 T n ( i + 1 ) = α o Δ τ Δ x 2 [ T n + 1 ( i ) + T n 1 ( i ) ] + ( 1 2 α o Δ τ Δ x 2 ) T n ( i ) n = 2 , , N 1
Therefore, when the heat flux on the surface of the test object was used as input, the model could calculate the transient temperature on the material’s surface. This can be succinctly expressed as follows:
T f = f q ( k o , α o , q f )
where fq represents the transformed heat transfer model with heat flux as input, qf denotes the heat flux, and Tf is the surface temperature of the object. Here, qf and Tf are measured by sensors, ko is predicted by the BP NN model, and the function contains only one unknown variable. Thus, by scanning αo within a certain range, calculating the temperature and solving for the error with the actual measured temperature, the αo corresponding to the minimum error is searched as the result for the thermal diffusivity.
In summary, the proposed data-driven method for measuring thermal properties is illustrated in Figure 6. The algorithm combined forward calculation based on the heat transfer model to build a database, a BP neural network, and a transformed inversion solution for thermal diffusivity. By using the measured temperature and heat flux signals, it achieved quantitative thermosensation for different objects.

4. Experiment

4.1. Samples of Tested Materials

To validate the effectiveness of the proposed measurement method, three types of materials with smooth surfaces were chosen as experimental samples, as illustrated in Figure 7. These samples include tempered glass, polymethyl methacrylate (PMMA), and aluminum alloy, each measuring 80 mm × 80 mm × 20 mm. These materials, characterized by varying levels of thermal conductivity, are all homogeneous. Furthermore, it was necessary to accurately obtain the thermal properties of the sample materials as reference. To ensure accuracy, high-precision measuring instruments were used to test the samples, obtaining their density, specific heat capacity, and thermal diffusivity.
The specific experiments were as follows: (a) three types of solid samples were prepared, each cut to dimensions required by the analytical instruments. (b) The thermal diffusivities were quantified using the NETZSCH LFA447 Nanoflash analyzer. (c) The specific heat capacities were ascertained utilizing the Mettler-Toledo DSC3 differential scanning calorimeter. (d) The densities of the samples were determined through the displacement method, employing a precision balance. Finally, the results were recorded as shown in Table 2.

4.2. Experimental Measurement System

Based on the measurement method, a thermal sensation system was constructed, as shown in Figure 8. This system was utilized to verify the contracted based algorithm. The system could be specifically divided into three layers: the first layer consisted of a flexible heat flux sensor, temperature sensor, and flexible Polyimide (PI) film. The heat flux sensor used was the FHF05 series produced by Hukseflux company (Delft, Netherlands). The sensor was encapsulated in PI and outputted a voltage proportional to the heat flux. It was positioned between the test object and the serpentine heater, with a thickness of 0.4 mm and an area of 10 mm × 10 mm. Its sensitivity was 0.56 × 10−6 V/(W∙m−2), and had a measurement range of (−10~10) × 103 W∙m−2.
The PI film served as a thermal resistance structure with the aim of aligning the thermal resistance perpendicular to the object’s surface. This alignment ensured that the temperature sensor’s heat transfer in the perpendicular direction shared identical thermal characteristics with the measurement area of the heat flux sensor. To attain this effect, a PI film matching the heat flux sensor in material and thickness, was chosen. The temperature sensor selected was a K-type fine-wire thermocouple (aidiwen, Yancheng, China). The probe part of the sensor had a thickness of 20 μm and was installed beneath the PI film. To fill the minute air gaps at the contact interface and between devices, thermally conductive grease (Arctic Silver 5) was used.
The system’s second layer, a serpentine heater, was positioned directly above the first layer. Comprising a serpentine metal electrode and a PI package, the heater generated Joule heat over a 55 mm × 60 mm area, with adjustable heating power achieved by varying the supply voltage.
Positioned above the heater, the third layer, or substrate layer, was made of 30 mm thick polyurethane (PU). During measurements, the heater supplied thermal energy, which was conducted to the object. Simultaneously, this thermal energy was transferred to the surrounding air. To minimize noise and disturbance, the substrate was made of a material with low thermal conductivity.
During the heating process, the heat flux sensor measured the heat flux signal across the boundary, while the thermocouple gauged boundary temperature in real-time, with both producing voltage output signals. A high-precision Keithley DAQ6510 digital multimeter was employed for voltage acquisition, configured with a 7700 series 20-channel plug-in switching module. This module, featuring built-in cold-end compensation circuitry, connected to K-type thermocouples and automatically converted the output to temperature readings. A Keithley 2280S-60 precision DC source supplied the input voltage to the heater. In addition, the sampling interval of measuring instruments differed from the algorithm’s time step, thus requiring adjustment through cubic spline interpolation.

5. Results and Discussion

Measurements were conducted using the developed thermal sensing system, yielding experimental data on temperature and heat flux, which was then processed using the proposed data-driven algorithm. To validate the effectiveness of the algorithm, the system’s power supply voltage was varied to adjust the heating power, resulting in different measured physical signals, which were subsequently analyzed.
Initially, the experiments focused on tempered glass, employing 12 V, 15 V, and 18 V heating voltages. The transient temperature and heat flux during heating were recorded, labeled as experimental data sets I, II, and III (refer to Figure 9).
Based on the experimental data of tempered glass, the algorithm was employed for signal processing, setting the αo scan range from 1 × 10−7 to 1 × 10−6 m2∙s−1 with a step size of 0.1 × 10−7 m2∙s−1. The algorithm’s calculated optimal curves and thermal properties are shown in Figure 10. The reference values were: ko = 1.097 W∙m−1∙K−1 and αo = 5.52 × 10−7 m2∙s−1 as shown in Table 2, with the calculated results having a relative error of less than 10%.
For PMMA, system voltages of 8 V, 15 V, and 20 V were used. The transient temperature and real-time heat flux during heating were recorded as experimental data sets I, II, and III, as depicted in Figure 11. Utilizing the experimental data, the algorithm processed the data with an αo scanning range of 1 × 10−8 to 5 × 10−7 m2∙s−1, and a step size of 0.05 × 10−7 m2∙s−1. The calculations yielded thermal conductivity and diffusivity, with algorithm-fitting curves presented in Figure 12. These values correspond to PMMA’s reference thermophysical properties: ko = 0.185 W∙m−1∙K−1 and αo = 1.10 × 10−7 m2∙s−1.
Figure 13 presents the surface heat flux and temperature measurements for the Al alloy, with supply voltages set at 15 V, 20 V, and 25 V, respectively. These results are respectively denoted as experimental data sets I, II, and III. The algorithmic computations and corresponding fitting curves are depicted in Figure 14, where the αo scanning range was set between 1 × 10−5 and 1 × 10−4 m2∙s−1, with a step increment of 0.1 × 10−5 m2∙s−1. Reference values for the Al alloy are as follows: ko = 120.4 W∙m−1∙K−1 and αo = 5.2 × 10−5 m2∙s−1.
Through experimentation, the method accurately calculates material thermal conductivity (ko) and diffusion coefficient (αo) across various materials, typically with less than 15% error under different heat power conditions. The algorithm simplifies the process by measuring only the surface excess temperature, eliminating the need for absolute temperature measurement and temperature compensation. This approach innovates in contact-based quantitative thermosensation.

6. Conclusions

This article introduces a contact-based thermosensation measurement method, focusing on the system design and signal processing algorithm. The system comprises a flexible heat flux sensor, a thermocouple, and a heater, facilitating the measurement of heat flux and real-time temperature at the material interface. A discrete transient heat transfer model was developed to establish the relationship between the heating power, heat flux, and temperature across various materials. The model was further analyzed and validated through finite element simulation. Building on this, a data-driven algorithm based on the heat transfer model and BP neural network was proposed. This algorithm calculates the thermal conductivity and thermal diffusivity of contacted materials through temperature and heat flux signals. In experiment, three different materials—PMMA, tempered glass, and aluminum alloy were measured under varying heating powers, yielding relative errors within 10% and 20% for thermal conductivity and thermal diffusivity, respectively. This method achieves enhanced thermosensation and holds potential for applications in intelligent robotic tactile sensing and automated control systems.

Author Contributions

Conceptualization, T.M. and M.Z.; methodology, T.M. and M.Z.; software, T.M.; validation, T.M. and M.Z.; formal analysis, T.M.; investigation, T.M.; resources, M.Z.; data curation, T.M. and M.Z.; writing—original draft preparation, T.M.; writing—review and editing, M.Z.; visualization, T.M.; supervision, M.Z.; project administration, M.Z.; funding acquisition, M.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Shenzhen Fundamental Research Funds (No. JCYJ20220530143011026).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the authors.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Shi, J.; Dai, Y.; Cheng, Y.; Xie, S.; Li, G.; Liu, Y.; Wang, J.; Zhang, R.; Bai, N.; Cai, M.; et al. Embedment of sensing elements for robust, highly sensitive, and cross-talk–free iontronic skins for robotics applications. Sci. Adv. 2023, 9, eadf8831. [Google Scholar] [CrossRef]
  2. Yuan, Z.; Shen, G.; Pan, C.; Wang, Z.L. Flexible sliding sensor for simultaneous monitoring deformation and displacement on a robotic hand/arm. Nano Energy 2020, 73, 104764. [Google Scholar] [CrossRef]
  3. Zhao, S.; Zhu, R. Electronic skin with multifunction sensors based on thermosensation. Adv. Mater. 2017, 29, 1606151. [Google Scholar] [CrossRef]
  4. Jones, L.A.; Ho, H.N. Warm or Cool, Large or Small? The Challenge of Thermal Displays. IEEE Trans. Haptics 2008, 1, 53–70. [Google Scholar] [CrossRef] [PubMed]
  5. Tadesse, M.G.; Loghin, E.; Pislaru, M.; Wang, L.; Chen, Y.; Nierstrasz, V.; Loghin, C. Prediction of the Tactile Comfort of Fabrics from Functional Finishing Parameters Using Fuzzy Logic and Artificial Neural Network Models. Text. Res. J. 2019, 89, 4083–4094. [Google Scholar] [CrossRef]
  6. Xiong, W.; Feng, H.; Liwang, H.; Li, D.; Yao, W.; Duolikun, D.; Zhou, Y.; Huang, Y.A. Multifunctional tactile feedbacks towards compliant robot manipulations via 3D-shaped electronic skin. IEEE Sens. J. 2022, 22, 9046–9056. [Google Scholar] [CrossRef]
  7. Li, G.; Liu, S.; Mao, Q.; Zhu, R. Multifunctional electronic skins enable robots to safely and dexterously interact with human. Adv. Sci. 2022, 9, 2104969. [Google Scholar] [CrossRef]
  8. Choi, C.; Ma, Y.; Li, X.; Chatterjee, S.; Sequeira, S.; Friesen, R.F.; Felts, J.R.; Hipwell, M.C. Surface haptic rendering of virtual shapes through change in surface temperature. Sci. Robot. 2022, 7, eabl4543. [Google Scholar] [CrossRef]
  9. Zhao, Y.; Bergmann, J.H.M. Non-Contact Infrared Thermometers and Thermal Scanners for Human Body Temperature Monitoring: A Systematic Review. Sensors 2023, 23, 7439. [Google Scholar] [CrossRef]
  10. Zhao, D.; Qian, X.; Gu, X.; Jajja, S.A.; Yang, R. Measurement techniques for thermal conductivity and interfacial thermal conductance of bulk and thin film materials. J. Electron. Packag. 2016, 138, 040802. [Google Scholar] [CrossRef]
  11. Pope, A.L.; Zawilski, B.; Tritt, T.M. Description of removable sample mount apparatus for rapid thermal conductivity measurements. Cryogenics 2001, 41, 725–731. [Google Scholar] [CrossRef]
  12. Tritt, T.M.; Weston, D. Measurement techniques and considerations for determining thermal conductivity of bulk materials. In Thermal Conductivity: Theory, Properties, and Applications; Springer: Boston, MA, USA, 2004; pp. 187–203. [Google Scholar]
  13. Dasgupta, T.; Umarji, A.M. Thermal properties of MoSi2 with minor aluminum substitutions. Intermetallics 2007, 15, 128–132. [Google Scholar] [CrossRef]
  14. Abu-Hamdeh, N.H.; Khdair, A.I.; Reeder, R.C. A comparison of two methods used to evaluate thermal conductivity for some soils. Int. J. Heat Mass Transf. 2001, 44, 1073–1078. [Google Scholar] [CrossRef]
  15. Breuer, S.; Schilling, F.R. Improving thermal diffusivity measurements by including detector inherent delayed response in laser flash method. Int. J. Thermophys. 2019, 40, 95. [Google Scholar] [CrossRef]
  16. Gustafsson, S.E. Transient plane source techniques for thermal conductivity and thermal diffusivity measurements of solid materials. Rev. Sci. Instrum. 1991, 62, 797–804. [Google Scholar] [CrossRef]
  17. Maeda, Y.; Maeda, K.; Kobara, H.; Mori, H.; Takao, H. Integrated pressure and temperature sensor with high immunity against external disturbance for flexible endoscope operation. Jpn. J. Appl. Phys. 2017, 56, 04CF09. [Google Scholar] [CrossRef]
  18. Basov, M. Schottky diode temperature sensor for pressure sensor. Sens. Actuators A Phys. 2021, 331, 112930. [Google Scholar] [CrossRef]
  19. Labrado, C.; Thapliyal, H.; Prowell, S.; Kuruganti, T. Use of thermistor temperature sensors for cyber-physical system security. Sensors 2019, 19, 3905. [Google Scholar] [CrossRef]
  20. Zhao, S.; Zhu, R. A smart artificial finger with multisensations of matter, temperature, and proximity. Adv. Mater. Technol. 2018, 3, 1800056. [Google Scholar] [CrossRef]
  21. Li, G.; Liu, S.; Wang, L.; Zhu, R. Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci. Robot. 2020, 5, eabc8134. [Google Scholar] [CrossRef]
  22. Yang, W.; Xie, M.; Zhang, X.; Sun, X.; Zhou, C.; Chang, Y.; Zhang, H.; Duan, X. Multifunctional soft robotic finger based on a nanoscale flexible temperature–pressure tactile sensor for material recognition. ACS Appl. Mater. Interfaces 2021, 13, 55756–55765. [Google Scholar] [CrossRef] [PubMed]
  23. Lee, Y.; Park, J.; Choe, A.; Shin, Y.E.; Kim, J.; Myoung, J.; Lee, S.; Lee, Y.; Kim, Y.K.; Yi, S.W.; et al. Flexible pyroresistive graphene composites for artificial thermosensation differentiating materials and solvent types. ACS Nano 2022, 16, 1208–1219. [Google Scholar] [CrossRef] [PubMed]
  24. Wu, S.; Yang, J.; Xing, J.; Yu, J.; Zhang, K. An in-situ integrated material distinction sensor based on density and heat capacity. J. Phys. D Appl. Phys. 2023, 56, 455103. [Google Scholar] [CrossRef]
  25. Zhang, N.; Zou, H.; Zhang, L.; Puppala, A.J.; Liu, S.; Cai, G. A unified soil thermal conductivity model based on artificial neural network. Int. J. Therm. Sci. 2020, 155, 106414. [Google Scholar] [CrossRef]
  26. Fidan, S.; Oktay, H.; Polat, S.; Ozturk, S. An artificial neural network model to predict the thermal properties of concrete using different neurons and activation functions. Adv. Mater. Sci. Eng. 2019, 2019, 3831813. [Google Scholar] [CrossRef]
  27. Pan, B.; Zhu, D.; Zhang, M. Quantitative thermosensation in a single touch. Sens. Actuators A Phys. 2021, 321, 112584. [Google Scholar] [CrossRef]
  28. Zhang, N.; Ma, Y.; Zhang, Q. Prediction of sea ice evolution in Liaodong Bay based on a back-propagation neural network model. Cold Reg. Sci. Technol. 2018, 145, 65–75. [Google Scholar] [CrossRef]
  29. Li, X.; Xiang, S.; Zhu, P.; Wu, M. Establishing a dynamic self-adaptation learning algorithm of the BP neural network and its applications. Int. J. Bifurc. Chaos 2015, 25, 1540030. [Google Scholar] [CrossRef]
  30. Cao, H.; Cui, R.; Liu, W.; Ma, T.; Zhang, Z.; Shen, C.; Shi, Y. Dual mass MEMS gyroscope temperature drift compensation based on TFPF-MEA-BP algorithm. Sensor Rev. 2021, 41, 162–175. [Google Scholar] [CrossRef]
  31. Guiatni, M.; Kheddar, A. Theoretical and experimental study of a heat transfer model for thermal feedback in virtual environments. In Proceedings of the 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France, 22–26 September 2008; pp. 2996–3001. [Google Scholar]
  32. Tan, Z.; Guo, G. Thermophysical Properties of Engineering Alloys; Metallurgical Industry Press: Beijing, China, 1994. [Google Scholar]
  33. Wold, S.; Esbensen, K.; Geladi, P. Principal component analysis. Chemom. Intell. Lab. Syst. 1987, 2, 37–52. [Google Scholar] [CrossRef]
  34. Webb, R.C.; Pielak, R.M.; Bastien, P.; Ayers, J.; Niittynen, J.; Kurniawan, J.; Manco, M.; Lin, A.; Cho, N.H.; Malyrchuk, V.; et al. Thermal transport characteristics of human skin measured in vivo using ultrathin conformal arrays of thermal sensors and actuators. PLoS ONE 2015, 10, e0118131. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic diagram for measuring heat flux and temperature in the system.
Figure 1. Schematic diagram for measuring heat flux and temperature in the system.
Sensors 24 00369 g001
Figure 2. Heat transfer simulation model in Comsol.
Figure 2. Heat transfer simulation model in Comsol.
Sensors 24 00369 g002
Figure 3. Comparison between the model and simulation (a) boundary heat flux and (b) temperature.
Figure 3. Comparison between the model and simulation (a) boundary heat flux and (b) temperature.
Sensors 24 00369 g003
Figure 4. Conceptual schematic of the double hidden layer BP NN structure.
Figure 4. Conceptual schematic of the double hidden layer BP NN structure.
Sensors 24 00369 g004
Figure 5. Thermal properties of different materials.
Figure 5. Thermal properties of different materials.
Sensors 24 00369 g005
Figure 6. Flowchart of the data-driven algorithm for thermosensation.
Figure 6. Flowchart of the data-driven algorithm for thermosensation.
Sensors 24 00369 g006
Figure 7. (a) Experimental samples and (b) instruments used for reference values measurement.
Figure 7. (a) Experimental samples and (b) instruments used for reference values measurement.
Sensors 24 00369 g007
Figure 8. Experimental measurement system.
Figure 8. Experimental measurement system.
Sensors 24 00369 g008
Figure 9. Experimental measurements on tempered glass (a) heat flux signal and (b) excess temperature.
Figure 9. Experimental measurements on tempered glass (a) heat flux signal and (b) excess temperature.
Sensors 24 00369 g009
Figure 10. Experimental data and algorithmic calculation curve for tempered glass.
Figure 10. Experimental data and algorithmic calculation curve for tempered glass.
Sensors 24 00369 g010
Figure 11. Experimental measurements on PMMA (a) heat flux signal and (b) excess temperature.
Figure 11. Experimental measurements on PMMA (a) heat flux signal and (b) excess temperature.
Sensors 24 00369 g011
Figure 12. Experimental data and algorithmic calculation curve for PMMA.
Figure 12. Experimental data and algorithmic calculation curve for PMMA.
Sensors 24 00369 g012
Figure 13. Experimental measurements on Al alloy (a) heat flux signal and (b) excess temperature.
Figure 13. Experimental measurements on Al alloy (a) heat flux signal and (b) excess temperature.
Sensors 24 00369 g013
Figure 14. Experimental data and algorithmic calculation curve for Al alloy.
Figure 14. Experimental data and algorithmic calculation curve for Al alloy.
Sensors 24 00369 g014
Table 1. Setting of thermophysical parameters in modeling and simulation.
Table 1. Setting of thermophysical parameters in modeling and simulation.
ObjectThermal Conductivity/W∙m−1∙k−1Density/kg/m3Thermal Capacity /J/kg/K
Heating layer and sensing layer0.2141951.61064.6
Material I0.1500.22400
Material II1.52659.6800
Material III127860477.1
Table 2. Reference Measurements of Samples’ Thermal Properties.
Table 2. Reference Measurements of Samples’ Thermal Properties.
MaterialsThermal Diffusivity
/mm2∙s−1
Standard Deviation Heat Capacity
/J∙g−1∙K−1
Standard DeviationDensity
/kg∙m−3
Standard
Deviation
Tempered Glass0.5520.003500.8090.00122458.45.798
PMMA0.1108.17 × 10−41.4290.00291178.351.344
Aluminum Alloy51.90.220.8736.03 × 10−42651.517.82
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ma, T.; Zhang, M. Data-Driven Contact-Based Thermosensation for Enhanced Tactile Recognition. Sensors 2024, 24, 369. https://doi.org/10.3390/s24020369

AMA Style

Ma T, Zhang M. Data-Driven Contact-Based Thermosensation for Enhanced Tactile Recognition. Sensors. 2024; 24(2):369. https://doi.org/10.3390/s24020369

Chicago/Turabian Style

Ma, Tiancheng, and Min Zhang. 2024. "Data-Driven Contact-Based Thermosensation for Enhanced Tactile Recognition" Sensors 24, no. 2: 369. https://doi.org/10.3390/s24020369

APA Style

Ma, T., & Zhang, M. (2024). Data-Driven Contact-Based Thermosensation for Enhanced Tactile Recognition. Sensors, 24(2), 369. https://doi.org/10.3390/s24020369

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop