Next Article in Journal
Lights and Shadows: A Comprehensive Survey on Cooperative and Precoding Schemes to Overcome LOS Blockage and Interference in Indoor VLC
Previous Article in Journal
SDR Proof-of-Concept of Full-Duplex Jamming for Enhanced Physical Layer Security
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

HumTouch: Localization of Touch on Semi-Conductive Surfaces by Sensing Human Body Antenna Signal

Graduate School of Engineering, Nagoya University, Nagoya 464-8603, Japan
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(3), 859; https://doi.org/10.3390/s21030859
Submission received: 23 December 2020 / Revised: 23 January 2021 / Accepted: 26 January 2021 / Published: 28 January 2021
(This article belongs to the Section Physical Sensors)

Abstract

:
HumTouch is a touch sensing technology utilizing the environmental electromagnetic wave. The method can be realized using conductive and semi-conductive materials by simply attaching electrodes to the object’s surface. In this study, we compared three methods for localizing a touch on 20 × 16 cm 2 and 40 × 36 cm 2 papers, on which four or eight electrodes were attached to record the voltages leaked from the human fingertip. The number and positions of the electrodes and the data processing of the voltages differed according to the localization methods. By constructing a kernel regression analysis model between the electrode outputs and the actual physical locations, the touched locations were estimated. Each of the three methods was tested via leave-one-out cross validation. Out of the three methods discussed, two exhibited superior performances in terms of the estimation errors. Of these two methods, one simply uses the voltages recorded by the four electrodes attached on the middle of paper edges as inputs to the regression system. The other uses differential outputs of electrode pairs as the inputs. The smallest mean location errors were 0.31 cm on 20 × 16 cm 2 paper and 0.27 cm on 40 × 36 cm 2 paper, which are smaller than the size of a fingertip.

1. Introduction

Touch sensing techniques are widely used in consumer electronics such as smartphones and laptop computers. These touch sensing techniques provide a more intuitive way to interact with the computer interface. Capacity sensing methods are a common technology used in these commercial devices [1,2,3]. These sensing methods use a specialized surface that is constructed using multiple layers of different materials. This method has been developed for years and is considerably mature and reliable. However, the number of studies focusing on transforming daily objects into touch-sensitive objects has been increasing [4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20]. Acoustic waves are used for localizing touch on rigid planes [4,5]. The disturbance source, i.e., finger, is located on a vibrating surface. This method requires transmitters to generate the acoustic wave and receivers to record the vibration of the surface. For flexible objects, the resistance and capacitance of materials, e.g., conductive fabrics and conductive rubber, are used for touch sensing [6,7,8,9,10]. When the surface deforms, the electrical properties of such materials change accordingly. Therefore, these materials are often used as pressure sensors and flexion sensors. Cameras are also used for touch localization [11,12,13,14,15]. This optical method does not depend on the surface material but is limited owing to the issue of occlusion. Electric tomography is used for conductive materials or insulative objects with conductive coating [16,17,18,19]. This method uses a relatively large number of electrodes. The current from one electrode to another changes with the conductive state of the surface. These methods [4,5,6,7,8,9,10,11,12,13,16,17,18,19,20,21] can potentially make daily objects, such as furniture and toys, touch-sensitive.
In this study, we focus on a passive sensing method named HumTouch. Unlike the prominent methods that require surface activation, HumTouch utilizes environmental noise. Nowadays, AC power lines are widespread in our surroundings that generate 50/60 Hz electromagnetic waves. Further, the human body contains minerals and other conductive materials that react to the electromagnetic waves, inducing currents on the skin. These currents can be used for gesture recognition and human localization in a 3D space [22,23,24]. When a finger touches a conductive or semi-conductive material, the current leaks from the human body into the material surface. The voltage of this current can be detected via electrodes attached on the material, as shown in Figure 1a,b. Note that the positive electrodes are attached to the material surface, while the negative ones are grounded. Further, the human body is virtually coupled to the ground. In our pervious works, the application of HumTouch was validated for the development of a keyboard [25]. This method can be used with natural conductive materials such as granite [26,27]. For insulative materials, a semi-conductive hydrogel-paint for application to a 2D or 3D surface is available [28,29,30]. HumTouch does not require surface activation, which renders it different from other touch sensing methods. Hence, it can be potentially used with large-area surfaces and objects with limited volumes.
In our previous study, touch localization was achieved by constructing a kernel regression model with preprocessed voltages recorded at the electrodes [29,30]. The mean estimated errors in our former studies were 0.88 cm on a 16 × 19 cm 2 paper and 0.22 cm on a 30-cm-long cylinder with the dimeter of 3 cm. These results motivated us to extend our research and investigate the preprocess methods for the collected voltages and the number and locations of electrodes. Herein, we demonstrate three different localization methods that use multiple electrodes and kernel regression analyses. The three methods are different in terms of the preprocessing of recorded voltages. One method does not apply any preprocessing. For the other two methods, linear combinations of the voltages are used for the input to the kernel regression analysis. Each of the three methods is tested on both 20 × 18 cm 2 and 40 × 36 cm 2 papers. Finally, we determine the best localization method for 2D HumTouch surfaces.

2. Materials and Methods

We painted a semi-conductive hydrogel on two different-sized wiping papers ( 20 × 18 cm and 40 × 36 cm, Kimtowel, Nippon Paper Crecia, Tokyo, Japan). The hydrogel [28] was prepared using the following constituents: 15 g of polyvinyl alcohol, 300 mL of ultrapure water, 75 mL polyethylene glycol 400, and 37.5 mL Glutaraldehyde. The solution was stirred for approximately 3 h at 90 °C. Then, the wiping papers were dried at room temperature for a week. After being dried, the papers remained flexible, and thus the strength does not apparently change. Nevertheless, we did not measure the exact change in the strength and stiffness after painting the hydrogel.
To measure the current, we attached eight electrodes to the paper as shown in Figure 1. An oscilloscope (HS6DIFF, TiePie, Netherlands; sampling frequency: 500 kHz) was used to record the voltage at each electrode. For each channel of the oscilloscope, one electrode was connected to the paper, and the other electrode was grounded.
We marked 7 × 7 points (49 total points) on both papers with a marker pen. As Figure 2 shows, the intervals between each point were 2.5 cm and 2.25 cm for the smaller paper and 5 cm and 4.5 cm for the larger paper. The papers were placed on a non-conductive wooden table inside a regular office room. A participant was asked to touch each of the 49 points with his bare index finger. The contact force was not fixed because the voltage barely changed with the contact force as shown in Figure 3, where the point that was 12.8 cm away from an electrode on a paper was repeatedly touched with the normal forces varying 1–8 N. The contact period for each point was approximately 1 s. This procedure was repeated seven times (seven data sets).

3. Localization Using Kernel Regression Model

Kernel Regression Analysis

We applied kernel regression analysis as the model structure for our observations is unknown; however, the voltage at an electrode nonlinearly changes with the distance between the finger and electrode. The independent observations for learning the model are ( x 1 , y 1 ) , , ( x j , y j ) , , ( x n , y n ) where x j is the input vector, y j is the output scalar for the jth sample and n is the number of samples for learning. When the input vector is x , the estimated output y ˜ is defined as
y ˜ = j = 1 n α j k ( x j , x )
where k ( x j , x ) is a kernel function. Coefficient α j is a component of vector α = ( α 1 , , α j , , α n ) T , which is determined using
α = ( K + λ I ) 1 y 1 y j y n .
Matrix K R n × n is formed by k ( x i , x j ) ( i , j = 1 , 2 , , n ) , λ is the regularization value, and I is the identity matrix of n × n .
In our study, the location for each point was defined by the Cartesian coordinate system. We applied the kernel regression for each axis. Therefore, for the input vector x , the estimated two-dimensional location ( l ˜ x , l ˜ y ) T for each point can be written as
l ˜ x l ˜ y = j = 1 n α x j k ( x j , x ) j = 1 n α y j k ( x j , x )
where the coefficients α x j and α y j are the jth components of vectors α x and α y , which are computed by
α x = ( K + λ I ) 1 l x
α y = ( K + λ I ) 1 l y .
Here, l x = ( l x 1 , l x 2 , , l x n ) T and l y = ( l y 1 , l y 2 , , l y n ) T are the actual x and y locations for the touched points. The kernel function used in our study is the Gaussian kernel, which is
k ( x j , x ) = exp ( | x j x | 2 )
where | . | is the L2 norm. The regularization value λ was selected from 1 to 10 3 such that the smallest estimation error on average was achieved.

4. Three Voltage Processing Methods for Regression Model

4.1. Data Prepossessing Common for the Three Methods

A moving average filter with a span of five, i.e., a window size of 0.01 ms for a 500 kHZ sampling frequency of the oscilloscope, was used to smooth the signals recorded by the electrodes. The maximum voltage recorded by channel i during 1 s is v i and is used for the localization methods introduced in Section 4.2, Section 4.3 and Section 4.4.

4.2. Method 1: Simple Regression

In this method, we used the voltage preprocessed in Section 4.1 as the input for the regression model. We constructed three slightly different regression models using this method. One model used the data collected by eight electrodes as the input. Therefore, the input was x j = ( v 1 j , v 2 j , , v 8 j ) T , where v i j is the voltage output from the ith channel of sample j. Another model used the voltages recorded on the four corners x j = ( v 1 j , v 2 j , v 3 j , v 4 j ) as the input, and the other used those on the middle of each edge x j = ( v 5 j , v 6 j , v 7 j , v 8 j ) . The channel numbers and positions are shown in Figure 4. The model using eight channels is expected to be more accurate than the models using four channels.

4.3. Method 2: Regression Using Voltage Ratio

In our previous study [29], four electrodes were attached to the corners of a square paper. The localization was conducted via kernel regression using the voltage ratio defined by x = ( p x , p y ) T :
x j = p x j p y j = v 1 j + v 2 j + v 3 j v 4 j v 1 j + v 2 j + v 3 j + v 4 j v 1 j + v 2 j v 3 j v 4 j v 1 j + v 2 j + v 3 j + v 4 j .
These voltage ratios represent the touched location if the relationship between the channel output and distance between the electrode and fingertip is linear. However, the relationship is non-linear in reality, and we corrected this non-linearity by applying kernel regression analysis in [29].
In this study, we increased the number of channels to eight. Hence, we added two more parameters p x 2 and p y 2 using the voltage records at the middle of edges, i.e., v 5 , v 6 , v 7 and v 8 . The input vector for sample j was x j = ( p x 1 j , p y 1 j , p x 2 j , p y 2 j ) T , where
x j = p x 1 j p y 1 j p x 2 j p y 2 j = v 1 j + v 2 j + v 3 j v 4 j v 1 j + v 2 j + v 3 j + v 4 j v 1 j + v 2 j v 3 j v 4 j v 1 j + v 2 j + v 3 j + v 4 j v 5 j + v 6 j + v 7 j v 8 j v 5 j + v 6 j + v 7 j + v 8 j v 5 j + v 6 j v 7 j v 8 j v 5 j + v 6 j + v 7 j + v 8 j .
We expected the regression model built using the voltage ratio to be more accurate than the simple regression method because the input was related to the coordinates on the paper for the regression analysis.

4.4. Method 3: Regression Using Differential Output of Electrode Pair

We propose another method that utilizes the difference of preprocessed voltages between two channels as the input for regression models. The concept of this method is that although the magnitude of the voltage may be different among trials owing to environmental differences even if the same position is touched on the paper, the difference between the two channels’ outputs may be same among trails. Hence, the use of two channels’ difference is expected to lead to a smaller estimation error than the simple regression method. We used three different arrangements of the electrodes. One used the voltages measured at corners ( v 1 , , v 4 ). The input for sample j was defined as
x j = c 1 j c 2 j c 3 j c 4 j c 5 j c 6 j = v 1 j v 2 j v 1 j v 3 j v 1 j v 4 j v 2 j v 3 j v 2 j v 4 j v 3 j v 4 j .
Another arrangement used the voltages measured at the middle of edges ( v 5 , , v 8 ). In this case, the input for sample j was
x j = d 1 j d 2 j d 3 j d 4 j d 5 j d 6 j = v 5 j v 6 j v 5 j v 7 j v 5 j v 8 j v 6 j v 7 j v 6 j v 8 j v 7 j v 8 j .
Furthermore, we tested the input computed by the eight electrodes. The input for sample j contained 28 elements ( 8 C 2 ) and was defined as
x j = e 1 j e 2 j e 28 j = v 1 j v 2 j v 1 j v 3 j v 7 j v 8 j .

5. Results

5.1. Performance Evaluation Method

We applied the leave-one-out cross validation method to investigate the estimation error. Six of the seven data sets (294 out of 343 points) were used to build the regression model and the remaining data set (49 out of 343 points) was used to test the estimation performance. This procedure was conducted for every data set (repeated seven times), and then, the means and standard deviations of the errors were calculated.

5.2. Simple Regression

The points shown in Figure 5 are the mean estimated locations and the standard deviations for individual points. The intersections of the grids denote the actually touched locations. Figure 5a,b are the results when the eight electrodes were used for localization. The estimation error was 0.48 ± 0.10 cm for the 20 × 16 cm 2 paper and 1.39 ± 0.55 cm for the 40 × 16 cm 2 paper. For both papers, the estimation error and the standard deviation for the points near the edges were larger than those of the points near the center of the paper.
Figure 5c,d present the results when the four electrodes were placed on the corners ( x = ( v 1 , , v 4 ) ). The mean estimation errors were 0.84 ± 0.18 cm and 2.15 ± 0.63 cm for the 20 × 16 cm 2 and 40 × 36 cm 2 paper, respectively.
Figure 5e,f illustrate the results when the electrodes were placed on the middle of edges ( x = ( v 5 , , v 8 ) ). The mean estimation errors were 0.36 ± 0.07 cm and 0.27 ± 0.10 cm for the 20 × 16 cm and 40 × 36 cm 2 paper, respectively. For the 20 × 16 cm 2 paper, the estimation error was larger for the points close to the edges than those near the center of the paper.

5.3. Voltage Ratios

Figure 6a,b present the results for the method using voltage ratios calculated by the eight electrodes. The estimation errors were 0.31 ± 0.09 cm for the smaller paper and 0.69 ± 0.19 cm for the lager paper.
Figure 6c,d illustrate the results for the method using the four electrodes on corners. The mean estimation errors were 0.93 ± 0.32 cm for the 20 × 16 cm 2 paper and 3.26 ± 0.69 cm for the 40 × 36 cm 2 paper. For the 20 × 16 cm 2 paper, the estimation errors for the points near edges are larger than those near the center of the paper. The estimation errors for the 40 × 36 cm 2 paper were evidently larger than those for the smaller paper.
Figure 6e,f present the results for the method using four electrodes placed on the middle of edges. The estimation errors were 0.99 ± 0.79 cm for the smaller paper and 1.08 ± 0.12 cm for the lager paper.

5.4. Differential Output of Electrode Pair

Figure 7 shows the results for the differential output methods. Figure 7a,b show the estimation based on the corner electrodes, for which the localization of the touched points was failed. The estimation errors were 2.42 ± 0.21 on the small paper and 4.30 ± 0.82 on the large paper. As shown in Figure 7c,d, the estimation errors for the method using the four electrodes at corners for the 20 × 16 cm 2 and 40 × 36 cm 2 papers were 1.16 ± 0.19 cm and 2.39 ± 0.53 cm, respectively. As shown in Figure 7e,f, for the method using the four electrodes on the middle of edges, the estimation errors were 0.50 ± 0.13 cm and 0.31 ± 0.12 cm for the 20 × 16 cm 2 and the 40 × 36 cm 2 paper, respectively.

5.5. Summary and Comparison of Three Methods

Table 1 shows the mean estimation error and standard deviation for each method. The simple regression method using the electrodes on the middle of edges, voltage ratio method using eight electrodes, and differential output method using the electrodes on the middle of edges exhibited relatively small localization errors.
We tested the statistical differences in the mean errors between the method with the smallest error and the others for each type of the paper, and the results are summarized in Table 2. For the small paper, the method based on the voltage ratio of the eight electrodes, exhibited smaller errors than the other methods except for the simple regression method and differential output method using the electrodes on the middle of edges. In contrast, the simple regression method using the middle of edges showed the smallest error for the large paper. The error was smaller than those of the other methods expect for the simple regression method using eight electrodes, the voltage ratio method using eight electrodes, the voltage ratio method using electrodes on the middle of edges, and the differential output method using the electrodes on the middle of edges.

6. Discussion

The following three methods resulted in small localization errors: the simple regression method using the middle of the edges of the paper; the voltage ratio method using eight electrodes; and the differential output method using the middle of the edges of the paper. These methods did not exhibit statistical differences. The mean localization errors of three methods were smaller than a fingertip. These errors can be compared with those obtained by other touch sensing methods such as an electric tomography method with maximum mean localization errors of 10 mm and a method using an inertial measurement unit sensor with a maximum position error of 2.5 mm [19,31]. Among all the localization methods, the simple regression method using the middle of the edges of the paper is better than the other methods because of the low number of electrodes and mean localization errors.
The points near the edges incur larger estimation errors and standard deviations than those near the center of the papers. This can be explained based on the relationship between the measured voltages and finger-electrode distances, shown in Figure 8. The points shown in the figure denote the mean voltages measured at different distances from an electrode, and the error bars denote the standard deviation. For the points near the edges, the distance between the finger and electrode is either laid on highly sensitive distances or less sensitive distances. In the highly sensitive range, the voltage considerably varies when the location touched by the finger slightly varies, causing large standard deviations. In contrast, in the less sensitive range, the voltage does not evidently vary even when the location touched by the finger substantially varies. Therefore, the estimations for the points near edges are inaccurate.
In general, the mean estimation error for the 40 × 36 cm 2 paper was larger than that for the 20 × 16 cm 2 paper. The mean estimation errors for the 40 × 36 cm 2 and 20 × 16 cm 2 papers were 1.77 cm and 0.89 cm, respectively. The dimensions of the larger paper were nearly twice those of the smaller paper. This indicates that the lager are the papers, the greater are the localization errors. This could be because, for the larger paper, the distances between the touched locations and electrodes are large, and the sensitivity of the output voltage is low.
For the differential output method, the estimation errors obtained when using four electrodes are smaller than those obtained using eight electrodes, which disagrees with our initial expectation. This could potentially be because of the overlearning of the regression model. For the method using eight electrodes, the number of explanatory variables was 28 ( 8 C 2 ), while that for the methods using four electrodes was six. The model established based on the differential output method using eight electrodes might have been extremely specific to the data used for learning and not for general purposes.
HumTouch utilizes the environmental noise that cannot be easily replicated; thus, the localization results could depend on the participant and environment. In the future, the regression models constructed based on different participants and environments need to be compared. Further, although we used the Gaussian kernel functions, these functions were not optimized. Better kernel functions that could help obtain more accurate results can be determined. An equivalent circuit model of HumTouch is yet to be established and studied. Once the model is established, a computational optimization of electrode positions and numbers can be realized.

7. Conclusions

HumTouch is a passive sensing technology that can be used for semi-conductive materials; furthermore, this technology does not require surface activation or specialized surface structures. In this study, the localization of touch via the HumTouch technology was realized on two different-sized papers ( 20 × 16 cm 2 and 40 × 36 cm 2 ). Three different localization methods were tested on both papers for different electrode positions. The simple regression method using electrodes at the middle of the edges of the paper, the voltage ratio method using eight electrodes, and the differential output method using electrodes at the middle of the edges of the paper exhibited smaller localization errors than the other methods. The smallest errors for the 20 × 16 cm 2 and 40 × 36 cm 2 paper were 0.31 ± 0.09 cm and 0.27 ± 0.10 cm, respectively. These errors are smaller than a fingertip. The simple regression method using four electrodes at the middle of the four edges of the paper is the most commonly applied localization method since this method requires only four electrodes and incurs small errors. In the future, we will seek applications suitable for HumTouch.

Author Contributions

T.H.H. and S.O. have equally contributed to this study. Y.A. and Y.Y. contributed to the discussions pertaining to the analysis and experimental methods. All authors have read and agreed to the published version of the manuscript.

Funding

This research was in part supported by Mazda Foundation.

Institutional Review Board Statement

This study was approved by the IRB of the School of Engineering, Nagoya University (#20-8).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data can be requested by direct email contacts to the author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Walker, G. A Review of Technologies for Sensing Contact Location on the Surface of a Display. J. Soc. Inf. Disp. 2012, 20, 413–440. [Google Scholar] [CrossRef]
  2. An, J.; Hong, S.; Kwon, O. A Highly Linear and Accurate Touch Data Extraction Algorithm Based on Polar Coordinates for Large-sized Capacitive Touch Screen Panels. IEEE Trans. Consum. Electron. 2016, 62, 341–348. [Google Scholar] [CrossRef]
  3. Ozioko, O.; Navaraj, W.; Hersh, M.; Dahiya, R. Tacsac: A Wearable Haptic Device with Capacitive Touch-Sensing Capability for Tactile Display. Sensors 2020, 20, 4780. [Google Scholar] [CrossRef] [PubMed]
  4. Firouzi, K.; Nikoozadeh, A.; Carver, T.E.; Khuri-Yakub, B.T. Multitouch Touchscreen Using Reverberant Lamb Waves. In Proceedings of the IEEE International Ultrasonics Symposium, Washington, DC, USA, 6–9 September 2017; pp. 1–4. [Google Scholar]
  5. Chang, C.S.; Lee, Y.C. Ultrasonic Touch Sensing System Based on Lamb Waves and Convolutional Neural Network. Sensors 2020, 20, 2619. [Google Scholar] [CrossRef] [PubMed]
  6. Shimojo, M.; Namiki, A.; Ishikawa, M.; Makino, R.; Mabuchi, K. A Tactile Sensor Sheet Using Pressure Conductive Rubber with Electrical-wires Stitched Method. IEEE Sens. J. 2004, 4, 589–596. [Google Scholar] [CrossRef]
  7. Mazzeo, A.D.; Kalb, W.B.; Chan, L.; Killian, M.G.; Bloch, J.F.; Mazzeo, B.A.; Whitesides, G.M. Paper-based, Capacitive Touch Pads. Adv. Mater. 2012, 24, 2850–2856. [Google Scholar] [CrossRef] [PubMed]
  8. Hua, Q.; Sun, J.; Liu, H.; Bao, R.; Yu, R.; Zhai, J.; Pan, C.; Wang, Z.L. Skin-inspired Highly Stretchable and Conformable Matrix Networks for Multifunctional Sensing. Nat. Commun. 2018, 9, 1–11. [Google Scholar] [CrossRef] [PubMed]
  9. Matsuno, T.; Wang, Z.; Althoefer, K.; Hirai, S. Adaptive Update of Reference Capacitances in Conductive Fabric Based Robotic Skin. IEEE Robot. Autom. Lett. 2019, 4, 2212–2219. [Google Scholar] [CrossRef]
  10. Valasma, R.; Bozo, E.; Pitkänen, O.; Jarvinen, T.; Dombovari, A.; Mohl, M.; Lorite, G.S.; Kiss, J.; Konya, Z.; Kordas, K. Grid-type Transparent Conductive Thin Films of Carbon Nanotubes as Capacitive Touch Sensors. Nanotechnology 2020, 31, 305303. [Google Scholar] [CrossRef] [PubMed]
  11. Akaoka, E.; Ginn, T.; Vertegaal, R. DisplayObjects: Prototyping Functional Physical Interfaces on 3D styrofoam, Paper or Cardboard Models. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, Cambridge, MA, USA, 25–27 January 2010; pp. 49–56. [Google Scholar]
  12. Chen, Y.L.; Liang, W.Y.; Chiang, C.Y.; Hsieh, T.J.; Lee, D.C.; Yuan, S.M.; Chang, Y.L. Vision-based Finger Detection, Tracking, and Event Identification Techniques for Multi-touch Sensing and Display Systems. Sensors 2011, 11, 6868–6892. [Google Scholar] [CrossRef] [PubMed]
  13. Liang, J.R.; Lin, K.C.; Chen, H.C.; Wang, W.J. Turn Any Display into a Touch Screen Using Infrared Optical Technique. IEEE Access 2018, 6, 13033–13040. [Google Scholar] [CrossRef]
  14. Suto, S.; Watanabe, T.; Shibusawa, S.; Kamada, M. Multi-Touch Tabletop System Using Infrared Image Recognition for User Position Identification. Sensors 2018, 18, 1559. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Sferrazza, C.; D’Andrea, R. Design, Motivation and Evaluation of a Full-resolution Optical Tactile Sensor. Sensors 2019, 19, 928. [Google Scholar] [CrossRef] [Green Version]
  16. Fulton, W.; Lipczynski, R. Body-support Pressure Measurement Using Electrical Impedance Tomography. In Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ, San Diego, CA, USA, 31 October 1993; pp. 98–99. [Google Scholar]
  17. Booth, M.J.; Basarab-Horwath, I. Comparing Electrode Configurations for Electrical Impedance Tomography. Electron. Lett. 1996, 32, 648–649. [Google Scholar] [CrossRef]
  18. Silvera-Tawil, D.; Rye, D.; Soleimani, M.; Velonaki, M. Electrical Impedance Tomography for Artificial Sensitive Robotic Skin: A Review. IEEE Sens. J. 2015, 15, 2001–2016. [Google Scholar] [CrossRef] [Green Version]
  19. Zhang, Y.; Laput, G.; Harrison, C. Electrick: Low-cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May 2017; pp. 1–14. [Google Scholar]
  20. Hanh, N.Q.; Reju, V.G.; Khong, A.W.H. Impact Localization on Rigid Surfaces Using Hermitian Angle Distribution for Human-Computer Interface Applications. IEEE Trans. Multimed. 2018, 20, 1448–1461. [Google Scholar] [CrossRef]
  21. Mitsubayashi, H.; Yoshimoto, S.; Yamamoto, A. Adaptive Potential Scanning for a Tomographic Tactile Sensor with High Spatio-Temporal Resolution. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Las Vegas, NV, USA, 24–30 October 2020; pp. 9827–9832. [Google Scholar]
  22. Cohn, G.; Morris, D.; Patel, S.N.; Tan, D.S. Your Noise is My Command: Sensing Gestures Using the Body as an Antenna. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, 7–12 May 2011; pp. 791–800. [Google Scholar]
  23. Cohn, G.; Morris, D.; Patel, S.; Tan, D. Humantenna: Using the Body as an Antenna for Real-time Whole-body Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA, 5–10 May 2012; pp. 1901–1910. [Google Scholar]
  24. Grosse-Puppendahl, T.; Dellangnol, X.; Hatzfeld, C.; Fu, B.; Kupnik, M.; Kuijper, A.; Hastall, M.R.; Scott, J.; Gruteser, M. Platypus—Indoor Localization and Identification through Sensing Electric Potential Changes in Human Bodies. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, Singapore, 26–30 June 2016; pp. 17–30. [Google Scholar]
  25. Elfekey, H.; Bastawrous, H.A.; Okamoto, S. A Touch Sensing Technique Using the Effects of Extremely Low Frequency Fields on the Human Body. Sensors 2016, 16, 2049. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Elfekey, H.; Okamoto, S. Turning Surfaces into Touch Panels: A Granite-touch Pad. In Haptic Interaction: Science, Engineering and Design; Lecture Notes in Electrical Engineering; Hasegawa, S., Konyo, M., Kyung, K.U., Nojima, T., Kajimoto, H., Eds.; Springer: Berlin/Heidelberg, Germany, 2016; Volume 432, pp. 301–304. [Google Scholar]
  27. Elfekey, H.; Okamoto, S.; Yamada, Y. Localization of Touch on Granite based on AC Hum Noise. In Proceeding of the IEEE Global Conference on Consumer Electronics, Nagoya, Japan, 24–27 October 2017; pp. 163–164. [Google Scholar]
  28. Tachi, K.; Okamoto, S.; Akiyama, Y.; Yamada, Y. HumTouch: Finger Gesture Recognition on Hydrogel-painted Paper Using Hum-driven Signals. In Proceedings of the IEEE Global Conference on Consumer Electronic, Osaka, Japan, 15–18 October 2019; pp. 157–159. [Google Scholar]
  29. Hsia, T.H.; Okamoto, S.; Akiyama, Y.; Yamada, Y. HumTouch: Kernel Regression-based Localization of Touch on a Paper. In Proceedings of the IEEE Global Conference on Life Sciences and Technologies, Kyoto, Japan, 10–12 March 2020; pp. 28–30. [Google Scholar]
  30. Hsia, T.H.; Okamoto, S.; Akiyama, Y.; Yamada, Y. HumTouch: Localization of Touch on a Cylindrical Object. In Proceedings of the IEEE Global Conference on Consumer Electronic, Kobe, Japan, 13–16 October 2020; pp. 519–521. [Google Scholar]
  31. Oh, J.Y.; Park, J.; Park, J. FingerTouch: Touch Interaction Using a Fingernail-Mounted Sensor on a Head-Mounted Display for Augmented Reality. IEEE Access 2020, 8, 101192–101208. [Google Scholar] [CrossRef]
Figure 1. (a) Eight electrodes were attached to a semi-conductive paper. (b) A circuit was formed when a human touched the paper. (c) Photo of the paper ( 40 × 36 cm 2 ) with the electrodes attached. (d) The paper was dry, flexible, and durable.
Figure 1. (a) Eight electrodes were attached to a semi-conductive paper. (b) A circuit was formed when a human touched the paper. (c) Photo of the paper ( 40 × 36 cm 2 ) with the electrodes attached. (d) The paper was dry, flexible, and durable.
Sensors 21 00859 g001
Figure 2. Points marked on the 20 × 16 and 40 × 36 cm 2 paper.
Figure 2. Points marked on the 20 × 16 and 40 × 36 cm 2 paper.
Sensors 21 00859 g002
Figure 3. Voltages recorded at an electrode for different contact forces. The distance between the electrode and touched location was 12.8 cm. Five voltage values were recorded for each force.
Figure 3. Voltages recorded at an electrode for different contact forces. The distance between the electrode and touched location was 12.8 cm. Five voltage values were recorded for each force.
Sensors 21 00859 g003
Figure 4. Loci of electrodes on the paper.
Figure 4. Loci of electrodes on the paper.
Sensors 21 00859 g004
Figure 5. Results of the simple regression methods. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) shows the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Figure 5. Results of the simple regression methods. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) shows the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Sensors 21 00859 g005
Figure 6. Results of the voltage ratio method obtained using four or eight electrodes. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) show the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Figure 6. Results of the voltage ratio method obtained using four or eight electrodes. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) show the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Sensors 21 00859 g006
Figure 7. Results of the differential output methods. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) show the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Figure 7. Results of the differential output methods. (a,c,e) show the results for the 20 × 16 cm 2 paper. (b,d,f) show the results for the 40 × 36 cm 2 paper. (a,b) show the results obtained using eight electrodes. (c,d) show the results obtained using four electrodes placed in the corners of the paper. (e,f) show the results obtained using four electrodes placed in the middle of the edges of the paper. The points denote the mean estimated locations for the intersection points, and the error bars denote the standard deviations.
Sensors 21 00859 g007
Figure 8. Voltages measured at an electrode for a finger placed at different distances. The points denote the mean voltages for the seven measurements obtained, and the error bars denote the standard deviation.
Figure 8. Voltages measured at an electrode for a finger placed at different distances. The points denote the mean voltages for the seven measurements obtained, and the error bars denote the standard deviation.
Sensors 21 00859 g008
Table 1. Mean estimation error and standard deviation (cm) for each method.
Table 1. Mean estimation error and standard deviation (cm) for each method.
Localization MethodNumber of Electrodes 20 × 16  cm 2 Paper 40 × 36 cm 2 Paper
Simple regression8 0.48 ± 0.10 1.39 ± 0.55
Simple regression (corner)4 0.84 ± 0.18 2.15 ± 0.63
Simple regression (middle of edges)4 0.36 ± 0.07 0.27 ± 0.10
Voltage ratio8 0.31 ± 0.09 0.69 ± 0.19
Voltage ratio (corner)4 0.93 ± 0.32 3.36 ± 0.69
Voltage ratio (middle of edges)4 0.99 ± 0.79 1.08 ± 0.12
Differential output8 2.42 ± 0.21 4.30 ± 0.82
Differential output (corner)4 1.16 ± 0.19 2.39 ± 0.53
Differential output (middle of edges)4 0.50 ± 0.13 0.31 ± 0.12
Table 2. t and p values for each paper when the method with the smallest error and the others are statistically compared by t-tests without correction of p values. The degrees of freedom were six for all tests.
Table 2. t and p values for each paper when the method with the smallest error and the others are statistically compared by t-tests without correction of p values. The degrees of freedom were six for all tests.
Localization Method 20 × 16 cm 2 Paper 40 × 36 cm 2 Paper
t p t p
Simple regression with 8 electrodes2.970.0251.830.12
Simple regression (corner)2.780.0322.780.032
Simple regression (middle of edges)0.300.78N/AN/A
Voltage ratio with 8 electrodesN/AN/A0.720.50
Voltage ratio with 4 electrodes (corner)8.200.00023.820.009
Voltage ratio with 4 electrodes (middle of edges)3.520.013−0.840.43
Differential output with 8 electrodes9.250.000093.780.0092
Differential output (corner)3.870.0082.480.036
Differential output (middle of edges)1.720.141.0640.33
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hsia, T.H.; Okamoto, S.; Akiyama, Y.; Yamada, Y. HumTouch: Localization of Touch on Semi-Conductive Surfaces by Sensing Human Body Antenna Signal. Sensors 2021, 21, 859. https://doi.org/10.3390/s21030859

AMA Style

Hsia TH, Okamoto S, Akiyama Y, Yamada Y. HumTouch: Localization of Touch on Semi-Conductive Surfaces by Sensing Human Body Antenna Signal. Sensors. 2021; 21(3):859. https://doi.org/10.3390/s21030859

Chicago/Turabian Style

Hsia, Tzu Hsuan, Shogo Okamoto, Yasuhiro Akiyama, and Yoji Yamada. 2021. "HumTouch: Localization of Touch on Semi-Conductive Surfaces by Sensing Human Body Antenna Signal" Sensors 21, no. 3: 859. https://doi.org/10.3390/s21030859

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop