Next Article in Journal
Design and Implementation of Real-Time Localization System (RTLS) Based on UWB and TDoA Algorithm
Next Article in Special Issue
A Survey on Current-Mode Interfaces for Bio Signals and Sensors
Previous Article in Journal
In-Cabin Monitoring System for Autonomous Vehicles
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Low-Computing-Complexity Touch Signal Detection Method and Analog Front-End Circuits Based on Cross-Correlation Technology for Large-Size Touch Panel

1
School of Electronic and Information Engineering, Beihang University, Beijing 100191, China
2
BOE Technology Group Co., Ltd., Beijing 100015, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(12), 4354; https://doi.org/10.3390/s22124354
Submission received: 16 May 2022 / Revised: 6 June 2022 / Accepted: 7 June 2022 / Published: 8 June 2022
(This article belongs to the Special Issue Integrated Circuits and Systems for Smart Sensors)

Abstract

:
This paper proposes a low-computing-complexity touch signal detection method and analog front-end (AFE) circuits based on cross-correlation technology for large mutual capacitance touch screen panels (TSPs). To solve the traditional touch signal detection method problem of lots of invalid data being sampled and processed in a large-size TSP, the proposed method only samples and processes the signals around the touch points rather than full-screen data to decrease the computing complexity and analog–digital convertor (ADC) acquisition number. Compared with the traditional method, the proposed touch points search algorithm complexity decreases from MN to M + nN where M, N, and n are the number of RX channels, TX channels, and touch points, respectively. The maximum ADC acquisition number of the proposed method decreases from MN to 18n. Based on the proposed touch signal detection method, the AFE circuits are designed by a 0.11 μm process. The proposed dual cross-correlation AFE achieves detection of the weak touch signal submerged in the large display panel noise. The average channel area and power consumption are decreased to 0.015 mm2 and 0.227 mW, respectively. The maximum frame rate is 384.6 Hz with 10 touch points. The proposed cross-correlation AFE achieves a high frame rate while reducing the die area and power consumption.

1. Introduction

Nowadays, mutual capacitance touch screen panels (TSPs) are widely used in people’s daily lives due to the advantages of mutual capacitance screens, such as a high light transmission rate, fast response time, long life, and multiple-touch points support [1,2]. The touch signals recognition algorithm and circuits are two essential parts of the mutual capacitance touch system that determine the touch signal recognition capability. The touch signal recognition algorithm cannot be separated from the support of the analog front-end (AFE) circuit. With an increase in TSP size, new challenges arise related to the design of the AFE circuit.
The first challenge is that a large amount of invalid data is sampled and processed for the large-size TSP. Compared with a small-size TSP, the proportion of the untouched area to the total panel area increases significantly for the large-size TSP. Most of the touch screen area is not touched in the large-size touch panel because human fingers occupy only a small area, and most of the data sampled by the analog-digital convertors (ADC) are invalid [3,4]. In other words, the percentage of invalid data sampled by ADC increases correspondingly. A low-computing-complexity acquisition method to solve this problem is proposed in this paper. This method first judges the coarse position of the touch points. Then, only the signals around the touch points are sampled instead of sampling the full-screen data to calculate the precise touch point coordinates. This acquisition method effectively reduces the data acquisition and the requirement of the ADC. Only a low-speed ADC is required to complete the acquisition of touch point peripheral signals. Moreover, the computing complexity of the digital back-end is reduced because of insufficient data.
The second challenge is that the detection of the touch signal becomes more difficult because of the smaller receiving signal and the larger interference noise for the large-size TSP. The touch screen gradually transitions from on-glass to on-cell and in-cell to thin the screen and reduce the cost of the development of the touch screen [1,5]. However, the space between the touch panel and the display driver circuit becomes smaller, the capacitance between the touch panel and the display driver circuit becomes smaller, and the display driver noise on the touch electrode becomes larger [6,7,8,9,10]. In large-size displays, the display drivers are high-voltage circuits, so the display drive noise on the touch electrode further increases, and the touch signal is submerged in the display driver noise [11,12,13]. In addition, the touch electrode becomes longer with the increase in the touch panel size, and the low-frequency external noise is coupled to the touch electrode more easily. Compared with that of the small-size TSP, the signal received in the large-size TSP is smaller due to the larger panel load [7]. Overall, the difficulty of touch signal detection increases due to the smaller receiving signal and the larger noise for the large TSP. In order to detect the weak touch signals submerged in the noise, this paper proposes a novel AFE circuit based on cross-correlation technology to improve the recognition ability of touch signals.
The third challenge is the tradeoff of the high frame rate and small die area for the large-size TSP. There are three main driving methods for mutual capacitive TSP, including the serial driving method, parallel coded driving method, and parallel multi-frequency driving method [14,15,16,17,18,19,20,21,22,23,24,25,26]. The number of electrodes increases with the increase in the mutual capacitance TSP size [27,28]. The serial driving method cannot achieve a high frame rate because the scan time of a frame increases dramatically. The frame rate is reduced due to the long coding sequence in the parallel coding driver method for the large-size TSP [29]. To realize a high frame rate for the large-size TSP, the multi-frequency driving method, which transmits different frequency signals to different transmit channels, is adopted. However, fast Fourier transform (FFT) circuits that occupy a sizeable area are required to distinguish different transmit channels [30,31,32]. The proposed multi-frequency driving AFE circuits distinguish different transmit channels by cross-correlation technology without a complex FFT module for the large-size mutual capacitance TSP to solve this problem. The proposed cross-correlation AFE achieves a high frame rate while reducing the die area and power consumption.
This paper proposes a low computing complexity touch signal detection method and AFE circuits based on cross-correlation technology for large-size mutual capacitance TSPs. The main contributions of this work are as follows:
  • A novel cross-correlation operation AFE architecture and analog cross-correlation computing circuits are proposed;
  • The proposed cross-correlation AFE method achieved the detection of the weak touch signal submerged in the large display panel noise;
  • The proposed cross-correlation multi-frequency driving AFE realizes a high frame rate without complex FFT circuits to reduce the die area and power consumption;
  • The proposed touch signal detection method only samples and processes the signals around the touch points rather than full-screen data to decrease the computing complexity and ADC acquisition number.
The remaining sessions of this paper are organized as follows: Section 2 introduces the technique of touch signal identification under noise drowning, including channel differencing and cross-correlation techniques. Section 3 presents the AFE architecture of the low-computing-complexity acquisition method based on cross-correlation technology. Then, the cross-correlation circuits are described in detail. Section 4 gives the results and a discussion of the proposed method and AFE circuits. Section 5 draws some conclusions.

2. Channel Difference and Cross-Correlation Analysis

2.1. Channel Difference Analysis

The differential operation of two adjacent received channel signals can reduce the interference of common-mode noise and extracts the weak touch signal. Figure 1 shows the two adjacent received channel differential operation circuits and touch panel equivalent circuits with noise sources. TX is the transmitting signal. RXN and RXN+1 are two adjacent receiving signals. In the touch panel equivalent circuit, CTX and CRX are the TX electrode to ground capacitance and RX electrode to ground capacitance, respectively. RTX and RRX are the TX electrode equivalent resistance and RX electrode equivalent resistance, respectively. CM is the mutual capacitance between the TX electrode and the RX electrode. When there is a finger touch, CM changes to CM + ΔCM. Rf and Cf are the feedback resistance and feedback capacitance of the charge amplifier, respectively. The differential function is achieved by subtracting the charge amplifier outputs of two adjacent channels.
Consider display noise VDN and external noise VEN. CD1 is the equivalent capacitance between the display panel and the TX electrode. CD2 is the equivalent capacitance between the display panel and the RX electrode. CE1 is the equivalent capacitance between the external noise source and the TX electrode. CE2 is the equivalent capacitance between the external noise source and the RX electrode. Since the noise interference in the two adjacent received channels is basically the same, the differential operation could effectively eliminate the common noise interference.
According to the superposition theorem, the charge amplifier output voltage VCA1 and VCA2 are:
V C A 1 = H T X ( s ) V T X + H D N ( s ) V D N + H E N ( s ) V E N
V C A 2 = H T X ( s ) V T X + H D N ( s ) V D N + H E N ( s ) V E N ,
where HTX(s), HDN(s), and HEN(s) are the transfer functions of TX signal, display noise, and external noise, respectively, if there is not a touch point. HTX(s), HDN(s), and HEN(s) are the transfer functions of TX signal, display noise, and external noise, respectively, if there is a touch point.
The subtractor output voltage Vsub1 is:
V s u b 1 = V C A 1 V C A 2 = Δ H T X ( s ) V T X + Δ H D N ( s ) V D N + Δ H E N ( s ) V E N .
where ΔHTX(s), ΔHDN(s) and ΔHEN(s) are the difference of transfer functions. ΔHTX(s) = HTX(s) − HTX(s); ΔHDN(s) = HDN(s) − HsDN(s); ΔHEN(s) = HEN(s) − HEN(s).
To solve ΔHTX(s), set VDN and VEN to 0. In the touch panel equivalent circuit, V1 and V2 are two node voltages on both sides of the CM. According to Kirchhoff’s current law, we obtain
V T X V 1 R T X + V 2 V 1 1 s C M = V 1 1 s ( C T X + C D 1 + C E 1 )
V 1 V 2 1 s C M + V C M V 2 R R X = V 2 1 s ( C R X + C D 2 + C E 2 ) ,
where VCM is the common voltage. The voltage of both RXN and RXN+1 is VCM. Let C = CTX + CD1 + CE1 = CRX + CD2 + CE2. Because CM << CTX = CRX, CM << C. The node voltage V2 is:
V 2 = V C M s C R R X + 1 + s C M R R X V T X ( s C R T X + 1 ) ( s C R R X + 1 ) .
Similarly,
V 2 = V C M s C R R X + 1 + s ( C M + Δ C M ) R R X V T X ( s C R T X + 1 ) ( s C R R X + 1 ) .
The charge amplifier output voltage VCA is:
V C A = V C M I R X ( R f | | 1 s C f ) .
where IRX is the current of RX.
The subtractor output voltage Vsub1 is:
V s u b 1 = V C A 1 V C A 2 = ( I R X N + 1 I R X N ) ( R f | | 1 s C f ) = V 2 V 2 R R X ( R f | | 1 s C f ) .
Substituting Equations (6) and (7) into Equation (9), we obtain
V s u b 1 = s R f Δ C M ( s C f R f + 1 ) ( s C R T X + 1 ) ( s C R R X + 1 ) V T X = Δ H T X ( s ) V T X ,
where
Δ H T X ( s ) = s R f Δ C M ( s C f R f + 1 ) ( s C R T X + 1 ) ( s C R R X + 1 ) .
If there is a touch point, the variation of CM is ΔCM. The subtractor output voltage signal does not equal zero. If there is not a touch point, the variation of ΔCM equals zero. The subtractor output voltage signal equals zero.
Similarly, ΔHDN(s) and ΔHEN(s) are functions of ΔCM where ΔHDN(s) = fCM) and ΔHEN(s) = gCM). If there is not a touch point, the variation of ΔCM equals zero. ΔHDN(s) and ΔHEN(s) are equal to zero. If there is a touch point, ΔHDN(s) and ΔHEN(s) do not equal zero. In other words, after the two channels are differenced, there is still residual display noise and external noise.

2.2. Cross-Correlation Analysis

Cross-correlation technology is an effective way to detect weak signals submerged in the noise. If there is a touch point near the touch coordinate (p, q), p is the horizontal ordinate of the RX channel, and q is the vertical ordinate of the TX channel. The transfer function Hpq(s) becomes Hpq(s), where 1 ≤ pM and 1 ≤ qN.
The differential charge amplifier output signal Vsubi(t) of RX channel i is:
V s u b i ( t ) = { Δ H T X ( s ) T X q ( t ) + Δ H D N ( s ) V D N + Δ H E N ( s ) V E N , i = p 0 , i p .
There is a phase difference between the differential charge amplifier output signal and the TX(t). To avoid the result of cross-correlation operation between two signals with a zero frequency, two orthogonal transmitted signals, x(t) and x’(t), with the same frequency, are used for cross-correlation operations. The Fourier expansion form of the transmitted two orthogonal square waves with the same frequency is [33]:
x ( t ) = T X q _ 0 ( t ) = A n = 0 1 2 n + 1 sin ( 2 n + 1 ) ω q t
x ( t ) = T X q _ 90 ( t ) = A n = 0 1 2 n + 1 cos ( 2 n + 1 ) ω q t .
The Fourier expansion of the differential charge amplifier output signal is the superposition of sinusoidal signals, and the differential charge amplifier output signal Vsubp(t) is:
y ( t ) = V s u b p ( t ) = n = 0 b n sin [ ( 2 n + 1 ) ω q t + φ n ] + n ( t ) = v ( t ) + n ( t ) .
where φ is the phase difference between x(t) and y(t). The useful signal is v(t) which is interfered with by noise n(t). n(t) is the residual display noise and external noise.
The cross-correlation function of x(t) and y(t) is [34]:
R x y ( τ ) = lim T 1 2 T T T x ( t ) y ( t + τ ) d t .
If the frequencies of x(t) and n(t) are different, then x(t) and n(t) are independent of each other. In other words, they are not related to each other. The cross-correlation value between x(t) and n(t) equals zero. The cross-correlation function Rxy(τ) of the two signals x(t) and y(t) is:
R x y ( τ ) = E [ x ( t ) × y ( t + τ ) ] = E [ x ( t ) × ( v ( t + τ ) + n ( t + τ ) ) ] = E [ x ( t ) v ( t + τ ) ] + E [ x ( t ) n ( t + τ ) ] = E [ x ( t ) v ( t + τ ) ] = R x v ( τ )
The cross-correlation value of two signals disturbed by noise is the same as that of the useful signal. The cross-correlation operation further eliminates the effect of noise on the useful signal and improves the recognition ability of the touch signal.
The integration time of cross-correlation is directly proportional to the frequency difference between two adjacent transmission channels. The integration time is:
T = 2 π ω q ω q + 1 .
where ωq and ωq+1 are the angular frequency of the TXq channel and TXq+1 channel, respectively. Then, the cross-correlation value of zero delay between x(t) and y(t) is calculated as follows:
R x y ( 0 ) = A 0 T n = 0 b n sin [ ( 2 n + 1 ) ω q t + φ n ] n = 0 1 2 n + 1 sin ( 2 n + 1 ) ω q t d t = π A ω q ω q + 1 n = 0 b n cos φ n 2 n + 1
The touch screen equivalent circuit is a band-pass filter. The high harmonic attenuation amplitude is greater than the fundamental frequency signal when transmitting a square wave signal through the touch screen. The high harmonic receiving signal amplitude is much smaller than the fundamental frequency receiving signal amplitude. The cross-correlation value can be approximated as follows:
R x y ( 0 ) π A b 0 ω q ω q + 1 cos φ 0 = k 1 cos φ 0 ,
where k1 is a constant, and
k 1 = π A b 0 ω q ω q + 1 .
Similarly,
R x y ( 0 ) k 1 sin φ .
The results of the two cross-correlation operations must not be zero at the same time. The squares of the two cross-correlation results are added to obtain a value independent of the phase difference:
R x y ( 0 ) 2 + R x y ( 0 ) 2 = k 1 2 .
In using this principle, the cross-correlation value independent of the phase difference can be obtained. The weak signal submerged in the display panel noise could be detected by cross-correlation technology.

3. The Proposed Low-Computing-Complexity Acquisition Analog Front-End

3.1. The Architecture of the Proposed Low-Computing-Complexity AFE

In the mutual capacitive touch system, the AFE transmits a series of orthogonal signals to the touch panel. When there are touch points on the screen, the signals of the corresponding channel received by AFE will change. The touch point coordinates can be obtained by cross-correlation calculation between the changed received signals and the transmitted signals.
The architecture of the proposed low-computing-complexity acquisition AFE circuit is shown in Figure 2. The AFE circuit is composed of TX channels, an RX judgment module, a TX judgment module, a cross-correlation precise acquisition module with a 200 kHz 12-bit SAR-VCO ADC, and three 10-bit digital to analog convertors (DACs). Each TX channel transmits square wave signals with different frequencies to drive the touch panel. At the same time, quadrature square wave signals are generated for the TX judgment module and precise acquisition module. In the RX judgment module, the two adjacent RX signals are subtracted to reduce the influence of display noise by a differential amplifier. This is because the current signal realizes multiplication easier compared with a voltage signal. The voltage to current (VI) converter converts the differential amplifier output voltage signal to a current signal. The current signals are sent into the cross-correlation circuits in the RX judgment module, TX judgment module, and precise acquisition module. The DAC generates three reference voltages for the RX judgment module and TX judgment module. The threshold judgment circuits are provided with a large fault tolerance to avoid the influence of circuit mismatch and residual noise.
Figure 3 shows the operation sequence diagram of the proposed low-computing-complexity touch point detection method. A pipeline design is adopted to ensure that each module is fully utilized and to improve the frame rate.
The detailed steps of the proposed touch point recognition algorithm are as follows:
  • Step 1: The cross-correlation operation of the RX signal and RX signal passing through the symbol function realizes the on/off judgment function of the touch point of the RX channel;
  • Step 2: The cross-correlation operations of the RX signal with the touch point and each TX signal realize the on/off judgment function of the touch point of the TX channel. Rough touch point coordinates are obtained after the above two steps;
  • Step 3: The cross-correlation values around the touch point are sampled precisely by the 12-bit SAR-VCO ADC and sent to MCU;
  • Step 4: The touch point coordinates are accurately calculated with MCU and mapped to display coordinates.
If there are multiple touch points at the same time, repeat steps 2–4 multiple times until all touch points are calculated.
Figure 4 is the data flow diagram of the proposed cross-correlation precise acquisition and calculation in the touch system. The cross-correlation operation is realized by the analog circuit in the AFE, and the sum square of two cross-correlation values is realized in MCU. The results of the cross-correlation operation are sent to ADC for acquisition successively.

3.2. The Circuit Implementation of the Proposed Cross-Correlation AFE

3.2.1. The RX Judgment Circuit

Figure 5 and Figure 6 present the scheme and the working sequence of the proposed RX judgment circuit. The cross-correlation circuit and threshold judgment circuit constitute the proposed RX judgment circuit. The cross-correlation circuit is composed of a multiplier and an integrator.
The voltage to current convertor output current I1 is:
I 1 = G m V s u b .
where Gm is the transconductance of the VI convertor. The multiplier is a cascade current mirror. Only parts of I1 less than zero are copied. The output current I2 of the multiplier is:
I 2 = k 2 I 1 · sgn ( I 1 ) + 1 2 ,
where k2 is the current mirror magnification. If I1 is greater than zero, I2 is zero. If I1 is less than zero, I2 equals −k2I1. The integrator output signal VINT1 is:
V I N T 1 = V C M 1 C 0 T I 2 ( t ) d t = V C M k 2 G m 2 C 0 T V s u b ( t ) × sgn ( V s u b ( t ) ) d t = V C M k 3 R y z ( 0 )
where k3 is a constant and k3 = k2Gm/2C. z(t) is the output signal of Vsub(t) passing through the symbol function, and z(t) = sgn[Vsub(t)]. Ryz(0) is the cross-correlation function between Vsub(t) and z(t) when the delay time equals zero. The value of cross-correlation must be greater than zero at a time delay of zero if there is a touch point.
The threshold judgment circuit is a comparator that avoids the influence of front-stage circuits mismatch and residual noise. Ideally, if there is not a touch point on the RX channel, the value of VINT1 equals the common voltage. Actually, the value of VINT1 does not equal the common voltage due to the circuits mismatch and noise. It can be concluded that there is no touch point on the RX channel if VINT1 is greater than Vref1. If the cross-correlation output in the RX judgment module is less than the threshold voltage Vref1, it can be concluded that there is a touch point on the RX channel. The comparator output signal VOUT1 is at a high level when VINT1 is less than threshold voltage Vref1.
V O U T 1 = { 1 , V I N T 1 < V r e f 1 0 , V I N T 1 V r e f 1

3.2.2. The TX Judgment Circuit

Figure 7 presents the proposed cross-correlation circuit and threshold judgment circuit in each TX judgment channel. A TX judgment channel is composed of two cross-correlation circuits and a judgment circuit. The selected VI convertor output with touch point performs a cross-correlation operation with TX signals of 0° phase and 90° phase. RST is a reset signal, and the reset time is set to 10μs. The cross-correlation operation time is adjustable to achieve different frame rates. The value of feedback capacitance C in an integrator whose size is 20 × 16 μm is 3.12 pF.
In the multiplier, TX_0° and T X _ 0 ° ¯ are a pair of square signals whose phases are opposite. If TX_0° is high level, the current mirror in the multiplier copies the input current signal Isubp. If TX_0° is low level, the current mirror in the multiplier output current equals zero. The multiplication operation is realized by a simple current mirror with a pair of control switches. The integrator output signal VINT2 is:
V I N T 2 = V C M k 4 C 0 T I s u b p ( t ) × x ( t ) d t = V C M k 4 G m C 0 T V s u b ( t ) × x ( t ) d t = V C M k 5 R y x ( 0 )
where k4 and k5 are two constants; k4 is the current mirror magnification of the multiplier and k5 = k4Gm/C.
Similarly,
V I N T 3 = V C M k 5 R y x ( 0 ) .
The threshold judgment module is composed of two comparators and three two inputs or gates. The threshold judgment circuit avoids the influence of front-stage circuits mismatch and residual noise. Ideally, if there is not a touch point on the TX channel, the values of VINT2 and VINT3 are equal to the common voltage. Actually, the values of VINT2 and VINT3 do not equal the common voltage due to the circuits mismatch and noise. It can be concluded that there is no touch point on the TX channel if both VINT2 and VINT3 are greater than Vref2 and less than Vref3. The output signal VOUT2 of the threshold judgment is:
V O U T 2 = { 1 , V I N T 2 < V r e f 2   | |   V I N T 2 > V r e f 3   | |   V I N T 3 < V r e f 2   | |   V I N T 3 > V r e f 3 0 , V r e f 2 V I N T 2 V r e f 3   &   V r e f 2 V I N T 3 V r e f 3 .
It can be concluded that there is a touch point on this TX channel if there is a cross-correlation value less than the threshold voltage Vref2 or greater than the threshold voltage Vref3.

3.2.3. The Precise Cross-Correlation Sample Circuit

Figure 8 presents the scheme of the proposed cross-correlation circuit, sample and hold circuit, and working sequence. Signal Iin is a selected VI convertor output current signal that is the amplified RX signal with a touch point. TX and T X ¯ are two opposite square signals selected from TX channels, which are a pair of in-phase signals or quadrature signals. TX and T X ¯ is used to control the opening and closing of the switch to realize the multiplication of TX and Iin.
The cross-correlation value is sampled by the sample and hold circuits. S1 and S2 are two-phase non-overlapping clocks. If S1 is high level, the sample and hold circuits work in the sample state. The sample capacitance upper plate voltage equals VINT4. If S2 is high level, the sample and hold circuits work in the hold state. The output voltage VOUT3 equals the sample capacitance upper plate voltage. For the next frame of the cross-correlation operations, the cross-correlation values of the previous frame are converted by the 12-bit ADC. The nine data points around the touch point are sampled. Each point contains two cross-correlation values. The 18 cross-correlation values are converted to digital signals by the ADC successively.
The 18 cross-correlation values around the touch point are calculated and fitted with a parabolic equation by MCU. The vertex coordinate of the parabolic equation is the precise touch point coordinate.

4. Results and Discussion

The proposed cross-correlation AFE is designed by the 110 nm CMOS process. Figure 9 shows the layout of the proposed AFE. The total size and active size of the proposed cross-correlation AFE are 2250 × 1080 μm and 1728 × 572 μm, respectively. The average area of the proposed cross-correlation AFE is merely 0.015 mm2/channel.
Figure 10 is the power consumption of the proposed cross-correlation AFE. The total power consumption of the proposed cross-correlation AFE is 14.55 mW. There are 32 TX channels and 32 RX channels in the proposed AFE. The total number of channels in the proposed AFE is 64. So, the average channel power consumption is 0.227 mW/channel.
Figure 11 shows the cross-correlation value variation with the TX and subtractor output signal phase difference variation. If there is a phase difference between the TX and subtractor output signal, the cross-correlation value varies with a different phase difference. The sum of squares of the two cross-correlation values is independent of the phase difference.
Figure 12 and Figure 13 show the time-domain waveform of the RX judgment module and TX judgment module in the proposed cross-correlation AFE circuit, respectively. In Figure 12a, if there is a touch point on the RX channel, the VI convertor output signal is not zero. The cross-correlation calculation result of the VI convertor output signal and symbol function decreases gradually with an increase in integration time. The threshold judgment output jumps to a high level until the cross-correlation result is less than the threshold voltage Vref1. In Figure 12b, if there is not a touch point on the RX channel, the VI convertor output signal is zero, the cross-correlation calculation result of the VI convertor output signal and symbol function is zero, and the threshold judgment output is low level all the time. In Figure 13a, if there is a touch point on the TX channel, the cross-correlation calculation result of the VI convertor output signal and TX signal decreases or increases gradually with an increase in integration time. The threshold judgment output becomes high level until the cross-correlation result is less than the threshold voltage Vref2 or greater than the threshold voltage Vref3. In Figure 13b, if there is not a touch point on the TX channel, the cross-correlation calculation result of the VI convertor output signal and TX signal oscillates around zero. Moreover, the threshold judgment output is low level all the time.
Figure 14 shows the computing complexity of the traditional method and the proposed method, with the different number of RX channels and the different number of touch points in a frame. The ratio of the number of RX channels to the number of TX channels is 16:9. Assuming the number of RX channels and TX channels are M and N, respectively, the number of touch points is n. The computing complexity of the traditional peak search algorithm in MCU is MN because a traditional AFE processes the whole panel data. In the proposed cross-correlation AFE, the computing complexity of the RX judgment algorithm is M. The single time computing complexity of the TX judgment algorithm is N. The biggest computing complexity of the TX judgment algorithm is nN if there are n touch points. So, the computing complexity of the peak search algorithm in MCU is reduced from MN to M + nN. Since n is much less than M, M + nN is much less than MN. If there are 10 touch points in a frame, the maximum computing complexity of the proposed low-computing-complexity touch point search algorithm is M + 10N. The ratio of computing complexity of the proposed method versus the traditional method in a frame decreases significantly with an increase in the touch panel size. The power consumption of MCU decreases because of the reduction in computing complexity.
Figure 15 presents the maximum frame rate and the number of ADC acquisition variations with the different touch points. The frame rate is up to 10 kHz when determining the presence or absence of touch points. The maximum precise acquisition frame rate is 3846 Hz and 384.6 Hz with 1 touch point and 10 touch points, respectively. The frame rate could be set to smaller than the maximum frame rate by adjusting cross-correlation time and reset time to map different devices and screens. We also could set a smaller frame rate to sample more than 10 touch points in a frame. The ADC acquisition number of the traditional method is MN in a frame. The ADC acquisition number of the proposed method is 18n. If there are 10 touch points in a frame, the maximum ADC acquisition number of the proposed AFE is 180. The ratio of the ADC acquisition number in a frame in the proposed method versus the traditional method decreases significantly with an increase in the touch panel size. The ADC requirement is decreased by the proposed touch signal detection method. There is only an ADC in the proposed AFE. Assuming we adopt the same ADC in the traditional AFE, the number of ADCs is the same as the number of RX channels so as to achieve the same frame rate. There are 32 ADCs in the traditional AFE if the number of RX channels is 32. The power consumption and area of the ADCs in the proposed AFE are 1/32 of the power consumption and area of the ADCs in the traditional AFE. Therefore, the power consumption and die area of the proposed cross-correlation AFE are reduced significantly.
Table 1 provides a simulated performance summary of the proposed cross-correlation AFE in comparison with previous work. Compared with others’ work, the proposed AFE significantly decreases the average single area and power consumption to 0.015 mm2 and 0.227 mW, respectively. The signal-to-noise ratio (SNR) of the AFE is defined as follows [16,35]:
SNR = 20 log S T o u c h N T o u c h R M S 100 ,
where STouch and NTouchRMS100 are defined as follows:
S T o u c h = S i g n a l T o u c h , A V G 100 S i g n a l U n t o u c h , A V G 100
N T o u c h R M S 100 = n = 0 99 ( S i g n a l T o u c h [ n ] S i g n a l T o u c h , A V G 100 ) 2 100 ,
where SignalTouch,AVG100 and SignalUntouch,AVG100 are the average of the 100 cross-correlation values with the touch point and without the touch point, respectively. RMS100 is the root mean square of 100 data points. The proposed AFE achieves a 46.1 dB SNR with large capacitance and resistance loads for the 65-inch panel.

5. Conclusions

In this paper, a touch signal detection method of low computing complexity based on cross-correlation technology for large-size mutual capacitance TSP is proposed. The proposed low computing complexity touch method only samples and calculates the data around the touch points without sampling and calculating the full-screen data to improve the sampling and calculation efficiency. Compared with the traditional method, the proposed touch points search algorithm complexity decreases from MN to M + nN. The maximum ADC acquisition number of the proposed method decreases from MN to 18n. The touch point search algorithm complexity and ADC acquisition number decrease significantly.
The proposed cross-correlation AFE could detect the weak touch signal submerged in the large display panel noise. The proposed dual cross-correlation acquisition method eliminates the influence of the phase difference between the transmit and receive signals. The proposed AFE reaches 46.1 dB SNR for the 65-inch TSP. The proposed multi-frequency driving AFE circuits distinguish different transmit channels by cross-correlation technology without a complex FFT module for the large mutual capacitance TSP to reduce the die area and power consumption. The average channel area and power consumption of the proposed AFE are reduced to 0.015 mm2 and 0.227 mW, respectively. The maximum frame rate reaches 3864 Hz or 386.4 Hz if there is 1 touch point or 10 touch points, respectively. The frame rate is adjustable to map different devices. The proposed cross-correlation AFE achieves a high frame rate without increasing the die area and power consumption.

Author Contributions

Methodology and writing, X.G.; conceptualization, project administration, and supervision, H.L.; data curation and formal analysis, Y.C.; resources, software and funding acquisition, W.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

Thanks for BOE providing touch panel and touch data support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kwon, O.K.; An, J.S.; Hong, S.K. Capacitive touch systems with styli for touch sensors: A review. IEEE Sens. J. 2018, 18, 4832–4846. [Google Scholar] [CrossRef]
  2. Jang, H.; Shin, H.; Lee, J.; Yoo, C.; Chun, K.; Yun, I. A 51dB-SNR 120Hz-scan-rate 32 × 18 segmented-VCOM LCD in-cell touch-display-driver IC with 96-channel compact shunt-sensing self-capacitance analog front-end. In Proceedings of the 2020 IEEE International Solid- State Circuits Conference (ISSCC), San Francisco, CA, USA, 16–20 February 2020. [Google Scholar]
  3. Heo, S.; Ma, H.; Song, J.; Park, K.; Choi, E.-H.; Kim, J.J.; Bien, F. 72 dB SNR, 240 Hz Frame Rate Readout IC With Differential Continuous-Mode Parallel Architecture for Larger Touch-Screen Panel Applications. IEEE Trans. Circuits Syst. I Regul. Pap. 2016, 63, 960–971. [Google Scholar] [CrossRef]
  4. Hu, Y.S.; Huang, L.Y.; Chen, H.S. A 0.6 V 1.63 fJ/c.-s. detective open-loop dynamic system buffer for SAR ADC in zero-capacitor TDDI system. IEEE J. Solid-State Circuits 2019, 54, 2680–2690. [Google Scholar] [CrossRef]
  5. Jang, Y.-S.; Ko, Y.-H.; Choi, J.-M.; Oh, H.-S.; Lee, S.-G. A 45-dB, 150-Hz, and 18-mW Touch Controller for On-Cell Capacitive TSP Systems. IEEE Trans. Circuits Syst. II Express Briefs 2014, 61, 748–752. [Google Scholar] [CrossRef]
  6. Lee, C.-J.; Park, J.K.; Piao, C.; Seo, H.-E.; Choi, J.; Chun, J.-H. Mutual Capacitive Sensing Touch Screen Controller for Ultrathin Display with Extended Signal Passband Using Negative Capacitance. Sensors 2018, 18, 3637. [Google Scholar] [CrossRef] [Green Version]
  7. Park, J.; Hwang, Y.H.; Oh, J.; Song, Y.; Park, J.E.; Jeong, D.K. A mutual capacitance touch readout IC with 64% reduced-power adiabatic driving over heavily coupled touch screen. IEEE J. Solid-State Circuits 2019, 54, 1694–1704. [Google Scholar] [CrossRef]
  8. Ko, S.H.; Yang, B.D. An Ultra-Compact Low Power Self-Capacitive Touch Screen Readout IC Embedding Reconfigurable Noise Immunity and Current-Driven Capacitance Compensation. IEEE Trans. Circuits Syst. II Express Briefs 2018, 66, 1321–1325. [Google Scholar] [CrossRef]
  9. Park, K.; Oh, S.; Heo, S.; Shin, S.; Bien, F. 17-aFrms resolution noise-immune fingerprint scanning analog front-end for under-glass mutual-capacitive fingerprint sensors. IEEE Tran. Circuits Syst. I Reg. Pap. 2021, 69, 1135–1147. [Google Scholar] [CrossRef]
  10. Hussaini, S.; Jiang, H.; Walsh, P.; MacSweeney, D.; Makinwa, K.A. A 15-nW per Sensor Interference-Immune Readout IC for Capacitive Touch Sensors. IEEE J. Solid-State Circuits 2019, 54, 1874–1882. [Google Scholar] [CrossRef] [Green Version]
  11. Ko, S.H. A −24 dB in-Band Noise-Immunity Mutual Capacitance Readout System for Variable Refresh Rate of Active-Matrix OLED Display. IEEE Trans. Circuits Syst. I Regul. Pap. 2019, 67, 1126–1135. [Google Scholar] [CrossRef]
  12. Park, E.; Park, J.; Hwang, Y.H.; Oh, J.; Jeong, D.K. A noise-immunity-enhanced analog front-end for 36 × 64 touch-screen controllers with 20-Vpp noise tolerance at 100 kHz. IEEE J. Solid-State Circuits 2019, 54, 1497–1510. [Google Scholar] [CrossRef]
  13. Lim, G.W.; Kang, G.G.; Ma, H.; Jeong, M.; Kim, H.S. A 10b source-driver IC with LSB-stacked LV-to-HV-amplify DAC achieving 2688 μm2/channel and 4.8 mV DVO for mobile OLED displays. In Proceedings of the 2022 IEEE International Solid- State Circuits Conference (ISSCC), San Francisco, CA, USA, 20–26 February 2022. [Google Scholar]
  14. Lee, C.-J.; Park, J.K.; Seo, H.-E.; Huh, J.; Chun, J.-H. Fully Differential Touch Screen Controller with Wide Input Dynamic Range for Thin Displays. Sensors 2020, 20, 837. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. An, J.-S.; Han, S.-H.; Kim, J.E.; Yoon, D.-H.; Kim, Y.-H.; Hong, H.-H.; Ye, J.-H.; Jung, S.-J.; Lee, S.-H.; Jeong, J.-Y.; et al. A 3.9-kHz Frame Rate and 61.0-dB SNR Analog Front-End IC With 6-bit Pressure and Tilt Angle Expressions of Active Stylus Using Multiple-Frequency Driving Method for Capacitive Touch Screen Panels. IEEE J. Solid-State Circuits 2017, 53, 187–203. [Google Scholar] [CrossRef]
  16. Miyamoto, M.; Hamaguchi, M.; Nagao, A. A 143 × 81 mutual capacitance touch-sensing analog front-end with parallel drive and differential sensing Architecture. IEEE J. Solid-State Circuits 2014, 50, 335–343. [Google Scholar] [CrossRef]
  17. Miura, N.; Dosho, S.; Tezuka, H.; Miki, T.; Fujimoto, D.; Kiriyama, T.; Nagata, M. A 1 mm pitch 80 × 80 channel 322 Hz frame-rate multitouch distribution sensor with two-step dual-mode capacitance scan. IEEE J. Solid-State Circuits 2015, 50, 2741–2749. [Google Scholar] [CrossRef]
  18. Seong, S.; Lee, S.; Bae, S.; Lee, M. Alternating panel charge sharing technique for touch screen panel self-capacitance sensing IC. Electron. Lett. 2020, 56, 1103–1105. [Google Scholar] [CrossRef]
  19. Kong, B.Y.; Lee, J.; Park, I.C. A low-latency multi-touch detector based on concurrent processing of redesigned overlap split and connected component analysis. IEEE Tran. Circuits Syst. I Reg. Pap. 2020, 67, 166–176. [Google Scholar] [CrossRef]
  20. Hwang, H.; Lee, H.; Han, M.; Kim, H.; Chae, Y. A 1.8-V 6.9-mW 120-fps 50-Channel capacitive touch readout with current conveyor AFE and current-driven ΔΣ ADC. IEEE J. Solid-State Circuits 2018, 53, 204–218. [Google Scholar] [CrossRef]
  21. Du, L.; Zhang, Y.; Liu, C.C.; Tang, A.; Hsiao, F.; Chang, M.C.F. A 2.3-mW 11-cm range bootstrapped and correlated-double-sampling three-dimensional touch sensing circuit for mobile devices. IEEE Trans. Circuits Syst. II Exp. Briefs 2016, 64, 96–100. [Google Scholar] [CrossRef]
  22. Huh, Y.; Hong, S.W.; Park, S.H.; Shin, C.; Bang, J.S.; Park, C.; Park, S.; Cho, G.H. A 10.1” 183 μW/electrode, 0.73-mm2/sensor high-SNR 3-D hover sensor based on enhanced signal refining and fine error calibrating techniques. IEEE J. Solid-State Circuits 2018, 53, 1079–1088. [Google Scholar] [CrossRef]
  23. Choi, E.; Kim, S.; Park, K.; Heo, S.; Ma, H.; Namgoong, G.; Kim, H.; Bien, F. A 32-dB SNR readout IC with 20-Vpp Tx using on-chip DM-TISM in HV BCD process for mutual-capacitive fingerprint sensor. IEEE Trans. Circuits Syst. II Exp. Briefs 2019, 67, 1224–1228. [Google Scholar] [CrossRef]
  24. Song, T.G.; Kim, D.K.; Cho, J.H.; Lee, J.H.; Kim, H.S. A 50.7-dB-DR finger-resistance extracting multi-touch sensor IC for soft classification of fingers contacted on 6.7-in capacitive touch screen panel. IEEE J. Solid-State Circuits 2021, 56, 3470–3485. [Google Scholar] [CrossRef]
  25. An, J.S.; Ra, J.H.; Kang, E.; Pertijs, M.A.; Han, S.H. A readout IC for capacitive touch screen panels with 33.9 dB charge-overflow reduction using amplitude-modulated multi-frequency excitation. IEEE J. Solid-State Circuits 2021, 56, 3486–3498. [Google Scholar] [CrossRef]
  26. Guo, X.; Li, H. A novel analog-front-end circuit of the touch system for display panel. In Proceedings of the 20th IEEE International NEWCAS Conference, Quebec City, QC, Canada, 19–22 June 2022. [Google Scholar]
  27. Kim, S.; Cho, S.; Pu, Y.; Yoo, S.S.; Lee, M.; Hwang, K.C.; Lee, K.Y. A 39.5-dB SNR, 300-Hz frame-rate, 56 × 70 channel read-out IC for electromagnetic resonance touch panels. IEEE Trans. Ind. Electron. 2017, 65, 5001–5011. [Google Scholar] [CrossRef]
  28. Kim, S.Y.; Samadpoor, R.B.; Pu, Y.G. A high noise immunity, 28 × 16 channel finger touch sensing IC using OFDM and frequency translation technique. Sensors 2018, 18, 1652. [Google Scholar] [CrossRef] [Green Version]
  29. Heo, S.; Park, K.; Choi, E.H.; Bien, F. Differential coded multiple signaling method with fully differential receiver for mutual capacitive fingerprint TSP. IEEE Trans. Circuits Syst. I Reg. Pap. 2019, 67, 74–85. [Google Scholar] [CrossRef]
  30. An, J.S.; Han, S.H.; Park, K.B.; Kim, J.E.; Ye, J.H.; Lee, S.H.; Kwon, O.K. Multi-way interactive capacitive touch system with palm rejection of active stylus for 86” touch screen panels. In Proceedings of the 2018 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA, 11–15 February 2018. [Google Scholar]
  31. Park, S.H.; Kim, H.S.; Bang, J.S.; Cho, G.H.; Cho, G.H. A 0.26-nJ/node, 400-kHz Tx driving, filtered fully differential readout IC with parasitic RC time delay reduction technique for 65-in 169 × 97 capacitive-type touch screen panel. IEEE J. Solid-State Circuits 2016, 52, 528–542. [Google Scholar] [CrossRef]
  32. An, J.S.; Han, S.H.; Ye, J.H. A sensing mode reconfigurable analog front-end IC for capacitive touch and a-IGZO TFT-based active-matrix capacitive fingerprint sensors. IEEE Sens. J. 2019, 19, 11544–11552. [Google Scholar] [CrossRef]
  33. Cheon, J.; Lee, D.; Choi, H. A CMOS image sensor with a novel passive pixel array and high precision current amplifier for a compact digital X-ray detector. J. Med. Imaging Health Inform. 2020, 10, 2745–2753. [Google Scholar] [CrossRef]
  34. Heydari, P. Noise analysis of passive sampling mixers using auto- and cross-correlation functions. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Korea, 22–28 May 2021. [Google Scholar]
  35. ATMEL. Touch Sensors Design Guide; 10620E-AT42; ATMEL: San Jose, CA, USA, 2004. [Google Scholar]
Figure 1. Two adjacent received channel differential operation circuits and touch panel equivalent circuits with noise sources.
Figure 1. Two adjacent received channel differential operation circuits and touch panel equivalent circuits with noise sources.
Sensors 22 04354 g001
Figure 2. The architecture of the proposed low-computing-complexity AFE circuit based on cross-correlation operation.
Figure 2. The architecture of the proposed low-computing-complexity AFE circuit based on cross-correlation operation.
Sensors 22 04354 g002
Figure 3. The operation sequence diagram of the proposed low-computing-complexity touch point detection method.
Figure 3. The operation sequence diagram of the proposed low-computing-complexity touch point detection method.
Sensors 22 04354 g003
Figure 4. The data flow diagram of the proposed cross-correlation precise acquisition and calculation in the touch system.
Figure 4. The data flow diagram of the proposed cross-correlation precise acquisition and calculation in the touch system.
Sensors 22 04354 g004
Figure 5. The scheme of the proposed RX judgment circuit.
Figure 5. The scheme of the proposed RX judgment circuit.
Sensors 22 04354 g005
Figure 6. The working sequence of the proposed RX judgment circuit.
Figure 6. The working sequence of the proposed RX judgment circuit.
Sensors 22 04354 g006
Figure 7. The scheme of the proposed cross-correlation circuit and threshold judgment circuit in the TX judgment circuit.
Figure 7. The scheme of the proposed cross-correlation circuit and threshold judgment circuit in the TX judgment circuit.
Sensors 22 04354 g007
Figure 8. The scheme and working sequence of the proposed cross-correlation circuit, sample, and hold circuit. (a) The scheme; (b) the working sequence.
Figure 8. The scheme and working sequence of the proposed cross-correlation circuit, sample, and hold circuit. (a) The scheme; (b) the working sequence.
Sensors 22 04354 g008
Figure 9. The layout of the proposed low-computing-complexity cross-correlation AFE.
Figure 9. The layout of the proposed low-computing-complexity cross-correlation AFE.
Sensors 22 04354 g009
Figure 10. The power consumption of the proposed cross-correlation AFE.
Figure 10. The power consumption of the proposed cross-correlation AFE.
Sensors 22 04354 g010
Figure 11. The cross-correlation value variation with the TX and subtractor output signal phase difference variation.
Figure 11. The cross-correlation value variation with the TX and subtractor output signal phase difference variation.
Sensors 22 04354 g011
Figure 12. The time-domain waveform of the RX judgment module in the proposed cross-correlation AFE circuit. (a) Touched RX judgment output; (b) untouched RX judgment output.
Figure 12. The time-domain waveform of the RX judgment module in the proposed cross-correlation AFE circuit. (a) Touched RX judgment output; (b) untouched RX judgment output.
Sensors 22 04354 g012
Figure 13. The time-domain waveform of the TX judgment module in the proposed cross-correlation AFE circuit. (a) Touched TX judgment output; (b) untouched TX judgment output.
Figure 13. The time-domain waveform of the TX judgment module in the proposed cross-correlation AFE circuit. (a) Touched TX judgment output; (b) untouched TX judgment output.
Sensors 22 04354 g013
Figure 14. The computing complexity of the traditional method and the proposed method, with the different number of RX channels and the different number of touch points in a frame.
Figure 14. The computing complexity of the traditional method and the proposed method, with the different number of RX channels and the different number of touch points in a frame.
Sensors 22 04354 g014
Figure 15. The maximum frame rate and number of ADC acquisitions varies with a different number of touch points.
Figure 15. The maximum frame rate and number of ADC acquisitions varies with a different number of touch points.
Sensors 22 04354 g015
Table 1. Performance summary.
Table 1. Performance summary.
ParametersJSSC
2019 [12]
CAS-I
2020 [11]
Sensors J.
2019 [32]
JSSC
2021 [24]
Sensors
2020 [14]
This Work
Process0.18 μm0.13 μm0.13 μm0.18 μm0.35 μm0.11 μm
Supply3.3 V3 V3.3/20 V3.3 V3.3 V1.2/3.3 V
Frame Rate120 Hz240 Hz120 Hz120 Hz250 Hz~3846 Hz@ 1 point;
~384.6 Hz@ 10 points
ChannelsTX: 36; RX: 64TX: 31; RX: 15128 × 72TX: 8; RX: 17TX: 15; RX: 12TX: 32; RX: 32
Total Channels10046200252762
Power94.5 mW11.5 mW65.31 mW12 mW10.4 mW14.55 mW
Average Power0.945
mW/channel
0.25
mW/channel
0.327
mW/channel
0.48
mW/channel
0.385
mW/channel
0.227
mW/channel
Active Area36 mm21.49 mm256.25 mm23.04 mm24.1 mm20.988 mm2
Average Area0.36
mm2/channel
0.032
mm2/channel
0.281
mm2/channel
0.122
mm2/channel
0.152
mm2/channel
0.015
mm2/channel
SNR54 dB54.2 dB47.8 dB37.5 dB41 dB46.1 dB
Application12.2 inch5.3 inch32 inch6.7 inchN/A65 inch
ADC Number32311281 (shared)51
Computing ComplexityMNMNMNMNMNM + nN
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Guo, X.; Li, H.; Chen, Y.; Sun, W. A Low-Computing-Complexity Touch Signal Detection Method and Analog Front-End Circuits Based on Cross-Correlation Technology for Large-Size Touch Panel. Sensors 2022, 22, 4354. https://doi.org/10.3390/s22124354

AMA Style

Guo X, Li H, Chen Y, Sun W. A Low-Computing-Complexity Touch Signal Detection Method and Analog Front-End Circuits Based on Cross-Correlation Technology for Large-Size Touch Panel. Sensors. 2022; 22(12):4354. https://doi.org/10.3390/s22124354

Chicago/Turabian Style

Guo, Xiaoyu, Hongge Li, Yuhao Chen, and Wei Sun. 2022. "A Low-Computing-Complexity Touch Signal Detection Method and Analog Front-End Circuits Based on Cross-Correlation Technology for Large-Size Touch Panel" Sensors 22, no. 12: 4354. https://doi.org/10.3390/s22124354

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop