Next Article in Journal
Uplink NOMA-MIMO Systems with Rayleigh Power Distribution
Previous Article in Journal
Fast Fault Diagnosis in Industrial Embedded Systems Based on Compressed Sensing and Deep Kernel Extreme Learning Machines
Previous Article in Special Issue
Comprehensive Review on Wearable Sweat-Glucose Sensors for Continuous Glucose Monitoring
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Artificial Neurons on Flexible Substrates: A Fully Printed Approach for Neuromorphic Sensing

by
Surya A. Singaraju
1,*,
Dennis D. Weller
1,2,
Thurid S. Gspann
1,
Jasmin Aghassi-Hagmann
1,* and
Mehdi B. Tahoori
2
1
Institute of Nanotechnology, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
2
Institute of Computer Science & Engineering, Karlsruhe Institute of Technology, Kaiserstrasse 12, 76131 Karlsruhe, Germany
*
Authors to whom correspondence should be addressed.
Sensors 2022, 22(11), 4000; https://doi.org/10.3390/s22114000
Submission received: 30 March 2022 / Revised: 16 May 2022 / Accepted: 18 May 2022 / Published: 25 May 2022
(This article belongs to the Special Issue Smart Sensors for Wearable Applications)

Abstract

:
Printed electronic devices have demonstrated their applicability in complex electronic circuits. There is recent progress in the realization of neuromorphic computing systems (NCSs) to implement basic synaptic functions using solution-processed materials. However, a fully printed neuron is yet to be realised. We demonstrate a fully printed artificial neuromorphic circuit on flexible polyimide (PI) substrate. Characteristic features of individual components of the printed system were guided by the software training of the NCS. The printing process employs graphene ink for passive structures and In 2 O 3 as active material to print a two-input artificial neuron on PI. To ensure a small area footprint, the thickness of graphene film is tuned to target a resistance and to obtain conductors or resistors. The sheet resistance of the graphene film annealed at 300 °C can be adjusted between 200 Ω and 500 k Ω depending on the number of printed layers. The fully printed devices withstand a minimum of 2% tensile strain for at least 200 cycles of applied stress without any crack formation. The area usage of the printed two-input neuron is 16.25 mm 2 , with a power consumption of 37.7 mW, a propagation delay of 1 s, and a voltage supply of 2 V, which renders the device a promising candidate for future applications in smart wearable sensors.

Graphical Abstract

1. Introduction

1.1. Printed Electronics in Neuromorphic Sensing

Printed electronics (PE) are an emerging fabrication technology that5 enable new innovative products and application fields to drive the ever-increasing intelligent sensor market through smart front-end devices. It can substantially decrease manufacturing costs and the time to market, and allows for hardware with a flexible form factor. New application domains that require low-cost flexible electronics are targeted, since conventional silicon-based technologies possess form-factor limitations [1,2,3]. Typical applications are soft sensors [4,5], soft robotics [6,7,8], flexible wearable medical devices [9], fast-moving smart consumer goods [2,10,11], or Internet of Things (IoT) infrastructures [12]. Similar to conventional silicon technology, sensor preconditioning and processing can also be performed for printed technology [13], preferably with the deployment of power- and area-efficient neuromorphic computing systems (NCSs). As an example, NCS can be used to complement highly sensitive soft robotic pressure sensors [14] for optimizing the grabbing and releasing of objects.
Printed electronics rely on digital additive processes such as inkjet printing, and could be printed directly on flexible materials without requiring a mask or subtractive processes [15,16,17,18]. Due to the difficulty in printing dielectric materials, we chose an electrolyte gating approach that was inkjet-printer-friendly. Therefore, electrolyte-gated transistor technology (EGT) [19] is a promising candidate. It can be fully processed with digital drop-on-demand properties systems without the need for additional postprocessing steps, and thus fulfils the required for flexible, point-of-use, and low-cost electronics. Furthermore, EGTs can be driven by very low supply voltages, as low as 2 V, allowing for using printed batteries or energy harvesters for the power supply for portable applications. Owing to these offered benefits by EGTs, there are significant efforts in utilizing them for neuromorphic sensing, synaptic coupling, and artificial sensory systems [20].
Conventional electric circuit designs cannot be directly mapped to our EGT technology owing to missing PMOS, larger feature size and lower integration density. Even though there is progress in organic electronics [21], a PMOS is still missing in printed inorganic electronics and is not yet optimized for CMOS. Hence digital systems in the technology lead to substantial area overhead, high power consumption and low performance. Consequently, the requirements of the targeted applications cannot be met [22]. In that respect, biology-inspired neuromorphic computing [23] coupled with analog computing [24,25] can be leveraged to obtain an efficient circuit implementation for PE applications. An NCS is inspired by the topology of the brain and can be built from artificial synapses and neurons. A significant advantage of the NCS is that sensory data can be processed without having to convert into digital signals, which otherwise requires additional analog–digital converters which increase costs and the hardware footprint. The intrinsic fault tolerance of NCS [26,27] can be leveraged to tolerate manufacturing imperfections and defects, which is a benefit for printed systems. The challenge, however, is to fully print the neuromorphic circuits.

1.2. Device Architecture of Fully Printed Two-Input Neuron

In general, very common realizations of NCS are based on feed-forward or artificial neural networks (ANNs) [28], which are adapted in training routines such as back-propagation [29]. Printed NCSs consist of a network of artificial neurons comprising a network of resistors that are both intra- and interlayer interconnected to perform regression or classification tasks [29]. ANNs are implemented into the hardware owing to their simplicity and ease of training, which can be achieved by a least-mean-squares model. Most recently, artificial neural networks fabricated by additive technologies were presented, such as basic synaptic functions on flexible substrates [30] and a multiply–accumulate (MAC) operation on flexible substrates was also presented [31]. NCSs based on EGTs [32,33,34], and screen-printed [35] and aerosol-jet-printed NCS [36] were reported. Some works proposed organic functional materials [24] and suitable training algorithms for printed NCSs [33,34,37,38]. Although these contributions strongly indicated the relevance of printed NCS for prospective computing systems, most of the works investigating EGT-based NCSs still use rigid substrates such as silicon and glass. Moreover, passive conductive tracks are often not printed but thermally evaporated or sputtered, and hence require additional subtractive processes such as photolithography or laser ablation. Recent works [34] that reported printed NCS utilized laser ablation to fabricate resistors that encompass a large area overhead owing to the requirement of large resistances. Instead, a fully printed NCS system that includes printed resistors would greatly reduce the resistor area. However, only few works exist on devices fully printed on flexible substrates, and if so, are mainly screen printed [30].
In this article and, to our knowledge, for the first time, we present a fully printed and flexible two-input neuron for NCSs based on low-voltage EGT technology. The main advantage of the proposed neuron design and its fabrication process is its capability to be embedded as near-sensor processing units for preprocessing raw sensor data, such as matrix of pressure sensors as part of electronic skin. The NCS is first trained in software, and the proposed design is fabricated using easy additive-printing steps.
We circumvented previously deployed nonadditive structuring processes and substituted them with additive-printing processes for the EGT-based NCS on flexible polyimide (PI). We used graphene ink for conductive lines to act as resistors or wires depending on their shape, and utilized In 2 O 3 as the active channel material in the EGT owing to its superior performance on flexible substrates such as PI [39].

1.3. Proposed Two-Input Neuron

As illustrated in Figure 1, by replicating the neuron intra- and interlayer-wise, a full ANN can be formed for a given topology, which is similar to conventional (software-based) ANNs with few additional constraints that would need to be considered, such as bounded and coupled ANN weights. Thus, each layer of the ANN that is trained in software is fully printed. Given the ease of fabrication and the reproducibility of printed ANNs, a multiple-input neuron can be easily designed and printed with the proposed design.

2. Materials and Methods

2.1. Ink Preparation and Characterization

In this work, an inkjet printer (Dimatix 2831, Fujifilm, Santa Clara, CA, USA) and a Microplotter II (Sonoplot, Middleton, WI, USA) were utilized in order to fully print the two-input neuron. The inkjet printer had a fixed nozzle diameter of 20 μm, while the nozzle diameter in the Microplotter could be increased to for the easier printability of the graphene ink [40]. This removes the need for filtering large flakes out beforehand.
The In 2 O 3 semiconductor was prepared with a a precursor method, namely, 0.05 M In ( N O 3 ) 3 dissolved in a 4:1 water:ethylene glycol mixture was inkjet-printed and annealed at 350 °C. The precursor ink was stirred at 300 rpm for 12 h to ensure homogeneous mixing before filtering it through a PVDF filter and printing. For passive graphene structures, commercial ink (2.4 wt % solid graphene and ethyl cellulose in cyclohexanone and terpineol, Sigma Aldrich, Taufkirchen, Germany) was used. The graphene ink was printed with the Microplotter by adjusting the printer nozzle diameter to 30 μ m. The inkjet-printable composite solid polymer electrolyte (CSPE) was prepared by mixing two solutions. The first solution was a base solvent comprising 0.63 g of polyvinyl alcohol (PVA, hydrolyzed, 98%, Sigma-Aldrich) dissolved in 6 g dimethyl sulphoxide (DMSO, anhydrous, 99.9%, Sigma-Aldrich), stirred at 300 rpm for 1 h at 85 °C. The second solution was the electrolyte, which was prepared by dissolving 0.07 g LiClO 4 (anhydrous, 98%, Alpha Aesar, Kandel, Germany) in 3 g of propylene carbonate (PC, anhydrous, 99.7%, Sigma-Aldrich) and stirring at 300 rpm for 1 h. The two solutions were then stirred together at 300 rpm overnight before printing.
The material stack of the printed inplane electrolyte gated transistor (EGT), which was the basis for the two-input neuron, is depicted in Figure 2. The cross-section of the EGT is shown in Figure 2b with the graphene source/drain, the In 2 O 3 active layer, and the composite solid polymer electrolyte (CSPE) that performed the role of a dielectric in the printed transistor. A channel was formed on the In 2 O 3 semiconductor surface in contact with the CSPE due to the formation of a double electrical layer that attracted charge carriers onto the surface [41]. EGT channel length was 200 μ m, width was 100 μ m, the S/D was about 300 × 300 μ m, whereas the inplane gate electrode was 750 × 500 μ m. The overall size of the transistor was thus 1 × 1.5 mm. A scanning electron microscope image of the top view of the device, and the interface between graphene and In 2 O 3 are shown in Figure 2c.

2.2. Electrical Analysis of Printed Two-Input Neuron

Electrical analysis was conducted with the Agilent 156C (Keysight, Böblingen, Germany) Semiconductor Parameter Analyzer in combination with the Yokogawa DL6104 digital oscilloscope (Wehr, Germany) and Keithley 3390 waveform generators (Tektronix, Köln, Germany) for input pulse generation. In total, two types of measurements were performed: DC characterization of the EGT-based diode (gate and drain of transistor T 1 shortcut by R H ), and transient simulation of the whole neuron. For DC measurement, the Agilent Semiconductor Parameter Analyzer was deployed to sweep diode voltage V D S from −2 V to 2 V, and diode current I D S was recorded at a constant humidity of 58% and temperature of 27 °C. In the second measurement, the Agilent Semiconductor Parameter Analyzer was utilized to drive the ground potential, and two Keithley 3390 waveform generators generated input step pulses for V I N 1 / V I N 2 , alternating between −2 and 2 V and shifted in time by 90°. Output signals V x and V o u t were measured at a constant humidity level of 50% and a temperature of 27 °C in parallel with using the digital oscilloscope.

2.3. Bending Tests

We performed the bending tests on the fully printed devices on a cylinder with 4.5 mm radius for over 200 cycles. Transfer characteristics of the EGT were recorded before and after bending. Scanning electron micrographs and energy-dispersive X-ray mapping were performed directly on the bent substrates (Supplementary Information).

3. Results

3.1. Fabrication of EGT on Polyimide

In order to realise fully printed neurons on a flexible substrate, the processing temperature of the functional materials must be optimized to suit the substrate. The glass transition temperature (Tg) of polyimide occurs between 360 and 400 °C [42]. Therefore, printed films are processed at lower temperatures. While earlier works used temperatures as high as 400 °C to obtain In 2 O 3 films from halide precursors [43], we demonstrate that these films can be obtained from nitrate precursors at lower temperatures owing to the low decomposition temperature of In ( N O 3 ) 3 and the low crystallization temperature (290 °C) of In 2 O 3 [44]. The quality of indium oxide obtained from an aqueous In ( N O 3 ) 3 solution subjected to a heat treatment was comparable whether annealed to 300 or 400 °C. This was confirmed by X-ray diffraction (Figure 3a) on the same film, annealed first to 300 °C and then to 400 °C. As expected from the literature [45], crystallite size increased with temperature from 4.6 nm at 300 °C to 10.45 nm at 400 °C, as calculated per the Scherrer formula [46] for the highest intensity peak at (222). Typical values for indium oxide prepared by pulsed laser deposition were 19.8 nm [47], but for solution-processed polycrystalline indium oxide films, 4.6 nm is a very competitive value.
For this study, the most important conclusion from the XRD pattern was that characteristic In 2 O 3 peaks were equally observed at the lower-temperature treatment with no undesirable peaks. Subsequently, 300 °C was chosen as the maximal processing temperature in this work.
Passive graphene structures, i.e., electrodes and resistors, were annealed along with an In 2 O 3 precursor. After heating to 300 °C, a graphene film of 300 nm thickness on a glass substrate showed sheet resistance of 500 Ω [40]. The inset in Figure 3b shows an optical image of the film that was also used for SEM to determine the average flake size of 200 nm (image analysis in ImageJ). In order to realize different resistances as required for the conductors or resistors, the thickness of the printed graphene film was varied to ensure that the printed area footprint was as small as possible. Table 1 shows that the graphene film sheet resistance decreased with each additional printed layer for a variation of temperatures up to 300 °C. Figure 3b validates the inverse relation of the graphene sheet resistance to its thickness. In conventional inks, e.g., silver ink [48], the resistance can be changed by either increasing the length by a very large measure or decreasing the thickness to below the possible minimum for printing. For graphene, however, we can go the opposite way and add layers to tune the resistance to our requirements without increasing the printing area.
The good printability of both the oxide precursor and the graphene ink was achieved by preconditioning the substrate (for details, see Section 2). The contact angles of the printed films were 78° for graphene ink (Figure S1a) and 38° for aqueous In ( N O 3 ) 3 (Figure S1b), with an angle < 90° indicating that good wettability was ensured. A processing temperature below the glass transition temperature of the PI substrate helps in avoiding crack formation in In 2 O 3 . The morphology of the processed In 2 O 3 was probed using the atomic force micrograph seen in Figure S2 at different areas on the In 2 O 3 surface. This showed a homogeneous morphology without crack formation, which is crucial for electrical performance. A scanning electron micrograph (SEM, Figure 2c) of the interface of graphene-In 2 O 3 indicated the contrast in the roughness of the two materials, and showed good contact without any delamination. Graphene film roughness (average of 40 nm) was clearly several times greater than that of In 2 O 3 , which had an average roughness of 6 nm. Detailed information on the fabrication steps is provided in Section 2.
Since the In 2 O 3 semiconductor dimensions matched those in our previous work [39], the tensile strain that could be applied on the fully printed devices without any damage was 2%, which amounts to a 4.5 mm extension. While the PI substrate, graphene film, and CSPE would allow for larger tensile strains, even as high as 100% [49,50] thanks to the presence of polymer inside them (Section 2), the oxide semiconductor is brittle in comparison. Therefore, the bending radius was limited by the oxide semiconductor. However, given the small size of In 2 O 3 in comparison with that of polymer-containing components, it is possible to bend the substrate at higher tensile strain. On the other hand, since a 4.5 mm bending radius is sufficient for most flexible applications [51], this value was the minimal bending radius for the printed neurons. To test bending stability, we examined the EGT characteristics before and after 200 bending cycles to 2% strain (Figure 4). The difference between the transfer curves before and after bending was negligible. The threshold voltage increased very slightly, while the on current remained constant. No cracks occured in the semiconductor, as confirmed by using the energy-dispersive X-ray mapping of elements directly on the bent device (Figure S3).
With regard to the longevity of the devices, performance depends on the electrolyte and the drying effects. We tested the transfer characteristics of EGTs over four weeks, during which performance was stable. The transfer characteristics of the EGT initially and after four weeks (Figure S4) are shown in the supplementary information. Thus, the device achieved consistent performance for several bending cycles over several weeks.

3.2. Printed Flexible 2-Input Neural Network

The fabrication steps of the printed EGT-based two-input neuron are depicted in Figure 5. As substrate material, flexible polyimide (PI, Kapton® HN, Dupont, Wilmington, DE, USA) was deployed. To counter any differences in the thermal expansion of substrate and films to be deposited, the PI was initially annealed at 400 °C, and then rinsed with a 1:1 mixture of acetone and isopropanol [39]. Source, drain, and gate electrodes, contact pads, and R o u t , R 1 , R 2 and R 3 resistances were printed according to the desired resistance values. After printing the In ( N O 3 ) 3 precursor, the whole substrate was annealed at 300 °C for two hours (ramp rate 1 °C/min) to form the In 2 O 3 semiconductor attached to the source or drain. Once the passive structures had been printed and ready, the CSPE electrolyte was printed across the gate and the In ( N O 3 ) 3 semiconductor to construct a transistor-based diode.
The analog circuit design of the fully printed two-input neuron is illustrated in Figure 6a. It consisted of the MAC operation combined with a printed piecewise linear unit (pPLU) that included the diode. An optical microscope image of the fabricated circuit on flexible polyimide foil is shown in Figure 6b; voltage signals (colored pads) and printed materials are annotated. The design parameters of the printed hardware prototype are depicted in Table 2.
The fabricated flexible neuron realized the two fundamental building blocks to implement artificial neural networks: the multiply–accumulate (MAC) and nonlinear-activation functions [29]. These operations can be expressed as follows:
z ( x i ) = σ ( i x i w i ) ,
where summation i x i w i is the MAC operation, and σ ( · ) is the (preferably nonlinear) activation function. To realize these functions, analog designs were chosen. To this end, quantities x i and z were encoded as voltages ( V I N i and V o u t ), and ANN weights w i and the MAC operation were realized with resistors [33]. The applied input voltages were converted into proportional currents to resistor conductance according to Ohm’s law (multiplication). These currents were then summed up at the T-junction ( V x in Figure 6a) following Kirchhoff’s rule (addition). As resistors are linear circuit elements, the output voltage of the resistor can be computed by solving the linear problem of a resistor network, where resistors are known, and the output voltage is the unknown variable [34].
Output voltage V x of the MAC operation for our two-input neuron was obtained from
V x = i V I N i w i = V I N 1 w 1 + V I N 2 w 2 ,
with
w i = 1 R i j 1 R j = 1 R i 1 R 1 + 1 R 2 ,
where i , j { 1 , , N } denote the index of the N input resistors R i , R j .
Since activation functions for ANNs must provide nonlinear behavior between its inputs and output, a suitable candidate for implementation is a diode-based circuit. Hence, activation function ( V o u t = σ ( V x ) ) in this work was realized with an analog diode-based circuit ( T 1 and R H ) in combination with a pull-down resistor R o u t (see Figure 6a) to convert the diode current into output voltage. This allows for cascading several neurons to obtain multiple ANN layers, as each neuron inputs and outputs voltages. As a result, total neuron output z could be obtained by computing the voltage drop across R o u t caused by diode current I D S . Using Kirchhoff’s rule, the following equation is obtained:
V o u t = σ ( V x ) = I D S ( V x V o u t ) · R o u t ,
where I D S ( V x V o u t ) is a function of voltage drop V x V o u t across the diode. In contrast to Equation (2), Equation (4) must be numerically solved.

4. Discussion

4.1. Measurement Results

For the electrical characterization of the printed two-input neuron, we first measured the DC behavior of the printed EGT-based diode, which is part of the pPLU activation function and allows for extracting the transfer function of the pPLU corresponding to Equation (4). The DC measurement results of the EGT-based diode in Figure 7a clearly show that the diode had an input voltage regime with a high forward current ( I D S ) and a low current in the reverse direction. The diode’s forward threshold voltage was about 750 mV, which was suitable to observe a nonlinear response of the diode within the operating voltage. Figure 7a also shows the computed voltage of the pPLU, which validated the nonlinear behavior of this analog activation function circuit. As the resulting resistance was already high enough to obtain a suitable output voltage swing for the pPLU, only one-fourth of the length of the printed graphene-based resistor was used for the pPLU and neuronal measurements (measurement needle for GND came into contact in the middle of the first meander of R o u t ), leading to R o u t = 3.75 MΩ (instead of 4 × 3.75 = 15 ). Such high R o u t resistances do not affect the MAC output, which had resistances R i below 1 KΩ, and currents in the MAC circuit were much higher than those in the pPLU.
In the second measurement step, we analyzed the MAC circuit and the overall two-input neuronal behavior. Figure 7b shows the transient measurements of the printed neuron. Output V x of the MAC operation was the sum of inputs V I N 1 and V I N 2 , as expected, i.e., when the inputs were complementary, the MAC output V x was close to 0 V, as resistors R 1 and R 2 were of equal size, and the resulting weights were w 1 = w 2 = 0.5 , respectively. When both inputs were pulled up to 2 V or −2 V, MAC output voltage V x was likewise. Second, the nonlinear response of the pPLU could also be obtained with the measured waveforms. When pPLU input V x was negative, output V o u t was suppressed; inversely, for positive input voltages, V o u t was pulled up to a higher voltage level. In other words, the pPLU response was nonlinear with respect to the MAC output, as desired. In summary, we successfully demonstrated the overall function of the fully printed neuron prototype, and validated that both fundamental neuron operations operated correctly.

4.2. Outlook

From the transient measurements (Figure 7), an input–output delay of 1 s was obtained with an average power consumption of 37.7 mW, the calculation of which is shown in Supplementary Information. The consumed area of the hardware prototypewas as small as 16.25 mm2. However, a substantial reduction in power consumption could be achieved by choosing smaller resistances of R i , and with a smaller area of printed resistors and contact pads. This is feasible, as a predefined set of ANN weights can be realized by differently sized resistors, e.g., choosing a common scale factor for all resistors R i in Equation (3) [34]. Predefining resistors through the training model also allows for the usage of printed resistors, which are positive weights that cannot be dynamically tuned. We, therefore, assumed that our neuron was trained beforehand in software and fabricated accordingly, which basically rendered our ANN as a “post-trained” network that could perform near-sensor processing. Following this approach, our NN is not run-time-adaptive, but targets applications that require low-cost fabrication on flexible substrates. In order to tune the weights, conductive materials such as Pedot:PSS can be printed on top, and this is being investigated. Furthermore, the number of neuronal inputs is usually not limited to two; by adding additional resistors R i to the MAC, inputs can be scaled up in accordance to taking into account the maximal voltage headroom defined by the input signal and power supply.
As the interconnects of the circuit, such as measurement pads for drain, source, gate, GND or R o u t , parasitic resistances are introduced to the circuit of the neuronal hardware prototype; their area and consequently their conductance were enlarged compared to passive components R 1 , R 2 and R o u t . Although input contact pads V I N 1 and V I N 2 influenced the effective resistance of input resistors R 1 and R 2 when measuring the hardware prototype, they did not impact ANN weights. Only the ratio of the effective resistance determines the ANN weights, not their absolute value; see Equation (3). In our experiment, both weights were set to 0.5, and input pads and resistors R 1 and R 2 were of equal size. However, when a neuron is fabricated as part of a commercial product, no measurement pads are required, and only the output impedance of the connected input device (e.g., a sensor) must be lower than neuron input resistors R i .

5. Conclusions

We successfully fabricated a two-input fully printed neuron on flexible polyimide using drop-on-demand additive-printing techniques. To the best of our knowledge, this is the first time that such a demonstrator is reported that integrates digital printing techniques with flexible substrates in this field of application. The software-pretrained neuron is based on graphene ink for the conductive tracks, resistors, and EGT source, gate, and drain electrodes. The resistance of the printed graphene film was modulated by changing its thickness. The heating process, simultaneously annealing both graphene ink and In 2 O 3 , was optimized, such that there was no crack formation in In 2 O 3 . The transistor-based diode used electrolyte gating; thereby, the two-input neuron operated at only 2 V, rendering it a suitable candidate for self-powered portable printed-computing systems. The printed neuron had propagation delay of 1 s, power consumption of 37.7 mW, and area utilization of 16.25 mm2, paving the road for upscaling fully printed two-input neurons.
The presented NCS concept can be further improved by extending currently used ANN building blocks with circuits for negative weight operation. Another extension would be to use a nonlinear activation function. Our future work will implement these changes to fabricate an extended neuronal concept while using the fully printed approach on flexible substrate.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/s22114000/s1. Figure S1. Contact angle of (a) graphene on polyimide and (b) indium nitrate precursor on polyimide. Figure S2. Atomic force micrography scans performed on the In 2 O 3 channel in various directions to check for surface morphology. A maximal roughness of 6 nm was observed without any cracks, with a standard deviation of about 2 nm. Figure S3. Electron-dispersive X-ray mapping of EGT-based ANN bent at 4.5 mm. (a) SEM imagewith corresponding EDX measurements of (b) carbon, (c) indium present in the semiconductor, and (d) nitrogen present in polyimide. Figure S4. Aging effect on the electrolyte gated transistor. Transfer characteristics initially and after four weeks matched exactly with each other.

Author Contributions

Conceptualization, S.A.S. and D.D.W.; methodology, S.A.S.; software, D.D.W.; validation, S.A.S., J.A.-H. and M.B.T.; formal analysis, S.A.S. and T.S.G.; writing—original draft preparation, D.D.W. and S.A.S.; writing—review and editing, S.A.S. and T.S.G.; supervision, J.A.-H. and M.B.T.; funding acquisition, J.A.-H. and M.B.T. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge support by the KIT-Publication Fund of the Karlsruhe Institute of Technology.

Data Availability Statement

Data supporting reported results can be accessed from the authors upon request.

Acknowledgments

The authors would like to thank the Neuromorphic Systems and Soft Electronics for Resource-Constraint Artificial Intelligence in Soft Robotics and Wearables (SoftNeuro) program for the project funding.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ANNArtificial neural networks
CSPEComposite solid polymer electrolyte
DMSODimethyl sulfoxide
EGTElectrolyte gated transistor
IoTInternet of Things
NCSNeuromorphic computing systems
PEPrinted electronics
PIPolyimide
pPLUPrinted piecewise linear unit

References

  1. Kim, Y.J.; Chun, S.E.; Whitacre, J.; Bettinger, C.J. Self-deployable current sources fabricated from edible materials. J. Mater. Chem. B 2013, 1, 3781–3788. [Google Scholar] [CrossRef] [PubMed]
  2. Maly, W. Cost of silicon viewed from VLSI design perspective. In Proceedings of the 31st Annual Design Automation Conference, San Diego, CA, USA, 6–10 June 1994; pp. 135–142. [Google Scholar]
  3. Subramanian, V.; Chang, J.B.; de la Fuente Vornbrock, A.; Huang, D.C.; Jagannathan, L.; Liao, F.; Mattis, B.; Molesa, S.; Redinger, D.R.; Soltman, D.; et al. Printed electronics for low-cost electronic systems: Technology status and application development. In Proceedings of the 2008-34th ESSCIRC, Edinburgh, UK, 15–19 September 2008; pp. 17–24. [Google Scholar]
  4. Lee, Y.; Oh, J.Y.; Xu, W.; Kim, O.; Kim, T.R.; Kang, J.; Kim, Y.; Son, D.; Tok, J.B.H.; Park, M.J.; et al. Stretchable organic optoelectronic sensorimotor synapse. Sci. Adv. 2018, 4, eaat7387. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Kim, Y.; Chortos, A.; Xu, W.; Liu, Y.; Oh, J.Y.; Son, D.; Kang, J.; Foudeh, A.M.; Zhu, C.; Lee, Y.; et al. A bioinspired flexible organic artificial afferent nerve. Science 2018, 360, 998–1003. [Google Scholar] [CrossRef] [Green Version]
  6. Chortos, A.; Liu, J.; Bao, Z. Pursuing prosthetic electronic skin. Nat. Mater. 2016, 15, 937–950. [Google Scholar] [CrossRef]
  7. dos Santos, A.; Pinela, N.; Alves, P.; Santos, R.; Farinha, R.; Fortunato, E.; Martins, R.; Águas, H.; Igreja, R. E-Skin Bimodal Sensors for Robotics and Prosthesis Using PDMS Molds Engraved by Laser. Sensors 2019, 19, 899. [Google Scholar] [CrossRef] [Green Version]
  8. dos Santos, A.; Fortunato, E.; Martins, R.; Águas, H.; Igreja, R. Transduction Mechanisms, Micro-Structuring Techniques, and Applications of Electronic Skin Pressure Sensors: A Review of Recent Advances. Sensors 2020, 20, 4407. [Google Scholar] [CrossRef]
  9. Kim, J.; Jeerapan, I.; Imani, S.; Cho, T.N.; Bandodkar, A.; Cinti, S.; Mercier, P.P.; Wang, J. Noninvasive alcohol monitoring using a wearable tattoo-based iontophoretic-biosensing system. ACS Sens. 2016, 1, 1011–1019. [Google Scholar] [CrossRef]
  10. Research and Markets. Global FMCG Market Opportunity Analysis, 2018–2019 & 2025—A Billion New Consumers in Emerging Markets; Research and Markets: Dublin, Ireland, 2019. [Google Scholar]
  11. Shao, B. Fully Printed Chipless RFID Tags Towards Item-Level Tracking Applications. Ph.D. Thesis, KTH Royal Institute of Technology, Stockholm, Sweden, 2014. [Google Scholar]
  12. Khan, Y.; Thielens, A.; Muin, S.; Ting, J.; Baumbauer, C.; Arias, A.C. A new frontier of printed electronics: Flexible hybrid electronics. Adv. Mater. 2020, 32, 1905279. [Google Scholar] [CrossRef]
  13. Scholz, A.; Gerig, D.; Zimmermann, L.; Seiberlich, M.; Strobel, N.; Hernandez-Sosa, G.; Aghassi-Hagmann, J. A Hybrid Optoelectronic Sensor Platform with an Integrated Solution-Processed Organic Photodiode. Adv. Mater. Technol. 2020, 6, 2000172. [Google Scholar] [CrossRef]
  14. Tang, Z.; Jia, S.; Zhou, C.; Li, B. 3D Printing of Highly Sensitive and Large-Measurement-Range Flexible Pressure Sensors with a Positive Piezoresistive Effect. ACS Appl. Mater. Interfaces 2020, 12, 28669–28680. [Google Scholar] [CrossRef]
  15. Cui, Z. Printed Electronics: Materials, Technologies and Applications; John Wiley & Sons: Hoboken, NJ, USA, 2016. [Google Scholar]
  16. Zhao, J.; Gao, Y.; Gu, W.; Wang, C.; Lin, J.; Chen, Z.; Cui, Z. Fabrication and electrical properties of all-printed carbon nanotube thin film transistors on flexible substrates. J. Mater. Chem. 2012, 22, 20747–20753. [Google Scholar] [CrossRef]
  17. Chen, P.Y.; Chen, C.L.; Chen, C.C.; Tsai, L.; Ting, H.C.; Lin, L.F.; Chen, C.C.; Chen, C.Y.; Chang, L.H.; Shih, T.H.; et al. 30.1: Invited Paper: 65-Inch Inkjet Printed Organic Light-Emitting Display Panel with High Degree of Pixel Uniformity. In Proceedings of the SID Symposium Digest of Technical Papers, San Diego, CA, USA, 7 July 2014; Wiley Online Library: Hoboken, NJ, USA, 2014; Volume 45, pp. 396–398. [Google Scholar]
  18. Mohammed, M.G.; Kramer, R. All-Printed Flexible and Stretchable Electronics. Adv. Mater. 2017, 29, 1604965. [Google Scholar] [CrossRef] [PubMed]
  19. Cadilha Marques, G.; Weller, D.; Erozan, A.T.; Feng, X.; Tahoori, M.; Aghassi-Hagmann, J. Progress Report on “From Printed Electrolyte-Gated Metal-Oxide Devices to Circuits”. Adv. Mater. 2019, 31, 1806483. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Ling, H.; Koutsouras, D.A.; Kazemzadeh, S.; van de Burgt, Y.; Yan, F.; Gkoupidenis, P. Electrolyte-gated transistors for synaptic electronics, neuromorphic computing, and adaptable biointerfacing. Appl. Phys. Rev. 2020, 7, 011307. [Google Scholar] [CrossRef]
  21. Yang, C.Y.; Stoeckel, M.A.; Ruoko, T.P.; Wu, H.Y.; Liu, X.; Kolhe, N.B.; Wu, Z.; Puttisong, Y.; Musumeci, C.; Massetti, M.; et al. A high-conductivity n-type polymeric ink for printed electronics. Nat. Commun. 2021, 12, 2354. [Google Scholar] [CrossRef]
  22. Mubarik, M.; Weller, D.; Bleier, N.; Tomei, M.; Aghassi-Hagmann, J.; Tahoori, M.; Kumar, R. Printed Machine Learning Classifiers. In Proceedings of the 53rd Annual IEEE/ACM International Symposium on Microarchitecture, Athens, Greece, 17–21 October 2020. [Google Scholar]
  23. Benda, J. Neural adaptation. Curr. Biol. 2021, 31, R110–R116. [Google Scholar] [CrossRef]
  24. Nawrocki, R.A.; Voyles, R.M.; Shaheen, S.E. Neurons in polymer: Hardware neural units based on polymer memristive devices and polymer transistors. IEEE Trans. Electron Devices 2014, 61, 3513–3519. [Google Scholar] [CrossRef]
  25. van De Burgt, Y.; Melianas, A.; Keene, S.T.; Malliaras, G.; Salleo, A. Organic electronics for neuromorphic computing. Nat. Electron. 2018, 1, 386–397. [Google Scholar] [CrossRef]
  26. Liu, B.; Li, H.; Chen, Y.; Li, X.; Wu, Q.; Huang, T. Vortex: Variation-aware training for memristor x-bar. In Proceedings of the 52nd Annual Design Automation Conference, San Francisco, CA, USA, 7–11 June 2015; p. 15. [Google Scholar]
  27. Leung, C.S.; Wan, W.Y.; Feng, R. A regularizer approach for RBF networks under the concurrent weight failure situation. IEEE Trans. Neural Netw. Learn. Syst. 2016, 28, 1360–1372. [Google Scholar] [CrossRef]
  28. Schuman, C.D.; Potok, T.E.; Patton, R.M.; Birdwell, J.D.; Dean, M.E.; Rose, G.S.; Plank, J.S. A survey of neuromorphic computing and neural networks in hardware. arXiv 2017, arXiv:1705.06963. [Google Scholar]
  29. Bishop, C.M. Pattern Recognition and Machine Learning; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
  30. van de Burgt, Y.; Lubberman, E.; Fuller, E.J.; Keene, S.T.; Faria, G.C.; Agarwal, S.; Marinella, M.J.; Talin, A.A.; Salleo, A. A non-volatile organic electrochemical device as a low-voltage artificial synapse for neuromorphic computing. Nat. Mater. 2017, 16, 414–418. [Google Scholar] [CrossRef]
  31. Douthwaite, M.; García-Redondo, F.; Georgiou, P.; Das, S. A Time-Domain Current-Mode MAC Engine for Analogue Neural Networks in Flexible Electronics. In Proceedings of the 2019 IEEE Biomedical Circuits and Systems Conference (BioCAS), Nara, Japan, 17–19 October 2019; pp. 1–4. [Google Scholar]
  32. Gkoupidenis, P.; Schaefer, N.; Garlan, B.; Malliaras, G.G. Neuromorphic functions in PEDOT: PSS organic electrochemical transistors. Adv. Mater. 2015, 27, 7176–7180. [Google Scholar] [CrossRef] [PubMed]
  33. Weller, D.D.; Hefenbrock, M.; Tahoori, M.B.; Aghassi-Hagmann, J.; Beigl, M. Programmable Neuromorphic Circuit based on Printed Electrolyte-Gated Transistors. In Proceedings of the Asia South Pacific Design Automation Conference (ASP-DAC), Beijing, China, 13–16 January 2020. [Google Scholar]
  34. Weller, D.D.; Hefenbrock, M.; Beigl, M.; Aghassi-Hagmann, J.; Tahoori, M.B. Realization and training of an inverter-based printed neuromorphic computing system. Sci. Rep. 2021, 11, 9554. [Google Scholar] [CrossRef] [PubMed]
  35. Liu, Q.; Liu, Y.; Li, J.; Lau, C.; Wu, F.; Zhang, A.; Li, Z.; Chen, M.; Fu, H.; Draper, J.; et al. Fully Printed All-Solid-State Organic Flexible Artificial Synapse for Neuromorphic Computing. ACS Appl. Mater. Interfaces 2019, 11, 16749–16757. [Google Scholar] [CrossRef]
  36. Feng, P.; Xu, W.; Yang, Y.; Wan, X.; Shi, Y.; Wan, Q.; Zhao, J.; Cui, Z. Printed Neuromorphic Devices Based on Printed Carbon Nanotube Thin-Film Transistors. Adv. Funct. Mater. 2017, 27, 1604447. [Google Scholar] [CrossRef]
  37. Ansari, M.; Fayyazi, A.; Banagozar, A.; Maleki, M.A.; Kamal, M.; Afzali-Kusha, A.; Pedram, M. PHAX: Physical Characteristics AwareEx-SituTraining Framework for Inverter-Based Memristive Neuromorphic Circuits. IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst. 2017, 37, 1602–1613. [Google Scholar] [CrossRef]
  38. BanaGozar, A.; Maleki, M.A.; Kamal, M.; Afzali-Kusha, A.; Pedram, M. Robust neuromorphic computing in the presence of process variation. In Proceedings of the Design, Automation & Test in Europe Conference & Exhibition (DATE), Lausanne, Switzerland, 27–31 March 2017; pp. 440–445. [Google Scholar]
  39. Singaraju, S.A.; Marques, G.C.; Gruber, P.; Kruk, R.; Hahn, H.; Breitung, B.; Aghassi-Hagmann, J. Fully Printed Inverters using Metal-Oxide Semiconductor and Graphene Passives on Flexible Substrates. Phys. Status Solidi (RRL) Rapid Res. Lett. 2020, 14, 2000252. [Google Scholar] [CrossRef]
  40. Singaraju, S.A.; Baby, T.T.; Neuper, F.; Kruk, R.; Hagmann, J.A.; Hahn, H.; Breitung, B. Development of Fully Printed Electrolyte-Gated Oxide Transistors Using Graphene Passive Structures. ACS Appl. Electron. Mater. 2019, 1, 1538–1544. [Google Scholar] [CrossRef]
  41. Kim, S.H.; Hong, K.; Xie, W.; Lee, K.H.; Zhang, S.; Lodge, T.P.; Frisbie, C.D. Electrolyte-Gated Transistors for Organic and Printed Electronics. Adv. Mater. 2012, 25, 1822–1846. [Google Scholar] [CrossRef]
  42. DupontResearch. Kapton HN Polyimide Film Specifications; DupontResearch: Wilmington, DE, USA, 2019. [Google Scholar]
  43. Garlapati, S.K.; Mishra, N.; Dehm, S.; Hahn, R.; Kruk, R.; Hahn, H.; Dasgupta, S. Electrolyte-Gated, High Mobility Inorganic Oxide Transistors from Printed Metal Halides. ACS Appl. Mater. Interfaces 2013, 5, 11498–11502. [Google Scholar] [CrossRef]
  44. Hwang, Y.H.; Seo, J.S.; Yun, J.M.; Park, H.; Yang, S.; Park, S.H.K.; Bae, B.S. An ‘aqueous route’ for the fabrication of low-temperature-processable oxide flexible transparent thin-film transistors on plastic substrates. NPG Asia Mater. 2013, 5, e45. [Google Scholar] [CrossRef] [Green Version]
  45. Lee, J.H.; Kim, Y.H.; Ahn, S.J.; Ha, T.H.; Kim, H.S. Grain-size effect on the electrical properties of nanocrystalline indium tin oxide thin films. Mater. Sci. Eng. B 2015, 199, 37–41. [Google Scholar] [CrossRef]
  46. Ahmed, N.M.; Sabah, F.A.; Abdulgafour, H.; Alsadig, A.; Sulieman, A.; Alkhoaryef, M. The effect of post annealing temperature on grain size of indium-tin-oxide for optical and electrical properties improvement. Results Phys. 2019, 13, 102159. [Google Scholar] [CrossRef]
  47. Abd, J.A.; Mohammed, W.M. Indium oxide: Synthesis and characterization for future industrial applications. In AIP Conference Proceedings; AIP Publishing: Melville, NY, USA, 2019. [Google Scholar] [CrossRef]
  48. Mypati, S.; Dhanushkodi, S.R.; McLaren, M.; Docoslis, A.; Peppley, B.A.; Barz, D.P.J. Optimized inkjet-printed silver nanoparticle films: Theoretical and experimental investigations. RSC Adv. 2018, 8, 19679–19689. [Google Scholar] [CrossRef] [Green Version]
  49. Tadesse, M.G.; Mengistie, D.A.; Chen, Y.; Wang, L.; Loghin, C.; Nierstrasz, V. Electrically conductive highly elastic polyamide/lycra fabric treated with PEDOT:PSS and polyurethane. J. Mater. Sci. 2019, 54, 9591–9602. [Google Scholar] [CrossRef] [Green Version]
  50. Hatamie, A.; Angizi, S.; Kumar, S.; Pandey, C.M.; Simchi, A.; Willander, M.; Malhotra, B.D. Review—Textile Based Chemical and Physical Sensors for Healthcare Monitoring. J. Electrochem. Soc. 2020, 167, 037546. [Google Scholar] [CrossRef]
  51. Rojas, J.P.; Sevilla, G.A.T.; Hussain, M.M. Can We Build a Truly High Performance Computer Which is Flexible and Transparent? Sci. Rep. 2013, 3, 2609. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Topology of printed ANN with the proposed neuron design, two layers, and a topology of 3 × 2 .
Figure 1. Topology of printed ANN with the proposed neuron design, two layers, and a topology of 3 × 2 .
Sensors 22 04000 g001
Figure 2. (a) Top and (b) side views of the printed transistor. (c) Top-view SEM image of the transistor structure. Inset shows SEM and AFM micrographs of the interface between graphene film and In 2 O 3 . Average graphene flake size was about 200 nm. Atomic force micrography shows that the graphene ink had higher roughness of more than 200 nm as compared to that of the indium oxide film, which had a roughness of 6 nm.
Figure 2. (a) Top and (b) side views of the printed transistor. (c) Top-view SEM image of the transistor structure. Inset shows SEM and AFM micrographs of the interface between graphene film and In 2 O 3 . Average graphene flake size was about 200 nm. Atomic force micrography shows that the graphene ink had higher roughness of more than 200 nm as compared to that of the indium oxide film, which had a roughness of 6 nm.
Sensors 22 04000 g002
Figure 3. (a) XRD diffraction pattern of indium oxide obtained from aqueous nitrate precursors. Films obtained at 300 °C had characteristic peaks of indium oxide and did not show any unwanted peaks. (b) Variation in graphene sheet resistance with layer thickness showed inverse proportionality. Inset shows a photograph of a printed graphene film on 5 × 5 mm 2 glass substrate annealed at 300 °C as used for resistance dependance measurement.
Figure 3. (a) XRD diffraction pattern of indium oxide obtained from aqueous nitrate precursors. Films obtained at 300 °C had characteristic peaks of indium oxide and did not show any unwanted peaks. (b) Variation in graphene sheet resistance with layer thickness showed inverse proportionality. Inset shows a photograph of a printed graphene film on 5 × 5 mm 2 glass substrate annealed at 300 °C as used for resistance dependance measurement.
Sensors 22 04000 g003
Figure 4. Transfer characteristics of electrolyte gated transistor before and after 200 bending cycles showed merely negligible difference between curves. Inset shows devices on the polyimide substrate bent to a 4.5 mm radius.
Figure 4. Transfer characteristics of electrolyte gated transistor before and after 200 bending cycles showed merely negligible difference between curves. Inset shows devices on the polyimide substrate bent to a 4.5 mm radius.
Sensors 22 04000 g004
Figure 5. Neuron fabrication steps using the printing equipment described in Section 2. For each step, the top and side views of the printed structure are provided. Polyimide was preheated to 400 °C. In Step 1, graphene of varied thickness was printed, reflected in magnitude of resistance postannealing. In Step 2, aqueous indium nitrate was printed, and the substrate was annealed at 300 °C. In Step 3, CSPE was printed across the gate and In 2 O 3 .
Figure 5. Neuron fabrication steps using the printing equipment described in Section 2. For each step, the top and side views of the printed structure are provided. Polyimide was preheated to 400 °C. In Step 1, graphene of varied thickness was printed, reflected in magnitude of resistance postannealing. In Step 2, aqueous indium nitrate was printed, and the substrate was annealed at 300 °C. In Step 3, CSPE was printed across the gate and In 2 O 3 .
Sensors 22 04000 g005
Figure 6. Hardware prototype of fully printed two-input neuron: (a) Circuit schematic; (b) annotated optical micrograph of the printed two-input neuron on flexible polyimide film. The image was digitally postprocessed and stitched together from multiple microscopy photos.
Figure 6. Hardware prototype of fully printed two-input neuron: (a) Circuit schematic; (b) annotated optical micrograph of the printed two-input neuron on flexible polyimide film. The image was digitally postprocessed and stitched together from multiple microscopy photos.
Sensors 22 04000 g006
Figure 7. (a) DC measurement of EGT-based diode ( I D S ( V D S ) ) and activation function ( V o u t ( V x ) ). (b) Transient measurements of the printed neuron.
Figure 7. (a) DC measurement of EGT-based diode ( I D S ( V D S ) ) and activation function ( V o u t ( V x ) ). (b) Transient measurements of the printed neuron.
Sensors 22 04000 g007
Table 1. Sheet resistance for one to five layers of graphene ink printed and annealed at different temperatures. Each layer was 100 nm thick.
Table 1. Sheet resistance for one to five layers of graphene ink printed and annealed at different temperatures. Each layer was 100 nm thick.
100 °C200 °C250 °C300 °C
1 layer6 G Ω 160 M Ω 12 k Ω 4000 Ω
2 layers5 G Ω 135 M Ω 8 k Ω 1250 Ω
3 layers5 G Ω 114 M Ω 7 k Ω 520 Ω
4 layers3 G Ω 96 M Ω 2 k Ω 360 Ω
5 layers1 G Ω 55 M Ω 1 k Ω 275 Ω
Table 2. Design parameters of the printed neuron hardware prototype.
Table 2. Design parameters of the printed neuron hardware prototype.
R 1 R 2 R H R out T 1 -WidthT 1 -LengthDiode V th
250 Ω250 Ω300 Ω3.75 MΩ400 μm140 μm750 mV
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Singaraju, S.A.; Weller, D.D.; Gspann, T.S.; Aghassi-Hagmann, J.; Tahoori, M.B. Artificial Neurons on Flexible Substrates: A Fully Printed Approach for Neuromorphic Sensing. Sensors 2022, 22, 4000. https://doi.org/10.3390/s22114000

AMA Style

Singaraju SA, Weller DD, Gspann TS, Aghassi-Hagmann J, Tahoori MB. Artificial Neurons on Flexible Substrates: A Fully Printed Approach for Neuromorphic Sensing. Sensors. 2022; 22(11):4000. https://doi.org/10.3390/s22114000

Chicago/Turabian Style

Singaraju, Surya A., Dennis D. Weller, Thurid S. Gspann, Jasmin Aghassi-Hagmann, and Mehdi B. Tahoori. 2022. "Artificial Neurons on Flexible Substrates: A Fully Printed Approach for Neuromorphic Sensing" Sensors 22, no. 11: 4000. https://doi.org/10.3390/s22114000

APA Style

Singaraju, S. A., Weller, D. D., Gspann, T. S., Aghassi-Hagmann, J., & Tahoori, M. B. (2022). Artificial Neurons on Flexible Substrates: A Fully Printed Approach for Neuromorphic Sensing. Sensors, 22(11), 4000. https://doi.org/10.3390/s22114000

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop