Next Article in Journal
A Hybrid Method for the Fault Diagnosis of Onboard Traction Transformers
Next Article in Special Issue
Solution pH Effect on Drain-Gate Characteristics of SOI FET Biosensor
Previous Article in Journal
Inverse Transform Using Linearity for Video Coding
Previous Article in Special Issue
Textile Antenna-Sensor for In Vitro Diagnostics of Diabetes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

How to Assess the Measurement Performance of Mobile/Wearable Point-of-Care Testing Devices? A Systematic Review Addressing Sweat Analysis

1
Department of Information Engineering, University of Padova, 35131 Padova, Italy
2
Department of Molecular and Translational Medicine, University of Brescia, 25123 Brescia, Italy
3
Department of Information Engineering, University of Brescia, 25123 Brescia, Italy
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(5), 761; https://doi.org/10.3390/electronics11050761
Submission received: 31 January 2022 / Revised: 16 February 2022 / Accepted: 25 February 2022 / Published: 1 March 2022

Abstract

:
Recent advances in technologies for biosensor integration in mobile or wearable devices have highlighted the need for the definition of proper validation procedures and technical standards that enable testing, verification and validation of the overall performance of these solutions. Thus, reliable assessment—in terms of limits of detection/quantitation, linearity, range, analytical and diagnostic sensitivity/specificity, accuracy, repeatability, reproducibility, cross-reactivity, diagnostic efficiency, and positive/negative prediction—still represents the most critical and challenging aspect required to progress beyond the status of feasibility studies. Considering this picture, this work aims to review and discuss the literature referring to the available methods and criteria reported in the assessment of the performance of point-of-care testing (PoCT) devices within their specific applications. In particular, without losing generality, we focused on mobile or wearable systems able to analyze human sweat. In performing this review, the focus was on the main challenges and trends underlined in the literature, in order to provide specific hints that can be used to set shared procedures and improve the overall reliability of the identified solutions, addressing the importance of sample management, the sensing components, and the electronics. This review can contribute to supporting an effective validation of mobile or wearable PoCT devices and thus to spreading the use of reliable approaches outside hospitals and clinical laboratories.

1. Introduction

Recent advances in nanotechnologies, microfluidics, printed electronics, additive manufacturing, and biomaterials have brought about a significant improvement in the integration of sensing elements within wearable devices for point-of-care testing (PoCT) applications [1]. These technological evolutions contributed to the design of complete integrated systems, including not only the specific biosensing components but also the sample treatment and distribution solutions, and the overall electronics [2]. This efficient integration allows these devices to work in a standalone modality and perform all the steps required to obtain a reliable detection of specific analytes, including sample collection and result interpretation [3]. This novel and continuously evolving approach appears to be particularly promising for on-site and (almost) real-time feedback on various biomarkers—i.e., any measurable indicator related to the health status of a subject—via non-invasive approaches. One of the main advantages of this method is the possibility of performing all these analyses without the necessity of accessing health facilities and to promote home-based and decentralized modalities [4]. Of course, several requirements, related to both the functions and applications, need to be satisfied in order to make these tools a solid and reliable method accepted by both the medical-scientific community and end users [5]. In particular:
  • Optimal levels of specificity and sensitivity are needed for the early detection of specific disease-related markers [6].
  • Repeatability and reproducibility of the methods can ensure reliable results, which must be strictly non-dependent on users/testers or the environmental conditions.
  • Stability over time is required to ensure reliable outcomes even when multiple tests need to be performed across a long span of years, as happens, for example, in the monitoring of chronic pathologies.
  • Usability aspects (e.g., invasiveness and complexity of the procedures for sample extraction and preparation, user interface, etc.) must be addressed to ensure a wide acceptance of the technology, and also the overall direct and indirect costs of the proposed solutions, which can be assessed in terms of general cost-effectiveness.
In the last decade, in order to develop specific PoCT solutions, several approaches have been investigated in terms of detection principles. These can be grouped into three main categories: (1) mass-based, (2) optical and (3) electrochemical biosensors. Even though mass-based and optical biosensors present high levels of sensitivity and specificity [7,8], both show significant challenges in terms of lack of repeatability, high dependency upon contour variables, high cost, excessive fragility, limited flexibility, reduced portability, and low integrability of the readout units [9]. On the contrary, electrochemical biosensors represent the easiest solution to fabricate and miniaturize, thus facilitating the possibility to integrate the customized readout circuits on the same sensing substrate [10]. Therefore, aiming towards large scale and low cost diagnostic solutions, the potential to integrate electrochemical biosensors in modular PoCT or lab-on-a-chip systems represents an extremely promising strategy in terms of impact [11], even when compared to the bulkier and more expensive optical and mass-based approaches [12,13].
Indeed, the recent advances in the area of printing technologies combined with the progress in bio- and electro-chemistry [14], nanostructures [15], solid-state and surface materials, integrated circuit electronics, microfluidics, and data processing have raised the possibility to design and develop a whole new generation of electrochemical biosensors [16].
Regardless of the chosen technology, it will be essential to pay close attention to the validation of the inherent metrological performance of each system in its entirety, including both the sample management, the sensing components, and the overall electronic design [1]. Thus, although recent advances in nanostructures, nano-printing strategies and hybrid nano-molecules have strongly improved the limit of detection (LoD) of specific biomarkers, the main overall challenges of PoCTs still concern selectivity, repeatability, and stability [17]. These characteristics need to be validated through standard procedures before the whole system can be considered valuable for applications.
Keeping in mind all those requirements, the validation procedures—including both the laboratory and clinical tests required to assess their overall metrological performances—represent the most crucial aspect in the design and development of PoCT solutions. From this perspective, a broad classification of PoCT systems can be made, distinguishing between qualitative/semi-quantitative solutions, devices able to provide a binary (yes/no) answer, and quantitative technologies, which associate a quantitative output with the performed analysis. Among these latter, the validation of quantitative electrochemical PoCT systems is the most articulated process, and often there are no standardized or commonly accepted procedures able to assess the overall validity of the novel devices in comparison to well-established lab methodologies.
This review aims to provide a deep insight into the main validation procedures adopted to assess the metrological characteristics of electrochemical PoCT systems. Further, this review is mainly focused on human sweat biofluid to highlight the importance of the non-invasiveness of this approach without losing generality.

2. Search Strategy and Papers Selection

The review took into consideration original studies identified on three different online databases (Scopus, Web of Science, and Pubmed) and published from 2010 to 2021. The search was performed on title, abstract, and keyword by using the following string:
(sweat) AND (validation OR accuracy OR performance OR precision OR sensitivity OR specificity OR assessment OR reliability OR repeatability OR error OR uncertainty OR “limit of detection”) AND electrochemic * AND (biosensor * OR sensor * OR test * OR instrument * OR technolog * OR method * OR equipment *).
Conference and review papers were excluded. A first title screening was then performed to exclude all papers focused only on materials, techniques or addressing electrochemistry rather than on a complete description of the development of wearable PoCT devices and their validation. Finally, articles selected for this review study were included only if (1) evaluating sweat as biofluid, (2) including both in vitro and in vivo validation stages, and (3) providing sufficient information about the customized electronics integrated into the mobile or wearable device. All papers that characterized the overall sensing platforms with a commercial potentiostat (such as [18,19]), or consisting of commercial sensors (such as [20]), or that failed to include a description of the customized electronics used were excluded (such as [21]). For example, in [22,23] the biodevices were validated only in vivo whereas in vitro validation tests of those devices were not reported in previous papers; instead in [24,25], the biodevices were tested only in vitro and by using the enzyme prepared in artificial solutions.
The whole screening and inclusion/exclusion process was performed by using an online tool for systematic review [26].
Included papers were analyzed and the following details were extracted, compared discussed through the text and summarized in the cumulative tables reported at the end of the paper. Particular attention was given to:
  • Application and type of transducing principle: target analyte, transducing principle (amperometric, impedimetric, or potentiometric), and detection protocol (Table 1).
  • Sensing (Table 2).
  • Validation protocols:
    In-laboratory validation (with standard solutions or artificial biofluid) (Table 3).
    On-body validation or clinical trials, comparison with gold standard analytical techniques (Table 4).
  • Electronics design (Table 5).
  • Adopted metrological figures, including sensitivity, limit of detection, accuracy, selectivity, repeatability, reproducibility, stability, linear range, response time, and recovery values (Table 6).
The literature research identified 255 papers published from 2010 to 2021 according to the string used as reported above. After carefully checking, conference papers and review articles were excluded from the analysis (51), further manuscripts focused on novel materials characterization or without metrological information reported in abstract with base research application (84) were excluded. After this first article selection, we had identified a panel of 120 manuscripts well characterized from a metrological point of view but among them only a few also reported on-body testing. Thus, 15 manuscripts were finally identified as the most representative to discuss validation procedures and technical standards for practical on-body testing for use in the near future. Based on in-depth analysis of those papers, the following sections address the most relevant standard parameters for validation, the validation procedures and the electronic design considerations. Finally, an overall discussion is provided on the main opportunities and challenges highlighted in the comparative analysis.

3. Standard Parameters for Validation

The performed review of scientific literature allowed identifying the main metrics that are used to validate the mobile or wearable PoCT devices.

3.1. Sensitivity

The sensitivity in electrochemical biosensors often refers to the slope of the calibration curve obtained by measuring the response of the sensor at different concentrations of the target analyte. It is usually expressed as the ratio between an electrical parameter and the analyte concentration, and it is one of the most relevant indicators of the performance of the biosensor. As the sensitivity increases, the ability to differentiate among very similar concentrations increases. Since one of the main issues in electrochemistry is unspecific binding, to guarantee optimal performance and the possibility of detecting low concentrations of analytes, high specificity should be combined with a limited signal derived from the background noise sample (blank or matrix sample) and low intrinsic variability of the sensing device with respect to the blank sample.

3.2. Limit of Detection and Limit of Quantification

The limit of detection, often referred to as LOD or LLOD (lower limit of detection), represents one of the most adopted quantities to characterize the performance of a biosensor and compares outputs among different solutions. LOD expresses the lowest quantity of target analyte that can be distinguished from the absence of that substance (a blank value) with a stated confidence level (generally 99%). It is estimated from the mean of the blank, the standard deviation (SD) of the blank, the slope (analytical sensitivity) of the calibration plot, and a defined confidence factor (usually 3SD) [27,28]. It can be also considered an indicator of the resolution of the system obtained with a statistical approach since it takes into consideration the contributions of both uncertainty and resolution [27]. Together with the LOD or LLOD, which look at the smallest detectable quantity, the upper limit of detection (ULOD) is often considered, looking at the greatest quantity that can be quantified. This is useful in particular for those biosensors involving selective membranes or enzymes that can become saturated above a certain concentration of analyte [29]. Another metrological parameter that can be associated with the LOD is the limit of quantification (LOQ), which is useful whenever the testing environment may lead to poor reliability due to the significant influence of surrounding variables. The LOQ is usually computed following the same protocol but using a simple “rule of thumb”, such as ten times the SD [30] or three times the LOD [27].

3.3. Error Analysis and Accuracy

Accuracy in a biosensor is computed as the maximum divergence from the most reliable “gold standard” in terms of assay output. It is usually expressed as a percentage of error of the output from the validated biosensor with respect to the output of traditionally accepted laboratory equipment. For example, pH measurement accuracy is often provided according to pH-meter output, flow rate measurement accuracy is provided according to optical measurement [31], while the gold standards for ion quantification are typically atomic absorption spectrophotometer (AAS) and ion chromatography (IC) [29]. Further, results from biosensors for metabolites such as glucose or lactate are usually compared with the outputs from commercially available strips [32], and the results of alcohol quantification are compared with a commercial FDA-approved breath analyzer [32]. This comparison is a fundamental step for validating and confirming the reliability of a new method, taking as reference already commercialized technologies.

3.4. Selectivity

Selectivity represents the ability of the biosensor to correlate changes to a specific analyte, reducing the cross-sensitivity, thus detecting a given analyte in a sample containing a mixture of other analytes and contaminants.
An ideal biosensor should present an output variation only in response to a variation in target analyte concentration, while no output variation should be detected for a change in any interfering substance. Therefore, the selectivity of a specific biosensor can be quantitatively expressed simply as a dimensionless scalar number, usually a percentage referring to the variation in the output when an interferent is added to a target analyte solution in equilibrium condition. Its quantification is useful to compare different sensors and different interfering effects, as can be found in [33], where the authors computed the percentage by which the variability in sensor response falls due to potential interferents or, as described in terms of cross-sensitivity, as the slope of the calibration curve when the biosensor is subjected to different concentrations of an interferent [34]. Often selectivity can be considered qualitatively good when no interfering peaks or additional contributions in the output are recorded in the presence of interfering analytes [35].

3.5. Repeatability and Reproducibility

Repeatability and reproducibility represent relevant parameters to characterize the performance of biosensors since they take into consideration the variability associated with the measurements, intrinsic due to fabrication variability or extrinsic due to variability in the measurement protocol. They are both usually expressed as percentage relative standard deviation with respect to average measurements.
Repeatability is the ability to respond with limited variability when identical input stimuli are applied under the same working conditions and measurement setup. Specific protocols for evaluating repeatability need to take into account modifications introduced in transducer properties during each measurement, thus applying a suitable protocol to restore the same condition before starting each measurement used to calculate repeatability [36,37].
Reproducibility refers to the ability to respond with limited variability when the same input stimuli are applied under different working conditions (different operators, different instrumentations, different setups).
During the biosensor validation phase, repeatability is the most frequently evaluated parameter since repeated measurements with the same instrumentation are performed on the same sensors or sensors from the same batch treated with the same functionalization protocol. When replicated measurements require a duplicated experimental setup then it is more correct to refer to reproducibility. This is the case, for example, when sensors are integrated into a paper-based or microfluidic setup. When two measurements are performed using the same sensors integrated into different setups, the variability among them, indicated in terms of standard deviation, is referred to as reproducibility. In other cases, repeatability refers to measurements made with a single biodevice, using a solution with the same analyte concentration, while reproducibility refers to the measurements provided by different sensors, such as in [38].
The main disadvantage of using poorly reproducible sensors is that they need to be frequently re-calibrated. Calibration is a necessary procedure that allows one to compensate for sensor-to-sensor fabrication variations, thus improving the accuracy of the sensors, and for sensor drift, mainly due to the instability of sensors. Calibration represents one of the main problems limiting the use of biosensors. Therefore, the information concerning the calibration of a given wearable biosensor should be specified in the biosensor datasheet.

3.6. Stability

Stability represents the degree of susceptibility to environmental disturbances and other factors that could take place in and/or around the biosensing system. The output of an unstable biosensor typically presents a drift that affects the quality of the measurement information. Stability is an important parameter when the sensor is applied in applications involving a continuous monitoring of the measurand. Two different approaches can be used to evaluate stability in biosensors for wearable devices. The first approach is to evaluate the stability of the biosensor when it is undergoing a continuous, long, and constant stimulus (e.g., a fixed analyte concentration). The second approach is to perform discrete measurements of the same sample concentration at specific time points. In both cases, stability outcome can be quantified by computing the maximum difference between starting and ending response of the sensor (absolute or as a percentage of the initial measurement) [32], or by computing the decreasing or increasing rate expressed as electrical quantity variation per unit of time [29].
In more detail, depending on the considered time period, the concept of “stability” can refer to (1) operational stability or (2) shelf/storage stability. In general, operational stability is evaluated over short periods of time—typically hours—so as to estimate the changes that might take place during a single phase of continuous measurement. Shelf/storage stability is evaluated over longer time periods—typically months—during which periodically repeated measurements are performed to check any possible change in the quantitative outcomes [39].

3.7. Linear Working Range and Linearity

Together with LOD and sensitivity, further relevant parameters that are extracted from the calibration curve are the limits of the linear working range and the linearity of the curve within those limits.
The definition of the linear working range consists in defining the lower and the upper concentrations of the analyte in which the calibration curve can be considered linear. Linearity is a quantitative indicator that defines how much the real curve differs from the ideal regression line. It is usually expressed as R-square [29]. The linear range might be strongly affected by the medium in which the target analyte is dissolved, therefore different results might be obtained from calibrations performed in standard solution with respect to those performed in artificial or real biofluid containing interfering molecules.

3.8. Response Time

The response time is a quantitative indicator of the time needed by the biosensor to provide an output that can be reliably correlated with the concentration of the analyte tested. It is usually computed thanks to a dynamic calibration, evaluating the time needed from the output to reach a fixed percentage of the maximum steady-state values. For traditional sensors, the response time is usually the time needed to go from 10 to 90% of the steady-state value, while for biosensor validation, high variability in the meaning of response time can be found. In some cases, as in [29], the response time to the electrolyte in potentiometric sensors is calculated from the in vitro calibration, as the time needed to go from the steady-state baseline value at the lowest concentration to the steady-state value of the concentration after a standard addition. In other cases, as in [31], the response time calculated from both in vitro and in vivo measurements is considered as the time between the injection of the target analyte and the moment in which the signal starts to rise or fall, changing from the steady-state in which it was before. In [38], since the biosensor was characterized according to the amperometric response, the times elapsed in different conditions were evaluated: (1) the time for the baseline stabilization, (2) the time for the signal appearance after the injection of the analyte, and (3) the time to reach the steady-state condition. This analysis allowed the determination of the minimum time for the best correlation between the analyte concentration and the biodevice output.

3.9. Recovery Values

Considering the in vitro validation of electrochemical sensors, another important metrological parameter is the recovery rate. This metric is usually obtained when a known amount of the target analyte is spiked into a sample matrix and then measured with the novel technologies, then, the variation between the measured concentration and the known value is calculated [40]. A bad outcome of the test suggests that the measure is affected by the matrix effect that occurs when there are differences between the sample matrix and calibrator diluent that affects the response in the signal [41].

4. Validation Procedures

A further important step in the definition of the correct assessment standards is to highlight the possible validation procedures used in the context of PoCT devices, visually summarized in Figure 1.

4.1. Laboratory Validation

The first stage of validation of any point of care refers to the analysis of the results obtained for the biosensor in controlled-environment laboratory conditions. Since in this phase the aim is not to characterize the complete PoCT device during its real use, portability is not required, and thus certified commercial instrumentation which serves as “gold standard” is often exploited to guarantee optimal accuracy, stability, resolution, and reproducibility of the measurement system. Moreover, these results are usually used as a reference comparison to validate any customized mobile or wearable electronic solution, and thus to ensure the reliability of in vivo [38] measurements. This phase is fundamental for optimizing the detection protocol, without taking into consideration further variability introduced by an on-body or a home-based use of the complete PoCT device. All the information acquired from the analyzed papers and concerning these approaches is summarized in Table 3. Furthermore, in the laboratory evaluation, all the issues about interferents need to be completely characterized in order to provide a controlled analysis of the effect of non-target analytes on the final output. The two main classes of laboratory validation are standard solution-based and artificial biofluid-based.

4.1.1. Validation Tests with Standard Solutions

The first stage to validate any electrochemical sensors included in wearable devices encompasses evaluation of the performance performing an in vitro calibration using standard solutions prepared in a controlled environment, containing only the target analyte, without any interfering agents.
The ranges of concentration used to perform sensor calibration depend on the specific target analyte’s physiological concentration expected during real operation. Focusing on validation of sensors for sweat analysis, standard solutions are usually obtained using deionized water to dilute electrolytes [29,31] or a diluting buffer containing a supporting electrolyte as phosphate-buffered saline (PBS) [32], potassium chloride [35], or acetate buffer [33]. The choice of the most suitable solvent depends mainly on three factors: the solubility of the analyte, the window voltages of interest to detect the analyte, and the material of the working and counter electrodes. Thus, a suitable solvent should ensure no response in the potential window tested, to avoid interfering signals in the baseline. The window potential in which this takes place is named the “stability window” and its definition represents one of the most crucial operations to establish the most suitable supporting electrolyte solution and to ensure the reliability of any signal recorded when the analyte is present.
Usually, two different protocols are employed to evaluate and calibrate the sensor response under analyte concentration changes. The first protocol refers to a standard calibration, often known as “single point” or “static” calibration, in which several sensors equal to the number of tested concentrations are employed to build a calibration curve. Each sensor is exposed to a specific concentration and its electrical response related to the value of concentration tested, in terms of potential or current [33]. If several sensors are tested with the same concentration, the standard deviation of each calibration point can be calculated, providing a quantitative idea of the reproducibility of the measurement. The resulting calibration plot correlates the analyte concentration and the electrical response of the sensor, and provides quantitative information in terms of sensitivity, LOD, LOQ, and RSD.
The second protocol, also known as “continuous” or “dynamic” calibration, refers to a calibration in which the same sensor is successively exposed to different steps of rising and falling concentration of the target analyte, and its electrical output quantity measured. Knowing exactly the time in which the concentration is changed, from the measured output signal it is possible to extract useful information concerning the response time, the transitory, and the steady-state duration. The value reached by the electrical output during the steady state before each successive injection is sampled and related to the corresponding concentration. Thus, a calibration curve can be extracted from these data, similarly to what is performed during a single-point calibration. Repeatability can be evaluated by performing the very same pattern of increasing and decreasing concentration on multiple sensors. This protocol is essential to validate sensor performance over time.
This continuous validation can be realized by using two different setups. The first one, more traditionally employed in electrochemistry, is based on sensor immersion in a beaker initially containing only the supporting electrolyte solution continuously stirred to ensure homogeneity. Before starting with the following additions, the sensor needs to be left in the supporting electrolyte solution for a period ranging from 2 to 10 min to stabilize. This period depends on the geometry of the sensor and the amount of liquid. Each step of increasing concentration is then achieved by adding standard additions of a highly concentrated solution, each decreasing, adding further diluting supporting electrolyte solution after the maximum concentration is reached. The amount of liquid and the velocity of the stirring process should be optimized since these aspects can affect the sensitivity of the resulting calibration curve.
The second setup, which resembles more realistically the real-operation conditions of the sensors, is based on the integration of the sensor itself within a dedicated microfluidic circuit. Essential elements of this circuit—which can be realized with various technologies—are: (1) a sample pad or wick used to collect the sample; (2) a thin channel necessary to continuously deliver the sample on top of the electrodes; (3) a waste reservoir needed to discard the already measured samples. The starting point level is usually obtained by providing a continuous flow of supporting electrolyte solution on top of the sensing electrodes to reach a steady-state level. After that, flows with increasing and decreasing concentrations are provided to the electrodes, and their response is measured. Using this second setup, the velocity of the flow is the main variable that can affect the response time and the sensitivity of the measurements. Thus, particular attention in dynamic calibration performed with the sensor integrated into microfluidic circuits is addressed to the optimization of the materials and geometries used to form the wick, channels, and waste reservoir in order to provide a continuous flow [31]. Furthermore, additional tests of the sensors integrated into standardized setups with controlled flows are often performed, in order to find the influence of flow rate on sensor sensitivity [35].
The time stability of both the setups described can be then evaluated by long-term stability tests of the response of the sensor to a fixed concentration and flow rate over a long period, continuously [29,31], or at discrete time points [32].

4.1.2. Validation Tests with Interfering Analytes

The second stage required to validate electrochemical sensors included in mobile or wearable devices encompasses the in vitro evaluation of their performances in presence of controlled concentrations of interfering agents in addition to the target analyte. By using this approach, it is possible to estimate the selectivity of the biosensor under near realistic working conditions. This analysis is usually referred to as an “interferent test” or “selectivity evaluation” since it focuses on the evaluation of the selectivity of the designed sensor against the target analyte even in presence of other analytes (e.g., electrolytes, metabolites, or proteins) that are physiologically present in human sweat.
The evaluation of the performance of sensors in non-ideal conditions can be either performed by adding standard solutions with a controlled concentration of interfering analytes [32,33] or by exploiting more complex multi-analyte solutions, also known, in this case, as “artificial sweat” [29]. In the first case, a solution containing a fixed concentration of the target analyte is measured until a steady state is reached. Then, during the same measurement (e.g., potentiometric, amperometric), interferents of known volume and concentration are added. In the final measurement, knowing the timepoint at which the addition of interferents was performed, it is possible to quantify their effect on the steady-state current measured. While performing those tests the change in sensor response (i.e., potential level, current peak amplitude, steady-state current) should be evaluated and quantified—in absolute or percentage terms [33]. For this specific application, the types of interfering agents are usually chosen considering the physiological composition of human sweat and are mainly: uric acid, ascorbic acid, glucose, lactate, and anions or cations other than the target ones.
Artificial sweat and sweat from control patients are some of the most useful fluids used directly as diluting buffer for the target analyte. The influence of interfering agents on the output of the sensor is usually evaluated considering different proportions between the target analyte and the interfering elements, to understand if there is a specific threshold above which they start to interfere. This can be obtained by employing different dilutions of the artificial sweat to change the concentration of interferents in the final solution [45].

4.2. In Vivo/Clinical Validation

Once the laboratory validation of the biosensor has been completed, the following step refers to the validation of the overall mobile or wearable PoCT device in non-controlled conditions, during realistic operation. Since, in this phase, it is essential to test the device as a whole stand-alone platform, highly portable, customized electronics, properly interfaced with the biosensor are used. This stage is essential to account for all the contour variables including influences of interferents, movement artifacts, time, humidity, and overall reliability of the mobile or wearable customized electronics. Concerning these issues, comprehensive information from the analyzed papers is summarized in Table 4.
For the identified application, the validation with real sweat samples can be distinguished mainly between ex situ analysis, taking into consideration samples previously sampled from human subjects, and in situ analysis, evaluating the wearable device during its real on-body operation.
Both ex situ and in situ sweat analysis can be performed on sweat collected spontaneously as a consequence of the subject performing physical exercises or thanks to a sweat induction through standard iontophoresis. The indoor cycling bike [12] or the treadmill [11] were typically used to control physical activity and the workload. For example, an elevation of the lactate concentration can be obtained by increasing the treadmill speed. Sweat induction through standard iontophoresis is a fairly widespread technique [38], especially for those experiments that are focused not on monitoring sweat during exercise, but on evaluation of particular physio-pathological conditions (e.g., stress or cardiac issues) [32,46]. In other cases, sweat analysis was used as an alternative to invasive blood analysis; for instance, in [38], the ethanol concentration measured in sweat by the proposed biosensors was demonstrated as a non-invasive method for the determination of ethanol concentration in the blood and a valuable alternative to the breathalyzer, especially for preventing measurement alteration by the users. The typical sweat induction is referred to as active iontophoresis (IZASA). Briefly, two recessed stainless-steel electrodes, covered with a gel containing pilocarpine are strapped on the target site of the subject’s body and a small electrical current (usually around 1.5 mA) is passed through the electrodes for 5 min by using a battery-powered device. The electrodes are usually then removed and two paths can be followed: the induced sweat is directly collected and analyzed ex situ [33] or the wearable biodevice is positioned onto the same spot and the measurement performed directly in situ [32,38]. According to the characteristics of the biosensor (i.e., disposable or reusable, repeatability, reproducibility, stability, etc.), the device could be tested in continuous single measurement modes [38]. Although the definition of the sample size is fundamental from the clinical perspective, among the considered papers, the number of volunteers—used as a control group—ranged from 1 to 40 [38].

4.3. Validation against “Gold Standard” Assays

Proper validation of any biosensor performances cannot be considered complete without a comparison of the results obtained with the outputs from “gold standard” methods, which are well accepted and certified in laboratories. The choice of the specific method depends on the category to which the target analyte belongs (e.g., protein, metabolite, or electrolyte). Those methods are represented by the “gold standard” techniques that are routinely adopted in wet laboratories (e.g., spectrophotometry, atomic force microscopy, optical measurements, chromatography, and standard protein quantification assays) but also by commercially available certified portable devices (e.g., glucometers, lactometers, and breath analyzers).
Regarding pH electrodes, the most-adopted reference technique is a standard pH meter comprising a solid electrode in a bulb and that is re-calibrated before any measurement to ensure high accuracy [34,42].
Regarding sweat rate measurement, the commonly adopted methods rely on an optical system (e.g., Macroduct system) that represents a standard sweat collection system used in cystic fibrosis diagnosis. This solution is extremely useful in optical sweat rate measurement since it can be worn on a small region of the body to measure the local sweat content and sweat rate [31].
Moreover, different methods are reported to be useful in validating biosensors addressing electrolyte quantification, such as atomic absorption spectrophotometer (e.g., for Ca2+) [42] or ion chromatography (e.g., for Cl) [29].
Further, the performance of sensors addressing metabolites (e.g., glucose or lactate) is usually validated using commercial strips combined with a 5glucometer/lactometer [32,45].
Differently, biosensors addressing alcohol quantification have been reported to be validated following different methods. A first approach relies on the use of a commercial FDA-approved breath analyzer that is able to quantify the analyte in breath [32], whereas a second approach is based on the use of a gas chromatography-based blood analysis of prewarmed, free-flowing, fingertip punctures into heparinized capillary tubes [38]. A third method relies on the measurement of salivary lactate using a commercial immunoassay kit [22].

5. Electronics Design Considerations

Regarding the different examples of conditioning and transmission electronics proposed in the analyzed papers, despite the evident use of different designs and specific components, a common scheme could be recognized; this overall approach allowed us to track useful indications for researchers of the field. It is worth further noting, that the electronic components play a fundamental role in the overall reliability of any complete PoCT device. All the information concerning electronics design and choices acquired from analyzing the papers is summarized in Table 5 and visually summarized in Figure 2.
First of all, essential considerations for the design of suitable electronics include, from one side, the requirements related to portability, ease, and duration of use and, from the other side, the requirements related to accuracy, resolution, and precision.
Regarding the first set of requirements, one of the most relevant aspects is the material of the substrate on which the electronic components are soldered, as well as its enclosure and integration with the sensor’s microfluidic part. Despite most of the examples reported still proposing standard miniaturized circuits realized on rigid printed circuit boards (PCB) [31,33], an interesting example of evolution toward flexible electronics can be observed. The first approach presented in [35] proposed ensuring flexibility of the electronic part by enclosing a rigid PCB in a properly designed flexible material, to avoid displacement during exercise. The second approach presented in [29,32] reported the use of flexible materials, such as polydimethylsiloxane [45] and polyimide [29,48] as useful substrates on which electronic components can be directly fixed thanks to suitable conductive epoxy glues.
Another relevant aspect to deal with is the battery life and overall power consumption. To enable stand-alone wireless functioning of the mobile or wearable PoCT devices, rechargeable lithium-ion batteries with a nominal voltage of 3.0 V [32,48] or 3.7 V [31,33] are usually adopted [33], which ensures a use duration of a few hours [32,35,49]. Furthermore, the conditioning system is typically a single-supply system, and the electronic components are selected in order to reduce the power consumption and thus extend the overall battery life. An interesting approach for the power supply is the design of battery-free biosensors, where power is harvested in the proximity of NFC-enabled smartphones then modulated to a stable voltage output for MCU and AFEs (˜2.76 V) [29].
The first stage of the electronics interfacing with the connections to the electrodes of the biosensor depends upon the category of electrochemical biosensors, i.e., amperometric, potentiometric, or impedimetric. In amperometric sensors, a three-electrodes layout is usually adopted, with working (WE), reference (RE), and auxiliary (AE) electrodes. The transducer circuit is composed of two elements: a control circuit, to keep the voltage potential of the electrochemical cell stable, and a current-to-voltage (I/V) converter, based on a transimpedance amplifier, to measure very low currents reducing the effect of changes in the output impedance [33]. In potentiometric and impedimetric sensors a two-electrode layout is usually adopted, with only WE and RE [31]. For potentiometric measurements, the conditioning circuit is composed of a control circuit and an instrument amplifier, that ensures amplification of the input voltage between the electrodes WE and RE, by guaranteeing, at the same time, a very high input impendence. A combination of a variable frequency generator and a frequency analyzer is generally used for impedimetric measurements [35]. This allows stimulation of the electrochemical cell at different frequencies, and the analysis of the resulting alternate current to compute the cell impedance. Operational amplifiers are used also for active filter stages to filter the signal and remove the noise as well as for gain stages. For example, in [20], the signal conditioning circuit was designed to amplify the current measured by the biosensor between 1000 and 2831 times to obtain a measurable voltage output. Rail-to-rail inputs and outputs, output stability over time, and high gains at lower supply voltages are fundamental features for the selection of the operational amplifiers.
The remaining blocks of the conditioning electronics are quite common among all the electronics proposed, and, in general, include:
  • Customized high impedance analog front ends to process voltage signals of the two or three electrodes to output stable voltages;
  • Built-in analog to digital converters (ADCs) to convert the analog signal into digital signals;
  • A micro-controller unit (MCU), usually programmable, that manages all the operations on the board;
  • A display [20];
  • A transceiver (typically a Bluetooth module) to wirelessly transmit the data provided by the MCU to a user interface for displaying the measurements on a laptop or mobile. Although integrated Bluetooth low energy (BLE) represents the most frequently employed method for wireless transmission from the wearable device to laptops [22,31], or smartphones [31], interesting examples can be found adopting also an NFC-based transmission [29,34]. This recent method can improve miniaturization since the power supply can be harvested from mobile phones via NFC, thus resolving the need for battery integration in the wearable device. As opposed to BLE-based PoCT, the NFC-based solutions need a short distance between the PoCT and the reader and allow single-point measurements.
  • A DC-DC converter (or low-dropout voltage regulator, etc.) to realize regulated and stable voltage from one single power supply and suitable for all the electronic sections—the analog front end and the digital components and the transceiver—which can need different voltage supplies [33].
If the platform consists of multiple sensors, multiplexes or high-voltage switches are required to measure multiple sensors within the same measurement chain [32,34,44]. In this way, the size and power consumption of the platform do not depend on the number of the sensors and can be kept to a minimum.

6. Discussion

The analysis of the works included in this review allowed us to identify not only recurring trends and useful guidelines but also limitations and gaps in the validation procedures more commonly adopted to validate complete PoCT devices, in a stand-alone configuration.
Although similar protocols and validation phases can be recognized, the papers analyzed often show several missing steps and stages, thus preventing recognition of a shared uniform standardized workflow that can—and should—be used for characterization.
The effort in trying to standardize methods for characterizing chemical and biological sensors can be highlighted in the literature produced during the last two decades [50,51]. However, emerging from this review is a lack of procedure standardization and the absence of clear scientific references able to explain why the validation protocol was organized in that specific way. This represents the main gap that exists between the validation of biochemical sensors, and the widespread physical sensors (e.g., accelerometers, pressure sensors), making them less robust and not yet ready for the commercialization stage. Despite this delay, the performed analysis shows an improvement in the procedures in terms of standardization and the number of metrological parameters reported in the last 5 years. Increased attention to, and a more accurate description of protocols used to characterize the biosensors, at least for the in vitro phase, can be seen [45].
An element of weakness that could be noticed even in papers with a relatively complete and standardized characterization procedure is the lack of indication of the number of samples or subjects evaluated and how average measures and standard deviation information were calculated; indeed, this represents a limitation since only the knowledge of sample dimension can discriminate between a proof-of-concept and a properly working biosensor that can proceed further to clinical trial testing or commercialization.
Another crucial point not always considered in the analyzed papers is represented by a proper comparison of the output of the wearable PoCT device under assessment with respect to commercially available certified systems. This comparison should include two different stages. The first unavoidable step is the comparison of the performance of customized electronics with results obtained using benchtop or portable commercial potentiostats while performing the same electrochemical measurement (e.g., amperometric, potentiometric, or impedimetric); this represents a preliminary fundamental step of the validation procedure, which is essential to ensure the reliability of any customized electronics integrated into mobile or wearable platforms. Often this comparison is missing within the same publication [33,38], whereas in a few papers authors declare only that the customized electronics provides similar measurements to the ones provided by the benchtop equipment [47]. In further studies, the performances of the mobile or wearable electronics during in vivo measurements are validated by comparing the results of analyte quantification with results from an ex situ analysis performed by benchtop instrumentation [43,52]. Once this reliability is guaranteed, it is possible to proceed with a second comparison: the validation of the outputs with those ones obtained from “gold standard” approaches, routinely adopted in wet labs. This validation is essential to ensure that the transducing principle of the biosensors included in the wearable devices is coherent with “gold standard” techniques, both in terms of absolute results and, especially, in terms of reproducibility and stability over time. Regarding this type of comparison, even when present, it often lacks proper quantitative parameters that could help to better characterize it. Accuracy and recovery value thus are often missing from the parameters indicated in papers. Indeed, as reported quantitatively [29,33,34,43] or only qualitatively [42,45] by some of the papers analyzed, these parameters represent a significant figure of merit to verify the reliability of the proposed novel methods in comparison with existing ones.
Finally, information about the comfort and the ease of use represent crucial aspects in the development of wearable solutions; however, this point was not always provided by the authors [38], even when the design optimization was studied extensively [35]. In more recent publications, movies of the real-time ex situ analyses operated by the proposed PoCT are provided [47] or extensive and detailed information about the practical use of the developed customized application are reported [29,33,43,48]. Regarding comfort, most of the analyzed works simply state that thanks to soft encapsulating materials (e.g., PDMS) the device can be comfortably worn by subjects [43,52]. Interesting analysis was performed in [29], where a specific combination of PDMS and silver nanowires was tested to achieve high stretchability of the electrodes with an all-printing technique, to accommodate to skin deformations, without compromising the distinct conductivity change of the wires. Another interesting analysis to ensure proper compatibility between comfort and performances was observed in [52] where extensive mechanical characterization of the device was reported, simulating stress due to continuous use.
In general, the focus of the analyzed papers is on the sensor design and its performance, while the measurement system is lightly described, or its description is only included in the supplementary material. In some cases, the power source and its nominal value are not reported in the text, such as in [38,44,47], as well as the power consumption [31,33]. The main thing to remember is that the circuit contributes significantly to the final results (for example on the accuracy and LOD). For example, the operational amplifiers and the passive components can increase the electrical noise when the input and output of the impedance converter are not properly biased because the metal electrodes can be polarized and this alters the measurements [31]. A proper filtering circuit is needed for a reliable measurement. An RC low-pass filter is often chosen [48,49], while active filters guarantee the best performance [31,33]. The sensor-electronics interface should also be properly designed. For example in [35], the electronics are rigidified in order to reduce the voltage offset due to the pressure induced by the patch on the case.
The nonuniformity in metrological parameters represents another key element that can be highlighted from the present analysis. Although at least one metric of sensitivity, slope, or LOD is given, they are often presented in non-standardized forms and often reported only graphically and/or left to be deduced from calibration curves. A similar discussion can be had on linearity, often reported with non-standardized indicators, or just stated qualitatively, and for repeatability and reproducibility, often confused or mistakenly overlapped. Further, selectivity and stability are often commented only in a qualitative way, without proper quantitative indicators, as reported in [35,43] but not provided in [31]. However, defining those parameters in quantitative terms represents a crucial point in the comparison among repetitive measurements even when considering replicated setups. Focusing on stability, accurate computation of both operational and storage stability is fundamental to improve sensor design and to better understand their behavior, as highlighted in [34,45]. Interesting examples can be found in [52], where results from the evaluation of stability are exploited to define a proper protocol for periodic calibrations; in [49] this information is used to improve the process for the fabrication of the microfluidic system in which biosensors are integrated; and finally, in [53], the authors discussed how stability results can be used to eventually design proper algorithms for compensating biosensor performances degradation during both operation and their shelf-life.
Table 1. Summary of specific analytes and transducing methods.
Table 1. Summary of specific analytes and transducing methods.
REFAnalyteMediatorSelective LayerTransducing Principle
Liang 2021 [49]K+noneion-selective membrane for K+potentiometric
Zhang 2021 [43]K+noneion-selective membrane for K+potentiometric
Vinoth 2021 [42]Lactate, Na+, K+, and pHPrussian Bluelactate oxidase enzyme
target-specific ionophores
amperometric
potentiometric
Wenya 2019 [44]glucose, lactate, ascorbic acid (AA), uric acid (AU), Na+, and K+Pt nanospheres
for glucose and lactate; EDOT: PSS
for Na+ and K+; none for AA and AU
enzymes for glucose and lactate;
ion-selective membranes respectively for K+ and Na+; selectivity ensured by representative oxidation peaks for AA and AU;
amperometric (glucose, lactate), potentiometric (K+ and Na+) voltammetric (AA and AU)
Zhang 2019 [34]pH, Na+, K+, and Ca2+noneAl2O3 sensing layer for pH;
ion-selective membranes respectively for K+, Ca2+ and Na+;
amperometric
ion-sensitive field effect transistors (ISFETs))
Lu 2019 [47]glucose, Na+, K+nonechitosan/NiCo2O4 for glucose;
ion-selective membranes respectively for K+, and Na+;
amperometric
capacitance sensor
Sempionatto 2019 [48]Na+, K+noneion-selective membranes respectively for K+ and Na+potentiometric
Bandodkar 2019 [45]sweat rate, pH, lactate, glucose, and ClTetrathiafulvalenepH-sensitive die and silver
chloranilate; lactate oxidase trapped in CNT paper; glucose oxidase in Nafion;
colorimetric (rate, pH, Cl)
biofuel cell (Lac and Glu)
Xu 2019 [29]calcium, chloridenoneIon-solvent polymeric membrane selective for Ca2+;
electrodes of Ag/AgCl chlorinated in 3M KCl solution for Cl.
potentiometric
Tai 2018 [33]caffeinenoneselectivity ensured by representative oxidation peaks for caffeinevoltammetric
Nyein 2018 [31]H+, Na+, K+, Clnoneionophore cocktails coated
with selectivity respectively for H+, Na+, K+, Cl
potentiometric
Alizadeh 2018 [35]Na+ and K+noneion solvent-polymeric membrane selective for Na+ and K+potentiometric
Kim 2018 [32]glucose and alcoholPrussian blueenzymes amperometric
Gao 2016 [52]glucose, lactate, sodium, potassiumPrussian blueenzymes for glucose and lactate
ion-selective membranes
amperometric,
potentiometric
Gamella 2014 [38]alcoholferrocenealcohol oxidase/horseradish peroxidaseamperometric
Table 2. Summary of biosensors specific features.
Table 2. Summary of biosensors specific features.
REFSensor GeometryElectrodes MaterialSensor Substrate MaterialFabrication TechnologyMicrofluidic Integration
Liang 2021 [49]two-electrode layout
Circular (2 mm diameter)
WE: carbon + PEDOT:PSS
RE: silver/silver chloride
blue insulator layer
flexible PETscreen-printingpaper-based microfluidic
Zhang 2021 [43]two-electrode layout
Circular
WE: MWCNTs and MXene-Ti3C2TX
RE: silver/silver chloride
flexible PETscreen-printingPDMS microfluidics
Vinoth 2021 [42]two-electrode layout
rectangular, parallel electrodes
WE: carbon
RE: silver
Insulator layer
flexible polyimide sheetscreen-printing3D printed microfluidic
Wenya 2019 [44]three-electrode layout for amperometric
two-electrode layout for potentiometric, circular (3 mm diameter)
WE and CE: SilkNCT
RE: Ag/AgCl
nickel conductive tape and flexible PETsewedsilk-based porous structure
Zhang 2019 [34]CMOS sensor chip containing five groups of 3D-EMG-ISFET sensors linearly distributedelectrodes: Au
passivation layers: Si3N4 and SiO2
WE for pH: Al2O3
quasi reference electrode (QRE): Ag/AgCl
silicon layerphotolithographycotton-based microfluidic
Lu 2019 [47]two-electrode layout:
concentric circular electrode arrays can be divided into power units (micro-supercapacitors, red dots part) and sensor arrays (dark dots part), respectively
Cr (30 nm)/Au (50 nm) electrodes
Al2O3 insulation layer.
PETphotolithography;
Atomic Layer Deposition;
none
Sempionatto 2019 [48]2 electrode layoutWE: Carbon
RE: Ag/AgCl
PDMSscreen Printing; photolitography;
electron
beam evaporation;
traditional PDMS/PMMA-based microfluidic pattern realized via photolitography
Bandodkar 2019 [45]two-electrode layout,
anode and cathode
current collector: gold
LaC anode: carbon nanotube (CNT) paper+ chitosan+ polyvinyl chloride
LaCcathode: platinum black + Nafion
Glu anode: carbon nanotube (CNT) paper
Glu cathode:
platinized carbon + Nafion
Polyimidephotolithography
drop casting;
paper-based microfluidics and microfluidic pattern via PDMS-based photolithography
Xu 2019 [29]two-electrode layout
circular (3 mm diameter)
Ca2+ WE: Carbon + Gold NPs + graphene oxide
Cl WE: Ag/AgCl
RE: Ag/AgCl
stretchable PDMSscreen printingporous sponge directly on top of the three electrodes
Tai 2018 [33]three-electrode layout
circular (1 mm diameter)
WE: Silver + Carbon + Carbon Nanotubes immobilized with NafionRE: Ag/AgCl
CE: Silver + Carbon
Additional insulation layer
PETroll-to-roll printingn.a.
Nyein 2018 [31]two-electrode layout for potentiometric, circular (1 mm diameter),
two parallel spirals (width 150 μm, separation 100 μm), aligned with
microfluidic channel, for sweat rate sensor
circular sensing electrodes: Ag and Gold.
spiral electrode: 30/80 nm Cr/Au
PETphotolithography; thermal evaporation.Spiral-shaped microfluidic channel via PDMS-based photolithography
Alizadeh 2018 [35]two-electrode layout, circular (3 mm diameter)WE and RE: conducting carbon + PEDOT
dielectric insulating layers
PETscreen printinglaminated microfluidics formed from one or more hydrophilically treated plastic films with patterned adhesives
Kim 2018 [32]three-electrode layout with an original design shaped like a panda.
Cathode and anode for sweat induction on the two sides in between WEs and CEs.
WE and CE: Prussian blue conductive carbon
RE: Ag AgCl
insulator to protect tracks
papilio temporary transfer tattoo base paperscreen printingnone since it is a tattoo directly on the skin
Gao 2016 [52]two-electrode layouts,
circular (3 mm diameter)
WE: 30 nm Cr/50 nm Au + PEDOT:PSS (for ions)/CNT (for metabolites)
RE: Ag/AgCl
Flexible PETPhotolithography, galvanostatic electrochemical polymerizationphotolithography-based microfluidics
Gamella 2014 [38]RE (Ag/AgCl) and an auxiliary (Pt), WE cylindrical pellets of bienzyme (HRP, AOD) + ferrocene (mediator) + graphite-Teflon electrodeno, working solution (phosphate buffer 0.05 M pH 7.4) separated from the skin by a PTFE membrane.nonesolid electrodesnone
Table 3. Summary of in vitro characterization protocols.
Table 3. Summary of in vitro characterization protocols.
REFNumber of SensorsIn Vitro Diluting
Solution Used
Calibration ProtocolSelectivity TestStability Test
Liang 2021 [49]5Deionized waterContinuous calibration: each sensor subjected to increasing concentration of K+ (non-homogeneous steps from 1 mM to 32 mM). Response time computed from the curve obtained.
All measurements performed using an electrochemical workstation.
Change in sensor response measured when selected interfering analytes (Mg2+,
Na+, Ca2+, HCO3, NO3, SO32−, lactate, Uric Acid, and Glucose) were added in the solution.
Long-term stability of the sensor was evaluated over a period of eight days
Zhang 2021 [43]5PBSContinuous calibration: each sensor subjected to increasing concentration of K+ (non-homogeneous steps from 1 mM to 32 mM).
The repeatability analysis of the sensor evaluated systematically by observing the potential response of
two sensors on ten separate occasions.
The selectivity experiment of
the sensor carried out by the potential response method with successive addition of 1 mM [K+] (two-fold), followed by electroactive interfering species of 20-μM Zn2+, 4 mM Na+, and 4 mM Ca2+;
and finally; 8 mM, 16 mM, and 32 mM [K+]
n.a.
Vinoth 2021 [42]6PBS, distilled waterCombined single point and continuous calibration with increasing concentration steps for lactate sensors. Only continuous calibration with both increasing and decreasing concentration steps for pH, Na and K sensors.For lactate single chronoamperograms were recorded with 5 mM lactate in the absence and presence of possible interfering species (Na+, K+, UA, AA, Glucose);
For ions change in sensor response was measured during a continuous choroamperometry when selected interfering analytes are added
to the probing solution (NH4, Ca+, Mg+)
Stability evaluated with repeated measurements over a period of 10 month
Wenya 2019 [44]50.1 M PBS (pH 7.0)Continuous calibration: each sensor subjected to increasing concentrations (low to high) of each target analyte.Change in sensor response measured when selected interfering analytes are added
to the probing solution
Measurement performed each week over a period of 4 weeks
Zhang 2019 [34]n.a.PBS and Artificial sweat containing 10 mM KClContinuous calibration: each sensor subjected to increasing and decreasing concentration/pH step changes (10 mM, 20 mM and 100 mM for [Na+] and 4,5,6,7,8 for pH).Change in sensor response measured
bringing the tested solution to different
pH and adding interfering ions
Measurement during time with a dynamic response of the sensor
Lu 2019 [47]n.a.Not specifiedContinuous calibration: increasing concentrations were dropped subsequently on the sensor. Glucose from 10 to 200 μm/[Na+] from 10 to 160 mM/[K+] from 1 to 16 mM.Change in sensor response measured when lactate solution is added
as interfering molecule.
Variation of capacitance stability of MSCs with 20,000 cycles.
Sempionatto 2019 [48]n.a.Deionized water or artificial sweat (composed of urea, lactic acid, NH4+, Ca2+, Mg2+,uric acid, glucose, Na+ and K+)Continuous calibration: injected on the sensor through a six-port valve varying concentrations of sodium (0.1 to 200 mM) and potassium (0.1–100 mM) with 10-fold increments.not performedVisual examination of the resiliency to mechanical strain: i) skin mounted device and the device under different strain tests: ii)t wisting, iii) bending and iv) stretching. Also, EMF stability of the sensor over several days (tested several days during a week period) for static system using 10 mM ion concentration in water
Bandodkar 2019 [45]3PBS, artificial sweatContinuous calibration: sensor suspended in a beaker containing buffer on a hot plate with controlled temperature starting from a no-analyte baseline and then adding increasing concentrations of glucose/lactate.Change in sensor response measured on addition of common interferents (ascorbic acid, uric acid, and glucose) in physiologically relevant concentrations.Sensors exposed to 10 mM lactate/150 uM glucose solution for 20 min.
Xu 2019 [29]5Deionized water,
Artificial serum, Artificial urine, Artificial tear, human sweat samples
Continuous calibration: during a single long potentiometric measurement, sensors subjected to concentration changes of target analyte from low to high and then from high to low. Linearity range and LOD were then calculated from steady-state value of each outstepped step.Change in sensor response measured when potential positive and negative interfering ions are added to the solution tested, in details:
for Cl sensor using HCO3, CO3,
OH and NO3
for Ca2+ sensor using Na+, K+, H+, NH4+
72 h potentiometric recording
Tai 2018 [33]n.a.Acetate buffer solutions; human sweat samplesSingle point calibration using standard solutions: caffeine solutions with different concentrations used on different sensors for DPV measurements performed with a commercial potentiometer.
Single point calibration using sweat-based solutions: caffeine added to sweat samples in different concentrations. To improve the sensitivity, accumulation of caffeine molecules at negative potential. Commercial potentiostat used for all the measurements.
Change in sensor response measured when selected analytes (urea, glucose, lactic acid, ascorbic acid, pilocarpine) were added in physiologically relevant concentrations to 40 × 10−6 m of caffeine in the acetate buffer solutions.n.a.
Nyein 2018 [31]n.a.Deionized waterCombined single point and continuous calibration of Na+ sensor and flow rate sensor:
(1) fixing the flow rate, sensing electrodes exposed to three different Na+ concentrations.
(2) fixing the Na+ concentration, spiral electrode exposed to three different flow rate values.
(3) continuous monitoring of the measurement during time to follow how both sensors respond to step variation in Na+ or flow rate
Not performedMeasurement for 350 s for Na+ sensor and for 1000 s for flow rate sensor
Alizadeh 2018 [35]3Deionized waterSingle point calibration with different salt concentrations directly on top of electrodes.
Continuous calibration of a Na+ ISE integrated in a patch to various salt solutions (0.1,1,10,100 mM) at a flow rate of 5–10 μL min.
All measurements performed with commercial instrumentation and using an in vitro fluidic system for artificial sweat delivery to the patch
Change in sensor response measured
when K+ is added in a Na+ environment.
n.a.
Kim 2018 [32]3PBSSingle point calibration: response of the glucose and alcohol biosensor tested in response to increasing ethanol concentrations tested with separate chronoamperometric measurements of 60 s.Change in sensor response measured
when relevant electroactive species (glucose, lactate, creatine, ascorbic acid, and uric acid) were added to 10 × 10−3 m ethanol.
Repetitive measurements of ethanol (left) and glucose (right).
Gao 2016 [52]8PBS, artificial sweatContinuous calibration: the chronoamperometric responses of the glucose and lactate sensors and the open circuit potential responses of the sodium and potassium sensors to increasing concentrations of the respective analyte solutions in phosphate-buffered saline (PBS) were measured.
Additional testing performed to evaluate the influence of mechanical bending and using artificial sweat diluting solution.
Change in sensor response measured
when relevant electroactive species are added. Shared solid-state Ag/AgCl or PVB reference electrodes were used respectively for metabolites and ions. Data recording was paused for 30 s for the addition of each analyte.
Repetitive measurements performed over a period of 4 weeks.
Gamella 2014 [38]10PBSSingle point calibration using different concentrations of ethanol in PBS with temperature control.
Repeatability tested repeating the same measurement on a single biodevice with 10 different solutions. Reproducibility tested repeating the same measurement on 10 different biodevices
n.a.Five different biodevices stored for 2 months in PBS and other five biodevices under dry conditions.
Table 4. Summary of in vivo characterization protocols.
Table 4. Summary of in vivo characterization protocols.
REFNumber of SubjectsEx Situ Analysis
Protocol
In Situ Analysis
Protocol
Data AnalysisComparison with Other
Gold Standard Test Techniques
Liang 2021 [49]1n.a.Task: three different phases, a 5-min warming-up, 20-min cycling, and a 5-min rest.Real-time analysis was performed on the volunteers during working on a cycle ergometer
with the device attached to the forearm area by a transparent adhesive PU membrane with a round hole for sweat evaporation
Only reference to standard K+ level from literature in serum
Zhang 2021 [43]1Ex situ (off-body) measurements from a PBS with known [K+] concentration value samples were employed to verify the accuracy of on-body measurements. Task: stationary cycling
real-time perspiration monitoring on the
arm
After properly connecting NFC and pre-installed application, the PC displays the sensor’s real-time output potential. Data are read from the FRAM, with the ADC values and corresponding raw voltages converted and displayed as [K+] concentration values using ex situ pre-calibration.No comparison with gold standard techniques, but performance comparison with that of
alternative sensors detailed in the published scientific literature
Vinoth 2021 [42]2Sweat samples were collected
at two different intervals of 15 and 30 min of stationary biking and analyzed using several gold standard techniques.
Task: 30 min stationary biking
load is initially increased, then maintained constant for up to ∼23 min, and
then decreased.
The sweat secretion and subsequent analysis of the data (real time presented) were started after 8–10 min of exercise activities.
Data obtained from in vivo calibrated device were compared with ex situ measurements.
Comparison with results from high-performance liquid
chromatography (HPLC), flame atomic absorption spectrometry
(FAAS), and a pH meter.
Wenya 2019 [44]5n.a.Task: 30 min cycling
Data acquisition: real-time and simultaneous on-body detection.
The test button was then pressed down to initiate the analysis, and results were displayed on the screen of smartphone after completion
of the analysis.
Compared glucose detection
with HPLC results
Zhang 2019 [34]2Sweat samples were induced and collected from volunteers, when sitting in a sauna, for off-body evaluationn.a.n.a.A commercial ISE (HORIBA LAQUAtwin-Na-11) to measure Na+ concentration, and a commercial pH meter (HORIBA LAQUAtwinpH-22) to measure pH,
Lu 2019 [47]1n.a.Task: 2 h of sport.
Data acquisition: real time monitoring of glucose/K+ and Na+ in sweat
Only qualitative results and graphs displayedn.a.
Sempionatto 2019 [48]3n.a.Task: 50 min cycling
Data acquisition: recorded in real-time during a 2000 s exercise activity
Data transmitted and displayed using a laptop and a homemade system control developed in Matlab.
Only qualitative graphs of analytes concentration during exercise time.
n.a.
Bandodkar 2019 [45]3n.a.Task: subjects wear the device
for two consecutive days and, on each day, execute a cycling exercise (15 min to 20 min) in the morning in fasting state, followed by another cycling bout 20 min after consuming 150 g of sweetened drink and then again 2 h after lunch in the evening.
Data acquisition: real-time data acquisition during each trial occurs either through a compact, short-range reader or an extended, long-range reader that was positioned in the vicinity of the device.
During human trials, the subjects paused
to take an image of the device using a smartphone camera, for colorimetric analysis. Mean values extracted from three random points (n = 3) from the colorimetric assays yielded the chloride concentration and pH. Mean concentration values calculated from the data generated by the electrochemical lactate and glucose sensors during the last 1 min (n = 60) of cycling resulted in concentrations.
Analyses using conventional techniques such as commercial blood lactate (Lactate Plus; Nova Biomedical, MA) and blood glucose (Accu-Chek Nano blood glucose meter, Roche Diabetes Care Inc.) meters capture blood lactate and glucose levels before and after each cycling bout, as points of comparison.
Xu 2019 [29]1n.a.Task: running on the treadmill
Data acquisition: 1 per minute, proximity of the smartphone
Real-time data and real-time plots of ion concentrations. The concentrations of Ca2+ and Cl during the whole exercising process could be calculated thanks to the calibration performed in vitro.The detection results of the electrochemical patch (N = 5) were compared with laboratory reference method, including atomic absorption spectrophotometer and ion chromatography.
Tai 2018 [33]2Human sweat samples collected thanks to a pilocarpine hydrogel-based iontophoresis from subject wrist for 30 min or from the forehead every 5 min during cycling analyzed ex situ with commercial potentiostatTask: subjects asked to consume a single-shot espresso (≈75 mg caffeine), then rest for 30 min, and then to begin cycling with the sensor fixed around the subject’s wrist with a PDMS band.
Data acquisition: 1 measure every 10 min
Raw data was then transmitted
via Bluetooth wirelessly to a user interface (CoolTerm serial-port terminal application), normalized to a common baseline current, and filtered (MATLAB Hampel and Smooth functions) for caffeine level monitoring on a computer. Curve fitting was performed and plotted as the dotted line (MATLAB Weibull function).
n.a.
Nyein 2018 [31]2 (sweat rate and Na)
1 (sweat rate, K, Cl, pH)
n.a.Task: cycling on an ergometer, constant power with the patch around the wrist Data acquisition: discrete measurement from Macroduct every 3 min to 4 min, continuous measurements performed with customized electronics with operating frequency 100 kHzQualitative comparison between the 2 subjects tested for sweat rate and Na+; qualitative plots for pH, K+, Cl and sweat rate to show possibility of multiple sensing. Parameters extracted: proportional trends, response timeOn-body performance of the sweat rate sensor was validated
with the Macroduct which is a standard sweat collection system
used in cystic fibrosis diagnosis. No validation for Na+, K+, Ph measurements
Alizadeh 2018 [35]1n.a.Task: high-intensity exercise on a bicycle or a treadmill with the patch on the subject’s back, adjacent to the spine on the latissimus dorsi muscle and/or thoracolumbar fascia in the region of the upper lumbar vertebra.
Data acquisition and transmission: The sweat patch and associated electronics module were monitored remotely via Bluetooth for the duration of the exercise sessions. Sample rate: 100 Hz, then moving averaged at 15 s
All work was carried out under a scope of work that was determined not to be human subject testing (E&I Institutional
Review Board). As a result of this process, the data collected during on-body was specifically not calibrated to prevent the generation of physiologic data on the subject, thus all data for on-body testing is presented in the raw form (mV).
n.a.
Kim 2018 [32]11n.a.Sweat induced with IP with the sensor placed onto the deltoid.
Task: initial baseline measurement, subjects sugar-rich food with an alcoholic beverage (12 oz. of beer or 5 oz. of table wine), wait for 15 min, second measurement. The same protocol repeated with varying chronologies of food/alcohol consumption.
Data Acquisition: flexible PCB board was connected to the tattoo using magnets to perform discrete measurements every 20 min.
Discrete values acquired compared among the different conditions tested.
The correlation blood level and sweat current signal for both glucose and alcohol was quantitatively described using R2 parameter,
Immediately before starting the experiment, blood glucose and alcohol levels were measured using commercial glucose strips (Accu-Chek Aviva Plus) and a commercial FDA-approved breath
analyzer (Alcovisor Mars Breathalyzer, Hong Kong) to validate the
sensor performance.
Gao 2016 [52]26Ex situ sensor performance conducted by testing sweat samples collected from the subjects’ foreheads. Sweat
samples were collected every 2–4 min by scratching cleaned foreheads with microtubes
Task: three trials: constant workload cycle ergometry (14 subj), graded workload cycle
Ergometry (7 subj), and outdoor running (12 subj). An ergometer providing real-time monitoring of heart rate, oxygen consumption, pulmonary ventilation and power output was used. The FISAs were
packaged inside traditional sweatbands during the indoor and outdoor trials. The
sensor arrays were calibrated, and worn on cleaned foreheads and wrists.
Due to differences in absolute potential values for ISEs in the same solution. Therefore, one-point calibration in a standard solution containing 1 mM KCl and 10 mM NaCl was performed for Na+ and K+ sensors before each use. The measured potential of ISEs in the standard solution was then set to zero by the microcontroller. The accuracy of on-body measurements was verified through the comparison of on-body sensor readings from
the forehead with ex situ (off-body) measurements from collected
sweat samples, no additional method used.
Gamella 2014 [38]40n.a.Sweat was induced by an IP system (Macroduct) for 5 min.
Task: alcoholic beverage assumption in 5–10 min (gin, rum or whisky mixed with a cola or juice soft drink) then alcohol monitoring following two protocols:
continuous mode → biodevice on the skin after sweat generation, continuous measurement from 30 min to 2 h.
single measurement mode → placing the biodevice in contact with the skin for 5 min every 15 min.
Data analyzed by computing the correlation between the ethanol content in sweat and in blood by gas chromatography, the correlation between BAC and the current measured in sweat with the biodevice time response and maximum ethanol concentration with respect to blood results.Reference standard blood analysis using gas chromatography method was performed 30 min after alcohol intake and every 10 min or after the single measurement.
Table 5. Summary of electronics specific features.
Table 5. Summary of electronics specific features.
REFElectronics Substrate MaterialElectronics Power SupplyKey Element BlocksData Transmission MethodsAdditional Filtering Circuits Integrated, Processing Algorithm
Liang 2021 [49]Flexible PCBLithium-polymer rechargeable battery of 50 mAh; measured average current consumption of the entire system during operation is 1–2 mA (depends on the Bluetooth data transmission frequency), which enables prolonged test.voltage follower circuit with an operational amplifier interface with electrodes; microcontroller; 12-bit ADC; 8-KB RAM;128-KB Flash; I2C interface and a leading RF transceiver was embedded.Bluetooth Low EnergyThe output of the voltage follower circuit is followed by an RC low-pass filter to minimize the noise and interference in the measurements. The potential of the reference electrode, from a voltage divider network, is constant and then digitized and recorded using the ADC.
Zhang 2021 [43]Copper and polyimide flexible film + PDMS coverBattery-free, power harvested from smartphone thanks to Near Field Communication interface chipThe SD14 module of the integrated NFC chip is a multi-channel sigma-delta analog-to-digital converter with up to 14 bits of resolution integrated into the NFC chip consisting of a programable gain amplifier (PGA) and a sigma-delta analog-to-digital converter (ADC). The output of the [K+] sensor was read through a 14-bit ADC convertor.Near Field Communication (NFC).
The core of an integrated circuit communicates with other modules via a memory data bus and a memory address bus. Instructions and data are sent from the smartphone to the RFID chip through the ISO15693 analog front end and decoded through the ISO15693 decoding module.
The smartphone application was developed based on an Android studio software program that displays the [K+] concentration by reading and calibrating the ADC’s output voltage.
Vinoth 2021 [42]Standard rigid PCB200 mAh Li-ion rechargeable battery; output regulated using a low dropout regulator to obtain precisely 3.0 V and stable power for every circuit component.For chronoamperometry, potential voltage generated by a 16-bits DAC, feedback loop compares its output with reference, a driver circuit controls the potential of the CE and a trans-impedance amplifier (TIA) converts WE current into voltages.
For potentiometry, three differential amplifiers built with operational amplifiers with extremely low input bias current (typically 0.5 pA) with rail-to-rail operation, enabling precise and wide-range measurement.
Both outputs are sampled and digitized by an ADC integrated in the MCU, that controls all the PCB via serial peripheral interface (SPI).
Bluetooth low energy (BLE)The real-time data are displayed using a custom-made graphic interface in the host platform. The regional dependence
in sweat secretion and its biomarker composition is investigated by performing the sweat analysis at the underarm
and upperback locations.
Wenya 2019 [44]Standard rigid PCBn.a.Signal transduction, conditioning, processing, I-V inverter; Transimpedance amplifier; Differential amplifier; ADC microcontroller;Bluetooth low energy (BLE)Low-pass filter
Zhang 2019 [34]Standard rigid PCBBattery-free, power harvested from smartphone thanks to Near Field Communication interface chipSignal transduction obtained with 3D-EMG ISFETs in an application-specific integrated circuit, a 16:1 multiplexer, 12-bit ADC, microcontrollerNear Field Communication (NFC)n.a.
Lu 2019 [47]Flexible polyethylene (PE) filmn.a.ADC, RC oscillating circuit, microcontrollerWiFi module provides a way to allow cached data in CPU transmit to Mobile APP.Signal from compensation electrodes used to reduce noise from unspecific responses
Sempionatto 2019 [48]Flexible PDMSLi-ion rechargeable battery (3.0 V)
with 100 mAh capacitance
Voltage follower circuit, ADC, microcontrollerBluetooth low energy (BLE)n.a.
Bandodkar 2019 [45]Copper-on-polyimideBattery free, power harvested from smartphone thanks to near field communication interface chip;Simple voltage-follower design, analog front-end independent from voltage supply thanks to zero-crossover operational amplifier, microcontroller and NFC front-end combination, various passive resistor and capacitor components using low-temperature solder paste.Near Field Communication (NFC)High-frequency filter that eliminates fluctuations introduced by the electric field of the primary NFC antenna.
Xu 2019 [29]Ultrathin flexible polyimide Battery-free, power harvested from smartphone thanks to Near Field Communication interface chip;Analog front ends, voltage stabilizers, 3 ADCs, microcontrollerNear field communication (NFC)Bias circuits, voltage buffer, and low-pass filter included in the analog front end
Tai 2018 [33]Standard rigid PCBSingle rechargeable lithium-ion polymer battery (3.7 V), to power:
the digital component of the circuit and the analog portion of the circuit at 5.0 V, achieved with DC-DC converter to boost up voltage
the Bluetooth module at 3.3 V, using only a low-dropout voltage regulator
16-bit DAC. low-pass transimpedance
amplifiers, 16-bit ADC, microcontroller
Bluetooth low energy (BLE)Fourth-order Sallen-Key low-pass filter
Nyein 2018 [31]Standard rigid PCBRechargeable lithium-ion battery (3.7 V)(1) For impedance measurement high precision impedance converter, on-chip ADC
(2) For the open-circuit potential measurement, voltage buffer provides a midrail reference voltage, 16-bit ADC, microcontroller.
Bluetooth low energy (BLE)Fourth-order Sallen-Key low-pass filter. Discrete Fourier transform (DFT) algorithm is used for impedance calculation.
Alizadeh 2018 [35]Standard rigid PCB
enclosed in a flexible material
Li-polymer battery; duration up to 3 h of continuous useHigh impedance inputs necessary for open-circuit monitoring
-No more details available
Bluetooth low energy (BLE)An application program interface (API) for Matlab was created which allowed the results to be visualized and processed remotely.
Kim 2018 [32]PolyimideCR2032 Lithium
coin battery, with power levels 30 and 6 mW in iontophoretic and amperometric
phases, respectively
Proprietary system-on-chip device: configurable analog front end potentiostat, several DC-DC converters for voltage supply regulations to generate reference potentials, a 3-terminal adjustable current source to provide iontophoretic currentBluetooth low energy (BLE)A set of high voltage
switches to switch between glucose and
alcohol sensing, as well as to enter a high-impedance state during iontophoretic processing.
Gao 2016 [52]Flexible PCBRechargeable lithium-ion polymer battery (3.7 V, 105-mAh)Programmable microcontroller through an in-circuit serial programming interface. The conditioning path for each sensor was implemented in relation to the corresponding sensing mode. In the case of the amperometric-based glucose and lactate sensors, the originally generated signal was in the form of electrical current.BluetoothAll the analog signal conditioning paths concluded with a corresponding unity gain four-pole low-pass filter, each with a −3-dB frequency at 1 Hz to minimize the noise and interference in our measurements.
A mobile application (the Perspiration
Analysis App) was designed to accompany the FISA and to provide a user-friendly interface for data display and aggregation
Gamella 2014 [38]Standard rigid PCBBattery-powered (V not available),
battery life 6–8 h
PCB, high current amplification circuit, I-V current, filtering circuit. AD8542, PIC 16F870, display LCDNot specified, provided information only about results displayed on LCDNoise removal
Table 6. Summary of in vivo characterization protocols.
Table 6. Summary of in vivo characterization protocols.
REFSensitivityLimit of DetectionAccuracy (Error Analysis)SelectivityRepeatabilityReproducibilityStabilityLinearityResponse TimeRecovery Values
Liang 2021 [49]61.79 mV/decn.a.The final sweat potassium level is similar to the serum one, with a slightly broader range (approximately 2–8 mM).Negligible interference of other ions and metabolites to the response of the K selective sensor (approximately 1 mV).n.a.RSD: 0.38%;however, absolute potential values for sensors differ in the same concentration of a solution, so calibration in standard solution, 1 mM KCl, is necessary before use.The sensor has a stable sensitivity.R2 = 0.999<5 s when concentration is doubledn.a.
Zhang 2021 [43]63 mV/dec, amplified to 173 mV/dec using an NFC amplificationn.a.Only reported a table comparing output from sensor and from complete system ExcellentRSD performance of 3.33% (sensor) and 2.67% (system) in four
measurements
Good reproducibilityn.a.Linear range 1–32 mM2 sFrom 92 to 97 %
Vinoth 2021 [42]71.4 mV/pH
59.5 and 60.1 mV/dec, respectively for Na and K
n.a.The HPLC analyses showed higher levels of lactate, which could be due to the accumulation of lactate
during sweat collection from the immediate vicinity of the microfluidic sensor.
The AAS studies and pH-meter outputs showed minimal variations with respect to the corresponding sensors.
3% increase in
current response compared to the response current; maximum of 3.7%
deviation in OCP responses
Similarly,
the potassium and pH sensors showed selective detection with
3.6% and 2% changes in the sensor responses
Reversibility with a negligible average RSD of 0.28%. Similarly, K-ISE (0.1–10 mM) and pH sensors
(pH 5–7) displayed good carryover efficiencies with average
RSDs of 0.32 and 0.47%, respectively
RSD=2.1%All of the sensor
performances are observed to be stable for more than 10
months. The sweat-extracting capability is reduced after 6
months due to the decrease in the hydrophilic nature of the
fluidic system
Linear range for Na 0.02–200 mM and for K
0.01–100 mM
Around 10 sn.a.
Wenya 2019 [44]Glu: 6.3 nA/µM
Lac: 174.0 nA/mM
AA: 22.7 nA/µM
UA: 196.6 nA/µM
Na+:51.8 mV/decade
K+:31.8 mV/decade
Glu: 5 µM
Lac: 0.5 mM
AA: 1 µM
UA: 0.1 µM
Na+:1 mM
K+:0.5 mM
n.a.Compared with the signal of the targeted molecule,
no noticeable interference signals were detected, implying the good
selectivity of each sensor, which is beneficial to the construction of
a multiplex sensing system.
n.a.RSDs are 3.6% for glucose, 4.2% for lactate,
2.8% for AA, 3.9% for UA, 8.2% for Na+, and 7.5% for K+
Negligible changes
over 4 weeks with RSDs of 6.4%
for glucose, 5.4% for lactate, 0.8% for AA, 3.4% for UA, 2.9% for Na+,
and 1.8% for K+
Glu: from 25 to 300 µM
Lac: from 5 to 35 mM
AA: from 20 to 300 µM
UA: from 2.5 to 115 µM
Na+: 5 to 100 mM
K+: 1.25 to
40 mM
n.a.n.a.
Zhang 2019 [34]Na+:−56.9 mV/decX
K+: −48.1 mV/decX
Ca2+: −25.7 mV/
decX
n.a.Compared to commercial Na+ meter and pH meter maximum deviation of maximum
12% and 2.3%, respectively.
Selectivity reported as cross-sensitivities in mV/decX:
for Na+ 2.7 vs. H, 2.3 vs. K+, 2.8 vs. Ca+;
for K+ 6.4 vs. H, 8.6 vs. Na+, 0.8 vs. Ca2+;
for Ca2+ 0.3 vs. H, −2.4 vs. Na+,−6.3 vs. K+
n.a.RSD 9.3% for
our Na+ sensors, and 2.3% for our pH sensors
Maximum time-dependent standard deviation of
1.95% in 3D-EMG-Na+ sensor, and 1.36% in the 3D-EMG-pH
sensor, with respect to their average value
n.a.Fast response (<5 s).n.a.
Lu 2019 [47]Glu: 0.5 μA/μM
()
Na+:2.25 μA/mM
(0.031 nF/mM capacitive mode)
K+: 4.25 μA/mM (0.056 nF/mM capacitive mode)
Glu: 10 μMn.a.n.a.n.a.n.a.Stable potential
windows between 0 and 1 V; after 20,000 cycles, the capacitance retention
still retained about 96.6% of its initial value, suggesting good cycling
stability
The response currents rise up linearly with the increase in
[Na+] from 10 to 160 mM and of [K+] from 1 mM to 16 mM
Glu from 5–25 mM
n.a.n.a.
Sempionatto 2019 [48]K+: slope 60 ± 12 mV
Na+: slope 46 ± 7 mV
n.a.n.a.Negligible interference from potential co-existing ions (Ca2+ and
Mg2+).
Response to 10 mM ion concentration in water using 10 repetitive flow
injections provided similar results
n.a.After a week change of 23% for Na+ and of 19% for K+linearity of r = 0.96 for K+ r = 0.98 for Na+It takes over 5 min for the
reservoir to be filled with sweat, during which only the
background signal is recorded.
n.a.
Bandodkar 2019 [45]Lac: 124 mV/(mM*cm2)
Glu: 5.4 mV/(mM*cm2)
Lac: 2.1 mM
Glu: 43 µM
Qualitative comparison between outputs from proposed sensor and conventional techniqueIncrement in signal due to interferents
~4% → Lac
~12% → Glu
Interference of pH changes:
Lac: SD 1 mV, maximum error of ~1.3 mM
Glu:
Maximum RSD ~6% for Lac
~4% for Glu
maximum RSD, ~5.5%The data reveal stable sensor response
throughout the first 6 days (maximum RSD of 1.9 and 4.4% for glucose
and lactate sensors, respectively) and a ~13 and ~23% Signal decrement
for glucose and lactate sensors, respectively, by 8 days.
The output voltage of the biofuel cell-based sensors increases
linearly with increasing load.
Glu: signal stabilizes within 10 to 20 s.
Lac: signal
stabilizes within 300 s
n.a.
Xu 2019 [29]Ca2+: 29.24 mV/decade
Cl: −51.02 mV/decade
Ca2+:
LLOD 5μM
ULOD 0.5 M
Cl:
LLOD 500 μM
ULOD > 1 M
Relative errors between the average sensor
readings and the real values acquired by AAS in serum, urine, sweat,
and tear (1.57%, 3.58%, 4.91%, and 1.32%, respectively for Ca2+ and
1.33%, 1.43%, 1.53%, and 1.15%, for Cl)
“Good selectivity”
stated from negligible response to other anions or cations tested
Ca2+ sensors:
RSD= 7.8%.
Cl sensors:
RSD = 13.8%
n.a.Ca2+: average
decreasing rate of 0.90 mV/h
Cl: average
decreasing rate of 1.50 mV/h during the first ten
hours. Then, the output became stable and decreased to 2.15 mV during the rest sixty-two hours
Ca2+: R2 of 0.99832
linear range: 10−5 to 10−1 M
Cl: R2 of 0.99983
linear range: from 10−2 to 1 M
Ca2+: 20 sCl: 30 sn.a.
Tai 2018 [33]Sensitivity of 110 nA/uM;
sensitivity of correlation between sweat caffeine concentration and caffeine intake of 45 × 10−6 M/g
LOD 3 × 10−6 MPeak current variations within 20%The results of selectivity test show that the change
in sensor response due to potential interferents falls within 9.2%.
n.a.n.a.n.a.The correlation between sweat caffeine
concentration and caffeine intake is highly linear with Pearson’s
correlation coefficient of 0.98
n.a.n.a.
Nyein 2018 [31]Na+: 56 mV/decaden.a.Error at each flow
rate varies between 6% and 11%. No accuracy data for Na+ measurements.
n.a.n.a.n.a.n.a.n.a.Na+ sensor: 12 min after the trial begins
Sweat rate: 22 min after the trial begins
n.a.
Alizadeh 2018 [35]54.8 ± 5.8 mV per log aNa+ per decade Na+
53.9 ± 5.0 mV per log aK+ per decade K+
n.a.n.a.K+ ISE shows no response to Na+ ions in the concentration
range of 1 × 10−4–1 × 10−1 M, while its sensitivity to potassium
ions is retained in an environment with more than onecationic species present.
n.a.n.a.n.a.Linear relationship in static calibration, R2 = 0.9979Around 15 min from sweat inductionn.a.
Kim 2018 [32]n.a.n.a.n.a.Highly selective response to glucose/alcohol
concentrations in the presence of relevant electroactive interference
<5% variation performing 10 repetitions of the same measurementn.a.Stability not evaluated during time but to repetitive measurements performed in time (<5% variation)(1) Observed signal in static calibration
resulted in a highly linear response
(2) linear correlation with R2 = 0.998 between blood and sweat glucose and R2 = 0.999 blood-alcohol level and sweat-alcohol using the same subject.
No response time evaluated: waited at least 5 min after the analyte intake to be sure to record steady state valuesn.a.
Gao 2016 [52]Glu: 2.35 nA/μM
Lac:220 nA/mM
Na+: 64.2 mV/dec
K+: 61.3 mV/dec
n.a.Similar results recorded ex situ and in situThe presence of nontarget
electrolytes and metabolites causes negligible interference to the
response of each sensor
n.a.RSD of ~1% in
sensitivity for ion sensors
RSD of ~5%
in sensitivity for metabolites sensors.
Metabolites sensors 5% uncertainty over 4 weeks.
Ion sensors non stable, one point calibration required before each use.
A linear relationship between current/potential and analyte
Concentrations could be observed
The responses
of both sensors showed drift initially but stabilized within 1 min of the data recording
n.a.
Gamella 2014 [38](1.6 ± 0.1)A g−1 L, r = 0.934, intercept = (0.02 ± 0.02) A g−1 L (after 5 min)0.0005 (in vivo, 40 volunteers)n.a.n.a.RSD: 9.1%RSD: 10.5%30 days in PBS, 2 months if dry stored.0.0005–0.6 g L−1 (in vivo, 40 volunteers)Baseline: in 2–6 min. signal appearance: 2–5 s. Steady state: 2–4 min (depends on ethanol content)n.a.

7. Conclusions

The present work revised and discussed the main validation procedures and standards for the assessment of mobile or wearable PoCT devices, specifically focusing on sweat analysis. The metrological aspects highlighted showed that recent years have brought much attention to making those devices more reliable. However, a further effort is still needed in order to standardize the procedure that should be used in validating stand-alone electronic platforms based on electrochemical biosensors; only by having common and shared guidelines, will it be possible to enable the reliable use and commercialization of such systems for multiple biomarker detection in wearable devices.

Author Contributions

Conceptualization, S.T., N.F.L., M.B. and G.A.; writing—original draft preparation, S.T., M.B. and G.A.; writing—review and editing, N.F.L., M.S. and E.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sardini, E.; Serpelloni, M.; Tonello, S. Printed electrochemical biosensors: Opportunities and metrological challenges. Biosensors 2020, 10, 11. [Google Scholar] [CrossRef] [PubMed]
  2. Criscuolo, F.; Hanitra, I.N.; Aiassa, S.; Taurino, I.; Oliva, N.; Carrara, S.; De Micheli, G. Wearable multifunctional sweat-sensing system for efficient healthcare monitoring. Sens. Actuators B Chem. 2021, 328, 129017. [Google Scholar] [CrossRef]
  3. Shrivastava, S.; Trung, T.Q.; Lee, N.-E. Recent progress, challenges, and prospects of fully integrated mobile and wearable point-of-care testing systems for self-testing. Chem. Soc. Rev. 2020, 49, 1812–1866. [Google Scholar] [CrossRef] [PubMed]
  4. Tyler, J.; Choi, S.W.; Tewari, M. Real-time, personalized medicine through wearable sensors and dynamic predictive modeling: A new paradigm for clinical medicine. Curr. Opin. Syst. Biol. 2020, 20, 17–25. [Google Scholar] [CrossRef] [PubMed]
  5. Islam, T.; Mukhopadhayay, S.C. Wearable sensors for physiological parameters measurement: Physics, characteristics, design and applications. In Wearable Sensors: Applications Design and Implementation; IOP Publishing: Bristol, UK, 2017; pp. 1–31. [Google Scholar]
  6. Tonello, S.; Serpelloni, M.; Lopomo, N.F.; Sardini, E.; Abate, G.; Uberti, D.L. Preliminary study of a low-cost point-of-care testing system using screen-printed biosensors: For early biomarkers detection related to Alzheimer Disease. In Proceedings of the IEEE International Symposium on Medical Measurements and Applications (MeMeA), Benevento, Italy, 15–18 May 2016; pp. 1–6. [Google Scholar]
  7. Rezabakhsh, A.; Rahbarghazi, R.; Fathi, F. Surface plasmon resonance biosensors for detection of Alzheimer’s biomarkers; an effective step in early and accurate diagnosis. Biosens. Bioelectron. 2020, 167, 112511. [Google Scholar] [CrossRef]
  8. Sharma, S.; Kumari, R.; Varshney, S.K.; Lahiri, B. Optical biosensing with electromagnetic nanostructures. Rev. Phys. 2020, 5, 100044. [Google Scholar] [CrossRef]
  9. Méjard, R.; Griesser, H.J.; Thierry, B. Optical biosensing for label-free cellular studies. TrAC Trends Anal. Chem. 2014, 53, 178–186. [Google Scholar] [CrossRef]
  10. Yu, H.L.L.; Maslova, A.; Hsing, I.-M. Rational design of electrochemical DNA biosensors for point-of-care applications. ChemElectroChem 2017, 4, 795–805. [Google Scholar] [CrossRef]
  11. Kanitthamniyom, P.; Zhou, A.; Feng, S.; Liu, A.; Vasoo, S.; Zhang, Y. A 3D-printed modular magnetic digital microfluidic architecture for on-demand bioanalysis. Microsyst. Nanoeng. 2020, 6, 1. [Google Scholar] [CrossRef]
  12. Solhi, E.; Hasanzadeh, M.; Babai, P. Electrochemical paper-based analytical devices (ePADs) toward biosensing: Recent advances and challenges in bioanalysis. Anal. Methods 2020, 12, 1398–1414. [Google Scholar] [CrossRef]
  13. Kit-Anan, W.; Olarnwanich, A.; Sriprachuabwong, C.; Karuwan, C.; Tuantranont, A.; Wisitsoraat, A.; Srituravanich, W.; Pimpin, A. Disposable paper-based electrochemical sensor utilizing inkjet-printed Polyaniline modified screen-printed carbon electrode for Ascorbic acid detection. J. Electroanal. Chem. 2012, 685, 72–78. [Google Scholar] [CrossRef]
  14. Tonello, S.; Lopomo, N.F.; Serpelloni, M.; Serzanti, M.; Dell’Era, P.; Sardini, E. Preliminary study of inkjet printed sensors for monitoring cell cultures. Procedia Eng. 2016, 168, 578–581. [Google Scholar] [CrossRef]
  15. Tonello, S.; Stradolini, F.; Abate, G.; Uberti, D.; Serpelloni, M.; Carrara, S.; Sardini, E. Electrochemical detection of different p53 conformations by using nanostructured surfaces. Sci. Rep. 2019, 9, 17347. [Google Scholar] [CrossRef]
  16. Han, Y.; Dong, J. Electrohydrodynamic printing for advanced micro/nanomanufacturing: Current progresses, opportunities, and challenges. J. Micro Nano-Manuf. 2018, 6, 4. [Google Scholar] [CrossRef]
  17. Menon, S.; Mathew, M.R.; Sam, S.; Keerthi, K.; Kumar, K.G. Recent advances and challenges in electrochemical biosensors for emerging and re-emerging infectious diseases. J. Electroanal. Chem. 2020, 878, 114596. [Google Scholar] [CrossRef]
  18. Lee, H.; Song, C.; Hong, Y.S.; Kim, M.S.; Cho, H.R.; Kang, T.; Shin, K.; Choi, S.H.; Hyeon, T.; Kim, D.-H. Wearable/disposable sweat-based glucose monitoring device with multistage transdermal drug delivery module. Sci. Adv. 2022, 3, e1601314. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Cinti, S.; de Lellis, B.; Moscone, D.; Arduini, F. Sustainable monitoring of Zn(II) in biological fluids using office paper. Sens. Actuators B Chem. 2017, 253, 1199–1206. [Google Scholar] [CrossRef] [Green Version]
  20. Sun, A.; Venkatesh, A.G.; Hall, D.A. A multi-technique reconfigurable electrochemical biosensor: Enabling personal health monitoring in mobile devices. IEEE Trans. Biomed. Circuits Syst. 2016, 10, 945–954. [Google Scholar] [CrossRef]
  21. Zhang, M.; Guo, S.; Weller, D.; Hao, Y.; Wang, X.; Ding, C.; Chai, K.; Zou, B.; Liu, R. CdSSe nanowire-chip based wearable sweat sensor. J. Nanobiotechnol. 2019, 17, 42. [Google Scholar] [CrossRef] [PubMed]
  22. Anastasova, S.; Crewther, B.; Bembnowicz, P.; Curto, V.; Ip, H.M.; Rosa, B.; Yang, G. Zwearable multisensing patch for continuous sweat monitoring. Biosens. Bioelectron. 2017, 93, 139–145. [Google Scholar] [CrossRef] [PubMed]
  23. Martín, A.; Kim, J.; Kurniawan, J.F.; Sempionatto, J.R.; Moreto, J.R.; Tang, G.; Campbell, A.C.; Shin, A.; Lee, M.Y.; Liu, X.; et al. Epidermal microfluidic electrochemical detection system: Enhanced sweat sampling and metabolite detection. ACS Sens. 2017, 2, 1860–1868. [Google Scholar] [CrossRef]
  24. Currano, L.J.; Sage, F.C.; Hagedon, M.; Hamilton, L.; Patrone, J.; Gerasopoulos, K. Wearable sensor system for detection of lactate in sweat. Sci. Rep. 2018, 8, 15890. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Garcia, S.O.; Ulyanova, Y.V.; Figueroa-Teran, R.; Bhatt, K.H.; Singhal, S.; Atanassov, P. Wearable sensor system powered by a biofuel cell for detection of lactate levels in sweat. ECS J. Solid State Sci. Technol. 2016, 5, M3075–M3081. [Google Scholar] [CrossRef] [Green Version]
  26. Ouzzani, M.; Hammady, H.; Fedorowicz, Z.; Elmagarmid, A. Rayyan—A web and mobile app for systematic reviews. Syst. Rev. 2016, 5, 210. [Google Scholar] [CrossRef] [Green Version]
  27. Lavín, Á.; Vicente, J.D.; Holgado, M.; Laguna, M.F.; Casquel, R.; Santamaría, B.; Maiger, M.V.; Hernandez, A.L.; Ramirez, Y. On the determination of uncertainty and limit of detection in label-free biosensors. Sensors 2018, 18, 7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Armbruster, D.A.; Pry, T. Limit of blank, limit of detection and limit of quantitation. Clin. Biochem. Rev. 2008, 29, S49–S52. [Google Scholar]
  29. Xu, G.; Cheng, C.; Yuan, W.; Liu, Z.; Zhu, L.; Li, X.; Lu, Y.; Chen, Z.; Liu, J.; Cui, Z.; et al. Smartphone-based battery-free and flexible electrochemical patch for calcium and chloride ions detections in biofluids. Sens. Actuators B Chem. 2019, 297, 126743. [Google Scholar] [CrossRef]
  30. Gauglitz, G. Analytical evaluation of sensor measurements. Anal. Bioanal. Chem. 2018, 410, 5–13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Nyein, H.Y.Y.; Tai, L.C.; Ngo, Q.P.; Chao, M.; Zhang, G.B.; Gao, W.A.; Bariya, M.; Billock, J.; Kim, H.; Fahad, H.H.; et al. Wearable microfluidic sensing patch for dynamic sweat secretion analysis. ACS Sens. 2018, 3, 944–952. [Google Scholar] [CrossRef]
  32. Kim, J.; Sempionatto, J.R.; Imani, S.; Hartel, M.C.; Barfidokht, A.; Tang, G.; Campbell, A.S.; Mercier, P.P.; Wang, J. Simultaneous monitoring of sweat and interstitial fluid using a single wearable biosensor platform. Adv. Sci. 2018, 5, 1800880. [Google Scholar] [CrossRef] [Green Version]
  33. Tai, L.C.; Gao, W.; Chao, M.; Bariya, M.; Ngo, Q.P.; Shahpar, Z.; Hnin, Y.Y.N.; Park, H.; Sun, J.; Jung, Y.; et al. Methylxanthine drug monitoring with wearable sweat sensors. Adv. Mater. 2018, 30, 1707442. [Google Scholar] [CrossRef] [PubMed]
  34. Zhang, J.; Rupakula, M.; Bellando, F.; Garcia Cordero, E.; Longo, J.; Wildhaber, F.; Hermet, G.; Guerin, H.; Ionescu, A.M. Sweat biomarker sensor incorporating picowatt, three-dimensional extended metal gate ion sensitive field effect transistors. ACS Sens. 2019, 4, 2039–2047. [Google Scholar] [CrossRef] [PubMed]
  35. Alizadeh, A.; Burns, A.; Lenigk, R.; Gettings, R.; Ashe, J.; Porter, A.; McCaul, M.; Berrett, R.; Diamond, D.; White, P.; et al. Wearable patch for continuous monitoring of sweat electrolytes during exertion. Lab. Chip 2018, 18, 2632–2641. [Google Scholar] [CrossRef] [PubMed]
  36. Ang, L.F.; Por, L.Y.; Yam, M.F. Study on different molecular weights of chitosan as an immobilization matrix for a glucose biosensor. PLoS ONE 2013, 8, e70597. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Karnes, H.T.; Shiu, G.; Shah, V. Validation of bioanalytical methods. Pharm. Res. 1991, 8, 421–426. [Google Scholar] [CrossRef]
  38. Gamella, M.; Campuzano, S.; Manso, J.; de Rivera, G.G.; López-Colino, F.; Reviejo, A.J.; Pingarron, J.M. A novel non-invasive electrochemical biosensing device for in situ determination of the alcohol content in blood by monitoring ethanol in sweat. Anal. Chim. Acta 2014, 806, 1–7. [Google Scholar] [CrossRef] [PubMed]
  39. Gibson, T. Biosensors: The stability problem. Analysis 1999, 27, 630–638. [Google Scholar] [CrossRef] [Green Version]
  40. Andreasson, U.; Perret-Liaudet, A.; van Waalwijk van Doorn, L.J.; Blennow, K.; Chiasserini, D.; Engelborghs, S.; Fladby, T.; Genc, S.; Kruse, N.; Kuiperij, H.B. A practical guide to immunoassay method validation. Front. Neurol. 2015, 6, 179. [Google Scholar] [CrossRef] [PubMed]
  41. Suydam, L.A.; Rulis, A.M. Guidance for industry. Bioanalytical method validation. Fed. Regist. 2001, 66, 28526–28527. [Google Scholar]
  42. Vinoth, R.; Nakagawa, T.; Mathiyarasu, J.; Mohan, A.M.V. Fully printed wearable microfluidic devices for high-throughput sweat sampling and multiplexed electrochemical analysis. ACS Sens. 2021, 6, 1174–1186. [Google Scholar] [CrossRef]
  43. Zhang, S.; Zahed, M.A.; Sharifuzzaman, M.; Yoon, S.; Hui, X.; Barman, S.C.; Sharma, S.; Yoon, H.Y.; Park, C.; Park, J.Y. A wearable battery-free wireless and skin-interfaced microfluidics integrated electrochemical sensing patch for on-site biomarkers monitoring in human perspiration. Biosens. Bioelectron. 2021, 175, 112844. [Google Scholar] [CrossRef] [PubMed]
  44. He, W.; Wang, C.; Wang, H.; Jian, M.; Lu, W.; Liang, X.; Zhang, X.; Yang, F.; Zhang, Y. Integrated textile sensor patch for real-time and multiplex sweat analysis. Sci. Adv. 2019, 5, eaax0649. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Bandodkar, A.J.; Gutruf, P.; Choi, J.; Lee, K.; Sekine, Y.; Reeder, J.T.; Jeang, W.J.; Aranyosi, A.J.; Lee, S.P.; Model, J.B.; et al. Battery-free, skin-interfaced microfluidic/electronic systems for simultaneous electrochemical, colorimetric, and volumetric analysis of sweat. Sci. Adv. 2019, 5, eaav3294. [Google Scholar] [CrossRef] [Green Version]
  46. Moonen, E.; Haakma, J.; Peri, E.; Pelssers, E.; Mischi, M.; Toonder, J. Wearable sweat sensing for prolonged, semicontinuous, and nonobtrusive health monitoring. View 2020, 1, 20200077. [Google Scholar] [CrossRef]
  47. Lu, Y.; Jiang, K.; Chen, D.; Shen, G. Wearable sweat monitoring system with integrated micro-supercapacitors. Nano Energy 2019, 58, 624–632. [Google Scholar] [CrossRef]
  48. Martin, A.; García-Carmona, L.; Barfidokht, A.; Kurniawan, J.F.; Moreto, J.R.; Tang, G.; Shin, A.; Liu, X.; Escarpa, A.; Wnag, J. Skin-worn soft microfluidic potentiometric detection system. Electroanalysis 2019, 31, 239–245. [Google Scholar]
  49. Liang, B.; Cao, Q.; Mao, X.; Pan, W.; Tu, T.; Fang, L.; Ye, X. An integrated paper-based microfluidic device for real-time sweat potassium monitoring. IEEE Sens. J. 2021, 21, 9642–9648. [Google Scholar] [CrossRef]
  50. Purohit, B.; Vernekar, R.; Shetti, N.; Chandra, P. Biosensor nanoengineering: Design, operation, and implementation for biomolecular analysis. Sens. Int. 2020, 1, 100040. [Google Scholar] [CrossRef]
  51. Migliozzi, D.; Guibentif, T. Assessing the Potential deployment of biosensors for point-of-care diagnostics in developing countries: Technological, economic and regulatory aspects. Biosensors 2018, 8, 119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Gao, W.; Emaminejad, S.; Nyein HY, Y.; Challa, S.; Chen, K.; Peck, A.; Fahad, H.M.; Ota, H.; Shiraki, H.; Kiriya, D.; et al. Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 2016, 529, 509–514. [Google Scholar] [CrossRef] [Green Version]
  53. May, E.E.; Harper, J.C.; Brozik, S.M. Computational biosensors: Molecules, algorithms, and detection platforms. Model. Methodol. Tools Mol. Nano-Scale Commun. 2016, 9, 541–577. [Google Scholar]
Figure 1. Summary of the most significant validation procedures of wearable sensors: (a) example of a single point chronoamperometric calibration reproduced from [32] (open access); (b) example of a dynamic chronoamperometric measurement of glucose, reproduced with permission from [42] Copyright 2021 American Chemical Society; (c) example of a standard selectivity test for K+ potentiometric sensor reproduced with permission from [43], copyright 2020 Elsevier; (d) example of an operation stability test, reproduced with permission from [29] copyright 2020 Elsevier; (e) example of a typical setup for an exercise-induced sweat test, reproduced from [44] (open access); (f) example of a typical setup for a iontophoresis-induced test, reproduced with permission from [33], copyright 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.
Figure 1. Summary of the most significant validation procedures of wearable sensors: (a) example of a single point chronoamperometric calibration reproduced from [32] (open access); (b) example of a dynamic chronoamperometric measurement of glucose, reproduced with permission from [42] Copyright 2021 American Chemical Society; (c) example of a standard selectivity test for K+ potentiometric sensor reproduced with permission from [43], copyright 2020 Elsevier; (d) example of an operation stability test, reproduced with permission from [29] copyright 2020 Elsevier; (e) example of a typical setup for an exercise-induced sweat test, reproduced from [44] (open access); (f) example of a typical setup for a iontophoresis-induced test, reproduced with permission from [33], copyright 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.
Electronics 11 00761 g001
Figure 2. Wearable electronics design and connectivity: (a) example of a wearable device with rigid PCB electronics, reproduced with permission from [31], copyright 2018, American Chemical Society; (b) example of a flexible polyimide circuit integrated in a wearable sensing device, reproduced with permission from [29], copyright 2020 Elsevier; (c) typical block scheme of a Bluetooth-based wearable device, reproduced with permission from [33], copyright 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim; (d) typical block scheme of a WiFi-based wearable device, reproduced with permission from [47], copyright 2019 Elsevier; (e) typical example of an NFC-based wearable device block scheme, reproduced from [45], open access.
Figure 2. Wearable electronics design and connectivity: (a) example of a wearable device with rigid PCB electronics, reproduced with permission from [31], copyright 2018, American Chemical Society; (b) example of a flexible polyimide circuit integrated in a wearable sensing device, reproduced with permission from [29], copyright 2020 Elsevier; (c) typical block scheme of a Bluetooth-based wearable device, reproduced with permission from [33], copyright 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim; (d) typical block scheme of a WiFi-based wearable device, reproduced with permission from [47], copyright 2019 Elsevier; (e) typical example of an NFC-based wearable device block scheme, reproduced from [45], open access.
Electronics 11 00761 g002
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tonello, S.; Abate, G.; Borghetti, M.; Lopomo, N.F.; Serpelloni, M.; Sardini, E. How to Assess the Measurement Performance of Mobile/Wearable Point-of-Care Testing Devices? A Systematic Review Addressing Sweat Analysis. Electronics 2022, 11, 761. https://doi.org/10.3390/electronics11050761

AMA Style

Tonello S, Abate G, Borghetti M, Lopomo NF, Serpelloni M, Sardini E. How to Assess the Measurement Performance of Mobile/Wearable Point-of-Care Testing Devices? A Systematic Review Addressing Sweat Analysis. Electronics. 2022; 11(5):761. https://doi.org/10.3390/electronics11050761

Chicago/Turabian Style

Tonello, Sarah, Giulia Abate, Michela Borghetti, Nicola Francesco Lopomo, Mauro Serpelloni, and Emilio Sardini. 2022. "How to Assess the Measurement Performance of Mobile/Wearable Point-of-Care Testing Devices? A Systematic Review Addressing Sweat Analysis" Electronics 11, no. 5: 761. https://doi.org/10.3390/electronics11050761

APA Style

Tonello, S., Abate, G., Borghetti, M., Lopomo, N. F., Serpelloni, M., & Sardini, E. (2022). How to Assess the Measurement Performance of Mobile/Wearable Point-of-Care Testing Devices? A Systematic Review Addressing Sweat Analysis. Electronics, 11(5), 761. https://doi.org/10.3390/electronics11050761

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop