Next Article in Journal
A Review on Non-Enzymatic Electrochemical Biosensors of Glucose Using Carbon Nanofiber Nanocomposites
Previous Article in Journal
Selective Sensing of Darolutamide and Thalidomide in Pharmaceutical Preparations and in Spiked Biofluids
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Use of Biological Sensors and Instrumental Analysis to Discriminate COVID-19 Odor Signatures

by
Vidia A. Gokool
1,†,
Janet Crespo-Cajigas
1,†,
Amritha Mallikarjun
2,
Amanda Collins
2,
Sarah A. Kane
2,
Victoria Plymouth
2,
Elizabeth Nguyen
2,
Benjamin S. Abella
3,
Howard K. Holness
1,
Kenneth G. Furton
1,
Alan T. Charlie Johnson
4 and
Cynthia M. Otto
2,*
1
Global Forensic and Justice Center, Department of Chemistry and Biochemistry, Florida International University, Miami, FL 33199, USA
2
Penn Vet Working Dog Center, Clinical Sciences and Advanced Medicine, School of Veterinary Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
3
Department of Emergency Medicine and Penn Acute Research Collaboration, University of Pennsylvania, Philadelphia, PA 19104, USA
4
Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA 19104, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Biosensors 2022, 12(11), 1003; https://doi.org/10.3390/bios12111003
Submission received: 26 September 2022 / Revised: 1 November 2022 / Accepted: 8 November 2022 / Published: 11 November 2022
(This article belongs to the Section Biosensor and Bioelectronic Devices)

Abstract

:
The spread of SARS-CoV-2, which causes the disease COVID-19, is difficult to control as some positive individuals, capable of transmitting the disease, can be asymptomatic. Thus, it remains critical to generate noninvasive, inexpensive COVID-19 screening systems. Two such methods include detection canines and analytical instrumentation, both of which detect volatile organic compounds associated with SARS-CoV-2. In this study, the performance of trained detection dogs is compared to a noninvasive headspace-solid phase microextraction-gas chromatography-mass spectrometry (HS-SPME-GC-MS) approach to identifying COVID-19 positive individuals. Five dogs were trained to detect the odor signature associated with COVID-19. They varied in performance, with the two highest-performing dogs averaging 88% sensitivity and 95% specificity over five double-blind tests. The three lowest-performing dogs averaged 46% sensitivity and 87% specificity. The optimized linear discriminant analysis (LDA) model, developed using HS-SPME-GC-MS, displayed a 100% true positive rate and a 100% true negative rate using leave-one-out cross-validation. However, the non-optimized LDA model displayed difficulty in categorizing animal hair-contaminated samples, while animal hair did not impact the dogs’ performance. In conclusion, the HS-SPME-GC-MS approach for noninvasive COVID-19 detection more accurately discriminated between COVID-19 positive and COVID-19 negative samples; however, dogs performed better than the computational model when non-ideal samples were presented.

Graphical Abstract

1. Introduction

The outbreak of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) began affecting people in the United States (US) in the winter of 2019. Infection with the virus has resulted in the deaths of over 1 million individuals in the US and over 6 million globally [1]. It has been determined that the virus primarily travels via airborne respiratory droplets, typically generated during talking, coughing, and sneezing [2,3]. SARS-CoV-2 is generally spread when aerosolized droplets from an infected person come into contact with a healthy person’s mucous membranes (i.e., the eyes, nose, or mouth) or through direct physical contact between an infected and uninfected person [4]. Some infected patients may present as asymptomatic [5], while other cases involve fever, cough, and unexplained fatigue [6,7]; more severe cases can result in hospitalization for respiratory failure [7], heart failure [8], or sepsis [9]. Since SARS-CoV-2 is capable of rapid transmission, and has proven to result in drastic health consequences, there is a pressing need for effective surveillance testing.
Currently, the most sensitive testing methods for SARS-CoV-2 are fairly time consuming, and the rapid tests can fail to detect low viral loads. Nucleic amplification detection methods such as reverse-transcriptase polymerase chain reaction (RT-PCR) are the gold standard for the diagnosis of SARS-CoV-2. Although RT-PCR testing has a relatively high sensitivity, false negatives can occur for several reasons, including viral content below the test’s limit of detection, poor sample collection, and faulty technique in sample testing [10]. False negative results can lead to increased spreading of the virus from unknowingly infected individuals [11]. Additionally, those with asymptomatic COVID-19 expression may not proactively seek out testing due to their lack of symptoms [12].
Due to disease state misdiagnosis and lack of detection in asymptomatic carriers, there is a persisting need for the deployment of noninvasive population screening for COVID-19. This study investigates two prospective screening methodologies applied to clothing worn by individuals in the community who had been tested for COVID-19: the first is the use of trained detection dogs, and the second is the analysis of samples via headspace-solid phase-microextraction-gas chromatography-mass spectrometry (HS-SPME-GC-MS). These noninvasive biological and instrumental systems were applied in parallel to discriminate the complex odor signature from COVID-19 body odor samples.
Current research demonstrates that dogs can be trained to detect hypoglycemia [13], lung cancer [14], ovarian cancer [15,16], prostate cancer [17], and urinary tract infections [18]. More recently, several research groups have trained dogs to identify signature volatile organic compounds (VOCs) of SARS-CoV-2 in a variety of mediums; including pharyngeal secretions [19], urine [20], saliva [20], sweat [21,22], and breath [23,24]. However, the distinct VOCs associated with the SARS-CoV-2 virus have been minimally explored outside of VOCs in exhaled breath [25,26]. VOCs are produced by cells during metabolic processes, inflammatory processes, and oxidative stress. These compounds are released from the human body via breath, urine, feces, and blood [27]. While several studies have identified key COVID-19-associated VOCs in breath [23,24,25,26,28,29,30], it can be risky to utilize breath as a medium for detection in dogs, since breath from positive patients contains live virus [28,31] and dogs are susceptible to contracting COVID-19. In contrast, sweat from COVID-19 positive patients is a safer sample source, containing no live virus [32].
VOCs associated with the SARS-CoV-2 virus in sweat samples can be identified using headspace analysis via solid phase microextraction (SPME), which allows for the capture of gaseous analytes onto a coated sorbent surface, the SPME fiber [33]. Once on the SPME fiber, the analytes can be transferred to another instrument for desorption and analysis. HS-SPME is often used in conjunction with gas chromatography-mass spectrometry (GC-MS), where the GC-MS separates and analyzes the compounds captured by the HS-SPME procedure. Various works have been published on the use of HS-SPME-GC-MS for the detection and characterization of VOCs from human specimens, including sweat, blood, saliva, urine, breath, hair, and fingernails (see [34] for a review). Complementary detection of VOCs by biosensors (dogs) and analytical instrumentation (HS-SPME-GC-MS) can narrow down areas of volatile biomarkers [16] and allow for further characterization of these unique VOC profiles, providing a critical step forward for the detection of COVID-19.
In this study, we compared the performance of dogs and the headspace analysis of COVID-19 samples by HS-SPME-GC-MS. Both methods used T-shirts containing body odor/sweat from both infected and healthy individuals, regardless of identifying factors such as gender, race, age, and geography. This work demonstrates the ability to create a multi-modal approach to complex odor detection and propels this conversation through the task of detecting COVID-19 presence.

2. Materials and Methods

2.1. Collection of COVID-19 Samples

2.1.1. Approvals

All animal studies were reviewed and approved by the institutional animal care and use committee at the University of Pennsylvania (IACUC protocols 806922, 804900). Handlers of privately owned dogs that performed the detection tasks provided informed consent. The human study collecting T-shirts was reviewed and approved by the University of Pennsylvania Institutional Review Board (IRB protocol 843534). Participants provided informed consent.

2.1.2. Human Participant Recruitment and Follow-Up Health Survey

People recruited on social media (from July 2020 to April 2021) were asked to participate in the study by wearing a T-shirt overnight if they had been tested for COVID-19 within the previous 48 h. Participants filled out a survey to determine their eligibility. Data collected included: age, type of COVID-19 test performed, whether the test was performed within the preceding 48 h, COVID-19 test results (positive/negative/inconclusive) and when the results were received, presence of symptoms in the past 7 days, COVID-19 vaccination history, contact information, T-shirt size, how they heard about the study, and their preferred method of communication. Potential candidates were disqualified if they were younger than 18 years of age, not living in the United States, allergic to cotton, did not provide contact information, were tested via rapid antigen COVID-19 test instead of a PCR test, or if they were not tested for COVID-19 within the past 48 h.
Eligible participants were shipped an unwashed cotton T-shirt, assigned a case identification number (case I.D.), and were categorized as: positive symptomatic, positive asymptomatic, negative symptomatic, or negative asymptomatic. Informed consent was obtained via electronic signature (Qualtrics) or a scanned copy of the consent form with a written signature. Participants provided a de-identified copy of their PCR test results.
Following receipt of the T-shirt and instructions (wear it overnight without washing it or wearing any other type of nightshirt under it), participants were asked to complete a health survey confirming test results and symptomology, including duration that the shirt was worn, use of any fragrances, any humans or animals with whom they shared their bed, a rating of their current stress level on a scale of 1 (little) to 10 (maximal), current or past medical conditions, and current medications. The results of this health survey can be found in the supplementary information (Tables S1 and S2). The term “symptom count” is used to reference the number of separately accounted symptoms disclosed by the participant; for example, a participant who noted coughing and headaches as symptoms would have a symptom count of two.

2.1.3. Preparation of Sample Collection Materials

All T-shirts were handled with nitrile gloves, individually numbered on the collar with a permanent black marker, and packaged in the same environment. The numbered T-shirt was sealed in a one-gallon Ziploc™ bag removing as much air as possible. The case I.D. number was on the Ziploc™ bag, as well as the enclosed instructions. The participant was instructed to write the date and time when the T-shirt was put on and when it was removed on the label affixed to the bag. The prepared collection materials were stored according to size, in boxes at room temperature.
Each participant was shipped (a) one labeled T-shirt of the designated size (in a Ziploc™ bag), (b) one labeled Tyvek return shipping bag, and (c) one set of instructions via overnight courier. The return shipment was made via a scheduled pickup at least 24 h after the shirt was removed, placed back in the ZiplocTM bag, and sealed in the shipping bag to ensure a lack of infectivity [35].
T-shirts were shipped from participants back to the University of Pennsylvania between July 2020 and June 2021. The date the samples were sent to the Penn Vet Working Dog Center (PVWDC) was accounted for in the randomization when creating training and test sample sets, adding another layer of variability for the dogs to generalize across. Sample processing was performed by PVWDC and the Penn Acute Research Collaboration coordinator team at the University of Pennsylvania. All negative shirts were processed prior to any positive shirts. Fresh nitrile gloves were worn for handling each individual shirt. All surfaces were cleaned with isopropyl alcohol between shirts.
Shirts were cut into six pieces: (1–2) the front cut in half, (3–4) the back cut in half, (5) the right sleeve, and (6) the left sleeve. Once cut, the right side and left side pieces were separated, and each half of the shirt was placed into a mason jar labeled with the case I.D. number and the donor’s COVID-19 status (+/−). The right halves of the shirts were sent to Florida International University (FIU) and the University of Pennsylvania Johnson Lab to be utilized for VOC analysis or other COVID-19 studies, respectively. The left halves of the shirts were kept for canine use.

2.1.4. Collected COVID-19 Positive and COVID-19 Negative T-Shirt Samples

Samples were collected from people across the US; only samples returned with a completed donor health survey were considered for canine training/testing. Two hundred and ninety-three (293) samples were collected, entered into the total dataset, and used for training purposes in the study. Additional samples were collected, but these were not used in the training/testing schemes. The majority of samples were obtained from participants who identified as White or Caucasian, which was accounted for when distributing samples throughout pre-determined training sets for canine training. The demographic distribution of the collected T-shirt sample inventory can be found in Table A1.
The sample portions allocated for canine use were sealed in appropriately labeled mason jars and stored in lockers kept at room temperature. Samples remained in the lockers before and after being utilized for canine training/testing. Additionally, samples were separated based on COVID-19 test results, so negative and positive samples were never stored adjacent to one another. In total, for the dogs, 220 samples were used in the training phases, and 73 samples were used in the test phase; donor demographics are shown in Table 1. Two COVID negative samples, #291 and #432, were included in both the training and test sample sets. All other samples were seen once by each canine.
T-shirt portions allocated for instrumental analysis using HS-SPME-GC-MS were sent to Florida International University (FIU) in labeled ZiplocTM bags. In accordance with the safety protocols in place at the time of analysis, all T-shirt materials received by FIU were irradiated using a 10-min exposure to 254 nm ultraviolet (UV) light. This procedure was conducted to ensure that no live virus was present on the samples before they were handled.

2.2. Canine Odor Discrimination Methods

2.2.1. Canine Participants

Five dogs (4 privately owned, one owned by the PVWDC) were selected to participate in the study (see Table 2). To participate in the study, dogs must have demonstrated (a) a “trained final response” (stand-stare alert for greater than 2 s, or a sit alert) to training odor presented on the wheel (see Figure 1), (b) the ability to sequentially search the scent wheel ports 1 through 8, and (c) a “blank wheel response” by leaving the wheel room or sitting on a platform when the target odor was not present in the wheel and all ports have been searched. All dogs were initially trained on wheel searching mechanics using the universal detector calibrant training odor (UDC) [36].

2.2.2. Use of T-Shirt Samples in Training and Testing

Each week, after the dogs had been initially trained on the odor, the dogs were exposed to two training sets containing four negative and two positive samples, all unique and only used once throughout training. Both negative and positive samples contained only the sleeves of the collected T-shirts. The distribution of samples was randomized to ensure dogs were exposed to a range of ages, genders, ethnicities, races, and pre-existing medical conditions in each training session. A similar method of randomization was used to create the sets on which the dogs were tested at the end of their training. The majority of test sets contained 12 novel negative samples and 2–3 novel positive samples (Tables S2 and A3). Each of the selected samples varied in demographic categorizations and length of time T-shirt was stored between and within tests. Two previously seen negative samples (#291 and #432) were included in the test set, leading to a total of 59 negative samples across tests. A range of sample demographics was used to examine the generalization of the COVID-19 odor cue from person to person.

2.2.3. Distractors

In addition to the positive and negative T-shirt samples, dogs were also presented with distractor items. These items were selected to ensure that the dogs were alerting on COVID-19 positive T-shirts and not on any untargeted scents/odors that potentially coincided with these samples. Items included an unworn T-shirt, a shipping envelope from the PVWDC, a shipping envelope sourced from the research assistant sending out shirts, latex gloves, nitrile gloves, isopropyl alcohol, and a permanent marker.

2.2.4. Training Procedure

The training progression that was implemented while training each canine (Table 2) is outlined in Table 3 and described in further detail below.

2.2.5. Odor Learning Phase

In the initial phase of the study, dogs were rewarded for sniffing the COVID-19 positive sample. Dogs were presented with jars containing the sleeves of shirts worn by COVID-19 positive patients as a target odor. When the dog sniffed this target odor, the behavior was marked with a conditioned secondary reinforcer (i.e., noise generated by a “clicker”) and paired with a food or toy reward. The target jars were covered with a mesh lid, allowing full odor release but preventing access to the material. In the same session, dogs were presented with jars containing the sleeves of shirts worn by people who were COVID-19 negative. Dogs were not rewarded, nor was their behavior marked for sniffing the negative sample.
During this phase, the COVID-19 negative jars were covered by a lid with 1 hole in the top, as compared to the fully open COVID-19 positive jars. This approach allowed the dogs to utilize two differences in odor for differentiation: first, the scent profile difference between COVID-19 negative and COVID-19 positive, and second, a concentration difference where the COVID-19 positive odor, covered with a mesh lid, was stronger than the COVID-19 negative odor, covered with a single-hole punch lid. The concentration difference functioned as “training wheels”, which were phased out as the dogs’ training progressed. This method is known as “errorless learning” [37] and has been used in a previous COVID-19 detection study from the PVWDC [20].
At the beginning of each training session during the odor learning phase, the dogs were presented with the COVID-19 positive and COVID-19 negative jars on the floor. The location was randomized—either left or right—across ten trials. The trainer clicked when the dog sniffed or showed a trained final response on the COVID-19 positive jar and was ignored when the dog sniffed or showed a trained final response on the COVID-19 negative jar.

2.2.6. Odor Learning Sessions on the Wheel

After 10 trials with only two samples (1—positive, 1—negative) were completed, the COVID-19 positive and COVID-19 negative jars were moved onto the scent wheel. The scent wheel contains 8 total ports: two of these were the COVID-19 positive and COVID-19 negative odors, respectively, and the remaining 6 ports were distractor items (Figure 1). All trials were video recorded.
To prevent human cues and bias, the dog and trainer were blocked from the trial area to prevent visual observation of sample placement. The trainer remained behind a barrier during the trial, such that they were out of sight from the dog. During each trial, the dog was sent to search the scent wheel. A positive response to COVID-19 positive odor was marked by the trainer with a conditioned secondary reinforcer (e.g., a clicker), then rewarded with praise and food or a toy. False negatives (passing the target odor) and false positives (alerting at the incorrect odor) were ignored. If the dog passed the positive odor without presenting a trained response (false negative), they were sent back to the wheel without a reward to execute a new search for the positive odor.
For any given session in this phase, there were 4 to 6 “blank wheels” where there were control and distractor odors but no target odor present on the scent wheel. During a blank trial, dogs are to sniff and pass each of the eight ports and then exit the wheel room and sit.
When the dog achieved 90% accuracy (9/10 correct trials) across all scent wheel trials in one session, the dogs moved to the subsequent phase of training.

2.2.7. Training Phase 1

In Training Phase 1, there was no longer exposure to a positive sample prior to the dogs’ wheel trials. Additionally, dogs were presented with double the number of positive and negative samples in each session. Per trial, the scent wheel contained one or zero COVID-19 positive samples and up to 4 COVID-19 negative samples. The other ports contained distractor items, which were covered by a mesh lid. The jars containing the COVID-19 positive shirts were covered with a mesh lid. The jars containing COVID-19 negative shirts continued to have one hole in the lid, again to restrict odor output.
Training sessions included multiple presentations of both targets and controls; however, only the initial response was used to calculate the required performance to move to the next phase.
For a dog to move to the next phase, it needed to have a minimum true positive response of 5/6 to positive targets on first presentation (83% sensitivity) and a minimum true negative response of 10/12 non-targeted odors on first presentation (83% specificity). Due to the number of samples, they had to complete a minimum of 3 sessions in any given phase to achieve this benchmark. This benchmark was applied to Training Phases 1–4.

2.2.8. Training Phase 2–4

Phases 2–4 were procedurally identical to Phase 1. In Phase 2, the jars containing the COVID-19 negative shirts used lids that had four holes punched in the top. In Phase 3, the jars containing the COVID-19 negative shirts used lids that had 16 holes punched in the top. In Phase 4, the jars containing the COVID-19 negative shirts had mesh lids. The increase in holes in the COVID-19 negative jar lids slowly removed the concentration cue that was initially provided to help the dogs distinguish it from the COVID-19 positive odor. Training sessions included multiple presentations of both targets and controls; however, only the initial response was used to calculate the required performance to move to the next phase.

2.2.9. Test Phase

Dogs completed five test sessions consisting of three trials each. The sessions were run double-blind (i.e., the handler did not know the location of the positive sample, and the experimenter left the room prior to the start of each trial); such that the dog would not inadvertently be cued to alert on any sample. Two of the test sessions contained one blank trial, in which there was no positive sample. The remaining sessions contained 3 trials with a novel COVID-19 positive sample each trial. As such, there were 13 total COVID-19 positive samples shown to the dogs, as well as 59 COVID-19 negative samples (Table S2). The positive samples were purposefully selected to be diverse in race, age, vaccination status, time the shirt was collected, and the number of symptoms (See Table A2).

2.2.10. Behavioral Analysis

The test phase data was behaviorally coded (translated into numerical values) by two research assistants using BORIS [38]. The coders recorded the duration of time each dog spent at each odor port for each trial in the 5 test sessions. The coders were unaware of the location of the positive sample.

2.2.11. Statistical Analysis

A binomial mixed-effects logistic regression with sample type as the fixed effect and dog as a random effect was conducted to determine the effects of a COVID-19 positive or COVID-19 negative status of a sample on the duration of time spent at port for each dog. Analyses were carried out in R using GLMER [39].

2.3. HS-SPME-GC-MS Methods

2.3.1. Sample Set Demographics

A subset of the samples used in the dog trials were transferred to FIU for HS-SPME-GC-MS analysis. Due to this subgrouping, the HS-SPME-GC-MS samples reflect a different distribution of demographics than are reflected by the dog trial samples (Table 1). Table 4 shows a demographic breakdown of the donors contributing to HS-SPME-GC-MS characterized T-shirt samples. Eleven (11) sample donors did not provide demographic information.

2.3.2. HS-SPME-GC-MS Analysis Procedure

Following sample irradiation, T-shirt samples were prepared for reagent-free sampling by removing a 4 × 4 inch piece of fabric from the underarm section using sterilized scissors. This piece was then placed inside a 40 mL headspace vial, which was pre-cleaned according to the methods published by Gokool et al. (2022) [40]. Samples were stored at room temperature (20 °C) between sample collection and analysis.
Samples were placed in a digital heating bath set at 50 °C immediately prior to sample extraction. A clean 50/30 µm divinylbenzene/carboxen/polydimethylsiloxane (DVB/CAR/PDMS) SPME fiber was exposed to the headspace of the T-shirt samples at a 1-inch fiber exposure setting. No previous sample equilibration was performed. After 24 h, SPME fibers were unexposed and removed from the sample headspace.
Analytes on the SPME fibers were thermally desorbed at 270 °C for 4 min (3-inch fiber height) into the heated inlet of the GC (Agilent 8890; Agilent Technologies, Santa Clara, CA, USA). A splitless injection method with a 1 mL/min column flow was implemented on a HP5-MS UI capillary column (15 m × 0.250 mm I.D. × 0.25 µm phase thickness; Agilent Technologies). Helium was used as the carrier gas. Oven temperature parameters started at 40 °C (1.25 min hold), increased to 165 °C (5 °C/min rate), and concluded at 270 °C (30 °C/min rate). The total method runtime was 29.75 min. A mass spectrometer (Agilent 5977B MSD; Agilent Technologies) with an electron impact ionization (EI) source and quadrupole mass analyzer was used with the following parameters: MS source was maintained at 230 °C, MS Quad at 150 °C, transfer line at 280 °C, EI source at 70 eV, and scan range at m/z 50–550.

2.3.3. Statistical Analysis

A semi-quantitative approach was taken for the analytical procedure because of the novelty of the samples collected (bodily emanations from individuals who tested as positive or negative for COVID-19). Due to a lack of pre-existing knowledge of the sample and sample matrix, the researchers opted for a pattern recognition-based approach to data analysis.
Linear discriminant analysis (LDA) was used to model the class separation of COVID-19 positive/negative samples. LDA is a dimensionality reduction technique that is used for supervised classification problems. The technique creates a linear combination of the submitted features to form separation between the classes.

2.3.4. Data Pre-Processing

An untargeted approach was applied to the dataset to uncover underlying relationships and their contributing compounds. All 148 received T-shirt samples were analyzed using HS-SPME-GC-MS. The resulting GC-MS chromatograms were pre-processed using a proprietary piece of software developed at FIU; this software has previously been applied in the pre-processing of human odor data collected by HS-SPME-GC-MS [40]. The collective dataset was evaluated for compounds eluting at approximately the same time. In addition to the 148 COVID-19 positive/COVID-19 negative samples, three blank unworn T-shirts were sampled to establish background signals from the fabric substrate. Compounds that were present in all the background samples were removed. The following calculations were determined using a dataset consisting of square-root transformed, total ion chromatogram (TIC) peak areas for retention time-aligned peaks.

3. Results

3.1. Canine Behavioral Coding Interrater Analysis

An inter-rater analysis was run in R to determine the reliability of the participating video coders. Six randomly chosen videos out of the 25 total test videos (24%) were used for this analysis The inter-rater analysis was run based on a single-rating, consistency, two-way mixed effects model. The model displayed an intraclass coefficient of 0.843, with a 95% confidence interval of 0.793 to 0.882. These findings indicate that the video coding was performed with good to excellent reliability [41].

3.2. Canine Training Data

Dogs spent different amounts of time in each training phase prior to achieving the benchmark to be tested (see Figure 2). In the last phase, where both the negative and positive samples had fully open lids, there was a divide between Roxie and Rico, who spent very little time (5 sessions) in this phase as opposed to earlier phases, and Tuukka, Toby, and Griz, who spent the most time in this phase (12, 13, and 11 sessions, respectively).

3.3. Testing Data

This study examined dogs’ ability to detect COVID-19 positive odor samples on T-shirts. An analysis was performed to assess whether dogs alerted significantly more often on the COVID-19 positive samples than the COVID-19 negative samples. An alert was characterized as a two-second stand-and-stare alert (Griz, Toby, Tuukka, and Rico) or a sit at the positive sample (Roxie). Dogs are more likely to alert on the positive samples than the negative samples, X2 = 2.92, z value = 8.645, p < 0.0001. Table 5 shows the sensitivity and specificity of each dog in the study.

3.3.1. Factors Affecting Canine Behavior and Alert on Positive Samples

The authors examined how the dogs’ alert duration on positive samples was affected by demographic and symptomatic factors reported by the T-shirt sample donors. A linear mixed-effects regression with gender, age group, number of symptoms, and pet-owning status as the fixed effects and dog as a random effect was performed. None of these factors significantly affected alert duration (gender: F(56) = 1.11, t = 1.62, p = 0.11; age group: F(56) = −0.24, t = −1.06, p = 0.29; symptom count: F(56) = −0.01, t = −0.06, p = 0.95; pet ownership: F(56) = −0.64, t = −1.06, p = 0.29). Table 6 shows the results for alerts to positive test samples organized by the trial run. Table A2 depicts the dogs’ alert rate to the positive test samples; this information is organized by sample feature/characteristic (i.e., gender, age, etc.).

3.3.2. Factors Affecting Canine Behavior and Alert on Negative Samples

Additionally, the authors examined how the dogs’ alert duration at negative samples was affected by demographic factors reported by the study participants. A linear mixed-effects regression with gender, age group, and pet-owning status as the fixed effects and dog as a random effect was performed. None of these factors significantly affected alert duration (gender: F(279) = −0.04, t = −0.19, p = 0.84; age group: F(279) = −0.05, t = −1.28, p = 0.20; pet ownership: F(279) = 0.06, t = 0.49, p = 0.62).

3.3.3. Factors Affecting Canine Behavior and Alert on Positive or Negative Samples

A linear mixed effects model of duration at port with sample type (positive or negative) and sample number as fixed factors was created. The sample number denotes the order in which the samples were received over time. There is a main effect of sample type, B1 = −1.11, t(170) = −3.64, p= 0.0004, meaning canines spend statistically different amounts of time at the port for a positive sample (holding in place to alert) versus a negative sample (short interaction, no alert).
Importantly, there is no interaction between sample type and sample number, B1 = −0.001, t(170) = −1.03, p = 0.3. The earlier positive and negative samples did not have significantly different durations at odor than the later positive and negative samples. The time at which a sample was collected did not significantly affect the time spent alerting (for a positive) or passively sniffing (for a negative sample).

3.4. HS-SPME-GC-MS Results

Initial analysis of the formed dataset revealed a separation of data points. The observed separation is believed to be driven by one or more unidentified class characteristics. As seen in Figure 3, there is subgrouping occurring within the dataset that has not been attributed to a sole influence or characteristic, such as COVID-19 status. The separation may be due to a confounding effect or a combination of class characteristics. The characteristics which have been investigated and ruled out as sole contributors to the dataset grouping are gender, age, vaccination status, and pet ownership. An insight into subgrouping composition was achieved when viewing the dataset in terms of self-identified race.
The consideration of donor race indicated that all donors in one subgroup (right) share the racial identification of “White or Caucasian.” Due to this observation, the following co-interactions were considered for further explanation of data subgrouping: (a) race and COVID-19 status, (b) race and symptomatic presentation, (c) race and gender, (d) race and age, and (e) race and vaccination status. Although these co-interactions were investigated, they were not seen to provide any further explanation for the observed phenomenon.
The peaks of interest contributing to the subgrouping (i.e., the split observed) seen in Figure 3 were identified (by retention time) and removed from the dataset. This action constituted a removal of 15 peaks of interest. This caused the dataset to decrease from 126 features of interest to 111 features of interest. The removal of this subsetting factor mitigates the risk of building an instrumental model off erroneous information, which is not related to the COVID-19 positive/negative status of a donor. The refined dataset no longer demonstrated the previously observed, unexplained subgrouping indicating that the developed instrumental model would not be informed by the unidentified effect (Figure 4).

Model Development

Following the pre-processing procedure described above, the dataset containing retention-time-matched peaks of interest was square-root transformed. Note that the dataset was refined to remove peaks found to be present in all of the analyzed background samples (unworn T-shirts) and peaks that contributed to the subgrouping viewed in Figure 3. This dataset was used to build a linear discriminant analysis (LDA) model using JMP®, Version 16.1.0. (SAS Institute Inc., Cary, NC, USA 1989–2021). LDA is a supervised learning technique that uses a linear combination of features of interest (variables) to discriminate between classes. LDA allows for linear modeling of the COVID-19 positive and COVID-19 negative samples using the TIC peaks of interest (identified in the GC-MS data) to separate and differentiate between COVID-19 status in the sample set.
The LDA model displayed in Figure 5 demonstrates the separation of 54 COVID-19 positive and 94 COVID-19 negative donor profiles. The displayed model was seen to perform moderately when all data points were used to train it; true positive rate (TPR) = 96.3%, true negative rate (TNR) = 96.8%, false positive rate (FPR) = 3.2%, and false negative rate (FNR) = 3.7%. This model resulted in five misclassified samples with three False Positives and two False Negatives. When leave-one-out cross-validation (LOOCV) was applied to the model, the performance was very poor, with TPR = 57.4%, TNR = 61.7, FPR = 38.3%, and FNR = 42.6%. LOOCV was performed using R-3.6.1, an open-source software.
Further review of the misclassified donor samples, seen in the unvalidated model, revealed that the five misclassified individuals retained the class characteristic of “sharing their bed with at least one pet cat or pet dog”. The researchers believe that the transfer of pet fur and dander onto the collection substrate influenced the collected volatile organic compound profiles. This pet fur and dander was visible on several of the samples collected with this donor characteristic, as can be seen in Figure A1.
It was beyond the scope of this project to train a predictive model to differentiate between COVID-19 positive and COVID-19 negative samples despite the presence of animal interferents. As such, individuals who attested to sharing their bed with their pet animal(s) were removed from the dataset informing the LDA model. With the removal of these individuals, the model was tuned and cross-validated, demonstrating considerably less ambiguity than the previous iteration. The exclusion of individuals who shared the bed with their pet(s) reduced our sample population to 91. The updated model included 80 features of interest, reduced from the 111 features used to develop the model in Figure 5. There is a clear delineation between COVID-19 positive and COVID-19 negative donor profiles, as expressed in Figure 6.
The LDA model displayed in Figure 6 demonstrates the separation of (33) COVID-19 positive and (58) COVID-19 negative donor profiles. Both the non-validated model (informed by all data points) and the LOOCV model performed with a TPR = 100%, TNR = 100%, FPR = 0.0%, and FNR = 0.0%. The model did not “miss” any COVID-19 positive individuals. The donors in this subset stated that they did not share a bed with their pets. However, these donors did not indicate ownership of a pet. The previously discussed splitting of the dataset (seen in Figure 3) was not observed to be linked to pet ownership or sharing a bed with a pet.

4. Discussion

This study demonstrates a multi-modal comparative approach to the detection of COVID-19; the researchers utilized both dogs and HS-SPME-GC-MS to discriminate between COVID-19 statuses using human sweat samples. One of the challenges of many prior COVID-19 detection studies was that dogs were trained with relatively small sample sets, which lacked substantial demographic variation and focused on hospitalized COVID-19 patients [20,42,43]. Hospital populations are likely to be more severely affected by COVID-19 and be isolated during care. Whereas asymptomatic or mildly affected individuals are more likely to remain in the community and contribute to the spread of the virus. As such, their inclusion in the sample population is integral to identifying COVID-19 positive individuals in the populace. Another constraint posed by small sample sets, but evaded in this work, is the limited ability to determine the dogs’ capacity in generalizing to a broader donor population regarding age, race, and severity of illness, among other factors.
Both the dogs and the HS-SPME-GC-MS approach were able to discriminate COVID-19 positive from COVID-19 negative in this community-based population. Obtaining samples from a home environment led to an unexpected confounding factor: the presence of animal hair on the T-shirts. It is important to note that in this study 38.5% of individuals reported sharing their beds with a pet. The dogs’ performance was not affected by the presence of animal hair; however, the HS-SPME-GC-MS-informed model was. Despite the presence of animal hair interferents, the results of the study were consistent with the finding of Grandjean et al. (2022), who similarly tested dogs on samples from 335 individuals from two community screening centers [44]. Recent publications by Chaber et al. (2022) and by Grandjean et al. (2022) tested canine discrimination between COVID-19 positive and COVID-19 negative using sweat samples collected from France, UAE, and Australia [43,44]. These studies recounted high canine sensitivity and specificity, even reporting dogs could identify positive cases before the PCR test. These studies suggest that dogs could prove to be an effective population screening method [14,17].
Although the dogs were able to correctly identify and alert to COVID-19 positive samples and distinguish these amongst COVID-19 negative samples in this study, there was considerable variability observed in the dogs’ detection accuracy. Overall, the dogs gave correct responses (alerting on positive samples and ignoring negative samples) to 62.5% of the presented positive samples and 90% of the presented negative samples. When the canines were regrouped into high-performance (2/5) and low-performance (3/5) canines, a clear delineation in performance was seen. The high-performance group produced correct responses (alert to positive/pass negative) to 85% of positive samples and 94.8% of negative samples. In contrast, the low-performance group had correct responses to only 46.2% of positive samples and 87.2% of negative samples.
It is not always clear which dogs will perform well on specific odor detection tasks, and canine performances can vary widely (see Gonder-Frederick et al. (2017) for an example in diabetic alert dogs [45]). Canine performance is known to vary based upon several factors, including canine-oriented factors such as personality traits [46,47], specific polymorphisms in olfactory receptor genes [48], and handler-oriented factors, including the identity and familiarity of the handler [49] and the handler’s belief about the odor’s location and positive/negative status [50]. Identification of the specific VOCs may help provide the tools to evaluate the effects of canine-oriented factors. Further research can explore how to identify potentially high-performing detection dogs prior to training, to prevent significant loss of time and capital.
Importantly, the dogs did not display a significantly different performance in detecting COVID-19 within a specific demographic group, nor was their performance affected by the storage time of the samples used. The dogs were trained on a large number of samples from a variety of demographic groups. Additionally, dogs saw samples that ranged from 298 days (oldest negative sample seen by last tested dog) and 283 days (oldest positive sample seen by last tested dog) to 21 days (newest negative sample seen by first tested dog) and 63 days (newest positive sample seen by first tested dog), in terms of when the odor/scent was collected on the shirt to the time they were presented to the dogs (See Table A3). The consistent performance of the dogs suggests that the sample collection and storage procedures (collect onto cotton T-shirts and store in a sealed container at room temperature) produce a sample with a stable odor profile and non-depleted headspace through long periods of static storage. The canines’ performance in testing reinforces the idea that training detection dogs using a diverse set of samples supports their ability to generalize odors (see [51] for a similar concept in machine learning).
HS-SPME-GC-MS was used as a reagent-free technique for the capture and detection of VOCs present in human body odor samples. The human scent profiles obtained through this procedure were used to develop an LDA model for the predictive classification of COVID-19 status, informed by sweat expression. In this experiment, the developed LDA model depicted in Figure 5 was seen to perform very poorly in comparison to the model shown in Figure 6. The difference in model performance was linked to the inclusion of samples collected from donors who reported sharing a bed with their pet(s). The removal of these individuals from the LDA model allowed for the creation of a predictive model that had no misclassifications when cross-validated using a leave-one-out approach. The necessity of the removal of these individuals is contrasted by the results seen in the dog scent work, where the dogs were able to differentiate COVID-19 positive and negative samples regardless of the presence of pet interferents. The new predictive model for the differentiation of COVID-19 positive and COVID-19 negative T-shirt samples was informed by a sample set of 91 participants who did not share their beds with a pet. The model contained 80 features of interest, indicating a high degree of complexity in the characteristic VOC profile representative of COVID-19 expression in sweat. At its best performance, the developed LDA model (Figure 6) had a TPR = 100%, TNR = 100%, FPR = 0.0%, and FNR = 0.0% (validated using LOOCV). The contributing sample set, however, did not retain the same degree of diversity as the original sample population (reduced from 148 to 91 samples). The model requires further training, including the submission of more variation in donor demographics, if it is to be implemented in a non-academic setting.

4.1. Contrasts between Instrumental and Biological Methods Used for COVID-19 Positive/Negative Odor Discrimination

The duality of the methodology, using dogs and conventional analytical instrumentation, creates a parallel view of the strengths and challenges posed by each approach. Both techniques were demonstrated to be capable of discriminating between COVID-19 status when informed by human odor signatures. The use of scent work dogs demonstrated a method that allowed for the training of a detection system (dog) that was able to discriminate between samples sourced from a range of genders, races, and age groups, among other factors, without a demonstrated bias in their decision-making. However, while the training method utilized in this study proved to be effective for this set of participants, it also revealed variations in odor recognition between dogs, such as behavioral responses, that could not be controlled for. In a canine approach, the dog is the sensor, and unlike analytical instruments, canine abilities are highly variable between animals.
In contrast, the analytical approach was HS-SPME-GC-MS, a technique that uses components that are all commercially available and is easily reproduced. The LDA model, which was informed by the HS-SPME-GC-MS data, demonstrated a “perfect” determination of COVID-19 status. While the performance was superior to that of the dogs, the approach exhibited drawbacks of its own. In the context of canines being used as sensors, the dogs were calibrated to interpret odors sourced from domesticated animals, more specifically canine fur and dander, as background and not of interest to their task of identifying COVID-19 positive T-shirt samples. Dogs have previously been noted to distinguish specific target odors in environments with abundant and varied distracting odors [52]. The disparity in performance between the LDA model and dog trials speaks to the fact that while the dogs were trained to ignore non-targeted odors in their training, the LDA model was still in its training phase and had yet to learn how to disregard animal interferents in the dataset.
Another notable difference between the techniques is the issue of time. Using HS-SPME-GC-MS for status determination requires considerably more time per sample than required when using trained detection dogs. Excluding method development and training periods, the final procedure for determining if a single sample was COVID-19 positive or negative would require approximately 25h using HS-SPME-GC-MS; meanwhile, all five trained canines could be run on a single scent wheel line-up containing the sample in 10 min.

4.2. Limitations

The sample sets used to train/test the canines and computational model both skewed toward the same demographic categories. In terms of race, the sample sets were predominantly white or Caucasian, and in terms of gender, they were predominantly female. Additionally, the overarching dataset of total collected T-shirt samples lacked contributions from non-binary, genderqueer, and non-cis-gendered individuals.
While conducting a crowdsourcing campaign for sample donations allowed for a large number of samples to be collected from a geographically diverse set of donors, the procedure required some sacrifice of oversight into how the samples were handled pre-processing. The T-shirt samples used in this study were handled by multiple individuals from sample kit preparation to its final analysis, either by canine or HS-SPME-GC-MS analysis. At each point of interaction, the opening of containment vessels creates an opportunity for VOCs of interest to escape and interferents to settle onto the samples. In addition, the samples were stored in permeable membranes (Ziploc™ bags) from the time of collection until either (a) they were transferred to a glass mason jar and kept for storage by PVWDC or (b) they were transferred to FIU. Samples that were allocated for FIU remained in the permeable containment at room temperature until arriving at the facility. The storage of samples at room temperature or in permeable containers allows for the continuous emission of highly and nominally volatile compounds from the sample. The long-term storage of samples under these conditions creates opportunities for sample depletion and may have impacted the performance of both experiments by lowering the abundance of total analytes in the samples.
It is important to note that the canine and HS-SPME-GC-MS experiments were not informed by the same sample sets. While all samples were collected by PVWDC and processed in the same manner, not all of the specific samples used to train or test detection dogs were used to inform the LDA model. Of the 291 samples used in canine training and 148 used to inform the computational models, 79 samples were used to inform both models. The increased number of samples used in training the canines may have beneficially impacted their ability to generalize the COVID-19 odor signature despite the presence of pet interferents.
Samples processed at FIU were subjected to UVC light exposure at 254 nm for 10-min prior to analysis. Hudson et al. (2009) noted that prolonged exposure to UVA/UVB light resulted in a distortion of human scent profiles, with some VOCs reducing in abundance and other compounds appearing as UV light exposure increased [53]. However, the Hudson study looked at direct, continuous exposure to the light source for 0, 1, 3, 5, or 7 weeks [53]. This study utilized a shorter exposure time of 10 min which has been previously reported to not adversely impact the VOC profiles being investigated [18].

4.3. Advantages and Disadvantages

In contrasting the use of canines and instrumental analysis to detect COVID-19 infection, the disadvantages of one approach appear to be compensated by the other in terms of mobility, speed of detection, development time, and performance rate. The HS-SPME-GC-MS method was developed using conventional benchtop GC-MS instrumentation with the HS-SPME procedure requiring heat baths and stabile working surfaces to prevent damage to the fibers while in use. The canines on the other hand are quite mobile once trained, they can easily be taken to new areas and be prepared to conduct their duties in under an hour where the movement of a GC-MS unit would require a day’s time in pull-down and set-up.
When viewing speed of detection, the canine method boasts a high-throughput rate with all five dogs being able to screen a sample in under ten minutes. In contrast, the HS-SPME method requires roughly 25 h for a sample to be analyzed and interpreted. In practice, samples are analyzed in batches to increase the efficiency of this method, the average per sample time equates to 3 h. While the canine method is much faster in its deployment, the average training time (per canine) was reported to be 31 weeks with an additional 5 weeks of testing. The HS-SPME-GC-MS method was developed in 16 weeks, owing 8 weeks to sample analysis and another 8 weeks to data interpretation and computational analysis. While the canine method may be faster to deploy, the HS-SPME-GC-MS method was quicker to develop.
In terms of ease of use, both methods require the participation of a trained expert with an analytical chemist being required to operate and interpret the results of a HS-SPME-GC-MS procedure and a trained canine handler being needed to conduct the canine association trials. Neither method is designed to be performed by a lay person.
Finally, when comparing performance at detecting COVID-19 infection, the final HS-SPME-GC-MS model demonstrated perfect performance with a LOOCV performance of 100% sensitivity and 100% specificity compared to the overall canine performance of 63% sensitivity and 90% specificity. The general performance of these two approaches is noted to be within a similar, competitive range as that of other previously published COVID-19 detection methods (Table 7). All in all, the disadvantages posed by one method were seen to be an excelling point in the paired approach, supporting the argument for a dual investigation of disease detection through canine and instrumental avenues.

4.4. Prospective Application of Research

This work demonstrated an approach to the dual investigation of canine and instrument-based detection of disease using volatile metabolomic expression. The instrumental model performed with high sensitivity and efficiency and was quick to train and implement. This approach has the potential to be translated into a miniaturized GC-MS approach or be used to inform the development of sensor device, applying the concept of an instrument-based detection system while improving upon mobility and speed of use issues. In fact, developments in chemiresistive sensors allow for their use with low-manufacturing costs, and ability to be incorporated into large sensor arrays for the detection of VOCs [61].
When viewing the canine approach, the performance of individual canines caused disparities in performance metrics. It is important to note that the canines participating in this study largely consisted of “pet dogs”. This is in contrast to such works as Grandjean et al. (2022), who utilized seven operational “working dogs” for their COVID-19 detection study and was able to achieve an average 97% sensitivity and 91% specificity [44]. This observation is indicative of the fact that canine performance is based on the aggregate performance of individual beings with varied abilities and that recruiting from a pre-filtered pool of professional detection dogs would likely improve the performance of this approach in its formal application as a diagnostic technology. A recent study by Kantele et al. (2022), which also implemented canines experienced in scent work, demonstrated great performance in the detection of a “wild-type” variant of COVID-19 with an overall 92% sensitivity and 91% specificity [58]. However, they also noted a decrease in performance when the canines were confronted with a previously unseen mutation of the SARS-CoV-2 virus. As such, it was implied that incorporating relevant COVID-19 variants in the training samples would allow for better overall performance.
It is believed that the ideal expansion and application of this work lies in the optimization of both approaches to reduce the identified deficiencies. The optimized methods would then be highly poised for joint application as a fast-screening approach implementing canine detection followed by a more accurate secondary analysis of suspected individuals via an instrument-based procedure. This joint approach of utilizing detection animals followed by benchtop instrumentation to improve the efficiency of delivering medical diagnoses has been demonstrated to be extremely effective as seen by APOPO’s efforts in tuberculosis detection using giant pouched rats, which reduces four days of analysis time to a 20-min screening and supplemental confirmatory testing [62]. Jointly accessing the speed of use of canines and high-performance capabilities of the instrumental approach is the ideal path forward for this dual assessment technique.

5. Conclusions

Together, the completed experiments demonstrate the capacity to simultaneously create and test instrumental and biological approaches for the detection of novel odor signatures. This ability was expressed through the discrimination of COVID-19 expression in body odor collected on T-shirts. Both experiments demonstrate the capacity of human body odor to be used as a sample source for determining COVID-19 status. The described methods were characterized by different assets: (a) a rapid, mobile approach implementing canines and (b) a reagent-free instrumental analysis method with high degrees of reproducibility. The two highest performing canines were able to distinguish the COVID-19 positive and negative individuals with an average performance of 88% sensitivity and 95% specificity; building upon this, the instrumental model (with pet interferents removed) reached an ideal performance of 100% sensitivity and 100% specificity. Ideally, in future work, both methods can be used in conjunction to be able to efficiently screen and detect diseases in a noninvasive manner. In this work, the issues that hindered one experiment were not seen to affect both. Moving forward, it is suggested that multiple relevant COVID-19 variants be included in the training samples for both approaches, as it was seen to affect diagnostic performance in a previous canine study. Further concurrent investigations of combined canine and instrumental detection schemes may shed light on how to overcome issues in one approach, informed by the other.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bios12111003/s1, Table S1: Canine Training Samples-Health Survey Results; Table S2: Canine Test Samples-Health Survey Results.

Author Contributions

Conceptualization, C.M.O. and H.K.H.; methodology, J.C.-C., A.M. and S.A.K.; software, V.A.G.; validation, J.C.-C. and V.A.G.; formal analysis, V.A.G., J.C.-C. and A.M.; data curation, V.A.G., J.C.-C., A.M., A.C., S.A.K., E.N. and C.M.O.; investigation, J.C.-C.; resources, B.S.A., K.G.F. and C.M.O.; writing—original draft preparation, A.C. and V.P.; writing—review and editing, V.A.G., J.C.-C., A.M., S.A.K., A.C. and C.M.O.; visualization, V.A.G.; supervision, H.K.H.; project administration, K.G.F., A.T.C.J. and C.M.O.; funding acquisition, K.G.F. and A.T.C.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the NIH National Center for Advancing Translational Sciences 1-U18-Tr-003775-01.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of University of Pennsylvania (IRB#843534 approved on 06/26/2020). Additionally, the animal study protocol was approved by the Institutional Animal Care and Use Committee of University of Pennsylvania (IACUC#806922 approved on 5/7/2020, IACUC#804900 approved on 11/5/2020).

Informed Consent Statement

Informed consent was obtained via electronic signature (Qualtrics) or a scanned copy of the consent form with a written signature. Informed consent was acquired from all subjects involved in the study.

Acknowledgments

Thank you to the Penn Acute Research Collaboration coordinator team at University of Pennsylvania for their processing of COVID-19 T-shirt samples.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Demographic distribution of collected T-shirt samples.
Table A1. Demographic distribution of collected T-shirt samples.
COVID-19 Status/PresentationAsymp. (+)Symp. (+)Asymp. (−)Symp. (−)
Race/ethnicityAsian Or Asian American-382
Biracial--1-
Black Or African American-12-
Hispanic Or Latino-311-
Native Hawaiian or Other Pacific Islander--1-
White Or Caucasian96914133
Another race-221
Not reported-112
Identified genderFemale56014433
Male419215
Nonbinary/genderqueer--2-
Age group18–343408322
35–644357714
65+2472
On medication?Yes55410229
No/NA424649
NA011-
Stress levels0–584712423
5–101324215
Unanswered--1-
Shared bed with another human?Yes4356916
No5449822
Shared bed with an animal?Yes3407118
No6399620
Total97916738
Table A2. Canine Test Trial Results- Response to COVID-19 Positive Samples.
Table A2. Canine Test Trial Results- Response to COVID-19 Positive Samples.
Sample CharacteristicSample Categories# of Correct Alerts from Above-Chance Dogs/
Total # of Times Samples with This Characteristic Were Seen by These Dogs
GenderF
M
24/27
8/11
Age25–34
35–44
45–54
55–65+
13/14
6/9
5/6
6/9
Symptom count0
1–3
4–5
6–7
5/6
8/8
7/12
9/12
Race/ethnicityWhite
Asian
Hispanic
African American
20/23
5/6
3/6
2/3
Bed shared with pet?Yes
No
10/12
22/27
Figure A1. Image of COVID T-shirt for sample #165 containing animal fur.
Figure A1. Image of COVID T-shirt for sample #165 containing animal fur.
Biosensors 12 01003 g0a1
This table shows the samples used in the canine tests and the elapsed time between collection and the earliest and latest test done with the dogs.
Table A3. Table of canine test samples.
Table A3. Table of canine test samples.
Sample #Test UsedSample StatusDate Sample Placed in Collection BagDays until Sample Used in Earliest Test (Toby)Days until Sample Used in Latest Test (Roxie)
190Test 1negative10 September 20168229
284Test 1negative20 January 213697
29Test 1negative19 September 20159220
208Test 1negative23 December 2064125
240Test 1negative6 January 2150111
218Test 1negative2 December 2085146
203Test 1negative27 November 2090151
3Test 1negative9 September 20169230
186Test 1negative3 July 20237298
268Test 1negative16 January 2140101
210Test 1negative15 December 2072133
69Test 1negative24 August 20185246
417Test 2negative2 February 213593
28Test 2negative25 September 20165223
14Test 2negative13 August 20208266
90Test 2negative29 October 20131189
406Test 2negative31 January 213795
261Test 2negative8 January 2160118
251Test 2negative12 January 2166124
273Test 2negative3 February 213492
280Test 2negative19 January 2149107
452Test 2negative8 February 212987
427Test 2negative16 February 212179
453Test 2negative9 February 212886
407Test 3negative28 January 2154110
426Test 3negative13 February 213894
244Test 3negative16 December 2097153
271Test 3negative18 January 2164120
286Test 3negative21 January 2161117
162Test 3negative25 January 2157113
365Test 3negative19 February 213288
290Test 3negative20 January 2162118
410Test 3negative4 February 2147103
308Test 3negative16 January 2166122
363Test 3negative16 February 213591
341Test 3negative28 February 212379
243Test 4negative20 January 2177128
292Test 4negative24 January 2173124
306Test 4negative13 January 2184135
344Test 4negative26 February 214091
93Test 4negative10 November 20148199
192Test 4negative6 October 20183234
254Test 4negative11 January 2186137
287Test 4negative21 January 2176127
150Test 4negative30 December 2098149
129Test 4negative10 November 20148199
282Test 4negative20 January 2177128
236Test 4negative2 December 20126177
439Test 5negative9 March 2184145
437Test 5negative9 March 2184145
438Test 5negative10 March 2183144
515Test 5negative3 May 212990
309Test 5negative18 January 21134195
291Test 5negative20 January 21132193
349Test 5negative16 March 2177138
355Test 5negative27 April 213596
432Test 5negative26 February 2195156
316Test 5negative27 January 21125186
297Test 5negative22 January 21130191
508Test 5negative2 May 213091
232Test 1positive18 November 2099160
223Test 1positive2 December 2085146
250Test 2positive1 January 2167128
113Test 2positive30 July 20222283
195Test 2positive10 November 20119180
146Test 3positive16 December 2097158
248Test 3positive11 December 20102163
312Test 3positive19 January 2163124
124Test 4positive10 September 20209270
262Test 4positive13 January 2184145
299Test 5positive1 January 21151212
108Test 5positive24 November 20189250
137Test 5positive30 November 20183244

References

  1. WHO. Coronavirus (COVID-19) Dashboard; World Health Organization: Geneva, Switzerland, 2022. [Google Scholar]
  2. Jayaweera, M.; Perera, H.; Gunawardana, B.; Manatunge, J. Transmission of COVID-19 virus by droplets and aerosols: A critical review on the unresolved dichotomy. Environ. Res. 2020, 188, 109819. [Google Scholar] [CrossRef] [PubMed]
  3. Ali Rabaan, A.A.; Al-Ahmed, S.H.; Al-Malkey, M.; Alsubki, R.; Ezzikouri, S.; Al-Hababi, F.H.; Sah, R.; Al Mutair, A.; Alhumaid, S.; Al-Tawfiq, J.A.; et al. Airborne Transmission of SARS-CoV-2 is the Dominant Route of Transmission: Droplets and Aerosols. Le Infenzioni in Medicina. 2021, 29, 10–19. [Google Scholar]
  4. Geng, Y.; Wang, Y. Stability and transmissibility of SARS-CoV-2 in the environment. J. Med. Virol. 2022; 1–11, early view. [Google Scholar]
  5. Alene, M.; Yismaw, L.; Assemie, M.A.; Ketema, D.B.; Mengist, B.; Kassie, B.; Birhan, T.Y. Magnitude of asymptomatic COVID-19 cases throughout the course of infection: A systematic review and meta-analysis. PLoS ONE 2021, 16, e0249090. [Google Scholar] [CrossRef]
  6. Salomon, J.A.; Reinhart, A.; Bilinski, A.; Chua, E.J.; La Motte-Ker, W.; Rönn, M.M.; Reitsma, M.B.; Morris, K.A.; LaRocca, S.; Farag, T.H.; et al. The US COVID-19 Trends and Impact Survey: Continuous real-time measurement of COVID-19 symptoms, risks, protective behaviors, testing, and vaccination. Proc. Natl. Acad. Sci. USA 2021, 118, e2111454118. [Google Scholar] [CrossRef]
  7. Zamani Rarani, F.; Zamani Rarani, M.; Hamblin, M.R.; Rashidi, B.; Hashemian, S.M.R.; Mirzaei, H. Comprehensive overview of COVID-19-related respiratory failure: Focus on cellular interactions. Cell Mol. Biol. Lett. 2022, 27, 63. [Google Scholar] [CrossRef] [PubMed]
  8. Shchendrygina, A.; Nagel, E.; Puntmann, V.O.; Valbuena-Lopez, S. COVID-19 myocarditis and prospective heart failure burden. Expert Rev. Cardiovasc. Ther. 2021, 19, 5–14. [Google Scholar] [CrossRef] [PubMed]
  9. Zafer, M.M.; El-Mahallawy, H.A.; Ashour, H.M. Severe COVID-19 and sepsis: Immune pathogenesis and laboratory markers. Microorganisms 2021, 9, 159. [Google Scholar] [CrossRef]
  10. Mouliou, D.S.; Gourgoulianis, K.I. False-positive and false-negative COVID-19 cases: Respiratory prevention and management strategies, vaccination, and further perspectives. Expert Rev. Respir. Med. 2021, 15, 993–1002. [Google Scholar] [CrossRef]
  11. West, C.P.; Montori, V.M.; Sampathkumar, P. COVID-19 testing: The threat of false-negative results. Mayo Clin. Proc. 2020, 95, 1127–1129. [Google Scholar] [CrossRef]
  12. Han, D.; Li, R.; Han, Y.; Zhang, R.; Li, J. COVID-19: Insight into the asymptomatic SARS-CoV-2 infection and transmission. Int. J. Biol. Sci. 2020, 16, 2803–2811. [Google Scholar] [CrossRef]
  13. Hardin, D.S.; Anderson, W.; Cattet, J. Dogs can be successfully trained to alert to hypoglycemia samples from patients with type 1 diabetes. Diabetes Ther. 2015, 6, 509–517. [Google Scholar] [CrossRef] [PubMed]
  14. Buszewski, B.; Ligor, T.; Jezierski, T.; Wenda-Piesik, A.; Walczak, M.; Rudnicka, J. Identification of volatile lung cancer markers by gas chromatography-mass spectrometry: Comparison with discrimination by canines. Anal. Bioanal. Chem. 2012, 404, 141–146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Murarka, M.; Vesley-Gross, Z.I.; Essler, J.L.; Smith, P.G.; Hooda, G.; Drapkin, R.; Otto, C.M. Testing ovarian cancer cell lines to train dogs to detect ovarian cancer from blood plasma: A pilot study. J. Vet. Behav. 2019, 32, 42–48. [Google Scholar] [CrossRef]
  16. Kane, S.; Lee, Y.E.; Essler, J.L.; Mallikarjun, A.; Preti, G.; Plymouth, V.; Verta, A.; DeAngelo, A.; Otto, C.M. Canine discrimination of ovarian cancer through volatile organic compounds. Talanta 2022, 250, 123729. [Google Scholar] [CrossRef] [PubMed]
  17. Cornu, J.N.; Cancel-Tassin, G.; Ondet, V.; Girardet, C.; Cussenot, O. Olfactory detection of prostate cancer by dogs sniffing urine: A step forward in early diagnosis. Eur. Urol. 2011, 59, 197–201. [Google Scholar] [CrossRef]
  18. Koskinen, A.; Koskinen, H.; Bäck, L.; Saxen, H.; Klockars, T. A detection dog for paediatric urinary tract infection caused by Escherichia coli. Infect. Dis. 2017, 49, 874–877. [Google Scholar] [CrossRef]
  19. Eskandari, E.; Marzaleh, M.A.; Roudgari, H.; Farahani, R.H.; Nezami-Asl, A.; Laripour, R.; Aliyazdi, H.; Moghaddam, A.D.; Zibaseresht, R.; Akbarialiabad, H.; et al. Sniffer dogs as a screening/diagnostic tool for COVID-19: A proof of concept study. BMC Infect Dis. 2021, 21, 243, 1–8. [Google Scholar] [CrossRef]
  20. Essler, J.L.; Kane, S.A.; Nolan, P.; Akaho, E.H.; Berna, A.Z.; DeAngelo, A.; Berk, R.A.; Kaynaroglu, P.; Plymouth, V.; Frank, I.D.; et al. Discrimination of SARS-CoV-2 infected patient samples by detection dogs: A proof of concept study. PLoS ONE 2021, 16, e0250158. [Google Scholar] [CrossRef]
  21. Fathizadeh, H.; Taghizadeh, S.; Safari, R.; Khiabani, S.S.; Babak, B.; Hamzavi, F.; Ganbarov, K.; Esposito, S.; Zeinalzadeh, E.; Dao, S.; et al. Study presence of COVID-19 (SARS-CoV-2) in the sweat of patients infected with COVID-19. Microb. Pathog. 2020, 149, 104556. [Google Scholar] [CrossRef]
  22. Grandjean, D.; Sarkis, R.; Lecoq-Julien, C.; Benard, A.; Roger, V.; Levesque, E.; Bernes-Luciani, E.; Maestracci, B.; Morvan, P.; Gully, E.; et al. Can the detection dog alert on COVID-19 positive persons by sniffing axillary sweat samples? A proof-of-concept study. PLoS ONE 2020, 15, e0243122. [Google Scholar] [CrossRef]
  23. Jezierski, T.; Walczak, M.; Ligor, T.; Rudnicka, J.; Buszewski, B. Study of the art: Canine olfaction used for cancer detection on the basis of breath odour. Perspectives and limitations. J. Breath Res. 2015, 9, 027001. [Google Scholar] [CrossRef] [PubMed]
  24. Mendel, J.; Frank, K.; Edlin, L.; Hall, K.; Webb, D.; Mills, J.; Holness, H.K.; Furton, K.G.; Mills, D. Preliminary accuracy of COVID-19 odor detection by canines and HS-SPME-GC-MS using exhaled breath samples. Forensic Sci. Int. 2021, 3, 100155. [Google Scholar] [CrossRef] [PubMed]
  25. Chen, H.; Qi, X.; Ma, J.; Zhang, C.; Feng, H.; Yao, M. Breath-borne VOC Biomarkers for COVID-19. medRxiv 2020. [Google Scholar] [CrossRef]
  26. Woollam, M.; Angarita-Rivera, P.; Siegel, A.P.; Kalra, V.; Kapoor, R.; Agarwal, M. Exhaled VOCs can discriminate subjects with COVID-19 from healthy controls. J. Breath Res. 2022, 16, 036002. [Google Scholar] [CrossRef] [PubMed]
  27. Broza, Y.Y.; Mochalski, P.; Ruzsanyi, V.; Amann, A.; Haick, H. Hybrid volatolomics and disease detection. Angew. Chem. 2015, 54, 11036–11048. [Google Scholar] [CrossRef] [PubMed]
  28. Giovannini, G.; Haick, H.; Garoli, D. Detecting COVID-19 from breath: A game changer for a big challenge. ACS Sens. 2021, 6, 1408–1417. [Google Scholar] [CrossRef] [PubMed]
  29. Ibrahim, W.; Cordell, R.L.; Wilde, M.J.; Richardson, M.; Carr, L.; Dasi, A.S.D.; Hargadon, B.; Free, R.C.; Monks, P.S.; Brightling, C.E.; et al. Diagnosis of covid-19 by exhaled breath analysis using gas chromatography–mass spectrometry. ERJ Open Res. 2021, 7, 1–10. [Google Scholar] [CrossRef]
  30. Leung, N.H.L.; Chu, D.K.W.; Shiu, E.Y.C.; Chan, K.H.; McDevitt, J.J.; Hau, B.J.P.; Yen, H.L.; Li, Y.; Ip, D.K.M.; Peiris, J.S.M.; et al. Respiratory virus shedding in exhaled breath and efficacy of face masks. Nat. Med. 2020, 26, 676–680. [Google Scholar] [CrossRef] [Green Version]
  31. Ehsanifar, M. Airborne aerosols particles and COVID-19 transition. Environ. Res. 2021, 200, 111752. [Google Scholar] [CrossRef]
  32. Arslan, B.; Bercin, S.; Aydogan, S.; Islamogu, Y.; Dinc, B. SARS-CoV-2 is not found in the sweat of COVID-19 positive patients. Ir. J. Med. Sci. 2022, 191, 27–29. [Google Scholar] [CrossRef]
  33. Lamote, K.; Janssens, E.; Schillebeeckx, E.; Lapperre, T.S.; De Winter, B.Y.; van Meerbeeck, J.P. The scent of COVID-19: Viral (semi-)volatiles as fast diagnostic biomarkers? J. Breath Res. 2020, 14, 042001. [Google Scholar] [CrossRef] [PubMed]
  34. Huang, S.; Chen, G.; Ye, N.; Kou, X.; Zhu, F.; Shen, J.; Ouyang, G. Solid-phase microextraction: An appealing alternative for the determination of endogenous substances—A review. Anal Chim Acta 2019, 1077, 67–86. [Google Scholar] [CrossRef] [PubMed]
  35. Harbourt, D.E.; Haddow, A.D.; Piper, A.E.; Bloomfield, H.; Kearney, B.J.; Fetterer, D.; Gibson, K.; Minogue, T. Modeling the stability of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on skin, currency, and clothing. PLoS Negl. Trop. Dis. 2020, 14, e0008831. [Google Scholar] [CrossRef]
  36. Furton, K.G.; Beltz, K. Universal Detector Calibrant. US Patent 9250222, 2 February 2016. [Google Scholar]
  37. Mueller, M.M.; Palkovic, C.M.; Maynard, C.S. Errorless learning: Review and practical application for teaching children with pervasive developmental disorders. Psychol Sch. 2007, 44, 691–700. [Google Scholar] [CrossRef]
  38. Friard, O.; Gamba, M. BORIS: A free, versatile open-source event-logging software for video/audio coding and live observations. Methods Ecol. Evol. 2016, 7, 1325–1330. [Google Scholar] [CrossRef]
  39. Bates, D.; Mächler, M.; Bolker, B.; Walker, S. Fitting linear mixed-effects models using lme4. J. Stat. Softw. 2015, 67, 1–48. [Google Scholar] [CrossRef]
  40. Gokool, V.A.; Holness, H.K.; Furton, K.G. The influence of intra-personal variations in human hand odor on the determination of sample donor. Forensic Sci. Int. 2022, 334, 111235. [Google Scholar] [CrossRef]
  41. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [Green Version]
  42. Angeletti, S.; Travaglino, F.; Spoto, S.; Pascarella, M.C.; Mansi, G.; De Cesaris, M.; Sartea, S.; Giovanetti, M.; Fogolari, M.; Plescia, D.; et al. COVID-19 sniffer dog experimental training: Which protocol and which implications for reliable sidentification? J. Med. Virol. 2021, 93, 5924–5930. [Google Scholar] [CrossRef]
  43. Chaber, A.; Hazel, S.; Matthews, B.; Withers, A.; Alvergnat, G.; Grandjean, D.; Caraguel, C. Evaluation of canine detection of COVID-19 infected individuals under controlled settings. Transbound Emerg. Dis. 2022, 69, e1951–e1958. [Google Scholar] [CrossRef]
  44. Grandjean, D.; Elie, C.; Gallet, C.; Julien, C.; Roger, V.; Desquilbet, L.; Alvergnat, A.; Delarue, S.; Gabassi, A.; Minier, M.; et al. Diagnostic accuracy of noninvasive detection of SARS-CoV-2 infection by canine olfaction. PLoS ONE 2022, 17, e0268382. [Google Scholar] [CrossRef] [PubMed]
  45. Gonder-Frederick, L.A.; Grabman, J.H.; Shepard, J.A.; Tripathi, A.V.; Ducar, D.M.; McElgunn, Z.R. Variability of Diabetes Alert Dog Accuracy in a Real-World Setting. J. Diabetes Sci. Technol. 2017, 11, 714–719. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. DeMatteo, K.E.; Davenport, B.; Wilson, L.E. Back to the basics with conservation detection dogs: Fundamentals for success. Wildl. Biol. 2019, 2019, 1–9. [Google Scholar] [CrossRef] [Green Version]
  47. Sinn, D.L.; Gosling, S.D.; Hilliard, S. Personality and performance in military working dogs: Reliability and predictive validity of behavioral tests. Appl. Anim. Behav. Sci. 2010, 127, 51–65. [Google Scholar] [CrossRef]
  48. Sacharczuk, M.; Walczak, M.; Adamkiewicz, E.; Walasek, A.; Ensminger, J.; Presch, M.; Jezierski, T. Polymorphism of olfactory and neurotransmitters receptor genes in drug and explosives detection dogs can be associated with differences in detection performance. Appl. Anim. Behav. Sci. 2019, 215, 52–60. [Google Scholar] [CrossRef]
  49. Jamieson, L.T.J.; Baxter, G.S.; Murray, P.J. You are not my handler! impact of changing handlers on dogs’ behaviours and detection performance. Animals 2018, 8, 176. [Google Scholar] [CrossRef] [Green Version]
  50. Lit, L.; Schweitzer, J.B.; Oberbauer, A.M. Handler beliefs affect scent detection dog outcomes. Anim. Cogn. 2011, 14, 387–394. [Google Scholar] [CrossRef] [Green Version]
  51. Jiang, L.; Meng, D.; Yu, S.-I.; Lan, Z.; Shan, S.; Hauptmann, A.G. Self-paced learning with diversity. In Advances in Neural Information Processing Systems 27; Curran: Montreal, Canada, 2014; pp. 1–9. [Google Scholar]
  52. Angle, C.; Waggoner, L.P.; Ferrando, A.; Haney, P.; Passler, T. Canine detection of the volatilome: A review of implications for pathogen and disease detection. Front. Vet. Sci. 2016, 3, 47. [Google Scholar] [CrossRef]
  53. Hudson, D.T.; Curran, A.M.; Furton, K.G. The Stability of Collected Human Scent Under Various Environmental Conditions. J. Forensic Sci. 2009, 54, 1270–1277. [Google Scholar] [CrossRef]
  54. Kritikos, A.; Caruana, G.; Brouillet, R.; Miroz, J.-P.; Abed-Maillard, S.; Stieger, G.; Opota, O.; Croxatto, A.; Vollenweider, P.; Bart, P.-A.; et al. Sensitivity of Rapid Antigen Testing and RT-PCR Performed on Nasopharyngeal Swabs versus Saliva Samples in COVID-19 Hospitalized Patients: Results of a Prospective Comparative Trial (RESTART). Microorganisms 2021, 9, 1910. [Google Scholar] [CrossRef]
  55. Brihn, A.; Chang, J.; OYong, K.; Balter, S.; Terashita, D.; Rubin, Z.; Yeganeh, N. Diagnostic Performance of an Antigen Test with RT-PCR for the Detection of SARS-CoV-2 in a Hospital Setting—Los Angeles County, California, June–August 2020. Morb. Mortal. Wkly. Rep. 2021, 70, 702–706. [Google Scholar] [CrossRef] [PubMed]
  56. Lefever, S.; Indevuyst, C.; Cuypers, L.; Dewaele, K.; Yin, N.; Cotton, F.; Padalko, E.; Oyaert, M.; Descy, J.; Cavalier, E.; et al. Comparison of the Quantitative DiaSorin Liaison Antigen Test to Reverse Transcription-PCR for the Diagnosis of COVID-19 in Symptomatic and Asymptomatic Outpatients. J. Clin. Microbiol. 2021, 59, e00374-21. [Google Scholar] [CrossRef] [PubMed]
  57. Devillier, P.; Gallet, C.; Salvator, H.; Lecoq-Julien, C.; Naline, E.; Roisse, D.; Levert, C.; Breton, E.; Galtat, A.; Decourtray, S.; et al. Biomedical detection dogs for the identification of SARS-CoV-2 infections from axillary sweat and breath samples **. J. Breath Res. 2022, 16, 037101. [Google Scholar] [CrossRef] [PubMed]
  58. Kantele, A.; Paajanen, J.; Turunen, S.; Pakkanen, S.H.; Patjas, A.; Itkonen, L.; Heiskanen, E.; Lappalainen, M.; Desquilbet, L.; Vapalahti, O.; et al. Scent dogs in detection of COVID-19: Triple-blinded randomised trial and operational real-life screening in airport setting. BMJ Glob. Health 2022, 7, e008024. [Google Scholar] [CrossRef]
  59. Mougang, Y.K.; Zazzo, L.D.; Minieri, M.; Capuano, R.; Catini, A.; Legramante, J.M.; Paolesse, R.; Bernardini, S.; Di Natale, C. Sensor array and gas chromatographic detection of the blood serum volatolomic signature of COVID-19. iScience 2021, 24, 102851. [Google Scholar] [CrossRef]
  60. Bordbar, M.; Samadinia, H.; Hajian, A.; Sheini, A.; Safaei, E.; Aboonajmi, J.; Arduini, F.; Sharghi, H.; Hashemi, P.; Khoshsafar, H.; et al. Mask assistance to colorimetric sniffers for detection of Covid-19 disease using exhaled breath metabolites. Sens. Actuators B Chem. 2022, 369, 132379. [Google Scholar] [CrossRef]
  61. Kny, E.; Reiner-Rozman, C.; Dostalek, J.; Hassel, A.-W.; Nöhammer, C.; Pfaffeneder-Mantai, F.; Szunerits, S.; Weber, V.; Knoll, W.; Kleber, C. State of the Art of Chemosensors in a Biomedical Context. Chemosensors 2022, 10, 199. [Google Scholar] [CrossRef]
  62. Fiebig, L.; Beyene, N.; Burny, R.; Fast, C.D.; Cox, C.; Mgode, G.F. From pests to tests: Training rats to diagnose tuberculosis. Eur. Respir. J. 2020, 55, 1902243. [Google Scholar] [CrossRef]
Figure 1. A photo of the 8-port scent wheel used in this study.
Figure 1. A photo of the 8-port scent wheel used in this study.
Biosensors 12 01003 g001
Figure 2. This graph shows the number of sessions each dog spent in each phase of training prior to the test phase. After imprinting, dogs had to spend a minimum of 3 sessions in each phase to meet the benchmark of 5/6 correct alerts on COVID-19 positive samples and 10/12 correct passes on COVID-19 negative samples.
Figure 2. This graph shows the number of sessions each dog spent in each phase of training prior to the test phase. After imprinting, dogs had to spend a minimum of 3 sessions in each phase to meet the benchmark of 5/6 correct alerts on COVID-19 positive samples and 10/12 correct passes on COVID-19 negative samples.
Biosensors 12 01003 g002
Figure 3. Initial COVID T-shirt PCA labelled by donor’s COVID-19 status.
Figure 3. Initial COVID T-shirt PCA labelled by donor’s COVID-19 status.
Biosensors 12 01003 g003
Figure 4. COVID T-shirt PCA: subgrouping removed, labelled by donor’s COVID-19 status.
Figure 4. COVID T-shirt PCA: subgrouping removed, labelled by donor’s COVID-19 status.
Biosensors 12 01003 g004
Figure 5. COVID T-shirt LDA model and model performance.
Figure 5. COVID T-shirt LDA model and model performance.
Biosensors 12 01003 g005
Figure 6. No pets in bed, COVID-19 T-shirt LDA model and model performance.
Figure 6. No pets in bed, COVID-19 T-shirt LDA model and model performance.
Biosensors 12 01003 g006
Table 1. Donor demographic data for COVID-19 T-shirt samples used in dog training/testing.
Table 1. Donor demographic data for COVID-19 T-shirt samples used in dog training/testing.
Race/
Ethnicity
Identified GenderCOVID-19
Status/Presentation
Age GroupShared Bed with
FemaleMaleNB/GQAsym.Sym.Neg.18–3435–6465+No OneAnother PersonPerson and Pet(s)Pet(s)UKN
(+)(+)(-)
Asian or Asian American121--310112-5521-
Biracial1----1-1----1-
Black or African American21--1221-1--2-
Hispanic or Latino1121-31195-4424-
Native Hawaiian or Other Pacific Islander1----1-1--1---
White or Caucasian20645196917412011814827036622
Another race5---2341-2-12-
Not reported4---132111111-
Total23949297920214712815957942722
NB/GQ = nonbinary/genderqueer.
Table 2. Canine participant information.
Table 2. Canine participant information.
DogSexAge (Years)BreedPreviously Trained Odors
GrizM6GSDUDC, spotted lanternfly, Middle Eastern antiquities, live humans
RicoM6GSDUDC
RoxieF6LabradorUDC, narcotics, live humans
TobyM3Small MunsterlanderUDC, spotted lanternfly, live humans
TuukkaF7Husky/GSD mixUDC
M = male, F = female, GSD = German shepherd dog, UDC = universal detector calibrant.
Table 3. Training progression criteria.
Table 3. Training progression criteria.
PhaseHoles in Negative LidSensitivity
Required to
Advance
Specificity
Required to
Advance
Minimum # Sessions
Required to Advance
# COVID-19 (+) Samples/Session# COVID-19 (-) Samples/Session
Imprinting19/10 trials overall correct111
Phase 1180%
(5/6 correct)
80%
(10/12 correct)
3 in a row24
Phase 2480%
(5/6 correct)
80%
(10/12 correct)
3 in a row24
Phase 31680%
(5/6 correct)
80%
(10/12 correct)
3 in a row24
Phase 4Fully open80%
(5/6 correct)
80%
(10/12 correct)
3 in a row24
Sensitivity = TP/(TP + FN)                   Rate of alert to positive samples
Specificity = TN/(FP + TN)           Rate of no alert to negative/blank samples
Table 4. Donor demographic data for COVID-19 T-shirt samples informing computational models.
Table 4. Donor demographic data for COVID-19 T-shirt samples informing computational models.
Race/
Ethnicity
Identified GenderCOVID-19 Status/PresentationAge GroupShared Bed With
FemaleMaleNB/GQAsymp.
(+)
Sympt.
(+)
Neg.
(-)
18–3435–6465+No OneAnother PersonPerson & Pet(s)Pet(s)
Asian or Asian American5---1441-23--
Hispanic or Latino221-3232-1112
White or Caucasian1002503378558571036361934
Another Race2-- 112--1-1-
Not Reported--- 7 *×4 ×-------
Total1092713499667601040402136
NB/GQ = nonbinary/genderqueer * symptomology not reported. × demographic information not reported.
Table 5. Dogs’ sensitivity and specificity at test.
Table 5. Dogs’ sensitivity and specificity at test.
DogSensitivitySpecificity
Griz11/12 * (91.7%)51/56 * (91.1%)
Toby11/13 (84.6%) 59/60 (98.3%)
Tuukka9/13 (69.2%)55/60 (91.6%)
Rico5/13 (38.5%)56/60 (93.3%)
Roxie4/13 (30.8%)46/60 (76.6%)
* Griz was accidentally clicked and rewarded after alerting on a positive sample during a test trial; because dogs were not being clicked and reinforced during testing, this trial was removed from his results before analysis.
Table 6. Trial set individual positive results.
Table 6. Trial set individual positive results.
Trial# of Dogs who Correctly Alerted# Correctly Alerted, above Chance DogsGenderAgeSymptomCountRace/
Ethnicity
Bed Shared with Pet?
12/5
4/5
2/3
2/3
F
M
45–54
35–44
5
5
White
Hispanic
No
Yes, 1 dog
24/5
3/5
3/5
3/3
1/3
2/3
F
F
M
25–34
35–44
55–64
3
6
5
White
Hispanic
White
No
Yes, 1 cat
No
33/5
3/5
4/5
2/3
3/3
2/3
F
F
F
25–34
25–34
55–64
4
0
7
Asian
White
African American
No
No
Yes, 1 or more dogs
42/5
3/5
2/3
3/3
M
F
65+
25–34
0
7
White
Asian
No
No
53/4
4/5
3/5
2/2
3/3
3/3
M
F
F
25–34
45–54
35–44
3
1
7
White
White
White
No
No
Yes, 1 or more cats
Table 7. COVID-19 detection method comparisons.
Table 7. COVID-19 detection method comparisons.
Detection MethodSample MediumAverage Specificity and/or SensitivityReference
RT-PCRNasopharyngeal swab98% sensitivity
100% specificity
[54]
Saliva69% sensitivity
100% specificity
[54]
Antigen test Nasal swab72.1% sensitivity
98.7% specificity
[55]
Nasopharyngeal65.7% sensitivity
100% specificity
[56]
Canine screeningBreath—
face masks
83.1% sensitivity
88.6% specificity
[57]
Face masks and clothes86% sensitivity
92.9% specificity
[19]
Skin swab92% sensitivity
91% specificity
[58]
Axillary sweat97% sensitivity
91% specificity
[44]
Axillary sweat89.6% sensitivity
83.9%specificity
[57]
Body odor—T-shirts
(including axillary sweat)
63% sensitivity
90% specificity
Current study
HS-SPME-GC-MSBody odor—T-shirts
(including axillary sweat)
100% sensitivity
100% specificity
Current study
SPME-GC-MSBlood serum94% sensitivity
83% specificity
[59]
Quartz
microbalance
Blood serum94% sensitivity
80% specificity
[59]
Colorimetric paper sensorBreath78.3% sensitivity
83.6% specificity
[60]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Gokool, V.A.; Crespo-Cajigas, J.; Mallikarjun, A.; Collins, A.; Kane, S.A.; Plymouth, V.; Nguyen, E.; Abella, B.S.; Holness, H.K.; Furton, K.G.; et al. The Use of Biological Sensors and Instrumental Analysis to Discriminate COVID-19 Odor Signatures. Biosensors 2022, 12, 1003. https://doi.org/10.3390/bios12111003

AMA Style

Gokool VA, Crespo-Cajigas J, Mallikarjun A, Collins A, Kane SA, Plymouth V, Nguyen E, Abella BS, Holness HK, Furton KG, et al. The Use of Biological Sensors and Instrumental Analysis to Discriminate COVID-19 Odor Signatures. Biosensors. 2022; 12(11):1003. https://doi.org/10.3390/bios12111003

Chicago/Turabian Style

Gokool, Vidia A., Janet Crespo-Cajigas, Amritha Mallikarjun, Amanda Collins, Sarah A. Kane, Victoria Plymouth, Elizabeth Nguyen, Benjamin S. Abella, Howard K. Holness, Kenneth G. Furton, and et al. 2022. "The Use of Biological Sensors and Instrumental Analysis to Discriminate COVID-19 Odor Signatures" Biosensors 12, no. 11: 1003. https://doi.org/10.3390/bios12111003

APA Style

Gokool, V. A., Crespo-Cajigas, J., Mallikarjun, A., Collins, A., Kane, S. A., Plymouth, V., Nguyen, E., Abella, B. S., Holness, H. K., Furton, K. G., Johnson, A. T. C., & Otto, C. M. (2022). The Use of Biological Sensors and Instrumental Analysis to Discriminate COVID-19 Odor Signatures. Biosensors, 12(11), 1003. https://doi.org/10.3390/bios12111003

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop