Next Article in Journal
Novel Antiviral Agents: Synthesis, Molecular Modelling Studies and Biological Investigation
Previous Article in Journal
Mathematical Modeling of Rhesus Cytomegalovirus Transplacental Transmission in Seronegative Rhesus Macaques
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Viruses
Volume 15
Issue 10
10.3390/v15102041
viruses-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Establishment and Application of CRISPR–Cas12a-Based Recombinase Polymerase Amplification and a Lateral Flow Dipstick and Fluorescence for the Detection and Distinction of Deformed Wing Virus Types A and B

by
Yuting Xiao
1,†,
Dongliang Fei
2,†,
Ming Li
1,
Yueyu Ma
2 and
Mingxiao Ma
1,*
1
College of Animal Husbandry and Veterinary Medicine, Jinzhou Medical University, Jinzhou 121000, China
2
Experimental Animal Center of Jinzhou Medical University, Jinzhou 121000, China
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Viruses 2023, 15(10), 2041; https://doi.org/10.3390/v15102041
Submission received: 4 August 2023 / Revised: 21 September 2023 / Accepted: 30 September 2023 / Published: 1 October 2023
(This article belongs to the Section Invertebrate Viruses)
Browse Figures
Review Reports Versions Notes

Abstract

:
Deformed wing virus (DWV) is one of the important pathogens of the honey bee (Apis mellifera), which consists of three master variants: types A, B, and C. Among them, DWV types A (DWV-A) and B (DWV-B) are the most prevalent variants in honey bee colonies and have been linked to colony decline. DWV-A and DWV-B have different virulence, but it is difficult to distinguish them via traditional methods. In this study, we established a visual detection assay for DWV-A and DWV-B using recombinase polymerase amplification (RPA) and a lateral flow dipstick (LFD) coupled with the clustered regularly interspaced short palindromic repeats (CRISPR)–CRISPR-associated protein (Cas) 12a fluorescence system (RPA–CRISPR–Cas12a–LFD). The limit of detection of this system was ~6.5 × 100 and 6.2 × 101 copies/μL for DWV-A and DWV-B, respectively. The assays were specific and non-cross-reactive against other bee viruses, and the results could be visualized within 1 h. The assays were validated by extracting cDNA from 36 clinical samples of bees that were suspected to be infected with DWV. The findings were consistent with those of traditional reverse transcription–quantitative polymerase chain reaction, and the RPA–CRISPR–Cas12a assay showed the specific, sensitive, simple, and appropriate detection of DWV-A and DWV-B. This method can facilitate the visual and qualitative detection of DWV-A and DWV-B as well as the monitoring of different subtypes, thereby providing potentially better control and preventing current and future DWV outbreaks.

1. Introduction

The honey bee Apis mellifera is vital to the agricultural environment as a pollinator, with an estimated global economic value of >225 billion US dollars. However, studies have reported that honey bee colonies are severely threatened by deformed wing virus (DWV), especially in the presence of the external parasite Varroa destructor, which is one of the most well-characterized, globally distributed bee-infecting viruses [1,2,3]. DWV is a major pathogen that is detected in all developmental stages of honey bees and causes colony collapse disorder [3].
DWV is a member of the picorna-like insect virus family Iflaviridae, consisting of a 30 nm icosahedral particle with a single, positive-strand RNA genome [4]. Honey bees infected with DWV during development may exhibit wing deformities, whereas those infected with DWV in adulthood may have asymptomatic or symptomatic infections, characterized by a shortened abdomen, cuticle discoloration, and a reduced lifespan [5,6,7]. Three master variants of DWV have been identified: types A, B, and C [8,9,10]. The International Committee on Taxonomy of Viruses has further categorized DWV type A into two variants: DWV and Kakugo virus [11,12]. DWV-A and DWV-B infections are prevalent worldwide and have different virulence, with type B being the most virulent [13]. As DWV-C is the most recently described variant, its effects have not yet been elucidated [10]. DWV is mainly diagnosed based on reverse transcription–polymerase chain reaction (RT–PCR) technologies [8], such as RT–PCR, RT–quantitative PCR (qPCR), and SYBR Green qPCR [1,14]. However, owing to complex detection procedures, costly test equipment, and the requirement for qualified technical personnel, the clinical application of these methods is limited. As a novel isothermal nucleic acid amplification technology, recombinase polymerase amplification (RPA) has been demonstrated to be rapid, specific, sensitive, and cost-effective for detecting pathogens. The entire reaction can be accomplished at a constant temperature (optimally at 37°C–42°C) within a short time (20 min), making RPA a promising on-site detection method [15]. RPA has been employed for detecting pathogens such as bacteria, fungi, parasites, and viruses [16,17,18].
Clustered regularly interspaced short palindromic repeats (CRISPR)-associated protein (CRISPR–Cas) was developed for gene editing and detecting nucleic acids and has been used to diagnose infections [19,20]. CRISPR–Cas12a-based diagnosis involves a mixture of Cas12a and guide RNA (crRNA) with protospacer adjacent motif (PAM), which specifically binds target dsDNA to activate Cas12a for target DNA cleavage. Collateral cleavage is activated, resulting in the cleavage of the fluorescent reporter from the quencher and producing a detectable fluorescent signal [21]. Compared with RPA or PCR alone, a combination of RPA and CRISPR makes the highly sensitive Cas12a detection system (RPA–CRISPR–Cas12a) more specific, prevents the loss of trace nucleic acids [22], compensates for the disadvantages of RPA false positives, amplifies the cleavage signal of CRISPR, and reduces dye contamination generated during staining [23]. The RPA–CRISPR–Cas12a assay has been extensively used for detecting pathogens, such as plant RNA viruses, Ehrlichia canis, and Anaplasma platys [24,25]. The results of the RPA–CRISPR–Cas12a assay can be visually detected using a lateral flow dipstick (LFD) and directly interpreted by the naked eye within a few minutes [26]. LFDs are based on lateral flow technology using gold nanoparticles and can promptly detect amplification products, making results easy to observe [27]. To the best of our knowledge, no studies have reported the use of RPA and LFD coupled with the CRISPR–Cas12a fluorescence assay for detecting DWV-A and DWV-B.
To establish a novel method for detecting DWV, we first designed specific primers to amplify the target regions of the RdRp gene of DWV. Further, we synthesized CRISPR RNAs (crRNAs) targeting DWV-A and DWV-B. Then, we combined the RPA–CRISPR–Cas12a assay with LFD to detect and distinguish DWV-A and DWV-B. The sensitivity and specificity of our detection method were evaluated and its clinical performance was validated using field samples.

2. Materials and Methods

2.1. Viruses and Clinical Samples

DWV-A virus was preserved in our laboratory. DWV-B cDNA was donated by Professor Hou Chunsheng from China Bast Fiber Crop Research Institute. Israeli acute paralysis virus (IAPV), acute bee paralysis virus (ABPV), Black Queen cell virus (BQCV), and Chinese sacbrood virus (CSBV) cDNA were donated by Professor Magali Chabert-Ribière from the French National Food Safety Authority. Healthy bees were collected from Benxi, Liaoning Province. RT–PCR was used to confirm infection in bees [28]. In total, 36 clinical samples of bees suspected of DWV infection were randomly collected: 3-, 5-, 7- and 9-day-old bee larvae, Varroa-exposed and -nonexposed pupae, and symptomatic or asymptomatic worker bees and newly emerged bees from six different regions of Liaoning Province and Jilin Province. Details of the clinical samples are shown in Table S1.

2.2. Construction of Standard Recombinant Plasmids

The nucleotide sequences of 14 DWV-A and DWV-B (DWV-A gene IDs: AJ489744, MZ821832, MH069503, MG831201, MN538208, MN746311, MT415949, MW222481, and AY292384; DWV-B gene IDs: JX878305, MT747986, KX783225, NC_006494, and AY251269) variants were aligned via Mega 6.06 to help design variant-specific and conserved fragments for plasmid assembly (Figure S2A,B) [29]. AJ489744 (9146–9498 bp) and MT747986 (9153–9506 bp) were selected as conserved target gene sequences of the RdRp region in DWV-A and DWV-B, respectively. The conserved target gene sequences of DWV-A and DWV-B were synthesized and cloned into pUC57 vectors (Figure S3) as recombinant plasmids at Sangon Biotech (Shanghai, China) [30].

2.3. Design and Preparation of RPA Primers, crRNAs, and ssDNA Reporters

Three pairs of specific primers were designed for DWV-A and DWV-B, based on the target gene sequences of DWV-A and DWV-B and the principles of RPA primer design (Figure S2A,B). crRNAs were designed to detect the gene sequences of DWV-A and DWV-B adjacent to the 5′-TTN-3′ and 5′-TTTN-3′ PAM site (where N refers to A/G/C), respectively (Figure S2C,D). To prepare crRNA, synthetic crDNA, containing the T7 promoter, was used as a template, and crRNA was synthesized in vitro at 37 °C for 16 h using HiScribe T7 Quick High Yield RNA Synthesis Kit (NEB, MA, USA). Then, the transcription product was treated with DNase I at 37 °C for 1 h to degrade the dsDNA template. The crRNA was purified using the Monarch RNA Cleanup Kit (NEB, MA, USA). The concentration of the purified crRNA product was measured using a Qubit miRNA assay kit and Qubit 4 Fluorometer (Thermo Scientific, MA, USA). The crRNA product was stored at −80°C until use. To detect the need, we designed two types of reporters: an ssDNA reporter (5′FAM-TTATT-3′-BHQ) was used to detect CRISPR–Cas12a fluorescence, whereas a LFD ssDNA reporter (5′FAM-TTTTTTATTTTTT-3′-Biotin) was used to detect CRISPR–Cas12a–LFD. The primers and probes for target sequences were synthesized by Shanghai Sangon Co., Ltd. (Shanghai, China). The details of primers, crRNAs, and ssDNA reporters are presented in Table 1.

2.4. Establishment of the RPA Assay

RPA was performed in 50-µL reaction mixtures using TwistAmp Basic Kit (TwistDx, Maidenhead, United Kingdom). The composition of the stock reaction mix was as follows (working concentrations are indicated in parentheses): 29.5 µL of rehydration buffer, 1 µL of plasmid template, 2.4 µL of forward primer (10 µM), 2.4 µL of reverse primer (10 µM), 12.2 µL of dH2O, and 2.5 µL of magnesium acetate (280 mM). All reagents, except template and magnesium acetate, were prepared as a master mix, which was added into a 0.2 mL tube containing a dried enzyme pellet. Next, 1 µL of the template was gently pipetted into the reaction tubes; the internal and blank control templates were treated simultaneously. Finally, 2.5 µL of 280 mM magnesium acetate was added to each tube, and the tubes were covered tightly for a short spin to initiate the reaction. For amplification, the reaction mixture was incubated at 39 °C for 20 min. Subsequently, 20 μL of the amplified product was added to 40 μL of phenol solution, and the mixture was subjected to vortex centrifugation. The supernatant was run on 1% agarose gel and visualized under a UV transilluminator.

2.5. RPA–CRISPR–Cas12a Fluorescence-Based Detection Assay (FBDA)

The 20 μL CRISPR–Cas12a reaction mixture contained 1.5 µL of crRNA (10 µM), 0.5 µL of LbCas12a nuclease (10 µM) (TOLOBIO, Shanghai, China), 1 µL of ssDNA reporter (10 µM), 2 µL of HOLMES Buffer 1 (10×), 2 μL of RPA product, and 13 µL of nuclease-free water. The reaction mixture was incubated at 37.5 °C for 20 min, and the fluorescence (FAM) signal was detected every 20 s via QuantStudio1 (ABI, MA, United States). At the end of the assay, the reaction tube was examined under an LED transilluminator to visualize the fluorescence signal with the naked eye.

2.6. RPA–CRISPR–Cas12a Assay Combined with an LFD Assay

An LFD assay was established to improve the RPA–CRISPR–Cas12a assay, thereby making it easier to use the assay and interpret the results. The FAM–biotin ssDNA reporter and LFD were designed to capture labeled nucleic acids. The 20 μL RPA–CRISPR–Cas12a–LFD reaction mixture, containing 0.5 μL of LbCas12a nuclease (10 µM), 2 µL of HOLMES Buffer 1 (10×), 1 µL of ssDNA reporter (Sangon, Shanghai, China), 1.5 μL of crRNA A1 (10 µM), 13 μL of nuclease-free water, and 2 μL of RPA products, was mixed thoroughly and incubated at 37.5 °C for 20 min. Then, 10 μL of nuclease-free water was added to the reaction mixture and mixed thoroughly. The LFD was placed in the mixture for 3–5 min. If both the test and control lines were displayed, the result was considered positive. If only the control line was displayed, the result was considered negative. If the control line was not visible, the result was considered invalid, and the test was repeated using a new strip.

2.7. Validation with Clinical Samples

To evaluate the performance of RPA–CRISPR–Cas12a–LFDA on clinical samples, 36 samples were tested for DWV-A and DWV-B at different stages of bee development. Genomic RNA from clinical samples was extracted using the TIANamp Virus DNA/RNA Kit (Tiangen, Beijing, China) according to the manufacturer’s instructions. RNA was reverse-transcribed into cDNA using a first-strand cDNA synthesis kit (TransGen, Beijing, China) and then stored at −20 °C until use. cDNA extracted from the samples were analyzed using RPA–CRISPR–Cas12a–LFD assay and RT–qPCR. The method described by Bradford et al. was used to detect clinical samples via RT–qPCR [1]. The clinical samples were typed and tested, as described previously. The results were analyzed and compared with those of RT–qPCR. The primers used in this experiment are listed in Table 1.

2.8. Statistical Analysis

The agreement accessing between the two methods was calculated via Cohen’s “kappa” (κ) analysis, with a κ-value of ≥0.750 and p-value of <0.0005 denoting good agreement.

3. Results

3.1. Screening of RPA Primers and crRNA

According to the manufacturer’s instructions, primers with the brightest and most specific bands on the agarose gel were selected for subsequent experiments. Accordingly, the first set of primers (DWV-RPA-F1 and DWV-RPA-R) was selected for the experiments (Figure 1A). After isothermally amplifying the positive plasmid using RPA, the RPA–CRISPR–Cas12a fluorescence assay was used to screen the crRNAs. The amplification efficiency of the probes was evaluated based on a fluorescence amplification curve (Figure 1B,C). Finally, the crRNAs A1 and B1 were selected for the experiments.

3.2. Specificity and Sensitivity of the RPA–CRISPR–Cas12a-FBDA

The RPA reactions were performed using the cDNA of DWV-A, DWV-B, IAPV, ABPV, BQCV, and CSBV as templates. The RPA products were combined with CRISPR–Cas12a for the fluorescence assay. The results showed that only DWV-A or DWV-B was detected using the RPA–CRISPR–Cas12a–FBDA (Figure 2A,B).
To evaluate the possibility of cross-reactivity between the crRNAs designed for DWV-A and DWV-B, we conducted cross-reaction detection. The results demonstrated that crRNA A1 could only interact with DWV-A, whereas crRNA B1 could only interact with DWV-B. The primers of RPA and the crRNAs of CRISPR–Cas12a showed extremely high specificity without any cross-reactivity (Figure 3).
This finding demonstrates the specificity of RPA–CRISPR–Cas12a–FBDA for detecting DWV-A and DWV-B. To evaluate sensitivity, DNA plasmids of pUC57-DWV-A and pUC57-DWV-B were subjected to 10-fold serial dilutions to achieve concentrations ranging from 6.5 × 106 to 6.5 × 100 copies/μL and 6.2 × 106 to 6.2 × 100 copies/μL across seven gradients, respectively. The limit of detection (LOD) was 6.5 × 100 and 6.2 × 101 copies/μL, respectively (Figure 4A–D).

3.3. RPA–CRISPR–Cas12a–LFD Assay

To improve the RPA–CRISPR–Cas12a assay and make it more visual and easier to read for general use, we established the RPA–CRISPR–Cas12a–LFD assay. The LOD of this assay was 6.5 × 100 copies/μL for DWV-A and 6.2 × 101 copies/μL for DWV-B (Figure 4E,F). The results showed that the LFD assay could reliably distinguish known positive and negative samples.

3.4. Comparison of the Performance of the Assay and RT–qPCR in Clinical Samples

We evaluated the utility of the RPA–CRISPR–Cas12a–LFD assay for the rapid detection of DWV-A and DWV-B. We examined 36 samples of bees in different developmental stages (26 positive and 10 negative samples, as confirmed via traditional real-time PCR) and compared the results with those of RT–qPCR. RT–qPCR and the RPA–CRISPR–Cas12a–LFD assay (Table 2, Figure 5) were performed thrice for all samples.
The consistency in the results of the RPA–Cas12a–LFD assay and RT–qPCR for detecting DWV was 88.88% (32/36). Cohen’s “kappa” (κ) analysis revealed an extremely good agreement between the two methods, with a κ-value of ≥0.750 (κ = 0.753) and p-value of <0.0005 (p = 0.000) (Table 3).

4. Discussion

In recent years, DWV has become the most prevalent virus in honey bees, with a minimum average of 55% of colonies/apiaries infected across 32 countries [31], and is considered a major cause of colony decline [32]. DWV is a viral complex comprising at least three distinct genotypes or master variants—types A, B, and C—with types A and B being the most widespread variants [10]. The transmission efficiency of V. destructor, the main carrier and transmission medium of DWV, is different for each variant. A previous study showed that DWV-B, not DWV-A, infects mites and is more toxic to both individual bees and colonies than DWV-A [33]. Highly virulent and infectious DWV-B poses a major potential threat to wild bees and other nonvenomous bee colonies [34]. Mixed infections with DWV-A and DWV-B have greatly exacerbated bee mortality. Moreover, these variants are often mixed with other bee viruses such as BQCV, which is difficult to distinguish from DWV via single clinical diagnosis and serological tests. Therefore, the development of a rapid test for better visualization is key for distinguishing these two subtypes and performing epidemiological investigations of DWV. Therefore, the development of a qualitative visual detection method is key for helping bee farmers distinguish between these two subtypes and perform epidemiological investigations of DWV.
As a small RNA virus, DWV is more susceptible to mutations. Because DWV-A and DWV-B share high homology, distinguishing DWV-A subtypes from DWV-B subtypes is challenging [1,35,36]. We compared the nucleotide sequences of DWV-A and DWV-B isolates and revealed that these reference strains had a few relatively conserved gene regions, which were suitable for RPA [37]. We designed three primer pairs for RPA reaction based on these conserved regions. The results of agarose gel electrophoresis revealed that the first primer pair showed strong specificity and the brightest bands. Accordingly, we used this primer pair for subsequent experiments. In addition, multiple PAM sequences capable of undergoing CRISPR–Cas12a reactions were observed in this target segment. As the PAM sequences of DWV-A and DWV-B differed, we designed crRNA probes for DWV-A and DWV-B. Thus, we can distinguish DWV-A subtypes from DWV-B subtypes via CRISPR–Cas12a with high specificity. We amplified the target gene via RPA and used Cas12a to facilitate the binding of crRNA to target DNA, thereby forming a ternary complex, which activates transcleavage activity against nonspecific ssDNA [38]. Combining the advantages of the two methods enables trace detection. Therefore, the combination of RPA and CRISPR makes the highly sensitive Cas12a detection method more specific, prevents the loss of trace nucleic acids, compensates for the limitations of RPA false positives, and amplifies the lysis signal of CRISPR [23]. For 36 clinical samples of bees in different developmental stages, the consistency in the results of the RPA–CRISPR–Cas12a–LFD assay and RT–qPCR for detecting DWV-A and DWV-B was 88.88% (32/36). However, in bee larvae suspected of DWV infection, the detection rate of the LFD assay only reached 75%, probably because the viral copy number in bee larvae is low, resulting in the lower sensitivity of the RPA–CRISPR–Cas12a–LFD assay than that of RT–qPCR. The detection limits of RT–qPCR for DWV-A and DWV-B were reportedly 2.5 × 101 copies/μL, whereas the detection limits of the newly developed assay were 6.5 × 100 and 6.2 × 101 copies/μL, respectively [1]. As expected, the sensitivity of the two methods was similar. A previous study reported that honey bee colony decline is frequently associated with increasing DWV loads [39]. DWV suppresses the bee’s immune system when the viral copy number reaches a certain threshold, promoting replication [40,41]. Although this method based on copy number allows for the rapid detection of viruses, demonstrates high adaptability, and has been verified in larger clinical samples, it cannot accurately quantify viruses. There are some disadvantages in assessing the copy number of viruses infected by bee colonies, and further modifications are needed for this method. Global DWV has evolved into four major lineages: DWV-A, DWV-B, DWV-C, and several recombinant variants. In China, a widely circulating DWV is DWV-A, and occasionally DWV-B; however, DWV-C and DWV-D have never appeared [42]. Based on this, we mainly focus on the visual, qualitative, and rapid detection of DWV-A and DWV-B to facilitate clinical application in China. In this study, RNA extraction and reverse transcription were performed in the laboratory; however, in the future, we aim to use a viral DNA/RNA rapid extraction kit for complete RNA extraction at the sampling site and perform follow-up reactions, thereby achieving actual rapid clinical detection. In this study, detection results in most clinical samples were identified as DWV-A, whereas all DWV-B variants were detected from the same bee colony in a particular region. Our test results are consistent with those reported in the literature. The monitoring of DWV-A and DWV-B may be a key factor for apiary management. This method may facilitate the development of point-of-care testing products in the future, especially for rural apiaries with limited resources, because the detection process is easy, practical, portable, and visual and requires fewer materials and specialized instruments.
In summary, using the combination of RPA and LFD in our established CRISPR–Cas12a fluorescence detection system, DWV-A and DWV-B subtypes can be distinguished and categorized to achieve rapid visual detection. The method is simple to operate, does not require expensive equipment, provides more intuitive reaction results, has strong specificity and high sensitivity, and can be performed at a constant temperature using a simple water bath or heating block or even at body temperature. This method is of great significance for the prevention, control, and eradication of DWV with strong virulence and coinfection and provides an early warning for the continuous spread of DWV to bee colonies. It can facilitate the healthy development of apiculture in the future. Therefore, it is expected to become an efficient and robust visual detection platform to accelerate DWV-A and DWV-B detection and develop containment strategies.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/v15102041/s1, Table S1: Clinical sample source statistics table. Figure S2: Alignment analysis of DWV-A and DWV-B nucleotide sequences. Figure S3: Recombinant plasmid construction maps for DWV-A(A) and DWV-B(B).

Author Contributions

M.M. conceived and designed the experiments; Y.X. and D.F. performed the experiments. Y.M. and M.L. performed data analysis. Y.X. wrote the first draft of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by grants from the National Natural Science Foundation of China (Nos. 32172789 and 31972626) and Ming Li: Horizontal Project of Jinzhou Medical University (No. H2022043).

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Materials; further inquiries can be directed to the corresponding authors.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bradford, E.L.; Christie, C.R.; Campbell, E.M.; Bowman, A.S. A real-time PCR method for quantification of the total and major variant strains of the deformed wing virus. PLoS ONE 2017, 12, e0190017. [Google Scholar] [CrossRef] [PubMed]
  2. Parekh, F.; Daughenbaugh, K.F.; Flenniken, M.L. Chemical Stimulants and Stressors Impact the Outcome of Virus Infection and Immune Gene Expression in Honey Bees (Apis mellifera). Front. Immunol. 2021, 12, 747848. [Google Scholar] [CrossRef]
  3. de Miranda, J.R.; Genersch, E. Deformed Wing Virus. J. Invertebr. Pathol. 2010, 103, S48–S61. [Google Scholar] [CrossRef] [PubMed]
  4. Lamp, B.; Url, A.; Seitz, K.; Eichhorn, J.; Riedel, C.; Sinn, L.J.; Indik, S.; Köglberger, H.; Rümenapf, T. Construction and Rescue of a Molecular Clone of Deformed Wing Virus (DWV). PLoS ONE 2016, 11, 11. [Google Scholar] [CrossRef] [PubMed]
  5. Genersch, E.; Ohe, W.V.D.; Kaatz, H.; Schroeder, A.; Otten, C.; Büchler, R.; Berg, S.; Ritter, W.; Mühlen, W.; Gisder, S.; et al. The German Bee Monitoring Project: A Long Term Study to Understand Periodically High Winter Losses of Honey Bee Colonies. Apidologie 2010, 41, 332–352. [Google Scholar] [CrossRef]
  6. Annoscia, D.; Piccolo, D.F.; Covre, F.; Nazzi, F. Mite Infestation During Development Alters the in-Hive Behaviour of Adult Honeybees. Apidologie 2015, 46, 306–314. [Google Scholar] [CrossRef]
  7. Kristof, B.; Anneleen, G.V.; Dries, C.; De Smet, L.; de Graaf, D.C.; Schoofs, L.; Larmuseau, M.H.D.; Brettell, L.E.; Martin, S.J.; Wenseleers, T. Covert Deformed Wing Virus Infections Have Long-Term Deleterious Effects on Honeybee Foraging and Survival. Proc. Biol. Sci. 2017, 284, 2149. [Google Scholar]
  8. Ryabov, E.V.; Wood, G.R.; Fannon, J.M.; Moore, J.D.; Bull, J.C.; Chandler, D.; Mead, A.; Burroughs, N.; Evans, D.J. A virulent strain of deformed wing virus (DWV) of honeybees (Apis mellifera) prevails after Varroa destructor-mediated, or in vitro, transmission. PLoS Pathog. 2014, 10, e1004230. [Google Scholar] [CrossRef]
  9. Ongus, J.R.; Peters, D.; Bonmatin, J.M.; Bengsch, E.; Vlak, J.M.; van Oers, M.M. Complete sequence of a picorna-like virus of the genus lflavirus replicating in the mite Varroa destructor. J. Gen. Virol. 2004, 85, 3747–3755. [Google Scholar] [CrossRef]
  10. Mordecai, G.J.; Wilfert, L.; Martin, S.J.; Jones, I.M.; Schroeder, D.C. Diversity in a honey bee pathogen: First report of a third master variant of the Deformed Wing Virus quasispecies. ISME J. 2016, 10, 1264–1273. [Google Scholar] [CrossRef]
  11. Lanzi, G.; de Miranda, J.R.; Boniotti, M.B.; Cameron, C.E.; Lavazza, A.; Capucci, L.; Camazine, S.M.; Rossi, C. Molecular and biological characterization of Deformed Wing Virus of honeybees (Apis mellifera L.). J. Virol. 2006, 80, 4998–5009. [Google Scholar] [CrossRef] [PubMed]
  12. Fujiyuki, T.; Takeuchi, H.; Ono, M.; Ohka, S.; Sasaki, T.; Nomoto, A.; Kubo, T. Novel insect picorna-like virus identified in the brains of aggressive worker honeybees. J. Virol. 2004, 78, 1093–1100. [Google Scholar] [CrossRef] [PubMed]
  13. McMahon, D.P.; Natsopoulou, M.E.; Doublet, V.; Fürst, M.; Weging, S.; Brown, M.J.F.; Gogol-Döring, A.; Paxton, R.J. Elevated virulence of an emerging viral genotype as a driver of honeybee loss. Proc. Biol. Sci. 2016, 283, 20160811. [Google Scholar] [CrossRef] [PubMed]
  14. Brasesco, C.; Quintana, S.; Di Gerónimo, V.; García, M.L.G.; Sguazza, G.; Bravi, M.E.; Fargnoli, L.; Reynaldi, F.J.; Eguaras, M.; Maggi, M. Deformed wing virus type a and b in managed honeybee colonies of Argentina. Bull. Entomol. Res. 2021, 111, 100–110. [Google Scholar] [CrossRef] [PubMed]
  15. Salazar, A.; Ochoa-Corona, F.M.; Talley, J.L.; Noden, B.H. Recombinase polymerase amplification (RPA) with lateral flow detection for three Anaplasma species of importance to livestock health. Sci. Rep. 2021, 11, 15962. [Google Scholar] [CrossRef] [PubMed]
  16. Wang, X.; Sui, X.; Ma, Y.; Li, M.; Zhang, X.; Fei, D.; Ma, M. Real-time reverse transcription recombinase polymerase amplification for rapid detection of murine hepatitis virus. Front. Microbiol. 2022, 13, 1067694. [Google Scholar] [CrossRef]
  17. Davi, S.D.; Kissenkötter, J.; Faye, M.; Böhlken-Fascher, S.; Stahl-Hennig, C.; Faye, O.; Faye, O.; Sall, A.A.; Weidmann, M.; Ademowo, O.G. Recombinase polymerase amplification assay for rapid detection of Monkeypox virus. Diagn. Microbiol. Infect. Dis. 2019, 95, 41–45. [Google Scholar] [CrossRef]
  18. Pang, Y.; Cong, F.; Zhang, X.; Li, H.; Chang, Y.F.; Xie, Q.; Lin, W. A recombinase polymerase amplification-based assay for rapid detection of Chlamydia psittaci. Poult. Sci. 2021, 100, 585–591. [Google Scholar] [CrossRef]
  19. Pickar-Oliver, A.; Gersbach, C.A. The next generation of CRISPR–Cas technologies and applications. Nat. Rev. Mol. Cell Biol. 2019, 20, 490–507. [Google Scholar] [CrossRef]
  20. Nidhi, S.; Anand, U.; Oleksak, P.; Tripathi, P.; Lal, J.A.; Thomas, G.; Kuca, K.; Tripathi, V. Novel CRISPR-Cas Systems: An Updated Review of the Current Achievements, Applications, and Future Research Perspectives. Int. J. Mol. Sci. 2021, 22, 3327. [Google Scholar] [CrossRef]
  21. Chen, J.S.; Ma, E.; Harrington, L.B.; Da Costa, M.; Tian, X.; Palefsky, J.M.; Doudna, J.A. CRISPR-Cas12a target binding unleashes indiscriminate single-stranded DNase activity. Science 2018, 360, 436–439. [Google Scholar] [CrossRef] [PubMed]
  22. Wang, S.; Li, H.; Kou, Z.; Ren, F.; Jin, Y.; Yang, L.; Dong, X.; Yang, M.; Zhao, J.; Liu, H.; et al. Highly sensitive and specific detection of hepatitis B virus DNA and drug resistance mutations utilizing the PCR-based CRISPR-Cas13a system. Clin. Microbiol. Infect. 2021, 27, 443–450. [Google Scholar] [CrossRef] [PubMed]
  23. Li, S.; Wang, X.; Yu, Y.; Cao, S.; Liu, J.; Zhao, P.; Li, J.; Zhang, X.; Li, X.; Zhang, N.; et al. Establishment and application of a CRISPR-Cas12a-based RPA-LFS and fluorescence for the detection of Trichomonas vaginalis. Parasit. Vectors 2022, 15, 350. [Google Scholar] [CrossRef] [PubMed]
  24. Aman, R.; Mahas, A.; Marsic, T.; Hassan, N.; Mahfouz, M.M. Efcient, rapid, and sensitive detection of plant RNA viruses with one-pot RT-RPA–CRISPR/Cas12a assay. Front. Microbiol. 2020, 11, 610872. [Google Scholar] [CrossRef]
  25. Paenkaew, S.; Jaito, N.; Pradit, W.; Chomdej, S.; Nganvongpanit, K.; Siengdee, P.; Buddhachat, K. RPA/CRISPR-cas12a as a specific, sensitive and rapid method for diagnosing Ehrlichia canis and Anaplasma platys in dogs in Thailand. Vet. Res. Commun. 2023, 30, 1–13. [Google Scholar] [CrossRef]
  26. Daher, R.K.; Stewart, G.; Boissinot, M.; Bergeron, M.G. Recombinase polymerase amplifification for diagnostic applications. Clin. Chem. 2016, 62, 947–958. [Google Scholar] [CrossRef]
  27. Qi, Y.; Yin, Q.; Shao, Y.; Li, S.; Chen, H.; Shen, W.; Rao, J.; Li, J.; Li, X.; Sun, Y.; et al. Rapid and visual detection of Coxiella burnetii using recombinase polymerase amplifification combined with lateral flow strips. BioMed. Res. Int. 2018, 2018, 6417354. [Google Scholar] [CrossRef]
  28. Runckel, C.; Flenniken, M.L.; Engel, J.C.; Ruby, J.G.; Ganem, D.; Andino, R.; DeRisi, J.L. Temporal analysis of the honey bee microbiome reveals four novel viruses and seasonal prevalence of known viruses, Nosema, and Crithidia. PLoS ONE 2011, 6, e20656. [Google Scholar] [CrossRef]
  29. Tamura, K.; Stecher, G.; Peterson, D.; Filipski, A.; Kumar, S. MEGA6: Molecular evolutionary genetics analysis version 6.0. Mol. Biol. Evol. 2013, 30, 2725–2729. [Google Scholar] [CrossRef]
  30. Zhao, J.; Li, Y.; Xue, Q.; Zhu, Z.; Zou, M.; Fang, F. A novel rapid visual detection assay for Toxoplasma gondii combining recombinase-aided amplification and lateral flow dipstick coupled with CRISPR-Cas13a fluorescence (RAA-Cas13a-LFD). Parasite 2022, 29, 21. [Google Scholar] [CrossRef]
  31. Martin, S.J.; Brettell, L.E. Deformed Wing Virus in Honeybees and Other Insects. Annu. Rev. Virol. 2019, 6, 49–69. [Google Scholar] [CrossRef] [PubMed]
  32. Tehel, A.; Vu, Q.; Bigot, D.; Gogol-Döring, A.; Koch, P.; Jenkins, C.; Doublet, V.; Theodorou, P.; Paxton, R. The Two Prevalent Genotypes of an Emerging Infectious Disease, Deformed Wing Virus, Cause Equally Low Pupal Mortality and Equally High Wing Deformities in Host Honey Bees. Viruses 2019, 11, 114. [Google Scholar] [CrossRef] [PubMed]
  33. Gisder, S.; Genersch, E. Direct Evidence for Infection of Varroa destructor Mites with the Bee-Pathogenic Deformed Wing Virus Variant B—but Not Variant A—via Fluorescence-in situ-Hybridization Analysis. J. Virol. 2021, 95, e01786-20. [Google Scholar] [CrossRef] [PubMed]
  34. Fürst, M.A.; McMahon, D.P.; Osborne, J.L.; Paxton, R.J.; Brown, M.J. Disease associations between honeybees and bumblebees as a threat to wild pollinators. Nature 2014, 506, 364–366. [Google Scholar] [CrossRef] [PubMed]
  35. Domingo, E.; García-Crespo, C.; Lobo-Vega, R.; Perales, C. Mutation Rates, Mutation Frequencies, and Proofreading-Repair Activities in RNA Virus Genetics. Viruses 2021, 13, 1882. [Google Scholar] [CrossRef]
  36. Domingo, E.; Sheldon, J.; Perales, C. Viral quasispecies evolution. Microbiol. Mol. Biol. Rev. 2012, 76, 159–216. [Google Scholar] [CrossRef]
  37. Lobato, I.M.; O’Sullivan, C.K. Recombinase polymerase amplification: Basics, applications and recent advances. Trends Anal. Chem. 2018, 98, 19–35. [Google Scholar] [CrossRef]
  38. Jirawannaporn, S.; Limothai, U.; Tachaboon, S.; Dinhuzen, J.; Kiatamornrak, P.; Chaisuriyong, W.; Bhumitrakul, J.; Mayuramart, O.; Payungporn, S.; Srisawat, N. Rapid and sensitive point-of-care detection of Leptospira by RPA-CRISPR/Cas12a targeting lipL32. PLoS Negl. Trop. Dis. 2022, 16, e0010112. [Google Scholar] [CrossRef]
  39. Highfield, A.C.; El Nagar, A.; Mackinder, L.C.; Noël, L.M.; Hall, M.J.; Martin, S.J.; Schroeder, D.C. Deformed wing virus implicated in overwintering honeybee colony losses. Appl. Environ. Microbiol. 2009, 75, 7212–7220. [Google Scholar] [CrossRef]
  40. Nazzi, F.; Brown, S.P.; Annoscia, D.; Del Piccolo, F.; Di Prisco, G.; Varricchio, P.; Della Vedova, G.; Cattonaro, F.; Caprio, E.; Pennacchio, F. Synergistic parasite-pathogen interactions mediated by host immunity can drive the collapse of honeybee colonies. PLoS Pathog. 2012, 8, e1002735. [Google Scholar] [CrossRef]
  41. Di Prisco, G.; Annoscia, D.; Margiotta, M.; Ferrara, R.; Varricchio, P.; Zanni, V.; Caprio, E.; Nazzi, F.; Pennacchio, F. A mutualistic symbiosis between a parasitic mite and a pathogenic virus undermines honey bee immunity and health. Proc. Natl. Acad. Sci. USA 2016, 113, 3203–3208. [Google Scholar] [CrossRef] [PubMed]
  42. Li, N.; Li, C.; Hu, T.; Li, J.; Zhou, H.; Ji, J.; Wu, J.; Kang, W.; Holmes, E.C.; Shi, W.; et al. Nationwide genomic surveillance reveals the prevalence and evolution of honeybee viruses in China. Microbiome 2023, 11, 6. [Google Scholar] [CrossRef] [PubMed]
Viruses 15 02041 g001
Figure 1. An RPA–CRISPR/Cas12a platform for the detection of DWV-A and DWV-B. (A) Screening of the optimal RPA primers for DWV-A and DWV-B. M: DNA marker DL2000; 1: DWV-A-RPA-F1R; 2: DWV-A-RPA-F2R; 3: DWV-A-RPA-F3R; 4: DWV-B-RPA-F1R; 5: DWV-B-RPA-F2R; and 6: DWV-B-RPA-F3R. (B) Screening of the optimal crRNA probe for DWV-A plasmid detection based on the RPA–CRISPR–Cas12a fluorescence amplification curve. (C) Screening of the optimal crRNA probe for DWV-B plasmid detection using the RPA–CRISPR–Cas12a fluorescence amplification curve. Negative control represents nontemplate control.
Figure 1. An RPA–CRISPR/Cas12a platform for the detection of DWV-A and DWV-B. (A) Screening of the optimal RPA primers for DWV-A and DWV-B. M: DNA marker DL2000; 1: DWV-A-RPA-F1R; 2: DWV-A-RPA-F2R; 3: DWV-A-RPA-F3R; 4: DWV-B-RPA-F1R; 5: DWV-B-RPA-F2R; and 6: DWV-B-RPA-F3R. (B) Screening of the optimal crRNA probe for DWV-A plasmid detection based on the RPA–CRISPR–Cas12a fluorescence amplification curve. (C) Screening of the optimal crRNA probe for DWV-B plasmid detection using the RPA–CRISPR–Cas12a fluorescence amplification curve. Negative control represents nontemplate control.
Viruses 15 02041 g001
Viruses 15 02041 g002
Figure 2. Specificity of the RPA–CRISPR/Cas12a-FBDA for the detection of DWV-A and DWV-B (A,B). Specific fluorescence signals were obtained for DWV-A and DWV-B, whereas no signals were obtained for other bee viruses or the control.
Figure 2. Specificity of the RPA–CRISPR/Cas12a-FBDA for the detection of DWV-A and DWV-B (A,B). Specific fluorescence signals were obtained for DWV-A and DWV-B, whereas no signals were obtained for other bee viruses or the control.
Viruses 15 02041 g002
Viruses 15 02041 g003
Figure 3. Cross-reactivity between the primers of RPA and the cRNAs of CRISPR–Cas12a designed for DWV-A and DWV-B.
Figure 3. Cross-reactivity between the primers of RPA and the cRNAs of CRISPR–Cas12a designed for DWV-A and DWV-B.
Viruses 15 02041 g003
Viruses 15 02041 g004
Figure 4. Sensitivity of the RPA–CRISPR–Cas12a detection assay. (A) Sensitivity of RPA–CRISPR–Cas12a–FBDA for the detection of DWV-A and (B) DWV-B. Serial 10-fold dilutions of DWV-A and DWV-B DNA plasmids (106–100 copies/μL) were detected. Detection using a UV transilluminator allowed examination with the naked eye. Comparison of fluorescence values generated via RPA–CRISPR–Cas12a-FBDA at each dilution (C): DWV-A, (D): DWV-B. NC represents nontemplate control. Sensitivity of the RPA–CRISPR–Cas12a–LFD assay for the detection of (E) DWV-A and (F) DWV-B.
Figure 4. Sensitivity of the RPA–CRISPR–Cas12a detection assay. (A) Sensitivity of RPA–CRISPR–Cas12a–FBDA for the detection of DWV-A and (B) DWV-B. Serial 10-fold dilutions of DWV-A and DWV-B DNA plasmids (106–100 copies/μL) were detected. Detection using a UV transilluminator allowed examination with the naked eye. Comparison of fluorescence values generated via RPA–CRISPR–Cas12a-FBDA at each dilution (C): DWV-A, (D): DWV-B. NC represents nontemplate control. Sensitivity of the RPA–CRISPR–Cas12a–LFD assay for the detection of (E) DWV-A and (F) DWV-B.
Viruses 15 02041 g004
Viruses 15 02041 g005
Figure 5. The RPA–CRISPR–Cas12a–LFD assay for the detection of clinical samples. The results of the cDNA samples detected from 36 clinical specimens in Liaoning, Jilin Province, and other regions. T represents the test band, whereas C represents the control band. The stick on the left side represents DWV-A, whereas that on the right side represents DWV-B.
Figure 5. The RPA–CRISPR–Cas12a–LFD assay for the detection of clinical samples. The results of the cDNA samples detected from 36 clinical specimens in Liaoning, Jilin Province, and other regions. T represents the test band, whereas C represents the control band. The stick on the left side represents DWV-A, whereas that on the right side represents DWV-B.
Viruses 15 02041 g005
Table 1. Primer, probe, and reporter sequences for RPA, crRNA, and CRISPR/Cas12a.
Table 1. Primer, probe, and reporter sequences for RPA, crRNA, and CRISPR/Cas12a.
NameSequence (5′–3′)Amplicon Size (bp)
DWV-RPA-RGATTTRTCCTGATCCGTGAATTCCATCTTATAT
DWV-RPA-F1TAAAGACGAAATGAAGCGAGTAATGTGGAC353
DWV-RPA-F2AAATGAAGCGAGTAATGTGGACCATGGC342
DWV-RPA-F3ACCGAGTACCTTGTGGAATTCCATCAG307
crRNA A1ATCTCATGTTATCGCTAACATTCATGAATCTACAAGAGTAGAAATTcCCTATAGTGAGTCGTATTAatttc
crRNA A2ATCCAAAGGCAAATCAGTAATACCATCTACAAGAGTAGAAATTcCCTATAGTGAGTCGTATTAatttc
crRNA B1ATCCAAAGGCAAATCAGTAATACCATCTACAAGAGTAGAAATTcCCTATAGTGAGTCGTATTAatttc
crRNA B2ATCACCGTAACAAACTAGCACGACATGTCTAATCTACAAGAGTAGAAATTcCCTATAGTGAGTCGTATTAatttc
DWV-FBD-ssDNA reporterFAM-TTATT- BHQ
DWV-LFD-ssDNA reporterFAM-TTTTTTATTTTTT-Biotin
DWV-A-RT-qPCR-FGCGTGTTGCAACTCGCTTC211
DWV-A-RT-qPCR-RTGCCTGCACCGGATTCGATAAT
DWV-B-RT-qPCR-FGCAAGTTGGAGATAATTGTA116
DWV-B-RT-qPCR-FCGATACTTACATTCTTCAAGAT
Table 2. Detection of DWV using the RPA–CRISPR–Cas12a–LFD assay in clinical samples, and a comparison of its performance with that of RT–qPCR. Ct: Average Ct for positive results. Type A: DWV-A; Type B: DWV-B; +: positive; −: negative. The numbers in parentheses indicate the number of positive results among the total number of replicates.
Table 2. Detection of DWV using the RPA–CRISPR–Cas12a–LFD assay in clinical samples, and a comparison of its performance with that of RT–qPCR. Ct: Average Ct for positive results. Type A: DWV-A; Type B: DWV-B; +: positive; −: negative. The numbers in parentheses indicate the number of positive results among the total number of replicates.
Sample IDSample TypeAssay Results
RT–qPCRRPA–CRISPR–Cas12a–LFD
Type A or BCtcrRNA A1crRNA B1
1Bee larvae (3-day-old)negativenegative−−
2Bee larvae (3-day-old)A28.963+(2/3)−
3Bee larvae (3-day-old)A31.631+−
4Bee larvae (3-day-old)B34.123−+ (1/3)
5Bee larvae (5-day-old)negativenegative−−
6Bee larvae (5-day-old)negativenegative−−
7Bee larvae (5-day-old)A26.347+−
8Bee larvae (5-day-old)negativenegative−−
9Bee larvae (7-day-old)A27.933+(1/3)−
10Bee larvae (7-day-old)negativenegative−−
11Bee larvae (7-day-old)A22.283+−
12Bee larvae (7-day-old)A31.711+(1/3)−
13Bee larvae (9-day-old)A20.028+−
14Bee larvae (9-day-old)A23.672+−
15Bee larvae (9-day-old)B29.431−+
16Bee larvae (9-day-old)negativenegative− −
17Pupae (Varroa-exposed)A25.707+−
18Pupae (Varroa-exposed)A17.373+−
19Pupae (Varroa-exposed)A21.670+−
20Pupae (Varroa-exposed)B23.824−+
21Pupae (Varroa-nonexposed)A31.507+−
22Pupae (Varroa-nonexposed)negativenegative−−
23Pupae (Varroa-nonexposed)A33.868+−
24Pupae (Varroa-nonexposed)negativenegative−−
25Bee (newly emerged)A34.523+−
26Bee (newly emerged)A21.639+−
27Bee (newly emerged)negativenegative−−
28Bee (newly emerged)B30.706−+
29Worker bee (asymptomatic)negativenegative−−
30Worker bee (asymptomatic)A28.416+−
31Worker bee (asymptomatic)A30.933+−
32Worker bee (asymptomatic)A28.215+−
33Worker bee (symptomatic)A16.338+−
34Worker bee (symptomatic)B24.949−+
35Worker bee (symptomatic)A23.794+−
36Worker bee (symptomatic)A20.347+−
Table 3. Statistical analysis of DWV detection in samples using the RPA–CRISPR–Cas12a–LFD assay and real-time RT–qPCR. κ = 75.3%, p = 0.000. The difference was statistically significant, as determined via the kappa test using SPSS software.
Table 3. Statistical analysis of DWV detection in samples using the RPA–CRISPR–Cas12a–LFD assay and real-time RT–qPCR. κ = 75.3%, p = 0.000. The difference was statistically significant, as determined via the kappa test using SPSS software.
RT–qPCRCR
PositiveNegativeTotal
RPA–CRISPR–
Cas12a–LFD		Positive2202288.88%
Negative41014
Total261036
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xiao, Y.; Fei, D.; Li, M.; Ma, Y.; Ma, M. Establishment and Application of CRISPR–Cas12a-Based Recombinase Polymerase Amplification and a Lateral Flow Dipstick and Fluorescence for the Detection and Distinction of Deformed Wing Virus Types A and B. Viruses 2023, 15, 2041. https://doi.org/10.3390/v15102041

AMA Style

Xiao Y, Fei D, Li M, Ma Y, Ma M. Establishment and Application of CRISPR–Cas12a-Based Recombinase Polymerase Amplification and a Lateral Flow Dipstick and Fluorescence for the Detection and Distinction of Deformed Wing Virus Types A and B. Viruses. 2023; 15(10):2041. https://doi.org/10.3390/v15102041

Chicago/Turabian Style

Xiao, Yuting, Dongliang Fei, Ming Li, Yueyu Ma, and Mingxiao Ma. 2023. "Establishment and Application of CRISPR–Cas12a-Based Recombinase Polymerase Amplification and a Lateral Flow Dipstick and Fluorescence for the Detection and Distinction of Deformed Wing Virus Types A and B" Viruses 15, no. 10: 2041. https://doi.org/10.3390/v15102041

APA Style

Xiao, Y., Fei, D., Li, M., Ma, Y., & Ma, M. (2023). Establishment and Application of CRISPR–Cas12a-Based Recombinase Polymerase Amplification and a Lateral Flow Dipstick and Fluorescence for the Detection and Distinction of Deformed Wing Virus Types A and B. Viruses, 15(10), 2041. https://doi.org/10.3390/v15102041

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop