Next Article in Journal
Multi-Targeting Approach in Glioblastoma Using Computer-Assisted Drug Discovery Tools to Overcome the Blood–Brain Barrier and Target EGFR/PI3Kp110β Signaling
Previous Article in Journal
Genetic Polymorphisms Associated with Vincristine Pharmacokinetics and Vincristine-Induced Peripheral Neuropathy in Pediatric Oncology Patients
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 14
Issue 14
10.3390/cancers14143511
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Presence of EGFR T790M in TKI-Naïve Lung Cancer Samples of Patients Who Developed a T790M-Positive Relapse on First or Second Generation TKI Is Rare

by
Weiting Li
1,2,
Klaas Kok
2,*,
Geok Wee Tan
1,
Pei Meng
1,
Mirjam Mastik
1,
Naomi Rifaela
1,
Frank Scherpen
1,
T. Jeroen N. Hiltermann
3,
Harry J. M. Groen
3,
Anthonie J. van der Wekken
3 and
Anke van den Berg
1,*
1
Department of Pathology and Medical Biology, University of Groningen, University Medical Centre Groningen, 9713 GZ Groningen, The Netherlands
2
Department of Genetics, University Medical Center Groningen, 9713 AV Groningen, The Netherlands
3
Department of Pulmonary Diseases, University of Groningen, University Medical Center Groningen, 9712 CP Groningen, The Netherlands
*
Authors to whom correspondence should be addressed.
Cancers 2022, 14(14), 3511; https://doi.org/10.3390/cancers14143511
Submission received: 30 May 2022 / Revised: 14 July 2022 / Accepted: 16 July 2022 / Published: 19 July 2022
(This article belongs to the Section Cancer Therapy)
Browse Figures
Review Reports Versions Notes

Abstract

:

Simple Summary

Treatment outcomes for non-small cell lung cancer (NSCLC) patients have significantly improved since the introduction of targeted therapy using tyrosine kinase inhibitors (TKI). Despite the initial promising results, most patients develop resistance due to on- or off-target mechanisms. On-target mutations prevent the effective binding of TKIs. In this study, we determined whether the most common on-target resistance mutation for treatment with EGFR-TKI mutation, i.e., the EGFR T790M mutation, can be detected in pre-treatment tissue samples and can predict treatment outcome. We included 33 patients who progressed with a T790M positive relapse upon treatment with EGFR-TKI between 2013 to 2019. Progression-free survival (PFS) time of the single T790M positive patient was 9 months, while the T790M negative patients had a median PFS of 10 months (range 2–27). Our results show that the presence of EGFR T790M mutations in pre-TKI samples is rare, even in patients who subsequently progressed with an EGFR T790M mutation.

Abstract

EGFR-mutated non-small cell lung cancer (NSCLC) patients can be effectively treated with tyrosine kinase inhibitors (TKI) but frequently present with an EGFR T790M resistance mutation at relapse. We aimed to screen for T790M in pre-treatment formalin-fixed and paraffin-embedded (FFPE) tissue samples of patients with a confirmed T790M mutation at progression. We analyzed 33 pre-treatment DNA samples of NSCLC patients who progressed upon TKI between 2013 to 2019. To establish storage-time dependent formalin fixation-induced background levels for C>T mutations, we analyzed DNA isolated from archival (stored >1 year, n = 22) and recently generated (stored <1 month, n = 11) FFPE samples and included DNA isolated from white blood cells (WBC) (n = 24) as controls. DNA samples were analyzed by droplet digital (dd)PCR, and positivity was defined by outlier detection according to Grubb’s criterion. The T790M background allele frequency levels were 0.160% in DNA isolated from archival-FFPE, 0.100% in fresh FFPE, and 0.035% in WBC. Progression-free survival (PFS) time of the single T790M positive patient was 9 months, while T790M negative patients had a median PFS of 10 months (range 2–27). Proper storage time matched FFPE control samples are essential for reliable detection of T790M mutation at low VAF. The presence of EGFR T790M mutations in pre-TKI samples is rare, even in patients who progressed with EGFR T790M mutations.
Keywords:
NSCLC; EGFR; TKI; T790M; ddPCR

1. Introduction

Lung cancer is a heterogeneous malignancy with more than 50 subtypes [1]. Non-small cell lung cancer (NSCLC) accounts for approximately 85% of all cases, and patients treated with chemotherapy or surgery have a 5-year survival rate of less than 15% [2]. Lung adenocarcinoma (LUAD) is a histomorphological subtype of NSCLC comprising about 70% of all lung cancers [3]. A subgroup of about 10% of LUADs is characterized by activating mutations in tyrosine kinases, and these patients can be effectively treated with specific tyrosine kinase inhibitors (TKI) in the Netherlands [4,5]. Patients with activating mutations in the epidermal growth factor receptor (EGFR), such as the commonly observed exon 19 deletions (E19del) and the L858R mutation, achieve a progression-free survival (PFS) time of 10–14 months upon treatment with EGFR-TKIs [6,7,8,9]. First-generation EGFR inhibitors such as gefitinib [10] and erlotinib [11] and second-generation EGFR inhibitor afatinib [12] are regarded to be successful treatments, but most if not all patients develop resistance due to on-target or off-target mutations [13]. The EGFR T790M mutation detected in about 50–60% of the recurrent tumors in patients treated with a first- or second-generation EGFR TKI is the most commonly observed on-target resistance mechanism [14,15]. With the development of third-generation TKIs, many of the on-target resistance mechanisms, including the well-known T790M, can be subsequently treated with success.
It has been suggested that in a subset of cases, the resistant mutation is already present as a minor clone in treatment-naïve tumors, while in others outgrowth of a resistant subclone is induced by the selective pressure of the TKI treatment [14,15]. Several studies have addressed the question of whether the presence of the T790M resistance mutation in treatment-naïve LUAD carrying an activating EGFR mutation may be associated with a shorter PFS. Overall, T790M has been detected at low variant allele frequencies (VAF) ranging from 0.1% to 0.5% [16,17,18,19,20,21]. In several studies, the presence of T790M in pre-treatment samples has been associated with shorter survival [17,22]. However, some studies show conflicting data with either a longer PFS [16] or no correlation with PFS [23] for T790M positive cases. A drawback in many of these studies is that the observed resistance mechanism at progression has not been determined, making it hard to establish a true causal link. Moreover, a potential pitfall for detection of the c.2369C>T p.(T790M) mutation in formalin-fixed and paraffin-embedded (FFPE) tissue samples is the high background of C>T mutations induced by formalin fixation [24,25].
Here we report the T790M analysis in EGFR TKI-naïve FFPE samples using the highly sensitive ddPCR method in patients who developed a T790M dependent resistance after treatment with first- or second-generation EGFR TKIs. To discriminate between true positive and background signals in the ddPCR, we analyzed control DNA samples isolated from blood cells, recently prepared (<1 month) and archival (>1 year) FFPE blocks for C>T and non-C>T variants. The presence of T790M in pre-treatment patient samples was established based on storage time-matched control FFPE blocks. Moreover, we aimed to correlate the PFS of baseline T790M positive and negative patients to establish a potential effect of this resistance mutation on survival.

2. Materials and Methods

2.1. Patient Selection and Control Samples

A total of 54 patients treated with an EGFR-specific TKI and presenting with a recurrent tumor carrying the T790M resistance mutation were identified from 2013 to 2019 in the medical records of the University Medical Center Groningen (Figure 1). Of these, DNA isolated from pre-treatment FFPE biopsies for routine diagnostic testing was available in the molecular diagnostics (MD) archive for 33 patients. Control DNA samples were obtained from the MD archive of archival FFPE blocks stored >1 year before DNA isolation (n = 22), from FFPE blocks stored <1 month (n = 11) and from non-patient white blood cells (WBC) (n = 24) (Supplementary Figure S1). Genomic DNA of FFPE samples was extracted from the FFPE specimens using the QIAamp DNA FFPE tissue kit (Qiagen, Hilden, Germany), according to the manufacturer’s instructions. For each sample, a tumor-rich area was macro-dissected to ensure a sufficiently high tumor cell content. The minimal estimated tumor cell percentage was set at 20%. DNA from WBC was isolated using the ReliaPrep Large Volume HT gDNA Isolation kit (Promega, Madison, WI, USA) in combination with the Hamilton StarPlus robotic system (Hamilton, Reno, NV, USA). The study was performed under the OncoLifes biobanking protocol (Impact of gene amplifications on survival NWMO protocol OLS027 dd 20 May 2020), for which patients gave informed consent (https://umcgresearch.org/w/oncolifes accessed on 30 May 2022).

2.2. Droplet Digital (dd)PCR

We applied ddPCR to measure the number of wild-type and mutant EGFR allele copies in control and patient DNA samples according to the protocol provided by the manufacturer (Biorad, Hercules, CA, USA). Sequences of primers and probes used for the detection of the EGFR c.2369C>T (p.T790M), c.2573T>G (p.L858R), E19del (drop-off assay allowing the detection of all E19del variants), KRAS c.35G>T (p.G12V) and c.35G>A (p.G12D) mutations and their wild type counterparts are listed in Supplementary Table S1 and were ordered from Integrated DNA Technologies (IDT, Leuven, Belgium). The reaction mixes were placed in a QX200 droplet generator (Biorad, Hercules, CA, USA) and transferred to 96-well plates. Amplification reactions were done using an initial denaturation step at 95 °C for 10 min, which was followed by 39 cycles with incubation steps at 94 °C for 30 s, at the indicated annealing temperatures (Table S1) for 1 min, and a final extension step at 72 °C for 10 min, which was followed by cooling down to 4 °C. After amplification, fluorescence signals of individual droplets were detected with a QX200 droplet reader and analyzed using the QuantaSoft Analysis Pro software (Biorad, Hercules, CA, USA). In each run, multiple positive and negative control samples were included and used to set appropriate cut-off values for wild-type and mutant probes.
The number of wild-type and mutant allele copies were calculated per well, considering the Poisson distribution to correct for double positive droplets as recommended by the manufacturer. VAFs were calculated per well to establish the variation in VAF relative to the total number of allele copies analyzed. Next, VAFs were calculated per sample to determine the background for different DNA sources and different ddPCR assays. For samples with sufficient DNA, we performed multiple independent experiments with three independent wells per experiment. VAFs of samples were calculated based on the combined total number of mutant allele copies from all wells divided by the total number of allele copies over all wells. The DNA of patient tissue samples was analyzed in 1 to 5 independent experiments for T790M, dependent on the amount of available DNA. The ddPCRs for L858R and E19 del were performed once to establish the presence of sufficient tumor cell-derived DNA in the patient samples. DNA of control tissue samples were analyzed by ddPCR for T790M, L858R, KRAS G12V, and G12D in at least two independent experiments.

2.3. Statistical Analysis

For comparison of VAFs in DNA isolated from recently prepared and archival FFPE tissue blocks and blood, we used the Kruskal–Wallis test followed by a Dunn’s multiple comparisons test. We used Grubb’s criterion to determine whether the T790M VAF observed for patients was significantly higher as compared to storage time-matched FFPE control samples. Statistical analyses were performed using GraphPad Prism v 8.0. and IBM SPSS Statistics 23. p-values <0.05 were considered significant.

3. Results

3.1. T790M Background Levels in FFPE Tissue Samples

To determine the variation in background levels of the c.2369C>T (p.T790M) mutation relative to the number of allele copies analyzed, we first determined VAFs at the single well level in WBCs and in tissues embedded in FFPE blocks that were stored for a short (<1 month) or a long (>1 year) period. We observed a marked variation in background VAFs which was most pronounced in DNA isolated from archive FFPE stored >1 year (Figure 2A). This was followed by a somewhat lower level of variation in DNA isolated from recently prepared FFPE blocks (stored <1 month) (Figure 2B). Overall, the variation was most pronounced for wells containing a limited number of alleles, i.e., less than 2000 for DNA isolated from recently prepared FFPE blocks and less than 4000 for DNA isolated from FFPE blocks stored >1 year. In DNA isolated from WBC, we observed overall more alleles per well, probably due to the higher quality of the DNA samples, with less variation in background T790M VAFs levels (Figure 2C). These data indicate that it is critical to analyze sufficient allele copies to obtain reliable VAFs. As a next step, we calculated the VAF for each sample by using the sum of wild-type and mutant allele copies over all wells (Table 1 and Figure 2D). VAFs were significantly different between the three sources of DNA. The background VAF was lowest in DNA isolated from WBC with a median of 0.035% (IQR: 0.028–0.044%), followed by DNA isolated from recently prepared FFPE blocks with a median of 0.100% (IQR: 0.076–0.130%), and highest in DNA isolated from FFPE blocks stored >1 year with a median of 0.160% (IQR: 0.152–0.202%).
As an additional step in our analyses, we analyzed whether the relatively high background VAFs were specific to the T790M C>T mutation or not. For the KRAS G12D C>T mutation, the VAFs observed in the three sources of DNA were similar to those observed for T790M, with a median of 0.034% (IQR: 0.015–0.057%) for WBC, a median of 0.070% (IQR: 0–0.140%) for FFPE stored <1 month and a median of 0.160% (IQR: 0.110–0.231%) for FFPE blocks stored >1 year (Table 1). For both non-C>T ddPCR assays, VAF was close to 0% in all control samples, irrespective of the sample source (Table 1 and Supplementary Figure S1). These data show that background VAF is consistently higher for C>T mutations as compared to non-C>T mutations.
Based on these combined experiments, we decided to use storage-time matched FFPE blocks to determine whether T790M VAFs were significantly higher than the background VAF, and we aimed to analyze a total of at least 2000 alleles for each patient to achieve a reliable T790M VAF measurement.

3.2. Patient Characteristics and Detection of T790M in Pre-Treatment Samples

Characteristics of the 33 patients presenting with a T790M at progression and with available DNA from baseline tumor samples are shown in Table 2. The median age of the patients at diagnosis was 61 years (range 38–81) and included females (n = 17) and males (n = 16). Twenty-four patients carried an E19del and nine patients an L858R EGFR driver mutation. Patients were treated with gefitinib (n = 17), erlotinib (n = 10) or afatinib (n = 6). Median PFS was 10 months (range 2–27) for first-line EGFR-TKI therapy. The presence of a T790M mutation at progression was shown by routine molecular testing of the relapse sample using targeted NGS.
DNA from these 33 EGFR-TKI naïve NSCLC patients was first evaluated for tumor content by determining the VAF of the EGFR driver mutation (E19 del and L858R) by ddPCR. The median VAF was 49.2% for E19del (range 7.3% to 87.8%) and 43.6% for L858R (range 21.3% to 81.2%), indicating the presence of tumor cell DNA in all samples (Figure 3A, Table 2 and Table S2). For 31 out of 33 patients, DNA was isolated from FFPE blocks stored for <1 month, while for 2 patients, DNA was isolated from FFPE blocks stored for >1 year. Analysis of multiple wells and multiple experiments per patient revealed a median number of total allele copies analyzed per patient of 17,311 (IQR: 9499 to 31,690). The median T790M VAF in the patients with DNA isolated from FFPE blocks stored for <1 month was 0.145% (IQR: 0.114–0.180%). For the two patients with DNA being isolated from FFPE blocks with a long storage time, the VAF for T790M was 0.151% and 0.277%. Based on Grubb’s criterion, the T790M VAF of patient T22 was an outlier (1 out of 33 patients, 3% of the patients) (Figure 3B and Table S2). For a second patient (T40), the T790M VAF was very close but just below the upper limit according to Grubb’s criterion. For all other patients, the T790M VAF was not significantly different from those observed in storage-time matched FFPE controls. The observed T790M VAFs did not correlate with the VAF of the activating mutation (Table S2).
The PFS was 9 months for patient T22, and 10 months for patient T40 with a VAF close to the cut-off level. The PFS of the 31 T790M-negative patients ranged from 2 to 27, with a median PFS of 10 months. Thus, no differences were found between the PFS of patients with and without T790M in the pre-treatment samples in our patient group.

4. Discussion

In this study, we focused on the assessment of T790M positivity in EGFR-TKI pre-treatment samples of patients who developed a T790M mutation at disease progression. Our data show that before treatment, the frequency of T790M positivity is very low (1/33) even in this selected group of patients who all developed a T790M positive relapse at progression. Therefore, the mechanism for resistance in patients relapsing with a T790M positive tumor under TKI pressure depends on the outgrowth of new subclones and not on the outgrowth of pre-existing T790M positive subclones.
The ddPCR technique is regarded to be a very sensitive approach, allowing detection of VAF as low as 0.1% or even lower (0.01% [15] or 0.001% [26]). However, the actual sensitivity of the ddPCR is dependent on the number of allele copies studied per sample. Single or low numbers of positive droplets can potentially result in a relatively high VAF when low numbers of total allele copies are analyzed. Due to the frequency of small lung cancer biopsies available for diagnostic testing, the available amount of DNA is limited, and this precludes a reliable assessment, especially of variants present at low VAFs. A second factor influencing background VAFs in DNA isolated from FFPE tissue blocks is caused by formalin fixation, which leads to the deamination of cysteine nucleotides and subsequent incorporation of adenosine residues instead of guanine residues during the PCR [25]. We showed a clear difference between the background VAFs for two C>T variants compared to two non-C>T variants in DNA isolated from FFPE blocks, which was most pronounced in FFPE blocks stored for >1 year prior to DNA isolation. By determining VAFs per well, we showed that the variation in background VAFs is high, especially in wells with a limited number of analyzed allele copies and in DNA isolated from FFPE blocks stored for >1 year. Analysis of more than 2000 copies was enough to reduce the variation in VAFs for FFPE blocks stored for a short time prior to DNA isolation, while a total of more than 4000 copies was required for FFPE blocks stored for >1 year. These results indicate that analyzing sufficient allele copies is critical, especially when expecting low VAFs (<0.5%), and this can be achieved by pooling measurements of multiple wells and multiple independent experiments. Based on Grubb’s criterion, we used VAF cut-off values of 0.228 and 0.289 for DNA isolated from FFPE blocks stored for a short and long time, respectively. In the literature, VAF cut-offs used to discriminate between positive and negative cases varied from 0.1% to 0.5%, with a minimum of at least 2, 6, or 10 positive droplets per well [16,17,18,19,20,21,22]. Based on our control samples, 0.1% appears not to be discriminative, while 0.5% might be too strict. However, we cannot exclude variation in reliable cut-off values between different laboratories. Moreover, for most studies, the number of allele copies studied per sample is unclear.
Several studies have analyzed the presence of T790M in EGFR TKI naïve patients. In earlier studies, up to 13% of pre-TKI samples of EGFR driver mutation-positive patients were shown to be positive for T790M using techniques other than ddPCR [27]. In one of the first large ddPCR studies, close to 80% of the patients were found to be positive, but most cases had a VAF < 0.1% [25]. The authors indeed proposed that most of these cases should be considered negative [27,28]. Two smaller studies reported a relatively high frequency of T790M in pre-treatment samples, but also in these studies, the authors indicated that the percentage of positive samples would be much lower with more strict criteria [18,21]. In two recent larger studies, the frequency of T790M positive samples was less than 5% [20,21]. We also observed a low frequency of T790M positive patients, with 1 out of 33 being positive, like the two large studies. A strong point of our study is that we focused on patients who presented with T790M at progression, so we excluded patients with a resistance mechanism other than T790M. Despite this selection, the incidence of T790M positive pre-treatment samples was low.
We cannot rule out that the failure to detect T790M in treatment-naive patients is related to the heterogeneity of the tumor. The biopsy that was analyzed might not have contained the pre-existing T790M positive subclone that was responsible for the relapse. A potentially more effective strategy to detect pre-existing T790M positive subclones might be by ddPCR analysis of circulating cell-free (cf)DNA. This has the potential to circumvent the problem of intratumor heterogeneity. Good consistency between the presence of T790M in tissue and cfDNA has been shown in previous studies [19,29,30]. In a study focusing on the detection of T790M in longitudinal cfDNA samples, the authors showed good consistency between clinical response and T790M VAF [18]. However, a negative cfDNA test does not rule out the presence of T790M in the tumor [31]. Overall, this indicates that parallel screening of tissue and cfDNA can potentially increase sensitivity to detect all T790M positive patients at progression.
The presence of T790M in exon 20 of the EGFR gene reduces the binding of first- and second-generation EGFR TKIs by enhancing the binding affinity of ATP to the kinase domain of the EGFR-mutant receptor [32]. This mutation accounts for acquired resistance in about 50% to 60% of the patients treated with first or second-generation TKIs [33,34]. The T790M-positive patient in our study had the highest VAF for the EGFR driver mutation (88%), while the borderline positive patient had a slightly lower VAF (65%). On the one hand, a high driver-VAF might indicate a high tumor cell content, which might increase the chance of detecting the putative T790M positive subclone in the pre-TKI sample. On the other hand, a high driver-VAF might also indicate the presence of EGFR copy number gain in tumor cells, which would not lead to an increased chance of detecting a putative T790M positive subclone. We previously showed that EGFR copy number gain was associated with shorter overall survival time but not with PFS [35]. This might be related to previous observations that EGFR copy number gain is a resistance mechanism for osimertinib [36]. Third-generation EGFR TKIs like osimertinib are effective in the treatment of these T790M-positive patients. In Western countries, most EGFR-mutant patients are nowadays treated with Osimertinib as a first-line EGFR TKI treatment. However, as the less expensive first- and second-generation TKIs are still in use in many (developing) countries, this study remains relevant [37,38,39,40]. Moreover, our finding that a pre-existing T790M resistant mutation is very rare may be generalized to other TKI-related resistance mutations.
PFS of pre-treatment T790M negative patients in our study treated with first- or second-generation EGFR TKIs ranged from 2 to 27 months with a median of 10 months. Most papers showed shorter PFS in pre-treatment T790M-positive patients. Patients with negative or low T790M VAF had a PFS of 16.8 and 14 months, respectively, while patients with high T790M VAF had a PFS of 6.2 months [22]. In another study, the PFS was 13.1 months in T790M negative patients and 8.5 months in T790M positive patients [21]. Similarly, PFS of 11.5 and 6.3 months were observed in T790M negative and positive patients, respectively [41]. In contrast, PFS was reported to be longer in T790M positive patients compared to T790M negative patients, 29.2 months versus 17.7 months [28]. The single pre-TKI T790M positive patient in our study had a PFS of 9 months, while the borderline positive patient had a PFS of 10 months. This indicates that in our study presence of a T790M positive subclone in pre-TKI tumor samples was not associated with PFS. In a previous study including a limited number of patients, the authors proposed a model in which pre-treatment of T790M negative or weakly positive tumor samples might result in rapidly growing T790M-independent relapses, while pre-treatment samples with high T790M VAF would lead to more slowly growing T790M-dependent relapses [42]. In contrast to our study, previously published studies did not focus on patients with a proven T790M-dependent relapse.

5. Conclusions

We report an optimized approach to analyze ddPCR data allowing a more reliable measurement of low T790M VAFs as expected in pre-treatment FFPE samples. Moreover, to the best of our knowledge, this is the first study to focus specifically on patients with T790M as the proven resistance mutation. Despite this selection, the frequency of pre-TKI-positive patients using tissue biopsies remains low, with 1 out of 33 patients being positive. So, testing for T790M in pre-TKI tissue samples seems not to be effective in predicting clinical response to first and second-generation EGFR-TKIs in a clinical setting

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/cancers14143511/s1, Figure S1: Overview of control samples and results of ddPCR background assessment for one C>T variant (KRAS G12D) and two non-C>T variants (EGFR L858R and KRAS G12V), Table S1: Sequence of primers and probes used for ddPCR, Table S2: Characteristics of the 33 patients including VAF of the driver and the T790M variants.

Author Contributions

Conceptualization, K.K., T.J.N.H., H.J.M.G., A.J.v.d.W. and A.v.d.B.; Methodology, W.L., G.W.T., P.M., M.M., N.R. and F.S.; Validation, W.L., K.K. and A.v.d.B.; Formal Analysis, W.L., K.K. and A.v.d.B.; Investigation, W.L., G.W.T., P.M., M.M., N.R. and F.S.; Data Curation, K.K.; Writing—Original Draft Preparation, W.L. and K.K.; Writing—Review and Editing, K.K., T.J.N.H., H.J.M.G., A.J.v.d.W. and A.v.d.B.; Visualization, W.L.; Supervision, K.K., T.J.N.H., H.J.M.G., A.J.v.d.W. and A.v.d.B.; Funding Acquisition, W.L. All authors have read and agreed to the published version of the manuscript.

Funding

W.L. was supported by a grant from the China Scholarship Council (CSC). Grant number 092311 (awarded to W.L.).

Institutional Review Board Statement

OncoLifeS has been approved by the medical ethics committee of the UMCG (UMCG METC approval 2010/109, protocol OLS027 dd 20 May 2020) and has been ISO certified (9001:2008 Healthcare). All participants of the OncoLifeS data-biobank must sign an informed consent form.

Informed Consent Statement

The study was performed under the OncoLifes biobanking protocol (Impact of gene amplifications on survival NWMO), for which patients gave informed consent (https://umcgresearch.org/w/oncolifes accessed on 30 May 2022).

Data Availability Statement

Data supporting the reported results can be obtained from the corresponding author.

Acknowledgments

The authors would like to acknowledge I. Nolte (Epidemiology Department, UMCG) for support with the data analysis part.

Conflicts of Interest

T. Jeroen N. Hiltermann reports research grants from AstraZeneca, BMS, and Roche. He was involved in Board Membership for BMS, MSD, and Roche, all outside the submitted work, and payments were to the UMCG. Anthonie J. Van der Wekken reports research grants from AstraZeneca, Boehringer-Ingelheim, Roche, Pfizer and Takeda. He was involved in Board Membership for Agena, AstraZeneca, Boehringer-Ingelheim, Janssen, Pfizer, and Roche and Performed lectures for BMS, Novartis, AstraZeneca, Boehringer Ingelheim, Pfizer, and Takeda all outside the submitted work and payments were to the UMCG.

References

  1. Travis, W.D.; Brambilla, E.; Nicholson, A.G.; Yatabe, Y.; Austin, J.H.M.; Beasley, M.B.; Chirieac, L.R.; Dacic, S.; Duhig, E.; Flieder, D.B.; et al. The 2015 World Health Organization Classification of Lung Tumors: Impact of Genetic, Clinical and Radiologic Advances Since the 2004 Classification. J. Thorac. Oncol. 2015, 10, 1243–1260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Siegel, R.L.; Miller, K.D.; Fuchs, H.E.; Jemal, A. Cancer statistics, 2022. CA Cancer J. Clin. 2022, 72, 7–33. [Google Scholar] [CrossRef] [PubMed]
  3. Travis, W.D. Pathology of lung cancer. Clin. Chest Med. 2011, 32, 669–692. [Google Scholar] [CrossRef]
  4. Kerner, G.S.; Schuuring, E.; Sietsma, J.; Hiltermann, T.J.; Pieterman, R.M.; de Leede, G.P.; van Putten, J.W.; Liesker, J.; Renkema, T.E.; van Hengel, P.; et al. Common and rare EGFR and KRAS mutations in a Dutch non-small-cell lung cancer population and their clinical outcome. PLoS ONE 2013, 8, e70346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Remon, J.; Hendriks, L.E.L. Osimertinib Should be the Standard of Care for the Adjuvant Therapy of Stage IB to IIIA EGFR-Mutant NSCLC. J. Thorac. Oncol. 2021, 16, 368–370. [Google Scholar] [CrossRef]
  6. Mok, T.S.; Wu, Y.L.; Thongprasert, S.; Yang, C.H.; Chu, D.T.; Saijo, N.; Sunpaweravong, P.; Han, B.; Margono, B.; Ichinose, Y.; et al. Gefitinib or carboplatin-paclitaxel in pulmonary adenocarcinoma. N. Engl. J. Med. 2009, 361, 947–957. [Google Scholar] [CrossRef]
  7. Wu, Y.L.; Zhou, C.; Hu, C.P.; Feng, J.; Lu, S.; Huang, Y.; Li, W.; Hou, M.; Shi, J.H.; Lee, K.Y.; et al. Afatinib versus cisplatin plus gemcitabine for first-line treatment of Asian patients with advanced non-small-cell lung cancer harbouring EGFR mutations (LUX-Lung 6): An open-label, randomised phase 3 trial. Lancet Oncol. 2014, 15, 213–222. [Google Scholar] [CrossRef]
  8. Wu, S.G.; Shih, J.Y. Management of acquired resistance to EGFR TKI-targeted therapy in advanced non-small cell lung cancer. Mol. Cancer 2018, 17, 38. [Google Scholar] [CrossRef]
  9. Koopman, B.; Cajiao Garcia, B.N.; Kuijpers, C.; Damhuis, R.A.M.; van der Wekken, A.J.; Groen, H.J.M.; Schuuring, E.; Willems, S.M.; van Kempen, L.C. A Nationwide Study on the Impact of Routine Testing for EGFR Mutations in Advanced NSCLC Reveals Distinct Survival Patterns Based on EGFR Mutation Subclasses. Cancers 2021, 13, 3641. [Google Scholar] [CrossRef]
  10. Yano, S.; Yamaguchi, M.; Dong, R.P. EGFR tyrosine kinase inhibitor “gefitinib (Iressa)” for cancer therapy. Nihon Yakurigaku Zasshi 2003, 122, 491–497. [Google Scholar] [CrossRef] [Green Version]
  11. Moyer, J.D.; Barbacci, E.G.; Iwata, K.K.; Arnold, L.; Boman, B.; Cunningham, A.; DiOrio, C.; Doty, J.; Morin, M.J.; Moyer, M.P.; et al. Induction of apoptosis and cell cycle arrest by CP-358,774, an inhibitor of epidermal growth factor receptor tyrosine kinase. Cancer Res. 1997, 57, 4838–4848. [Google Scholar] [PubMed]
  12. Wecker, H.; Waller, C.F. Afatinib. Recent Results Cancer Res. 2018, 211, 199–215. [Google Scholar]
  13. da Cunha Santos, G.; Shepherd, F.A.; Tsao, M.S. EGFR mutations and lung cancer. Annu Rev. Pathol. 2011, 6, 49–69. [Google Scholar] [CrossRef] [Green Version]
  14. Hata, A.N.; Niederst, M.J.; Archibald, H.L.; Gomez-Caraballo, M.; Siddiqui, F.M.; Mulvey, H.E.; Maruvka, Y.E.; Ji, F.; Bhang, H.E.; Krishnamurthy Radhakrishna, V.; et al. Tumor cells can follow distinct evolutionary paths to become resistant to epidermal growth factor receptor inhibition. Nat. Med. 2016, 22, 262–269. [Google Scholar] [CrossRef] [PubMed]
  15. Vendrell, J.A.; Mazieres, J.; Senal, R.; Rouquette, I.; Quantin, X.; Pujol, J.L.; Roch, B.; Bouidioua, A.; Godreuil, S.; Coyaud, E.; et al. Ultra-sensitive EGFR (T790M) Detection as an Independent Prognostic Marker for Lung Cancer Patients Harboring EGFR (del19) Mutations and Treated with First-generation TKIs. Clin. Cancer Res. 2019, 25, 4280–4289. [Google Scholar] [CrossRef] [Green Version]
  16. Lettig, L.; Sahnane, N.; Pepe, F.; Cerutti, R.; Albeni, C.; Franzi, F.; Veronesi, G.; Ogliari, F.; Pastore, A.; Tuzi, A.; et al. EGFR T790M detection rate in lung adenocarcinomas at baseline using droplet digital PCR and validation by ultra-deep next generation sequencing. Transl. Lung Cancer Res. 2019, 8, 584–592. [Google Scholar] [CrossRef] [PubMed]
  17. Dong, Y.; Zhou, Z.; Wang, J.; Ma, L.; Liu, Z.; Wang, Y.; Song, J.; Zhang, S.; Che, N. Origin of the T790M mutation and its impact on the clinical outcomes of patients with lung adenocarcinoma receiving EGFR-TKIs. Pathol. Res. Pract. 2019, 215, 946–951. [Google Scholar] [CrossRef]
  18. Yang, Z.; Li, J.; Hu, Y.; Chen, M.; Peng, D.; Zong, D.; Shang, Q.; Tao, L.; Zhao, Y.; Ni, Y.; et al. Dynamics of Plasma EGFR T790M Mutation in Advanced NSCLC: A Multicenter Study. Target. Oncol. 2019, 14, 719–728. [Google Scholar] [CrossRef]
  19. Spence, T.; Perera, S.; Weiss, J.; Grenier, S.; Ranich, L.; Shepherd, F.; Stockley, T.L. Clinical implementation of circulating tumour DNA testing for EGFR T790M for detection of treatment resistance in non-small cell lung cancer. J. Clin. Pathol 2021, 74, 91–97. [Google Scholar] [CrossRef]
  20. Wang, X.; Li, X.; Guo, H.; Zhu, L.; Peng, Z.; Wang, J.; Yang, F.; Guo, Y. Highly Sensitive Droplet Digital PCR Method for Detection of de novo EGFR T790M Mutation in Patients with Non-Small Cell Lung Cancer. Onco Targets Ther. 2020, 13, 10621–10630. [Google Scholar] [CrossRef]
  21. Beau-Faller, M.; Pencreach, E.; Leduc, C.; Blons, H.; Merlio, J.P.; Bringuier, P.P.; de Fraipont, F.; Escande, F.; Lemoine, A.; Ouafik, L.; et al. Independent prognostic value of ultra-sensitive quantification of tumor pre-treatment T790M subclones in EGFR mutated non-small cell lung cancer (NSCLC) treated by first/second generation TKI.; depends on variant allele frequency (VAF): Results of the French cooperative thoracic intergroup (IFCT) biomarkers France project. Lung Cancer 2020, 140, 19–26. [Google Scholar] [PubMed]
  22. Matsumoto, Y.; Sawa, K.; Fukui, M.; Oyanagi, J.; Yoshimoto, N.; Suzumura, T.; Watanabe, T.; Kaneda, H.; Mitsuoka, S.; Asai, K.; et al. Predictive impact of low-frequency pretreatment T790M mutation in patients with EGFR-mutated non-small cell lung cancer treated with EGFR tyrosine kinase inhibitors. Lung Cancer 2020, 139, 80–88. [Google Scholar] [CrossRef]
  23. Babu Koyyala, V.P.; Batra, U.; Jain, P.; Sharma, M.; Goyal, P.; Medisetty, P.; Jajodia, A.; Maheshwari, U.D. Frequency of T790M mutations after progression on epidermal growth factor receptor tyrosine kinase inhibitor in metastatic non-small cell lung cancer in Indian patients: Real-time data from tertiary cancer hospital. Lung India 2018, 35, 390–394. [Google Scholar] [CrossRef]
  24. Wong, S.Q.; Li, J.; Tan, A.Y.; Vedururu, R.; Pang, J.M.; Do, H.; Ellul, J.; Doig, K.; Bell, A.; MacArthur, G.A.; et al. Sequence artefacts in a prospective series of formalin-fixed tumours tested for mutations in hotspot regions by massively parallel sequencing. BMC Med. Genom. 2014, 7, 23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Mathieson, W.; Thomas, G.A. Why Formalin-fixed, Paraffin-embedded Biospecimens Must Be Used in Genomic Medicine: An Evidence-based Review and Conclusion. J. Histochem. Cytochem. 2020, 68, 543–552. [Google Scholar] [CrossRef] [PubMed]
  26. Iwama, E.; Takayama, K.; Harada, T.; Okamoto, I.; Ookubo, F.; Kishimoto, J.; Baba, E.; Oda, Y.; Nakanishi, Y. Highly sensitive and quantitative evaluation of the EGFR T790M mutation by nanofluidic digital PCR. Oncotarget 2015, 6, 20466–20473. [Google Scholar] [CrossRef] [Green Version]
  27. Chen, L.Y.; Molina-Vila, M.A.; Ruan, S.Y.; Su, K.Y.; Liao, W.Y.; Yu, K.L.; Ho, C.C.; Shih, J.Y.; Yu, C.J.; Yang, J.C.; et al. Coexistence of EGFR T790M mutation and common activating mutations in pretreatment non-small cell lung cancer: A systematic review and meta-analysis. Lung Cancer 2016, 94, 46–53. [Google Scholar] [CrossRef]
  28. Watanabe, M.; Kawaguchi, T.; Isa, S.; Ando, M.; Tamiya, A.; Kubo, A.; Saka, H.; Takeo, S.; Adachi, H.; Tagawa, T.; et al. Ultra-Sensitive Detection of the Pretreatment EGFR T790M Mutation in Non-Small Cell Lung Cancer Patients with an EGFR-Activating Mutation Using Droplet Digital PCR. Clin. Cancer Res. 2015, 21, 3552–3560. [Google Scholar] [CrossRef] [Green Version]
  29. Liu, Y.; Sun, L.; Xiong, Z.C.; Sun, X.; Zhang, S.L.; Ma, J.T.; Han, C.B. Meta-analysis of the impact of de novo and acquired EGFR T790M mutations on the prognosis of patients with non-small cell lung cancer receiving EGFR-TKIs. Onco Targets Ther. 2017, 10, 2267–2279. [Google Scholar] [CrossRef] [Green Version]
  30. Su, K.Y.; Tseng, J.S.; Liao, K.M.; Yang, T.Y.; Chen, K.C.; Hsu, K.H.; Yang, P.C.; Yu, S.L.; Chang, G.C. Mutational monitoring of EGFR T790M in cfDNA for clinical outcome prediction in EGFR-mutant lung adenocarcinoma. PLoS ONE 2018, 13, e0207001. [Google Scholar] [CrossRef]
  31. Mao, C.; Yuan, J.Q.; Yang, Z.Y.; Fu, X.H.; Wu, X.Y.; Tang, J.L. Blood as a Substitute for Tumor Tissue in Detecting EGFR Mutations for Guiding EGFR TKIs Treatment of Nonsmall Cell Lung Cancer: A Systematic Review and Meta-Analysis. Medicine 2015, 94, e775. [Google Scholar] [CrossRef] [PubMed]
  32. Yun, C.H.; Mengwasser, K.E.; Toms, A.V.; Woo, M.S.; Greulich, H.; Wong, K.K.; Meyerson, M.; Eck, M.J. The T790M mutation in EGFR kinase causes drug resistance by increasing the affinity for ATP. Proc. Natl. Acad. Sci. USA 2008, 105, 2070–2075. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Sequist, L.V.; Waltman, B.A.; Dias-Santagata, D.; Digumarthy, S.; Turke, A.B.; Fidias, P.; Bergethon, K.; Shaw, A.T.; Gettinger, S.; Cosper, A.K.; et al. Genotypic and histological evolution of lung cancers acquiring resistance to EGFR inhibitors. Sci. Transl. Med. 2011, 3, 75ra26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Yu, H.A.; Arcila, M.E.; Rekhtman, N.; Sima, C.S.; Zakowski, M.F.; Pao, W.; Kris, M.G.; Miller, V.A.; Ladanyi, M.; Riely, G.J. Analysis of tumor specimens at the time of acquired resistance to EGFR-TKI therapy in 155 patients with EGFR-mutant lung cancers. Clin. Cancer Res. 2013, 19, 2240–2247. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Wei, J.; Meng, P.; Terpstra, M.M.; van Rijk, A.; Tamminga, M.; Scherpen, F.; Ter Elst, A.; Alimohamed, M.Z.; Johansson, L.F.; Stigt, J.; et al. Clinical Value of EGFR Copy Number Gain Determined by Amplicon-Based Targeted Next Generation Sequencing in Patients with EGFR-Mutated NSCLC. Target. Oncol. 2021, 16, 215–226. [Google Scholar] [CrossRef] [PubMed]
  36. Leonetti, A.; Sharma, S.; Minari, R.; Perego, P.; Giovannetti, E.; Tiseo, M. Resistance mechanisms to osimertinib in EGFR-mutated non-small cell lung cancer. Br. J. Cancer 2019, 121, 725–737. [Google Scholar] [CrossRef]
  37. Cavic, M.; Kovacevic, T.; Zaric, B.; Stojiljkovic, D.; Korda, N.J.; Rancic, M.; Jankovic, R.; Radosavljevic, D.; Stojanovic, G.; Spasic, J. Lung Cancer in Serbia. J. Thorac. Oncol. 2022, 17, 867–872. [Google Scholar] [CrossRef]
  38. Tran, H.T.T.; Nguyen, S.; Nguyen, K.K.; Pham, D.X.; Nguyen, U.H.; Le, A.T.; Nguyen, G.H.; Tran, D.V.; Phung, S.D.H.; Do, H.M.; et al. Lung Cancer in Vietnam. J. Thorac. Oncol. 2021, 16, 1443–1448. [Google Scholar] [CrossRef]
  39. Pennell, N.A.; Neal, J.W.; Chaft, J.E.; Azzoli, C.G.; Janne, P.A.; Govindan, R.; Evans, T.L.; Costa, D.B.; Wakelee, H.A.; Heist, R.S.; et al. SELECT: A Phase II Trial of Adjuvant Erlotinib in Patients With Resected Epidermal Growth Factor Receptor-Mutant Non-Small-Cell Lung Cancer. J. Clin. Oncol. 2019, 37, 97–104. [Google Scholar] [CrossRef]
  40. Deb, D.; Moore, A.C.; Roy, U.B. The 2021 Global Lung Cancer Therapy Landscape. J. Thorac. Oncol. 2022, 17, 931–936. [Google Scholar] [CrossRef]
  41. Lee, Y.; Lee, G.K.; Hwang, J.A.; Yun, T.; Kim, H.T.; Lee, J.S. Clinical likelihood of sporadic primary EGFR T790M mutation in EGFR-mutant lung cancer. Clin. Lung Cancer 2015, 16, 46–50. [Google Scholar] [CrossRef] [PubMed]
  42. Isobe, K.; Hata, Y.; Tochigi, N.; Kaburaki, K.; Kobayashi, H.; Makino, T.; Otsuka, H.; Ishida, F.; Hirota, N.; Sano, G.; et al. Usefulness of nanofluidic digital PCR arrays to quantify T790M mutation in EGFR-mutant lung adenocarcinoma. Cancer Genom. Proteom. 2015, 12, 31–37. [Google Scholar]
Cancers 14 03511 g001 550
Figure 1. Flowchart of the patient selection strategy applied in this study.
Figure 1. Flowchart of the patient selection strategy applied in this study.
Cancers 14 03511 g001
Cancers 14 03511 g002 550
Figure 2. Background variant allele frequency (VAF) for the T790M mutation as assessed by droplet digital (dd)PCR. (A) Background VAF per well in DNA samples isolated from FFPE blocks stored >1 year. (B) Background VAF per well in DNA samples isolated from FFPE blocks stored <1 month. (C) Background VAF per well in DNA samples isolated from white blood cells (WBC). (D) Background T790M VAF per sample as assessed based on the sum of all mutant and wild-type probe positive droplets over all wells. Kruskall–Wallis with Dunn’s multiple comparisons test was used to establish the significance of differences observed between the three DNA sources. A p-value < 0.05 was considered significantly different.
Figure 2. Background variant allele frequency (VAF) for the T790M mutation as assessed by droplet digital (dd)PCR. (A) Background VAF per well in DNA samples isolated from FFPE blocks stored >1 year. (B) Background VAF per well in DNA samples isolated from FFPE blocks stored <1 month. (C) Background VAF per well in DNA samples isolated from white blood cells (WBC). (D) Background T790M VAF per sample as assessed based on the sum of all mutant and wild-type probe positive droplets over all wells. Kruskall–Wallis with Dunn’s multiple comparisons test was used to establish the significance of differences observed between the three DNA sources. A p-value < 0.05 was considered significantly different.
Cancers 14 03511 g002
Cancers 14 03511 g003 550
Figure 3. Overview of EGFR E19del, L858R, and T790M variant allele frequencies (VAFs) as assessed by droplet digital (dd)PCR. (A). VAF of the EGFR driver mutations in the 33 selected patients. (B) T790M VAF in controls and patients split based on storage time of the FFPE blocks. Archive FFPE, storage time of FFPE blocks before isolation of DNA >1 year; fresh FFPE, storage time of FFPE blocks before isolation of DNA <1 month. Grubb’s criterion was applied to determine whether individual patients were outliers relative to the storage time-matched controls. Grubb’s criterion resulted in a VAF cut-off value of 0.228 and 0.289 for DNA isolated from FFPE blocks stored for a short and long time, respectively. Patient T22 was positive, while patient T40 was just below the cut-off.
Figure 3. Overview of EGFR E19del, L858R, and T790M variant allele frequencies (VAFs) as assessed by droplet digital (dd)PCR. (A). VAF of the EGFR driver mutations in the 33 selected patients. (B) T790M VAF in controls and patients split based on storage time of the FFPE blocks. Archive FFPE, storage time of FFPE blocks before isolation of DNA >1 year; fresh FFPE, storage time of FFPE blocks before isolation of DNA <1 month. Grubb’s criterion was applied to determine whether individual patients were outliers relative to the storage time-matched controls. Grubb’s criterion resulted in a VAF cut-off value of 0.228 and 0.289 for DNA isolated from FFPE blocks stored for a short and long time, respectively. Patient T22 was positive, while patient T40 was just below the cut-off.
Cancers 14 03511 g003
Table
Table 1. Results of the ddPCR tests on DNA isolated from WBC and FFPE blocks stored for a short (<1 month) and long time (>1 year).
Table 1. Results of the ddPCR tests on DNA isolated from WBC and FFPE blocks stored for a short (<1 month) and long time (>1 year).
ddPCR AssaySample GroupMedian VAF (%)IQRp-Value
EGFR T790M C>Tarchive FFPE0.1600.145–0.207Poverall < 0.001
(archive vs. blood < 0.001; archive vs. fresh 0.003)
fresh FFPE0.1000.061–0.150
Blood0.0350.028–0.045
KRAS G12D C>Tarchive FFPE0.1580.071–0.220Poverall < 0.001
(archive vs. blood < 0.001)
fresh FFPE0.0470.010–0.090
Blood0.0200.016–0.025
KRAS G12V nonC>Tarchive FFPE0.0000.000–0.074NS
fresh FFPE0.0000.000–0.000
Blood0.0000.000–0.008
EGFR L858R nonC>Tarchive FFPE0.0000.000–0.006NS
fresh FFPE0.0000.000–0.002
Blood0.0000.000–0.011
Table
Table 2. Clinical characteristics of the 33 patients with T790M at the progression of EGFR-TKI.
Table 2. Clinical characteristics of the 33 patients with T790M at the progression of EGFR-TKI.
Patient CharacteristicsNumber/Frequency
Gender (male/female)16/17
Age (median (range)61 (38–81)
TKI (n=)
Gefitinib
Erlotinib
Afatinib
17
10
6
PFS median (range) in months10 (2–27)
Driver mutation (n=)
E19del
L858R
24
9
Median variant allele frequency (range) (%)47 (7–88)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, W.; Kok, K.; Tan, G.W.; Meng, P.; Mastik, M.; Rifaela, N.; Scherpen, F.; Hiltermann, T.J.N.; Groen, H.J.M.; Wekken, A.J.v.d.; et al. The Presence of EGFR T790M in TKI-Naïve Lung Cancer Samples of Patients Who Developed a T790M-Positive Relapse on First or Second Generation TKI Is Rare. Cancers 2022, 14, 3511. https://doi.org/10.3390/cancers14143511

AMA Style

Li W, Kok K, Tan GW, Meng P, Mastik M, Rifaela N, Scherpen F, Hiltermann TJN, Groen HJM, Wekken AJvd, et al. The Presence of EGFR T790M in TKI-Naïve Lung Cancer Samples of Patients Who Developed a T790M-Positive Relapse on First or Second Generation TKI Is Rare. Cancers. 2022; 14(14):3511. https://doi.org/10.3390/cancers14143511

Chicago/Turabian Style

Li, Weiting, Klaas Kok, Geok Wee Tan, Pei Meng, Mirjam Mastik, Naomi Rifaela, Frank Scherpen, T. Jeroen N. Hiltermann, Harry J. M. Groen, Anthonie J. van der Wekken, and et al. 2022. "The Presence of EGFR T790M in TKI-Naïve Lung Cancer Samples of Patients Who Developed a T790M-Positive Relapse on First or Second Generation TKI Is Rare" Cancers 14, no. 14: 3511. https://doi.org/10.3390/cancers14143511

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop