Next Article in Journal
Increased Expression Levels of Netrin-1 in Visceral Adipose Tissue during Obesity Favour Colon Cancer Cell Migration
Previous Article in Journal
Bevacizumab as Single Agent in Children and Teenagers with Optic Pathway Glioma
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 15
Issue 4
10.3390/cancers15041037
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Parametric Radiomic Model to Predict 1p/19q Co-Deletion in Patients with IDH-1 Mutant Glioma: Added Value to the T2-FLAIR Mismatch Sign

by
Shingo Kihira
1,
Ahrya Derakhshani
1,
Michael Leung
1,
Keon Mahmoudi
1,
Adam Bauer
2,
Haoyue Zhang
3,
Jennifer Polson
3,
Corey Arnold
1,3,
Nadejda M. Tsankova
4,
Adilia Hormigo
5,
Banafsheh Salehi
1,
Nancy Pham
1,
Benjamin M. Ellingson
1,6,
Timothy F. Cloughesy
6,7 and
Kambiz Nael
1,*
1
Department of Radiological Sciences, David Geffen School of Medicine at University of California Los Angeles, 757 Westwood Plaza, Suite 1621, Los Angeles, CA 90095, USA
2
Department of Radiology, Kaiser Permanente Fontana Medical Center, Fontana, CA 92335, USA
3
Department of Bioengineering, University of California Los Angeles, Los Angeles, CA 90095, USA
4
Department of Pathology and Laboratory Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
5
Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
6
UCLA Brain Tumor Imaging Laboratory, Department of Radiological Sciences, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, CA 90095, USA
7
Department of Neurology, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, CA 90095, USA
*
Author to whom correspondence should be addressed.
Cancers 2023, 15(4), 1037; https://doi.org/10.3390/cancers15041037
Submission received: 13 December 2022 / Revised: 28 January 2023 / Accepted: 28 January 2023 / Published: 7 February 2023
(This article belongs to the Section Methods and Technologies Development)
Browse Figures
Review Reports Versions Notes

Abstract

:

Simple Summary

The T2-FLAIR mismatch sign has shown promise in determining IDH mutant 1p/19q non-co-deleted diffuse gliomas with a high specificity and modest sensitivity. We aim to develop a multi-parametric radiomic model using MRI to predict the 1p/19q co-deletion status in patients with newly diagnosed IDH1 mutant diffuse glioma. In this retrospective study, patients with a diagnosis of IDH1 mutant gliomas with a known 1p/19q status who had preoperative MRI were included. T2-FLAIR mismatch was evaluated independently by two board-certified neuroradiologists. eXtremeGradient Boosting (XGboost) classifiers were used for model development. A total of 103 patients included for model development and 18 patients for external testing validation. The diagnostic performance (sensitivity/specificity/accuracy) in determination of 1p/19q co-deletion status were 59%/83%/67% (training) and 62.5%/70.0%/66.3% (testing) for T2-FLAIR mismatch sign. This was significantly improved (p = 0.04) using the radiomics model to 77.9%/82.8%/80.3% (training) and 87.5%/89.9%/88.8% (testing), respectively. The proposed radiomic model provides much needed sensitivity to the highly specific T2-FLAIR mismatch sign in determination of 1p/19q non-co-deletion status and improves overall diagnostic performance of neuroradiologists when used as an assistive tool.

Abstract

Purpose: The T2-FLAIR mismatch sign has shown promise in determining IDH mutant 1p/19q non-co-deleted gliomas with a high specificity and modest sensitivity. To develop a multi-parametric radiomic model using MRI to predict 1p/19q co-deletion status in patients with newly diagnosed IDH1 mutant glioma and to perform a comparative analysis to T2-FLAIR mismatch sign+. Methods: In this retrospective study, patients with diagnosis of IDH1 mutant gliomas with known 1p/19q status who had preoperative MRI were included. T2-FLAIR mismatch was evaluated independently by two board-certified neuroradiologists. Texture features were extracted from glioma segmentation of FLAIR images. eXtremeGradient Boosting (XGboost) classifiers were used for model development. Leave-one-out-cross-validation (LOOCV) and external validation performances were reported for both the training and external validation sets. Results: A total of 103 patients were included for model development and 18 patients for external testing validation. The diagnostic performance (sensitivity/specificity/accuracy) in the determination of the 1p/19q co-deletion status was 59%/83%/67% (training) and 62.5%/70.0%/66.3% (testing) for the T2-FLAIR mismatch sign. This was significantly improved (p = 0.04) using the radiomics model to 77.9%/82.8%/80.3% (training) and 87.5%/89.9%/88.8% (testing), respectively. The addition of radiomics as a computer-assisted tool resulted in significant (p = 0.02) improvement in the performance of the neuroradiologist with 13 additional corrected cases in comparison to just using the T2-FLAIR mismatch sign. Conclusion: The proposed radiomic model provides much needed sensitivity to the highly specific T2-FLAIR mismatch sign in the determination of the 1p/19q non-co-deletion status and improves the overall diagnostic performance of neuroradiologists when used as an assistive tool.

1. Introduction

Gliomas are infiltrative brain neoplasms that are classified by isocitrate dehydrogenase (IDH) gene status and the whole-arm co-deletion of chromosome arms 1p and 19q [1]. In the new 2021 WHO guidelines, IDH1 mutation is a histopathological characterization of all lower-grade gliomas and, of those, 37–50% carry the 1p/19q co-deletion [2,3,4]. Patients with 1p/19q co-deleted tumors have a better treatment response to radiation and chemotherapy and a longer progression-free and overall survival [5,6].
Therefore, the more accurate and early detection of 1p/19q co-deletion status has prognostic and treatment implications.
Over the last decade, imaging markers on MRI have been explored as non-invasive signatures that could potentially serve as surrogates for some of the molecular alterations including 1p/19q co-deletion status in patients with glioma. This in turn may change the preoperative differential diagnosis of these tumors and potentially aid treatment decision processes [7]. In recent years, the “T2-FLAIR mismatch” has been investigated as a noninvasive imaging marker for 1p/19q co-deletion status [8,9] that is easily discernible and broadly available on standard routine MRI sequences. This sign is defined by a completely or almost completely homogeneous hyperintense signal on the T2 sequence and simultaneously completely or almost completely homogeneous hypointense signal on the FLAIR sequence with a complete or near-complete hyperintense peripheral rim on FLAIR.
Patel et al. [8] first described the T2-FLAIR mismatch sign as a positive predictor for 1p/19q non-co-deletion status within IDH1 mutant gliomas with PPV of up to 100%. However, the clinical utility of this mismatch sign is limited by its low sensitivity of about 55% and modest inter-observer agreement [8,10,11]. Furthermore, the sign was only seen in 15 out of 125 cases of LGGs with the 1p/19q non-co-deletion. In a recent study by Foltyn et al. [12], the T2-FLAIR mismatch sign showed a 100% specificity and PPV but only 10.9% sensitivity for the detection of 1p/19q co-deletion status. The presence of calcification has also emerged as a promising imaging predictor for 1p/19q co-deletion status as seen in oligodendroglioma with a specificity of up to 97%; however, again, sensitivity remains low around 40% [13,14].
Due to the low sensitivity of identifiable radiological features on conventional imaging such as T2-FLAIR mismatch or calcification, recent interest has been placed on exploring radiomic prediction. Zhou et al. [15] first described radiomic prediction of the co-deletion status, demonstrating AUC of up to 0.88. Several subsequent studies have also shown positive results for radiomics for the prediction of 1p/19q co-deletion status with or without the inclusion of clinical models, reporting AUCs ranging from 0.87 to 0.89 [16,17,18,19,20,21]. The diagnostic performance of radiomics in the context of the routinely used T2-FLAIR mismatch sign in the same patient cohort has however not been systematically reported. The ability to accurately predict 1p/19q co-deletion status noninvasively can guide clinical management and assess prognosis. In addition, histopathological assessment of 1p/19q can occasionally be erroneous using Fluorescence In Situ Hybridization (FISH) [22]. Therefore, there may be a role for neuroimaging prediction to address these occasional discrepancies related to FISH error.
In this study, we aim to construct a radiomic model from preoperative MRI and evaluate its diagnostic performance compared to the routinely used T2-FLAIR mismatch sign by: (1) developing a radiomic model using eXtremeGradient Boosting (XGboost) classifiers from preoperative FLAIR images to predict the 1p/19q co-deletion status in patients with IDH mutant diffuse glioma; (2) performing a comparative analysis against the T2-FLAIR mismatch sign in predicting 1p/19q co-deletion status both in training and in an external validation cohort; and (3) through using the proposed radiomic model as a computer-assisted tool, assessing its added value to the diagnostic performance of the T2-FLAIR mismatch sign from a neuroradiologist.

2. Materials and Methods

2.1. Patient Selection

This retrospective study was approved by an institutional review board and informed consent was waived. Patients with initial diagnosis of gliomas between January 2016 to September 2018 were reviewed. Patients were included if they (1) had diagnosis of IDH1 mutant diffuse gliomas with known 1p/19q co-deletion status and (2) had preoperative MRI including T2WI and FLAIR within 30 days from the biopsy (Figure 1). 120 patients were excluded for not having preoperative MR within 30 days and an additional 20 patients were excluded for not having T2WI or FLAIR sequences. An external validation cohort was also included from an outside institution under an approved institutional review board. This cohort has identical inclusion and exclusion criteria.

2.2. Histopathologic Data

Tissue samples were obtained from patients undergoing targeted tissue biopsy, as part of routine clinical care and diagnostic neuropathology and molecular evaluation. Immunohistochemistry (IHC) was used to detect mutant status of IDH1 (specifically IDH1R132H immunoreactivity). Next-generation sequencing (NGS) was performed to confirm mutational status and in rare cases identified alternative IDH mutations which were not picked up by IHC. For determination of 1p/19q co-deletion status, dual-color interphase FISH hybridization was performed on paraffin-embedded tissue using locus-specific identifier probe sets 1p36/1q25 and 19q13/19p13, scored in 200 cells, for which a ratio of 1p/1q and 19q/19p, both less than 0.75, was considered as “co-deleted”/positive for co-deletion.

2.3. Image Analysis

Image acquisition was performed using a standardized preoperative brain tumor MRI protocol in accordance with consensus recommendations for a standardized brain tumor imaging in clinical trials [23].
Two board-certified neuroradiologists with 4 and 5 years of post-fellowship experience blinded to the results of 1p/19q status reviewed the images independently for T2-FLAIR mismatch sign. T2-FLAIR mismatch sign was determined based on strict inclusion criteria used in prior studies [8,9] as follows: (1) on T2WI, there was complete or near-complete and homogeneous hyperintense signal, and (2) on FLAIR, there was hypointense signal except for a thin, hyperintense peripheral rim. The discrepancies between observers were resolved during a consensus read session. The consensus reads were used to assess the diagnostic performance of T2-FLAIR mismatch sign.
For external validation, the T2-FLAIR mismatch were evaluated by both readers jointly and in the same session. The observers were blinded to the 1p/19q status.
In a separate experiment, Neuroradiologist 1 was asked to rescore the T2-FLAIR mismatch assignments while having access to the initial scores and radiomics-predicted scores. This experiment was performed several months after the initial readout to reduce recall bias. The observer remained blinded to the histopathology results.

2.4. Texture Analysis

Tumor segmentation was performed manually on FLAIR images using volume-of-interest (VOI) analysis on commercially available FDA-approved software (Olea Sphere, SP23, Olea Medical SAS, La Ciotat, France) with automated, standardized preprocessing and normalization through the software for each case. Subsequently, a VOI was generated using a voxel-based signal-intensity-threshold method subsuming the entire region of FLAIR hyperintensity. Using Olea Sphere texture analysis plug-in, a total of 92 texture features were extracted from each VOI in every patient and used for statistical analysis and radiomic model development. Texture features included nineteen first-order metrics, such as the mean, standard deviation, skewness, and kurtosis. Second-order metrics included twenty-three gray-level run-length matrices, sixteen gray-level run-length matrices, fifteen gray-level size-zone matrices, five neighboring gray tone difference matrices, and fourteen gray-level dependence matrices [24,25,26].

2.5. Statistical Analysis

Statistical analysis was performed using R software (version 4.1.3; htttps://www.r-project.org/ (accessed on 23 September 2022)). The interobserver agreement for T2-FLAIR mismatch sign was assessed using a weighted kappa test. The diagnostic performance of neuroradiologists using T2-FLAIR mismatch sign was evaluated in prediction of 1p/19q status using receiver-operating characteristic (ROC) curves and area under the curve (AUC) analysis for training and testing data sets.
From texture features, an imaging model was developed to predict 1p/19q co-deletion status using eXtremeGradient Boosting (XGboost) [27]. First, five-repeated 10-fold cross-validation and grid search was used to pick the best hyperparameters set for XGboost model and the top 6 most important texture features based on Gini index. Second, the model was trained using the fine-tuned hyperparameters and the 6 features. Internal leave-one-out-cross-validation (LOOCV) and external validation performance results were reported. Optimal thresholds were determined to maximize sensitivity and specificity for each biomarker using the top-left-corner cut-off point of the ROC curve. The criterion is defined as
cutoff =   min { ( 1 − sensitivity ) 2 + ( 1 − specificity ) 2 }
The aforementioned experiments were replicated 100 times using different random seed to account for randomness. Performance ranges were reported in a mean +/− standard deviation form.
The accuracy of the final radiomic model was evaluated using ROC and AUC analyses for training and testing data sets. The ROC comparison between radiomics and neuroradiology interpretation was performed using a DeLong test.

3. Results

3.1. Clinical Characteristics of Patient Population

From our internal data set that was used for model development, a total of 103 patients, 66 male and 37 female, included (Table 1). The average patient age was 41.1 ± 13.2 (mean ± SD). The tumor location was identified in the frontal lobe (n = 57), parietal lobe (n = 18), temporal (n = 23), occipital (n = 0), and cerebellum (n = 5). The status of 1p/19q was non-co-deleted in 68 patients and co-deleted in 35 patients.
External validation was performed in a cohort of 18 patients from an outside institution, 10 males and 8 females. Average patient age was 43.2 ± 13.0 (mean ± SD). The status of 1p/19q co-deletion was non-co-deleted in 10 patients and co-deleted in 8 patients.

3.2. T2-FLAIR-Mismatch-Based Prediction of 1p/19q Co-Deletion Status

Among 103 patients, the number of patients with T2-FLAIR mismatch/match was 43/60 for Neuroradiologist 1 (4 years of experience) and 62/41 for Neuroradiologist 2 (5 years of experience). The interobserver agreement for defining T2-FLAIR mismatch was modest (k = 0.49, 95% CI: 0.33–0.64). Following consensus reads, a total of 58 T2-FLAIR mismatches were identified while 45 patients were identified as having a T2-FLAIR match. This resulted in a diagnostic performance (AUC/sensitivity/specificity/accuracy) of 0.70/57%/83%/67%.
Examples of true positive, true negative, false positive, and false negative results for T2-FLAIR mismatch using consensus reads against 1p/19q co-deletion status are shown in Figure 2.

3.3. Radiomic-Based Prediction of 1p/19q Co-Deletion Status

Using a radiomic-generated model from a combination of six texture features (first-order uniformity, gray-level run-length matrix run percentage, neighborhood gray tone difference matrix coarseness, first-order energy, gray-level co-occurrence matrix cluster prominence, and neighborhood gray tone difference matrix strength) the diagnostic performance (AUC/sensitivity/specificity/accuracy) was 0.85/77.9%/82.8%/80.3%. The diagnostic performance of the radiomic model was significantly higher compared to the consensus read of the T2-FLAIR mismatch sign (p = 0.04), with a 21% increase in sensitivity and a 13% increase in overall accuracy while maintaining a similar (83%) specificity (Figure 3).

3.4. External Validation Results

The diagnostic performance (AUC/sensitivity/specificity/accuracy) of the T2-FLAIR mismatch sign was 0.66/62.5%/70.0%/66.3%. Using the T2-FLAIR mismatch sign, a total of 10/18 (55%) of 1p/19q co-deletion statuses were correctly identified.
The diagnostic performance (AUC/sensitivity/specificity/accuracy) of our radiomic model was 0.80/87.5%/89.9%/88.8%. Using the radiomic model, a total of 16/18 (89%) of 1p/19q co-deletion statuses were correctly identified.

3.5. Neuroradiologist + Radiomics

The initial diagnostic performance without the use of radiomic assistance was 0.67/53%/80%/67% (AUC/sensitivity/specificity/accuracy). Following the use of the radiomic model as a computer-assisted tool, the diagnostic performance improved to 0.74/65%/86%/75% (AUC/sensitivity/specificity/accuracy). Specifically, using the radiomic-assisted tool resulted in an increase in the correct identification of 13 cases in comparison to the initial interpretation with 11/13 correctly changed from matched to mismatch and 2/13 correctly changed from mismatch to match, which translates to approximately 12% increase in sensitivity and 2% increase in specificity. There were 11 cases of missed opportunities, where all cases were initially scored as matched and remained so despite the correct prediction of mismatch by radiomics.
ROC comparison showed significant improvement after using the radiomic-assisted tool (p = 0.019) (Figure 3).
Figure 4 shows an example of two instances where the initial incorrect assignment of the 1p-19q status was correctly changed after using a predictive texture model such as CAT.

4. Discussion

Results from the current study indicated that the proposed radiomic model outperformed the diagnostic accuracy of the T2-FLAIR mismatch sign in the prediction of 1p/19q co-deletion status and the diagnostic performance of the proposed radiomic model appears concordant with recently reported investigations [15,20]. In a study by Han et al. [20], radiomic-based prediction showed excellent performance in the detection of co-deletion status (AUCs of 0.89). They also showed that the integration of clinical factors such as demographic data and imaging features such as border cleanliness, homogeneity, and the presence of cysts did not improve the diagnostic accuracy over the radiomic-only model. Zhou et al. [15] combined radiomic features with Visually Accessible Rembrandt Images (VASARI) features (eloquent brain involved, proportion of enhancing tumor, proportion of non-enhancing tumor, cysts, multifocal or multicentric, definition of the non-enhancing margin, proportion of edema, diffusion, enhancing tumor crosses midline, and satellites) and only minimally improved the predictive performance of AUC 0.88 to 0.89 over the radiomics-only model. Additionally, to the best of our knowledge, the current study is one of the first to report comparative diagnostic performance of a radiomic-based model prediction to the T2-FLAIR mismatch signature in the same cohort of patients. The current results suggest that the added value obtained through the use of a radiomic model comes through the improved sensitivity without sacrificing the specificity known to accompany simple features as in T2-FLAIR mismatch. Specifically, data suggests the sensitivity for the prediction of 1p/19q co-deletion status was improved by approximately 21% in the training dataset and 25% in the testing data sets with the use of radiomics when compared to the use of T2-FLAIR mismatch alone. Importantly, results from the current study suggests that the use of radiomics as a computer-assisted tool can improve the diagnostic performance of neuroradiologists when estimating the 1p/19q status, with approximately a 12% increase in sensitivity, and even a 2% increase in specificity, when compared to the use of T2-FLAIR mismatch alone (p = 0.019).
While the use of T2-FLAIR mismatch has emerged as a promising and simple tool for the prediction of 1p/19q co-deletion status, its broad clinical utility has been impeded by a relatively low sensitivity and modest interobserver agreement. The sensitivity of the T2-FLAIR mismatch sign for the prediction of 1p/19q co-deletion status in the current study (57%) was comparable to prior reports, ranging from 37 to 55% [8,11]. These results suggest that roughly only half of the patients with 1p/19q non-co-deletion appear to exhibit the T2-FLAIR mismatch sign. The low sensitivity of T2-FLAIR mismatch may be due to prevalence of heterogeneity within and across gliomas, since a large majority may not demonstrate a homogenous suppression of fluid signal on FLAIR images, and hence lower sensitivity in using T2-FLAIR mismatch as defined by current convention [8,9]. Thus, the ~20% improvement in sensitivity with the current radiomic model and 12% increase in sensitivity when using the radiomic-assisted model may be a valuable addition to the current use of T2-FLAIR mismatch in routine clinical practice. In addition to increased sensitivity, the current study confirmed the relatively low interobserver agreement for the use of T2-FLAIR mismatch to identify 1p/19q status (k = 0.49). While the current study reported slightly lower agreement compared with prior reports, which range from 0.68 to 0.89 [8,10,11,28], the observed variability and subjective determination of T2-FLAIR mismatch further supports the need for a reliable and quantitative tool for quickly predicting 1p/19q status as suggested by the current radiomic approach. Lastly, it has been reported that FISH testing for 1p/19q can occasionally be erroneous which is an inherent limitation as the baseline 1p/19q status in this study was determined through FISH testing [22].
As more radiomic analysis is being incorporated in clinical applications, radiomic prediction of 1p/19q co-deletion status may be beneficial in guiding treatment management. With models with increased sensitivity, less LGGs with the 1p/19q co-deletion status may need to undergo invasive brain biopsy. Further, radiogenomics can assist in the optimization of patient management with regard to counseling and tumor classification when histologic characterization is not possible. In this study, we assessed several popular machine-learning approaches such as logistic regression, support vector machine, Adaboost, and Random Forest during the model development stage based on similar strategies in our previous studies [29,30] and other machine-learning radiomics studies [31,32]. We picked XGBoost as our final classifier based on its high performance, better automated feature selection, and robustness. Further investigation into classifiers is warranted as new algorithmic approaches are evaluated.
It is important to note that the current study was relatively small and retrospective in nature, only involving two institutions. A similar approach with a larger sample size, drawn from a pool of multicenter data, would improve statistical power and the generalizability of the current findings. Moreover, with a larger cohort, a deep-learning approach may be developed to provide an end-to-end solution. Importantly, the current study adheres to the standardized brain tumor imaging protocol [23], which should allow this approach to be generalized for use in clinical trials and for clinical management in centers that adhere to this international standard. It is also important to note that expression of T2/FLAIR mismatch is speculative and subjective, and further understanding of individual texture features correlating with 1p/19q co-deletion in relation to the mismatch will require further investigation.

5. Conclusions

The current study demonstrates the added value of a radiomic model to increase the sensitivity and diagnostic performance of determining 1p/19q status in IDH mutant gliomas when compared to the highly specific T2-FLAIR mismatch signature.

Author Contributions

Conceptualization: A.D. and K.N.; methodology: A.D., S.K., K.M., M.L., B.S., N.P., N.M.T. and A.D.; software: A.D., S.K., K.M., M.L., B.S., N.P., N.M.T. and A.D.; validation: A.D., S.K., K.M., M.L., B.S., N.P., N.M.T. and A.D.; formal analysis: K.N., A.B., H.Z., J.P. and C.A.; investigation: K.N., A.B., H.Z., J.P. and C.A.; resources: K.N., A.B., H.Z., J.P. and C.A.; data curation: A.D., A.H., S.K., K.M., M.L., B.S., N.P., N.M.T. and A.D.; writing—original draft preparation: S.K. and K.N.; writing—review and editing: S.K., A.D., K.N., T.F.C. and B.M.E.; visualization: S.K., A.D., K.N., T.F.C. and B.M.E.; supervision: K.N.; project administration: K.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Icahn School of Medicine at Mount Sinai (HS #: IRB-20-03376 on 4/10/22).

Informed Consent Statement

A waiver of informed consent was granted by the Ethics Committee at our institution (4/10/22: IRB-20-03376).

Data Availability Statement

The data presented in this study are available in this article.

Conflicts of Interest

K.N: Olea Medical Advisory Board. T.F.C: cofounder, major stock holder, consultant, and board member of Katmai Pharmaceuticals; member of the board and paid consultant for the 501c3 Global Coalition for Adaptive Research; holds stock in Chimerix and receives milestone payments and possible future royalties; member of the scientific advisory board for Break Through Cancer; member of the scientific advisory board for Cure Brain Cancer Foundation; has provided paid consulting services to Sagimet, Clinical Care Options, Ideology Health, Servier, Jubilant, Immvira, Gan & Lee, BrainStorm, Katmai, Sapience, Inovio, Vigeo Therapeutics, DNATrix, Tyme, SDP, Novartis, Roche, Kintara, Bayer, Merck, Boehinger Ingelheim, VBL, Amgen, Kiyatec, Odonate Therapeutics QED, Medefield, Pascal Biosciences, Bayer, Tocagen, Karyopharm, GW Pharma, Abbvie, VBI, Deciphera, VBL, Agios, Genocea, Celgene, Puma, Lilly, BMS, Cortice, Wellcome Trust, Novocure, Novogen, Boston Biomedical, Sunovion, Human Longevity, Insys, ProNai, Pfizer, Notable labs, Medqia Trizel, and Medscape; and has contracts with UCLA for the Brain Tumor Program with Oncovir, Merck, Oncoceutics, Novartis, Amgen, Abbvie, DNAtrix, Beigene, BMS, AstraZeneca, Kazia, Agios, Boston Biomedical, Deciphera, Tocagen, Orbus, AstraZenica, and Karyopharm. The Regents of the University of California (T.F.C.’s employer) have licensed intellectual property co-invented by T.F.C. to Katmai Pharmaceuticals. B.M.E: a consultant for Medicenna, MedQIA, Servier, Siemens, Janssen Pharmaceuticals, Kazia, Chimerix, Sumitomo Dainippon Pharma Oncology, ImmunoGenesis, Ellipses Pharma, Monteris, Global Coalition for Adaptive Research, Neosoma, Alpheus Medical, Curtana Pharma, Saimet Biosciences, and Sapience Therapeutics. He also receives grant support from Siemens and Janssen. None for others.

References

  1. Louis, D.N.; Perry, A.; Reifenberger, G.; von Deimling, A.; Figarella-Branger, D.; Cavenee, W.K.; Ohgaki, H.; Wiestler, O.D.; Kleihues, P.; Ellison, D.W. The 2016 World Health Organization Classification of Tumors of the Central Nervous System: A Summary. Acta Neuropathol. 2016, 131, 803–820. [Google Scholar] [CrossRef] [PubMed]
  2. Yan, H.; Bigner, D.D.; Velculescu, V.; Parsons, D.W. Mutant Metabolic Enzymes Are at the Origin of GliomasIDH Mutations in Gliomas. Cancer Res. 2009, 69, 9157–9159. [Google Scholar] [CrossRef] [PubMed]
  3. Wen, P.Y.; Packer, R.J. The 2021 WHO Classification of Tumors of the Central Nervous System: Clinical Implications. Neuro Oncol. 2021, 23, 1215–1217. [Google Scholar] [CrossRef] [PubMed]
  4. Louis, D.N.; Perry, A.; Wesseling, P.; Brat, D.J.; Cree, I.A.; Figarella-Branger, D.; Hawkins, C.; Ng, H.K.; Pfister, S.M.; Reifenberger, G.; et al. The 2021 WHO Classification of Tumors of the Central Nervous System: A Summary. Neuro Oncol. 2021, 23, 1231–1251. [Google Scholar] [CrossRef]
  5. Cairncross, G.; Wang, M.; Shaw, E.; Jenkins, R.; Brachman, D.; Buckner, J.; Fink, K.; Souhami, L.; Laperriere, N.; Curran, W.; et al. Phase III Trial of Chemoradiotherapy for Anaplastic Oligodendroglioma: Long-Term Results of RTOG 9402. J. Clin. Oncol. 2013, 31, 337–343. [Google Scholar] [CrossRef]
  6. van den Bent, M.J.; Carpentier, A.F. Adjuvant Procarbazine, Lomustine, and Vincristine Improves Progression-Free Survival but Not Overall Survival in Newly Diagnosed Anaplastic Oligodendrogliomas and Oligoastrocytomas: A Randomized European Organisation for Research and Treatment of Cancer Phase III Trial. J. Clin. Oncol. 2006, 24, 2715–2722. [Google Scholar]
  7. Smits, M.; van den Bent, M.J. Imaging Correlates of Adult Glioma Genotypes. Radiology 2017, 284, 316–331. [Google Scholar] [CrossRef]
  8. Patel, S.H.; Poisson, L.M.; Brat, D.J.; Zhou, Y.; Cooper, L.; Snuderl, M.; Thomas, C.; Franceschi, A.M.; Griffith, B.; Flanders, A.E.; et al. T2–FLAIR Mismatch, an Imaging Biomarker for IDH and 1p/19q Status in Lower-Grade Gliomas: A TCGA/TCIA Project. Clin. Cancer Res. 2017, 23, 6078–6085. [Google Scholar] [CrossRef]
  9. Jain, R.; Johnson, D.R.; Patel, S.H.; Castillo, M.; Smits, M.; van den Bent, M.J.; Chi, A.S.; Cahill, D.P. “Real World” Use of a Highly Reliable Imaging Sign: “T2-FLAIR Mismatch” for Identification of IDH Mutant Astrocytomas. Neuro Oncol. 2020, 22, 936–943. [Google Scholar] [CrossRef]
  10. Corell, A.; Ferreyra Vega, S.; Hoefling, N.; Carstam, L.; Smits, A.; Olsson Bontell, T.; Björkman-Burtscher, I.M.; Carén, H.; Jakola, A.S. The Clinical Significance of the T2-FLAIR Mismatch Sign in Grade II and III Gliomas: A Population-Based Study. BMC Cancer 2020, 20, 450. [Google Scholar] [CrossRef]
  11. Lasocki, A.; Gaillard, F.; Gorelik, A.; Gonzales, M. MRI Features Can Predict 1p/19q Status in Intracranial Gliomas. AJNR Am. J. Neuroradiol. 2018, 39, 687–692. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Foltyn, M.; Nieto Taborda, K.N.; Neuberger, U.; Brugnara, G.; Reinhardt, A.; Stichel, D.; Heiland, S.; Herold-Mende, C.; Unterberg, A.; Debus, J.; et al. T2/FLAIR-Mismatch Sign for Noninvasive Detection of IDH-Mutant 1p/19q Non-Codeleted Gliomas: Validity and Pathophysiology. Neurooncol. Adv. 2020, 2, vdaa004. [Google Scholar] [CrossRef] [PubMed]
  13. Saito, T.; Muragaki, Y.; Maruyama, T.; Komori, T.; Tamura, M.; Nitta, M.; Tsuzuki, S.; Kawamata, T. Calcification on CT Is a Simple and Valuable Preoperative Indicator of 1p/19q Loss of Heterozygosity in Supratentorial Brain Tumors That Are Suspected Grade II and III Gliomas. Brain Tumor Pathol. 2016, 33, 175–182. [Google Scholar] [CrossRef] [PubMed]
  14. Leonardi, M.A.; Lumenta, C.B. Oligodendrogliomas in the CT/MR-Era. Acta Neurochir. 2001, 143, 1195–1203. [Google Scholar] [CrossRef] [PubMed]
  15. Zhou, H.; Vallières, M.; Bai, H.X.; Su, C.; Tang, H.; Oldridge, D.; Zhang, Z.; Xiao, B.; Liao, W.; Tao, Y.; et al. MRI Features Predict Survival and Molecular Markers in Diffuse Lower-Grade Gliomas. Neuro Oncol. 2017, 19, 862–870. [Google Scholar] [CrossRef]
  16. Fan, Z.; Sun, Z.; Fang, S.; Li, Y.; Liu, X.; Liang, Y.; Liu, Y.; Zhou, C.; Zhu, Q.; Zhang, H.; et al. Preoperative Radiomics Analysis of 1p/19q Status in WHO Grade II Gliomas. Front. Oncol. 2021, 11, 616740. [Google Scholar] [CrossRef] [PubMed]
  17. Shofty, B.; Artzi, M.; Ben Bashat, D.; Liberman, G.; Haim, O.; Kashanian, A.; Bokstein, F.; Blumenthal, D.T.; Ram, Z.; Shahar, T. MRI Radiomics Analysis of Molecular Alterations in Low-Grade Gliomas. Int. J. Comput. Assist. Radiol. Surg. 2018, 13, 563–571. [Google Scholar] [CrossRef]
  18. Ren, X.; Cui, X.; Lin, S.; Wang, J.; Jiang, Z.; Sui, D.; Li, J.; Wang, Z. Co-Deletion of Chromosome 1p/19q and IDH1/2 Mutation in Glioma Subsets of Brain Tumors in Chinese Patients. PLoS ONE 2012, 7, e32764. [Google Scholar] [CrossRef]
  19. Kocak, B.; Durmaz, E.S.; Ates, E.; Sel, I.; Turgut Gunes, S.; Kaya, O.K.; Zeynalova, A.; Kilickesmez, O. Radiogenomics of Lower-Grade Gliomas: Machine Learning-Based MRI Texture Analysis for Predicting 1p/19q Codeletion Status. Eur. Radiol. 2020, 30, 877–886. [Google Scholar] [CrossRef]
  20. Han, Y.; Xie, Z.; Zang, Y.; Zhang, S.; Gu, D.; Zhou, M.; Gevaert, O.; Wei, J.; Li, C.; Chen, H.; et al. Non-Invasive Genotype Prediction of Chromosome 1p/19q Co-Deletion by Development and Validation of an MRI-Based Radiomics Signature in Lower-Grade Gliomas. J. Neurooncol. 2018, 140, 297–306. [Google Scholar] [CrossRef]
  21. Batchala, P.P.; Muttikkal, T.J.E.; Donahue, J.H.; Patrie, J.T.; Schiff, D.; Fadul, C.E.; Mrachek, E.K.; Lopes, M.-B.; Jain, R.; Patel, S.H. Neuroimaging-Based Classification Algorithm for Predicting 1p/19q-Codeletion Status in IDH-Mutant Lower Grade Gliomas. AJNR Am. J. Neuroradiol. 2019, 40, 426–432. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Patel, S.H.; Batchala, P.P.; Mrachek, E.K.S.; Lopes, M.-B.S.; Schiff, D.; Fadul, C.E.; Patrie, J.T.; Jain, R.; Druzgal, T.J.; Williams, E.S. MRI and CT Identify Isocitrate Dehydrogenase (IDH)-Mutant Lower-Grade Gliomas Misclassified to 1p/19q Codeletion Status with Fluorescence in Situ Hybridization. Radiology 2020, 294, 160–167. [Google Scholar] [CrossRef]
  23. Ellingson, B.M.; Bendszus, M.; Boxerman, J.; Barboriak, D.; Erickson, B.J.; Smits, M.; Nelson, S.J.; Gerstner, E.; Alexander, B.; Goldmacher, G.; et al. Consensus Recommendations for a Standardized Brain Tumor Imaging Protocol in Clinical Trials. Neuro. Oncol. 2015, 17, 1188–1198. [Google Scholar] [PubMed]
  24. Chicklore, S.; Goh, V.; Siddique, M.; Roy, A.; Marsden, P.K.; Cook, G.J.R. Quantifying Tumour Heterogeneity in 18F-FDG PET/CT Imaging by Texture Analysis. Eur. J. Nucl. Med. Mol. Imaging 2013, 40, 133–140. [Google Scholar] [CrossRef]
  25. Kickingereder, P.; Burth, S.; Wick, A.; Götz, M.; Eidel, O.; Schlemmer, H.-P.; Maier-Hein, K.H.; Wick, W.; Bendszus, M.; Radbruch, A.; et al. Radiomic Profiling of Glioblastoma: Identifying an Imaging Predictor of Patient Survival with Improved Performance over Established Clinical and Radiologic Risk Models. Radiology 2016, 280, 880–889. [Google Scholar] [CrossRef]
  26. Sakai, Y.; Yang, C.; Kihira, S.; Tsankova, N.; Khan, F.; Hormigo, A.; Lai, A.; Cloughesy, T.; Nael, K. MRI Radiomic Features to Predict IDH1 Mutation Status in Gliomas: A Machine Learning Approach Using Gradient Tree Boosting. Int. J. Mol. Sci. 2020, 21, 8004. [Google Scholar] [CrossRef]
  27. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 13 August 2016; Association for Computing Machinery: New York, NY, USA, 2016; pp. 785–794. [Google Scholar]
  28. Lasocki, A.; Rosenthal, M.A.; Roberts-Thomson, S.J.; Neal, A.; Drummond, K.J. Neuro-Oncology and Radiogenomics: Time to Integrate? AJNR Am. J. Neuroradiol. 2020, 41, 1982–1988. [Google Scholar] [CrossRef] [PubMed]
  29. Zhang, H.; Polson, J.; Nael, K.; Salamon, N.; Yoo, B.; Speier, W.; Arnold, C. A Machine Learning Approach to Predict Acute Ischemic Stroke Thrombectomy Reperfusion Using Discriminative MR Image Features. In Proceedings of the 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), Athens, Greece, 27–30 July 2021. [Google Scholar] [CrossRef]
  30. Polson, J.S.; Zhang, H.; Nael, K.; Salamon, N.; Yoo, B.Y.; El-Saden, S.; Starkman, S.; Kim, N.; Kang, D.-W.; Speier, W.F., 4th; et al. Identifying Acute Ischemic Stroke Patients within the Thrombolytic Treatment Window Using Deep Learning. J. Neuroimaging 2022, 32, 1153–1160. [Google Scholar] [CrossRef] [PubMed]
  31. Pasquini, L.; Napolitano, A.; Lucignani, M.; Tagliente, E.; Dellepiane, F.; Rossi-Espagnet, M.C.; Ritrovato, M.; Vidiri, A.; Villani, V.; Ranazzi, G.; et al. AI and High-Grade Glioma for Diagnosis and Outcome Prediction: Do All Machine Learning Models Perform Equally Well? Front. Oncol. 2021, 11, 601425. [Google Scholar] [CrossRef]
  32. Parmar, C.; Grossmann, P.; Bussink, J.; Lambin, P.; Aerts, H.J.W.L. Machine Learning Methods for Quantitative Radiomic Biomarkers. Sci. Rep. 2015, 5, 13087. [Google Scholar] [CrossRef] [Green Version]
Cancers 15 01037 g001 550
Figure 1. Study diagram with initial cohort and inclusion/exclusion criteria.
Figure 1. Study diagram with initial cohort and inclusion/exclusion criteria.
Cancers 15 01037 g001
Cancers 15 01037 g002 550
Figure 2. Examples of T2-FLAIR match and mismatch in 4 patients with IDH1 mutant gliomas with various 1p/19q co-deletion status. Axial T2 (A) and FLAIR (B) images demonstrate T2-FLAIR mismatch in a 25-year-old male with 1p/19q non-co-deletion correctly identified in a true positive instance. Axial T2 (C) and FLAIR (D) images demonstrate T2-FLAIR mismatch in a 58-year-old female with 1p/19q co-deletion in a false positive instance. Axial T2 (E) and FLAIR (F) images show T2-FLAIR match in a 55-year-old male with 1p/19q non-co-deletion in a false negative instance. Axial T2 (G) and FLAIR (H) images show T2-FLAIR match in a 60-year-old female with 1p/19q non-co-deletion correctly identified in a true negative instance. All cases were correctly identified by radiomic model.
Figure 2. Examples of T2-FLAIR match and mismatch in 4 patients with IDH1 mutant gliomas with various 1p/19q co-deletion status. Axial T2 (A) and FLAIR (B) images demonstrate T2-FLAIR mismatch in a 25-year-old male with 1p/19q non-co-deletion correctly identified in a true positive instance. Axial T2 (C) and FLAIR (D) images demonstrate T2-FLAIR mismatch in a 58-year-old female with 1p/19q co-deletion in a false positive instance. Axial T2 (E) and FLAIR (F) images show T2-FLAIR match in a 55-year-old male with 1p/19q non-co-deletion in a false negative instance. Axial T2 (G) and FLAIR (H) images show T2-FLAIR match in a 60-year-old female with 1p/19q non-co-deletion correctly identified in a true negative instance. All cases were correctly identified by radiomic model.
Cancers 15 01037 g002
Cancers 15 01037 g003 550
Figure 3. Receiver-operating characteristic (ROC) curves for prediction of 1p/19q co-deletion status. (A) Comparison of radiomics model to consensus T2-FLAIR mismatch with AUCs of 0.80 and 0.70, respectively (p = 0.044). (B) Comparison of radiologist T2-FLAIR mismatch alone to combined radiologist + radiomic (computer-assisted tool) with AUCs of 0.66 and 0.74, respectively (p = 0.019).
Figure 3. Receiver-operating characteristic (ROC) curves for prediction of 1p/19q co-deletion status. (A) Comparison of radiomics model to consensus T2-FLAIR mismatch with AUCs of 0.80 and 0.70, respectively (p = 0.044). (B) Comparison of radiologist T2-FLAIR mismatch alone to combined radiologist + radiomic (computer-assisted tool) with AUCs of 0.66 and 0.74, respectively (p = 0.019).
Cancers 15 01037 g003
Cancers 15 01037 g004 550
Figure 4. Two examples of correct changes made to T2-FLAIR mismatch evaluation with CAT. Axial T2 (A,B) and FLAIR (C,D) images in a 33-year-old male with IDH1 mutant glioma and non-co-deleted 1p/19q. During the initial interpretation, this was read as T2-FLAIR match but during the 2nd interpretation in conjunction with radiomic predicted result, this was correctly changed to T2-FLAIR mismatch. In this case, the heterogeneity of signal in different parts of tumor may have contributed to the initial error. Although there is relative matched signal between (A,C), there is subtle suppression of signal within the lower part of this tumor seen on (B,D) images. Axial T2 (E,F) and FLAIR (G,H) images in a 50-year-old male with IDH1 mutant glioma and co-deleted 1p/19q. During the initial interpretation this was read as T2-FLAIR mismatch; however, in 2nd interpretation in conjunction with radiomic predicted result, this was correctly changed to match. In this case, the prevalence of multiple small cystic components and their suppression on FLAIR images may have contributed to the initial error; however, when comparing (F–H), it is apparent that the majority of signal is matched between T2 and FLAIR.
Figure 4. Two examples of correct changes made to T2-FLAIR mismatch evaluation with CAT. Axial T2 (A,B) and FLAIR (C,D) images in a 33-year-old male with IDH1 mutant glioma and non-co-deleted 1p/19q. During the initial interpretation, this was read as T2-FLAIR match but during the 2nd interpretation in conjunction with radiomic predicted result, this was correctly changed to T2-FLAIR mismatch. In this case, the heterogeneity of signal in different parts of tumor may have contributed to the initial error. Although there is relative matched signal between (A,C), there is subtle suppression of signal within the lower part of this tumor seen on (B,D) images. Axial T2 (E,F) and FLAIR (G,H) images in a 50-year-old male with IDH1 mutant glioma and co-deleted 1p/19q. During the initial interpretation this was read as T2-FLAIR mismatch; however, in 2nd interpretation in conjunction with radiomic predicted result, this was correctly changed to match. In this case, the prevalence of multiple small cystic components and their suppression on FLAIR images may have contributed to the initial error; however, when comparing (F–H), it is apparent that the majority of signal is matched between T2 and FLAIR.
Cancers 15 01037 g004
Table
Table 1. Demographic information for study cohort.
Table 1. Demographic information for study cohort.
1p19q Co-Deleted (n = 35)1p19q Non-Co-Deleted
(n = 68)		p Value
Age (mean/SD)43/1340/130.91
Sex (M/F)12/2323/450.93
Location (F/P/T/O/C) *23/7/4/0/128/11/18/0/40.81
T2-FLAIR mismatch (Y/N)6/2939/29<0.05
* F: frontal lobe, P: parietal lobe, T: temporal lobe, O: occipital lobe, C: cerebellum.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kihira, S.; Derakhshani, A.; Leung, M.; Mahmoudi, K.; Bauer, A.; Zhang, H.; Polson, J.; Arnold, C.; Tsankova, N.M.; Hormigo, A.; et al. Multi-Parametric Radiomic Model to Predict 1p/19q Co-Deletion in Patients with IDH-1 Mutant Glioma: Added Value to the T2-FLAIR Mismatch Sign. Cancers 2023, 15, 1037. https://doi.org/10.3390/cancers15041037

AMA Style

Kihira S, Derakhshani A, Leung M, Mahmoudi K, Bauer A, Zhang H, Polson J, Arnold C, Tsankova NM, Hormigo A, et al. Multi-Parametric Radiomic Model to Predict 1p/19q Co-Deletion in Patients with IDH-1 Mutant Glioma: Added Value to the T2-FLAIR Mismatch Sign. Cancers. 2023; 15(4):1037. https://doi.org/10.3390/cancers15041037

Chicago/Turabian Style

Kihira, Shingo, Ahrya Derakhshani, Michael Leung, Keon Mahmoudi, Adam Bauer, Haoyue Zhang, Jennifer Polson, Corey Arnold, Nadejda M. Tsankova, Adilia Hormigo, and et al. 2023. "Multi-Parametric Radiomic Model to Predict 1p/19q Co-Deletion in Patients with IDH-1 Mutant Glioma: Added Value to the T2-FLAIR Mismatch Sign" Cancers 15, no. 4: 1037. https://doi.org/10.3390/cancers15041037

APA Style

Kihira, S., Derakhshani, A., Leung, M., Mahmoudi, K., Bauer, A., Zhang, H., Polson, J., Arnold, C., Tsankova, N. M., Hormigo, A., Salehi, B., Pham, N., Ellingson, B. M., Cloughesy, T. F., & Nael, K. (2023). Multi-Parametric Radiomic Model to Predict 1p/19q Co-Deletion in Patients with IDH-1 Mutant Glioma: Added Value to the T2-FLAIR Mismatch Sign. Cancers, 15(4), 1037. https://doi.org/10.3390/cancers15041037

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop