Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Population
2.2. MR Image Acquisition and Dicom Image Preparation
2.3. Deep Learning Process
2.4. Parsing Flowchart
2.5. Statistical Analysis
3. Results
3.1. Classification of Cine-MR Images
3.2. Classification of LGE Images
3.3. Classification of Combined Cine and LGE Images
3.4. Blind Reading by Experienced Radiologist/Cardiologist
3.5. Analysis of Saliency Maps for cineMR Images
4. Discussion
4.1. Differential Diagnosis between AL and ATTR Cardiac Amyloidosis
4.2. The CNN Tool Seemed to Be Promising in This Area
4.3. CNN Results for the Diagnosis of Cardiac Amyloidosis
4.4. Possible Explanations for CNN Distinction between AL and ATTR Cardiac Amyloidosis
4.5. The “Black-Box” Nature of CNNs Remains a Major Concern
4.6. Study Limitations
4.7. Perspectives
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Papathanasiou, M.; Carpinteiro, A.; Rischpler, C.; Hagenacker, T.; Rassaf, T.; Luedike, P. Diagnosing cardiac amyloidosis in every-day practice: A practical guide for the cardiologist. IJC Hear. Vasc. 2020, 28, 100519. [Google Scholar] [CrossRef] [PubMed]
- Maleszewski, J.J. Cardiac amyloidosis: Pathology, nomenclature, and typing. Cardiovasc. Pathol. 2015, 24, 343–350. [Google Scholar] [CrossRef] [PubMed]
- Siddiqi, O.K.; Ruberg, F.L. Cardiac amyloidosis: An update on pathophysiology, diagnosis, and treatment. Trends Cardiovasc. Med. 2018, 28, 10–21. [Google Scholar] [CrossRef] [PubMed]
- Garcia-Pavia, P.; Rapezzi, C.; Adler, Y.; Arad, M.; Basso, C.; Brucato, A.; Burazor, I.; Caforio, A.L.; Damy, T.; Eriksson, U.; et al. Diagnosis and treatment of cardiac amyloidosis. A position statement of the European Society of Cardiology W orking G roup on M yocardial and P ericardial D iseases. Eur. J. Hear. Fail. 2021, 23, 512–526. [Google Scholar] [CrossRef] [PubMed]
- Larsen, B.T.; Mereuta, O.M.; Dasari, S.; Fayyaz, A.U.; Theis, J.D.; Vrana, J.A.; Grogan, M.; Dogan, A.; Dispenzieri, A.; Edwards, W.D.; et al. Correlation of histomorphological pattern of cardiac amyloid deposition with amyloid type: A histological and proteomic analysis of 108 cases. Histopathology 2015, 68, 648–656. [Google Scholar] [CrossRef]
- Saito, Y.; Nakamura, K.; Ito, H. Molecular Mechanisms of Cardiac Amyloidosis. Int. J. Mol. Sci. 2021, 23, 25. [Google Scholar] [CrossRef]
- Kittleson, M.M.; Maurer, M.S.; Ambardekar, A.V.; Bullock-Palmer, R.P.; Chang, P.P.; Eisen, H.J.; Nair, A.P.; Nativi-Nicolau, J.; Ruberg, F.L.; On behalf of the American Heart Association Heart Failure and Transplantation Committee of the Council on Clinical Cardiology. Cardiac Amyloidosis: Evolving Diagnosis and Management: A Scientific Statement From the American Heart Association. Circulation 2020, 142, e7–e22. [Google Scholar] [CrossRef]
- Maurer, M.S.; Bokhari, S.; Damy, T.; Dorbala, S.; Drachman, B.M.; Fontana, M.; Grogan, M.; Kristen, A.V.; Lousada, I.; Nativi-Nicolau, J.; et al. Expert Consensus Recommendations for the Suspicion and Diagnosis of Transthyretin Cardiac Amyloidosis. Circ. Heart Fail. 2019, 12, e006075. [Google Scholar] [CrossRef]
- Gillmore, J.D.; Maurer, M.S.; Falk, R.H.; Merlini, G.; Damy, T.; Dispenzieri, A.; Wechalekar, A.D.; Berk, J.L.; Quarta, C.C.; Grogan, M.; et al. Nonbiopsy Diagnosis of Cardiac Transthyretin Amyloidosis. Circulation 2016, 133, 2404–2412. [Google Scholar] [CrossRef]
- González-López, E.; Gallego-Delgado, M.; Guzzo-Merello, G.; de Haro-Del Moral, F.J.; Cobo-Marcos, M.; Robles, C.; Bornstein, B.; Salas, C.; Lara-Pezzi, E.; Alonso-Pulpon, L.; et al. Wild-type transthyretin amyloidosis as a cause of heart failure with preserved ejection fraction. Eur. Heart J. 2015, 36, 2585–2594. [Google Scholar] [CrossRef]
- Chatzantonis, G.; Bietenbeck, M.; Elsanhoury, A.; Tschöpe, C.; Pieske, B.; Tauscher, G.; Vietheer, J.; Shomanova, Z.; Mahrholdt, H.; Rolf, A.; et al. Diagnostic value of cardiovascular magnetic resonance in comparison to endomyocardial biopsy in cardiac amyloidosis: A multi-centre study. Clin. Res. Cardiol. 2020, 110, 555–568. [Google Scholar] [CrossRef] [PubMed]
- Martinez-Naharro, A.; Treibel, T.A.; Abdel-Gadir, A.; Bulluck, H.; Zumbo, G.; Knight, D.S.; Kotecha, T.; Francis, R.; Hutt, D.F.; Rezk, T.; et al. Magnetic Resonance in Transthyretin Cardiac Amyloidosis. J. Am. Coll. Cardiol. 2017, 70, 466–477. [Google Scholar] [CrossRef] [PubMed]
- Wang, T.K.M.; Brizneda, M.V.; Kwon, D.H.; Popovic, Z.B.; Flamm, S.D.; Hanna, M.; Griffin, B.P.; Xu, B. Reference Ranges, Diagnostic and Prognostic Utility of Native T1 Mapping and Extracellular Volume for Cardiac Amyloidosis: A Meta-Analysis. J. Magn. Reson. Imaging 2020, 53, 1458–1468. [Google Scholar] [CrossRef] [PubMed]
- Pan, J.A.; Kerwin, M.J.; Salerno, M. Native T1 Mapping, Extracellular Volume Mapping, and Late Gadolinium Enhancement in Cardiac Amyloidosis. JACC: Cardiovasc. Imaging 2020, 13, 1299–1310. [Google Scholar] [CrossRef]
- Brownrigg, J.; Lorenzini, M.; Lumley, M.; Elliott, P. Diagnostic performance of imaging investigations in detecting and differentiating cardiac amyloidosis: A systematic review and meta-analysis. ESC Hear. Fail. 2019, 6, 1041–1051. [Google Scholar] [CrossRef]
- Venkadesh, K.V.; Setio, A.A.A.; Schreuder, A.; Scholten, E.T.; Chung, K.; Wille, M.M.W.; Saghir, Z.; van Ginneken, B.; Prokop, M.; Jacobs, C. Deep Learning for Malignancy Risk Estimation of Pulmonary Nodules Detected at Low-Dose Screening CT. Radiology 2021, 300, 438–447. [Google Scholar] [CrossRef]
- Zlochower, A.; Chow, D.S.; Chang, P.; Khatri, D.; Boockvar, J.A.; Filippi, C.G. Deep Learning AI Applications in the Imaging of Glioma. Top. Magn. Reson. Imaging 2020, 29, 115-00. [Google Scholar] [CrossRef]
- Brinker, T.J.; Hekler, A.; Enk, A.H.; Klode, J.; Hauschild, A.; Berking, C.; Schilling, B.; Haferkamp, S.; Schadendorf, D.; Holland-Letz, T.; et al. Deep learning outperformed 136 of 157 dermatologists in a head-to-head dermoscopic melanoma image classification task. Eur. J. Cancer 2019, 113, 47–54. [Google Scholar] [CrossRef] [Green Version]
- Xu, Q.; Zhu, Q.; Liu, H.; Chang, L.; Duan, S.; Dou, W.; Li, S.; Ye, J. Differentiating Benign from Malignant Renal Tumors Using T2—and Diffusion-Weighted Images: A Comparison of Deep Learning and Radiomics Models Versus Assessment from Radiologists. J. Magn. Reson. Imaging 2021, 55, 1251–1259. [Google Scholar] [CrossRef]
- McKinney, S.M.; Sieniek, M.; Godbole, V.; Godwin, J.; Antropova, N.; Ashrafian, H.; Back, T.; Chesus, M.; Corrado, G.S.; Darzi, A.; et al. International evaluation of an AI system for breast cancer screening. Nature 2020, 577, 89–94. [Google Scholar] [CrossRef]
- Goto, S.; Mahara, K.; Beussink-Nelson, L.; Ikura, H.; Katsumata, Y.; Endo, J.; Gaggin, H.K.; Shah, S.J.; Itabashi, Y.; MacRae, C.A.; et al. Artificial intelligence-enabled fully automated detection of cardiac amyloidosis using electrocardiograms and echocardiograms. Nat. Commun. 2021, 12, 1–12. [Google Scholar] [CrossRef] [PubMed]
- Martini, N.; Aimo, A.; Barison, A.; Della Latta, D.; Vergaro, G.; Aquaro, G.D.; Ripoli, A.; Emdin, M.; Chiappino, D. Deep learning to diagnose cardiac amyloidosis from cardiovascular magnetic resonance. J. Cardiovasc. Magn. Reson. 2020, 22, 1–11. [Google Scholar] [CrossRef] [PubMed]
- Agibetov, A.; Kammerlander, A.; Duca, F.; Nitsche, C.; Koschutnik, M.; Donà, C.; Dachs, T.-M.; Rettl, R.; Stria, A.; Schrutka, L.; et al. Convolutional Neural Networks for Fully Automated Diagnosis of Cardiac Amyloidosis by Cardiac Magnetic Resonance Imaging. J. Pers. Med. 2021, 11, 1268. [Google Scholar] [CrossRef] [PubMed]
- Germain, P.; Vardazaryan, A.; Padoy, N.; Labani, A.; Roy, C.; Schindler, T.H.; El Ghannudi, S. Deep Learning Supplants Visual Analysis by Experienced Operators for the Diagnosis of Cardiac Amyloidosis by Cine-CMR. Diagnostics 2021, 12, 69. [Google Scholar] [CrossRef]
- Halme, H.-L.; Ihalainen, T.; Suomalainen, O.; Loimaala, A.; Mätzke, S.; Uusitalo, V.; Sipilä, O.; Hippeläinen, E. Convolutional neural networks for detection of transthyretin amyloidosis in 2D scintigraphy images. EJNMMI Res. 2022, 12, 1–11. [Google Scholar] [CrossRef] [PubMed]
- Santarelli, M.F.; Genovesi, D.; Positano, V.; Scipioni, M.; Vergaro, G.; Favilli, B.; Giorgetti, A.; Emdin, M.; Landini, L.; Marzullo, P. Deep-learning-based cardiac amyloidosis classification from early acquired pet images. Int. J. Cardiovasc. Imaging 2021, 37, 2327–2335. [Google Scholar] [CrossRef] [PubMed]
- Nagy, D.; Révész, K.; Peskó, G.; Varga, G.; Horváth, L.; Farkas, P.; Tóth, A.D.; Sepp, R.; Vágó, H.; Nagy, A.I.; et al. Cardiac Amyloidosis with Normal Wall Thickness: Prevalence, Clinical Characteristics and Outcome in a Retrospective Analysis. Biomedicines 2022, 10, 1765. [Google Scholar] [CrossRef]
- Mongan, J.; Moy, L.; Kahn, C.E. Checklist for Artificial Intelligence in Medical Imaging (CLAIM): A Guide for Authors and Reviewers. Radiol. Artif. Intell. 2020, 2, e200029. [Google Scholar] [CrossRef] [Green Version]
- Simonyan, K.; Zisserman, A. Very Deep Convolutional Network for Large Scale Image Recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
- Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. arXiv 2016, arXiv:1610.02391. [Google Scholar]
- Ben Zadok, O.I.; Vaturi, M.; Vaxman, I.; Iakobishvili, Z.; Rhurman-Shahar, N.; Kornowski, R.; Hamdan, A. Differences in the characteristics and contemporary cardiac outcomes of patients with light-chain versus transthyretin cardiac amyloidosis. PLoS ONE 2021, 16, e0255487. [Google Scholar] [CrossRef]
- Quarta, C.C.; Solomon, S.D.; Uraizee, I.; Kruger, J.; Longhi, S.; Ferlito, M.; Gagliardi, C.; Milandri, A.; Rapezzi, C.; Falk, R.H. Left Ventricular Structure and Function in Transthyretin-Related Versus Light-Chain Cardiac Amyloidosis. Circulation 2014, 129, 1840–1849. [Google Scholar] [CrossRef]
- Dungu, J.N.; Valencia, O.; Pinney, J.H.; Gibbs, S.D.; Rowczenio, D.; Gilbertson, J.A.; Lachmann, H.; Wechalekar, A.; Gillmore, J.D.; Whelan, C.J.; et al. CMR-Based Differentiation of AL and ATTR Cardiac Amyloidosis. JACC Cardiovasc. Imaging 2014, 7, 133–142. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Slivnick, J.A.; Tong, M.S.; Nagaraja, H.N.; Elamin, M.B.; Wallner, A.; O’Brien, A.; Raman, S.V.; Zareba, K.M. Novel Cardiovascular Magnetic Resonance Model to Distinguish Immunoglobulin Light Chain From Transthyretin Cardiac Amyloidosis. JACC Cardiovasc. Imaging 2021, 14, 302–304. [Google Scholar] [CrossRef]
- Binder, C.; Duca, F.; Binder, T.; Rettl, R.; Dachs, T.M.; Seirer, B.; Ligios, L.C.; Dusik, F.; Capelle, C.; Qin, H.; et al. Prognostic implications of pericardial and pleural effusion in patients with cardiac amyloidosis. Clin. Res. Cardiol. 2020, 110, 532–543. [Google Scholar] [CrossRef] [PubMed]
- Picken, M.M. The Pathology of Amyloidosis in Classification: A Review. Acta Haematol. 2020, 143, 322–334. [Google Scholar] [CrossRef] [PubMed]
- Ridouani, F.; Damy, T.; Tacher, V.; Derbel, H.; Legou, F.; Sifaoui, I.; Audureau, E.; Bodez, D.; Rahmouni, A.; Deux, J.-F. Myocardial native T2 measurement to differentiate light-chain and transthyretin cardiac amyloidosis and assess prognosis. J. Cardiovasc. Magn. Reson. 2018, 20, 1–11. [Google Scholar] [CrossRef]
- Zhao, Y.; Chang, M.; Wang, R.; Xi, I.L.; Chang, K.; Huang, R.Y.; Vallières, M.; Habibollahi, P.; Dagli, M.S.; Palmer, M.; et al. Deep Learning Based on MRI for Differentiation of Low- and High-Grade in Low-Stage Renal Cell Carcinoma. J. Magn. Reson. Imaging 2020, 52, 1542–1549. [Google Scholar] [CrossRef]
- Yuan, Y.; Qin, W.; Buyyounouski, M.; Ibragimov, B.; Hancock, S.; Han, B.; Xing, L. Prostate cancer classification with multiparametric MRI transfer learning model. Med. Phys. 2018, 46, 756–765. [Google Scholar] [CrossRef]
- Zhou, H.; Li, L.; Liu, Z.; Zhao, K.; Chen, X.; Lu, M.; Yin, G.; Song, L.; Zhao, S.; Zheng, H.; et al. Deep learning algorithm to improve hypertrophic cardiomyopathy mutation prediction using cardiac cine images. Eur. Radiol. 2020, 31, 3931–3940. [Google Scholar] [CrossRef]
- Chacko, L.; Boldrini, M.; Martone, R.; Law, S.; Martinez-Naharrro, A.; Hutt, D.F.; Kotecha, T.; Patel, R.K.; Razvi, Y.; Rezk, T.; et al. Cardiac Magnetic Resonance–Derived Extracellular Volume Mapping for the Quantification of Hepatic and Splenic Amyloid. Circ. Cardiovasc. Imaging 2021, 14, e012506. [Google Scholar] [CrossRef]
- Zheng, Q.; Delingette, H.; Ayache, N. Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow. Med. Image Anal. 2019, 56, 80–95. [Google Scholar] [CrossRef] [PubMed]
- Neisius, U.; El-Rewaidy, H.; Nakamori, S.; Rodriguez, J.; Manning, W.J.; Nezafat, R. Radiomic Analysis of Myocardial Native T1 Imaging Discriminates Between Hypertensive Heart Disease and Hypertrophic Cardiomyopathy. JACC Cardiovasc. Imaging 2019, 12, 1946–1954. [Google Scholar] [CrossRef] [PubMed]
- Larroza, A.; Materka, A.; López-Lereu, M.P.; Monmeneu, J.V.; Bodí, V.; Moratal, D. Differentiation between acute and chronic myocardial infarction by means of texture analysis of late gadolinium enhancement and cine cardiac magnetic resonance imaging. Eur. J. Radiol. 2017, 92, 78–83. [Google Scholar] [CrossRef] [PubMed]
AL Amyloidosis | ATTR Amyloidosis | p | |
---|---|---|---|
N patients | 70 | 50 | |
Age (years) | 72.1 ± 9.7 | 75.9 ± 9.4 | 0.034 |
Sex (M/F) | 47/23 (67%) | 47/4 (94%) | 0.0004 |
Weight (kg) | 68.7 ± 15.1 | 77.8 ± 13.1 | 0.0007 |
Height (cm) | 170.1 ± 9.2 | 172.7 ± 9.4 | 0.14 |
BSA (m2) | 1.81 ± 0.24 | 1.95 ± 0.19 | 0.0007 |
IVS (mm) | 16.8 ± 3.0 | 19.7 ± 3.2 | 0.0001 |
LVMI (g/m2) | 107.9 ± 31.0 | 125.4 ± 26.6 | 0.0017 |
LVDVI (ml/m2) | 68.3 ± 23.7 | 74.9 ± 20.0 | 0.11 |
LVEF (%) | 60.8 ± 10.5 | 56.9 ± 12.2 | 0.06 |
LA surface (cm2) | 29.2 ± 5.9 | 31.1 ± 7.3 | 0.16 |
T1 (ms) (n = 48 vs. 42) | 1146.7 ± 77.9 | 1143.3 ± 54.0 | 0.8 |
ECV (%) (n = 36 vs. 35) | 50.7 ± 13.1 | 58.1 ± 13.1 | 0.019 |
T2 (ms) (n = 12 vs. 19) | 51.5 ± 4.4 | 50.7 ± 2.3 | 0.49 |
N cine frames/patient | 5.8 ± 1.8 | 5.9 ± 1.7 | 0.70 |
N LGE frames/patient | 15.5 ± 4.8 | 16.0 ± 4.7 | 0.53 |
N patient with pericard | 36 (51%) | 13 (26%) | 0.058 |
N patients with pleural | 28 (40%) | 8 (16%) | 0.0073 |
N patients with both | 16 (21%) | 3 (6 %) | 0.020 |
Accuracy | AUC | |
---|---|---|
CNN-cine | 0.750 | 0.839 [0.761–0.900] |
CNN-LGE | 0.611 | 0.679 [0.588–0.761] (0.0041) |
Cine and LGE Average | 0.708 | 0.821 [0.740–0.885] (0.42) |
Cine and LGE Logistic regression | 0.742 | 0.818 [0.738–0.883] (0.03) |
Accuracy | ROC AUC | |
---|---|---|
CNN-cine | 0.750 | 0.839 [0.761–0.900] |
Reader 1 | 0.633 | 0.622 [0.529–0.709] (0.0003) |
Reader 2 | 0.617 | 0.644 [0.552–0.729] (0.0014) |
Reader 3 | 0.675 | 0.714 [0.523–0.649] (0.0075) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Germain, P.; Vardazaryan, A.; Labani, A.; Padoy, N.; Roy, C.; El Ghannudi, S. Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images. Biomedicines 2023, 11, 193. https://doi.org/10.3390/biomedicines11010193
Germain P, Vardazaryan A, Labani A, Padoy N, Roy C, El Ghannudi S. Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images. Biomedicines. 2023; 11(1):193. https://doi.org/10.3390/biomedicines11010193
Chicago/Turabian StyleGermain, Philippe, Armine Vardazaryan, Aissam Labani, Nicolas Padoy, Catherine Roy, and Soraya El Ghannudi. 2023. "Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images" Biomedicines 11, no. 1: 193. https://doi.org/10.3390/biomedicines11010193
APA StyleGermain, P., Vardazaryan, A., Labani, A., Padoy, N., Roy, C., & El Ghannudi, S. (2023). Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images. Biomedicines, 11(1), 193. https://doi.org/10.3390/biomedicines11010193