Smart Visualization of Medical Images as a Tool in the Function of Education in Neuroradiology
Abstract
:1. Introduction
2. Materials and Methods
2.1. Standard Methods and Existing Problems
2.2. Smart Visualization Method (SVMI)
3. Results
3.1. Technological Description
3.2. Evaluation of the Developed SVMI Model
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
References
- Campbell-Washburn, A.E.; Ramasawmy, R.; Restivo, M.C.; Bhattacharya, I.; Basar, B.; Herzka, D.A.; Hansen, M.S.; Rogers, T.; Bandettini, W.P.; McGuirt, D.R.; et al. Opportunities in Interventional and Diagnostic Imaging by Using High-Performance Low-Field-Strength MRI. Radiology 2019, 293, 384–393. [Google Scholar] [CrossRef] [PubMed]
- Blanke, P.; Weir-McCall, J.R.; Achenbach, S.; Delgado, V.; Hausleiter, J.; Jilaihawi, H.; Marwan, M.; Nørgaard, B.L.; Piazza, N.; Schoenhagen, P.; et al. Computed tomography imaging in the context of transcatheter aortic valve implantation (TAVI)/transcatheter aortic valve replacement (TAVR) an expert consensus document of the Society of Cardiovascular Computed Tomography. JACC Cardiovasc. Imaging 2019, 12, 1–24. [Google Scholar] [CrossRef] [PubMed]
- Dong, X.; Lei, Y.; Wang, T.; Higgins, K.; Liu, T.; Curran, W.J.; Mao, H.; A Nye, J.; Yang, X. Deep learning-based attenuation correction in the absence of structural information for whole-body positron emission tomography imaging. Phys. Med. Biol. 2020, 65, 055011. [Google Scholar] [CrossRef] [PubMed]
- Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; et al. Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 2015, 115, 211–252. [Google Scholar] [CrossRef] [Green Version]
- Hirschberg, J.; Manning, C.D. Advances in natural language processing. Science 2015, 349, 261–266. [Google Scholar] [CrossRef]
- Hinton, G.; Deng, L.; Yu, D.; Dahl, G.E.; Mohamed, A.-R.; Jaitly, N.; Senior, A.; Vanhoucke, V.; Nguyen, P.; Sainath, T.N.; et al. Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups. IEEE Signal Process. Mag. 2012, 29, 82–97. [Google Scholar] [CrossRef]
- Lloyd, B. Minor, Harnessing the power of data in health. In Health Trends Report. Stanford Medicine; Stanford Medicine: Stanford, CA, USA, 2017; pp. 1–18. [Google Scholar]
- Esteva, A.; Robicquet, A.; Ramsundar, B.; Kuleshov, V.; Depristo, M.; Chou, K.; Cui, C.; Corrado, G.; Thrun, S.; Dean, J. A guide to deep learning in healthcare. Nat. Med. 2019, 25, 24–29. [Google Scholar] [CrossRef]
- Langlotz, C.P.; Allen, B.; Erickson, B.J.; Kalpathy-Cramer, J.; Bigelow, K.; Cook, T.S.; Flanders, A.E.; Lungren, M.P.; Mendelson, D.S.; Rudie, J.D.; et al. A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH/RSNA/ACR/The Academy Workshop. Radiology 2019, 291, 781–791. [Google Scholar] [CrossRef]
- Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017, 542, 115–118. [Google Scholar] [CrossRef]
- Lee, H.; Yune, S.; Mansouri, M.; Kim, M.; Tajmir, S.H.; Guerrier, C.E.; Ebert, S.A.; Pomerantz, S.R.; Romero, J.M.; Kamalian, S.; et al. An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets. Nat. Biomed. Eng. 2019, 3, 173–182. [Google Scholar] [CrossRef]
- Rajpurkar, P.; Irvin, J.; Zhu, K.; Yang, B.; Mehta, H.; Duan, T.; Ding, D.; Bagul, A.; Langlotz, C.; Shpanskaya, K.; et al. Chexnet: Radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv 2017, arXiv:1711.05225. [Google Scholar]
- Lazer, D.; Kennedy, R.; King, G.; Vespignani, A. The Parable of Google Flu: Traps in Big Data Analysis. Science 2014, 343, 1203–1205. [Google Scholar] [CrossRef] [PubMed]
- Alexander, A.; Jiang, A.; Ferreira, C.; Zurkiya, D. An Intelligent Future for Medical Imaging: A Market Outlook on Artificial Intelligence for Medical Imaging. J. Am. Coll. Radiol. 2020, 17, 165–170. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Ursuleanu, T.; Luca, A.; Gheorghe, L.; Grigorovici, R.; Iancu, S.; Hlusneac, M.; Preda, C.; Grigorovici, A. Deep Learning Application for Analyzing of Constituents and Their Correlations in the Interpretations of Medical Images. Diagnostics 2021, 11, 1373. [Google Scholar] [CrossRef] [PubMed]
- Dai, Y.; Gao, Y.; Liu, F. TransMed: Transformers Advance Multi-Modal Medical Image Classification. Diagnostics 2021, 11, 1384. [Google Scholar] [CrossRef]
- Shen, D.; Wu, G.; Suk, H.-I. Deep Learning in Medical Image Analysis. Annu. Rev. Biomed. Eng. 2017, 19, 221–248. [Google Scholar] [CrossRef] [Green Version]
- Rehman, M.U.; Cho, S.; Kim, J.; Chong, K.T. Brainseg-net: Brain tumor mr image segmentation via enhanced encoder–decoder network. Diagnostics 2021, 11, 169. [Google Scholar] [CrossRef]
- Zhang, W.; Li, R.; Deng, H.; Wang, L.; Lin, W.; Ji, S.; Shen, D. Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage 2015, 108, 214–224. [Google Scholar] [CrossRef] [Green Version]
- Kleesiek, J.; Urban, G.; Hubert, A.; Schwarz, D.; Maier-Hein, K.; Bendszus, M.; Biller, A. Deep MRI brain extraction: A 3D convolutional neural network for skull stripping. Neuroimage 2016, 129, 460–469. [Google Scholar] [CrossRef]
- Pereira, S.; Pinto, A.; Alves, V.; Silva, C.A. Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. IEEE Trans. Med. Imaging 2016, 35, 1240–1251. [Google Scholar] [CrossRef]
- El Kader, I.A.; Xu, G.; Shuai, Z.; Saminu, S.; Javaid, I.; Ahmad, I.S.; Kamhi, S. Brain Tumor Detection and Classification on MR Images by a Deep Wavelet Auto-Encoder Model. Diagnostics 2021, 11, 1589. [Google Scholar] [CrossRef] [PubMed]
- Latif, G.; Ben Brahim, G.; Iskandar, D.N.F.A.; Bashar, A.; Alghazo, J. Glioma Tumors’ Classification Using Deep-Neural-Network-Based Features with SVM Classifier. Diagnostics 2022, 12, 1018. [Google Scholar] [CrossRef] [PubMed]
- Xie, Y.; Zaccagna, F.; Rundo, L.; Testa, C.; Agati, R.; Lodi, R.; Manners, D.N.; Tonon, C. Convolutional Neural Network Techniques for Brain Tumor Classification (from 2015 to 2022): Review, Challenges, and Future Perspectives. Diagnostics 2022, 12, 1850. [Google Scholar] [CrossRef] [PubMed]
- VanBerlo, B.; Smith, D.; Tschirhart, J.; VanBerlo, B.; Wu, D.; Ford, A.; McCauley, J.; Wu, B.; Chaudhary, R.; Dave, C.; et al. Enhancing Annotation Efficiency with Machine Learning: Automated Partitioning of a Lung Ultrasound Dataset by View. Diagnostics 2022, 12, 2351. [Google Scholar] [CrossRef]
- Wu, G.; Kim, M.; Wang, Q.; Munsell, B.C.; Shen, D. Scalable High-Performance Image Registration Framework by Unsupervised Deep Feature Representations Learning. IEEE Trans. Biomed. Eng. 2015, 63, 1505–1516. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Suk, H.-I.; Lee, S.-W.; Shen, D. Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. Neuroimage 2014, 101, 569–582. [Google Scholar] [CrossRef] [Green Version]
- Shin, H.-C.; Roberts, K.; Lu, L.; Demner-Fushman, D.; Yao, J.; Summers, R.M. Learning to Read Chest X-rays: Recurrent Neural Cascade Model for Automated Image Annotation. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 2497–2506. [Google Scholar] [CrossRef] [Green Version]
- van Tulder, G.; de Bruijne, M. Combining Generative and Discriminative Representation Learning for Lung CT Analysis With Convolutional Restricted Boltzmann Machines. IEEE Trans. Med Imaging 2016, 35, 1262–1272. [Google Scholar] [CrossRef] [Green Version]
- Pang, X.; Zhao, Z.; Weng, Y. The Role and Impact of Deep Learning Methods in Computer-Aided Diagnosis Using Gastrointestinal Endoscopy. Diagnostics 2021, 11, 694. [Google Scholar] [CrossRef]
- Inamdar, M.A.; Raghavendra, U.; Gudigar, A.; Chakole, Y.; Hegde, A.; Menon, G.R.; Barua, P.; Palmer, E.E.; Cheong, K.H.; Chan, W.Y.; et al. A Review on Computer Aided Diagnosis of Acute Brain Stroke. Sensors 2021, 21, 8507. [Google Scholar] [CrossRef]
- Suk, H.-I.; Initiative, T.A.D.N.; Lee, S.-W.; Shen, D. Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Anat. Embryol. 2015, 220, 841–859. [Google Scholar] [CrossRef]
- Elsharkawy, M.; Sharafeldeen, A.; Soliman, A.; Khalifa, F.; Ghazal, M.; El-Daydamony, E.; Atwan, A.; Sandhu, H.S.; El-Baz, A. A Novel Computer-Aided Diagnostic System for Early Detection of Diabetic Retinopathy Using 3D-OCT Higher-Order Spatial Appearance Model. Diagnostics 2022, 12, 461. [Google Scholar] [CrossRef] [PubMed]
- Suk, H.-I.; Wee, C.-Y.; Lee, S.-W.; Shen, D. State-space model with deep learning for functional dynamics estimation in resting-state fMRI. NeuroImage 2016, 129, 292–307. [Google Scholar] [CrossRef] [Green Version]
- Oza, P.; Sharma, P.; Patel, S.; Bruno, A. A Bottom-Up Review of Image Analysis Methods for Suspicious Region Detection in Mammograms. J. Imaging 2021, 7, 190. [Google Scholar] [CrossRef] [PubMed]
- Dou, Q.; Chen, H.; Yu, L.; Zhao, L.; Qin, J.; Wang, D.; Mok, V.C.; Shi, L.; Heng, P.-A. Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks. IEEE Trans. Med. Imaging 2016, 35, 1182–1195. [Google Scholar] [CrossRef] [PubMed]
- Chesebro, A.G.; Amarante, E.; Lao, P.J.; Meier, I.B.; Mayeux, R.; Brickman, A.M. Automated detection of cerebral microbleeds on T2*-weighted MRI. Sci. Rep. 2021, 11, 4004. [Google Scholar] [CrossRef] [PubMed]
- Li, T.; Zou, Y.; Bai, P.; Li, S.; Wang, H.; Chen, X.; Meng, Z.; Kang, Z.; Zhou, G. Detecting cerebral microbleeds via deep learning with features enhancement by reusing ground truth. Comput. Methods Programs Biomed. 2021, 204, 106051. [Google Scholar] [CrossRef] [PubMed]
- Tijssen, M.P.M.; Hofman, P.A.M.; Stadler, A.A.R.; Van Zwam, W.; De Graaf, R.; Van Oostenbrugge, R.J.; Klotz, E.; Wildberger, J.E.; Postma, A.A. The role of dual energy CT in differentiating between brain haemorrhage and contrast medium after mechanical revascularisation in acute ischaemic stroke. Eur. Radiol. 2014, 24, 834–840. [Google Scholar] [CrossRef] [PubMed]
- Costine-Bartell, B.A.; McGuone, D.; Price, G.; Crawford, E.; Keeley, K.L.; Munoz-Pareja, J.; Dodge, C.P.; Staley, K.; Duhaime, A.C. Development of a model of hemispheric hypodensity (“big black brain”). J. Neurotrauma 2019, 36, 815–833. [Google Scholar] [CrossRef] [Green Version]
- Dekeyzer, S.; Reich, A.; Othman, A.E.; Wiesmann, M.; Nikoubashman, O. Infarct fogging on immediate postinterventional CT—a not infrequent occurrence. Neuroradiology 2017, 59, 853–859. [Google Scholar] [CrossRef]
- Borggrefe, J.; Gebest, M.P.; Hauger, M.; Ruess, D.; Mpotsaris, A.; Kabbasch, C.; Pennig, L.; Laukamp, K.R.; Goertz, L.; Kroeger, J.R.; et al. Differentiation of Intracerebral Tumor Entities with Quantitative Contrast Attenuation and Iodine Mapping in Dual-Layer Computed Tomography. Diagnostics 2022, 12, 2494. [Google Scholar] [CrossRef]
- Yingying, L.; Zhe, Z.; Xiaochen, W.; Xiaomei, L.; Nan, J.; Shengjun, S. Dual-layer detector spectral CT—a new supplementary method for preoperative evaluation of glioma. Eur. J. Radiol. 2021, 138, 109649. [Google Scholar] [CrossRef] [PubMed]
- Su, C.; Liu, C.; Zhao, L.; Jiang, J.; Zhang, J.; Li, S.; Zhu, W.; Wang, J. Amide Proton Transfer Imaging Allows Detection of Glioma Grades and Tumor Proliferation: Comparison with Ki-67 Expression and Proton MR Spectroscopy Imaging. Am. J. Neuroradiol. 2017, 38, 1702–1709. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Paech, D.; Windschuh, J.; Oberhollenzer, J.; Dreher, C.; Sahm, F.; Meissner, J.-E.; Goerke, S.; Schuenke, P.; Zaiss, M.; Regnery, S.; et al. Assessing the predictability of IDH mutation and MGMT methylation status in glioma patients using relaxation-compensated multipool CEST MRI at 7.0 T. Neuro-Oncology 2018, 20, 1661–1671. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Togao, O.; Yoshiura, T.; Keupp, J.; Hiwatashi, A.; Yamashita, K.; Kikuchi, K.; Suzuki, Y.; Suzuki, S.O.; Iwaki, T.; Hata, N.; et al. Amide proton transfer imaging of adult diffuse gliomas: Correlation with histopathological grades. Neuro-Oncology 2014, 16, 441–448. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Cha, S. Neuroimaging in neuro-oncology. Neurotherapeutics 2009, 6, 465–477. [Google Scholar] [CrossRef]
- Al-Okaili, R.N.; Krejza, J.; Woo, J.H.; Wolf, R.L.; O’Rourke, D.M.; Judy, K.D.; Poptani, H.; Melhem, E.R. Intraaxial brain masses: MR imaging–based diagnostic strategy—initial experience. Radiology 2007, 243, 539–550. [Google Scholar] [CrossRef]
- Wang, X.; Peng, Y.; Lu, L.; Lu, Z.; Bagheri, M.; Summers, R.M. ChestX-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 2097–2106. [Google Scholar]
- Poplin, R.; Varadarajan, A.V.; Blumer, K.; Liu, Y.; McConnell, M.V.; Corrado, G.S.; Peng, L.; Webster, D.R. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat. Biomed. Eng. 2018, 2, 158–164. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chilamkurthy, S.; Ghosh, R.; Tanamala, S.; Biviji, M.; Campeau, N.G.; Venugopal, V.K.; Mahajan, V.; Rao, P.; Warier, P. Deep learning algorithms for detection of critical findings in head CT scans: A retrospective study. Lancet 2018, 392, 2388–2396. [Google Scholar] [CrossRef]
Neuroradiology/Radiology Specialists | n = 9 | % |
Accurate diagnosis | 6 | 66.7% |
Performed characterization without a differential diagnosis | 1 | 11.1% |
Performed differential diagnosis including acute ischemic stroke | 2 | 22.2% |
MDs in the Radiology Residency Training Program | n = 11 | % |
No changes were observed | 5 | 45.5% |
Performed differential diagnosis excluding acute ischemic stroke | 1 | 9.1% |
Inadequate differential diagnosis | 3 | 27.3% |
Observed changes without characterization | 1 | 9.1% |
Inadequate characterization | 1 | 9.1% |
Neuroradiology/Radiology Specialists, and MDs in the Radiology Residency Training Program | n = 20 | % |
---|---|---|
Accurate diagnosis | 19 | 95.0% |
Incorrect diagnosis | 1 | 5.0% |
Yes, I Am | To Some Extent, I Am | I Have No Stance | To Some Extent, I’m Not | I’m Not |
---|---|---|---|---|
10 (50%) | 7 (35%) | / | 1 (5%) | 2 (10%) |
It Can | To Some Extent It Can | I Have No Stance | To Some Extent It Cannot | It Cannot |
---|---|---|---|---|
12 (60%) | 7 (35%) | / | / | 1 (5%) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Simović, A.; Lutovac-Banduka, M.; Lekić, S.; Kuleto, V. Smart Visualization of Medical Images as a Tool in the Function of Education in Neuroradiology. Diagnostics 2022, 12, 3208. https://doi.org/10.3390/diagnostics12123208
Simović A, Lutovac-Banduka M, Lekić S, Kuleto V. Smart Visualization of Medical Images as a Tool in the Function of Education in Neuroradiology. Diagnostics. 2022; 12(12):3208. https://doi.org/10.3390/diagnostics12123208
Chicago/Turabian StyleSimović, Aleksandar, Maja Lutovac-Banduka, Snežana Lekić, and Valentin Kuleto. 2022. "Smart Visualization of Medical Images as a Tool in the Function of Education in Neuroradiology" Diagnostics 12, no. 12: 3208. https://doi.org/10.3390/diagnostics12123208