Separating Surface Reflectance from Volume Reflectance in Medical Hyperspectral Imaging
Abstract
:1. Introduction
- The refractive index difference between sample and air causes specular reflectance at the tissue–air interface, i.e., reflectance from the surface.
- Light entering the tissue is scattered randomly multiple times. Although most of the scattered light will be absorbed, a fraction manages to escape from the surface. This fraction carries distinct spectral signatures and has been inside of the tissue, i.e., reflectance from the volume.
2. Materials and Methods
2.1. General Approach to Separate Surface and Volume Reflectance
2.2. Approach: Separating Surface and Volume Reflectance
2.3. Experimental Setup
2.4. Experiments
2.5. Phantoms
2.6. Excised Human Breast Tissue
2.7. Evaluation Performance
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
References
- Gowen, A.A.; O’Donnell, C.P.; Cullen, P.J.; Downey, G.; Frias, J.M. Hyperspectral imaging–an emerging process analytical tool for food quality and safety control. Trends Food Sci. Technol. 2007, 18, 590–598. [Google Scholar] [CrossRef]
- Edelman, G.J.; Gaston, E.; van Leeuwen, T.G.; Cullen, P.; Aalders, M.C. Hyperspectral imaging for non-contact analysis of forensic traces. Forensic Sci. Int. 2012, 223, 28–39. [Google Scholar] [CrossRef]
- Li, Q.; He, X.; Wang, Y.; Liu, H.; Xu, D.; Guo, F. Review of spectral imaging technology in biomedical engineering: Achievements and challenges. J. Biomed. Opt. 2013, 18, 100901. [Google Scholar] [CrossRef] [PubMed]
- Lu, G.; Fei, B. Medical hyperspectral imaging: A review. J. Biomed. Opt. 2014, 19, 010901. [Google Scholar] [CrossRef]
- Adam, E.; Mutanga, O.; Rugege, D. Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: A review. Wetl. Ecol. Manag. 2010, 18, 281–296. [Google Scholar] [CrossRef]
- Van der Meer, F.D.; van der Werff, H.M.; van Ruitenbeek, F.J.; Hecker, C.A.; Bakker, W.H.; Noomen, M.F.; van der Meijde, M.; Carranza, E.J.M.; de Smeth, J.B.; Woldai, T. Multi-and hyperspectral geologic remote sensing: A review. Int. J. Appl. Earth Obs. Geoinf. 2012, 14, 112–128. [Google Scholar] [CrossRef]
- Dale, L.M.; Thewis, A.; Boudry, C.; Rotar, I.; Dardenne, P.; Baeten, V.; Pierna, J.A.F. Hyperspectral imaging applications in agriculture and agro-food product quality and safety control: A review. Appl. Spectrosc. Rev. 2013, 48, 142–159. [Google Scholar] [CrossRef]
- Mahesh, S.; Jayas, D.; Paliwal, J.; White, N. Hyperspectral imaging to classify and monitor quality of agricultural materials. J. Stored Prod. Res. 2015, 61, 17–26. [Google Scholar] [CrossRef]
- Sun, D.W. Hyperspectral Imaging for Food Quality Analysis and Control; Elsevier: Amsterdam, The Netherlands, 2010. [Google Scholar]
- Pu, Y.Y.; Feng, Y.Z.; Sun, D.W. Recent progress of hyperspectral imaging on quality and safety inspection of fruits and vegetables: A review. Compr. Rev. Food Sci. Food Saf. 2015, 14, 176–188. [Google Scholar] [CrossRef]
- Feng, Y.Z.; Sun, D.W. Application of hyperspectral imaging in food safety inspection and control: A review. Crit. Rev. Food Sci. Nutr. 2012, 52, 1039–1058. [Google Scholar] [CrossRef]
- Schuler, R.L.; Kish, P.E.; Plese, C.A. Preliminary observations on the ability of hyperspectral imaging to provide detection and visualization of bloodstain patterns on black fabrics. J. Forensic Sci. 2012, 57, 1562–1569. [Google Scholar] [CrossRef]
- Liang, H. Advances in multispectral and hyperspectral imaging for archaeology and art conservation. Appl. Phys. A 2012, 106, 309–323. [Google Scholar] [CrossRef]
- Doneus, M.; Verhoeven, G.; Atzberger, C.; Wess, M.; Ruš, M. New ways to extract archaeological information from hyperspectral pixels. J. Archaeol. Sci. 2014, 52, 84–96. [Google Scholar] [CrossRef]
- Yuen, P.W.; Richardson, M. An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition. Imaging Sci. J. 2010, 58, 241–253. [Google Scholar] [CrossRef]
- Briottet, X.; Boucher, Y.; Dimmeler, A.; Malaplate, A.; Cini, A.; Diani, M.; Bekman, H.; Schwering, P.; Skauli, T.; Kasen, I.; et al. Military applications of hyperspectral imagery. In Proceedings of the Targets and Backgrounds XII: Characterization and Representation, Orlando, FL, USA, 18–20 April 2006; SPIE: Bellingham, WA, USA, 2006; Volume 6239, pp. 82–89. [Google Scholar]
- Brown, A.J.; Walter, M.R.; Cudahy, T. Hyperspectral imaging spectroscopy of a Mars analogue environment at the North Pole Dome, Pilbara Craton, Western Australia. Aust. J. Earth Sci. 2005, 52, 353–364. [Google Scholar] [CrossRef]
- Stuffler, T.; Förster, K.; Hofer, S.; Leipold, M.; Sang, B.; Kaufmann, H.; Penné, B.; Mueller, A.; Chlebek, C. Hyperspectral imaging—An advanced instrument concept for the EnMAP mission (Environmental Mapping and Analysis Programme). Acta Astronaut. 2009, 65, 1107–1112. [Google Scholar] [CrossRef]
- Schultz, R.A.; Nielsen, T.; Zavaleta, J.R.; Ruch, R.; Wyatt, R.; Garner, H.R. Hyperspectral imaging: A novel approach for microscopic analysis. Cytometry 2001, 43, 239–247. [Google Scholar] [CrossRef] [PubMed]
- Akbari, H.; Kosugi, Y.; Kojima, K.; Tanaka, N. Blood vessel detection and artery-vein differentiation using hyperspectral imaging. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; pp. 1461–1464. [Google Scholar]
- Akbari, H.; Kosugi, Y.; Kojima, K.; Tanaka, N. Detection and analysis of the intestinal ischemia using visible and invisible hyperspectral imaging. IEEE Trans. Biomed. Eng. 2010, 57, 2011–2017. [Google Scholar] [CrossRef] [PubMed]
- Sersa, G.; Simoncic, U.; Milanic, M. Imaging perfusion changes in oncological clinical applications by hyperspectral imaging: A literature review. Radiol. Oncol. 2022, 56, 420–429. [Google Scholar]
- Hren, R.; Stergar, J.; Simončič, U.; Serša, G.; Milanič, M. Assessing Perfusion Changes in Clinical Oncology Applications Using Hyperspectral Imaging. In Proceedings of the European Medical and Biological Engineering Conference, Portorož, Slovenia, 9–13 June 2024; Springer: Cham, Swizerland, 2024; pp. 122–129. [Google Scholar]
- Khoobehi, B.; Beach, J.M.; Kawano, H. Hyperspectral imaging for measurement of oxygen saturation in the optic nerve head. Investig. Ophthalmol. Vis. Sci. 2004, 45, 1464–1472. [Google Scholar] [CrossRef]
- Mordant, D.; Al-Abboud, I.; Muyo, G.; Gorman, A.; Harvey, A.; McNaught, A. Oxygen saturation measurements of the retinal vasculature in treated asymmetrical primary open-angle glaucoma using hyperspectral imaging. Eye 2014, 28, 1190–1200. [Google Scholar] [CrossRef] [PubMed]
- Johnson, W.R.; Wilson, D.W.; Fink, W.; Humayun, M.; Bearman, G. Snapshot hyperspectral imaging in ophthalmology. J. Biomed. Opt. 2007, 12, 014036. [Google Scholar] [CrossRef]
- Kho, E.; de Boer, L.L.; van de Vijver, K.K.; van Duijnhoven, F.; Vrancken Peeters, M.J.T.; Sterenborg, H.J.; Ruers, T.J. Hyperspectral imaging for resection margin assessment during cancer surgery. Clin. Cancer Res. 2019, 25, 3572–3580. [Google Scholar] [CrossRef]
- Kho, E.; Dashtbozorg, B.; de Boer, L.L.; van de Vijver, K.K.; Sterenborg, H.J.; Ruers, T.J. Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information. Biomed. Opt. Express 2019, 10, 4496–4515. [Google Scholar] [CrossRef] [PubMed]
- Kho, E.; de Boer, L.L.; Post, A.L.; Van de Vijver, K.K.; Jóźwiak, K.; Sterenborg, H.J.; Ruers, T.J. Imaging depth variations in hyperspectral imaging: Development of a method to detect tumor up to the required tumor-free margin width. J. Biophotonics 2019, 12, e201900086. [Google Scholar] [CrossRef]
- Baltussen, E.J.; Kok, E.N.; Brouwer de Koning, S.G.; Sanders, J.; Aalbers, A.G.; Kok, N.F.; Beets, G.L.; Flohil, C.C.; Bruin, S.C.; Kuhlmann, K.F.; et al. Hyperspectral imaging for tissue classification, a way toward smart laparoscopic colorectal surgery. J. Biomed. Opt. 2019, 24, 016002. [Google Scholar] [CrossRef]
- Jong, L.J.S.; de Kruif, N.; Geldof, F.; Veluponnar, D.; Sanders, J.; Peeters, M.J.T.V.; van Duijnhoven, F.; Sterenborg, H.J.; Dashtbozorg, B.; Ruers, T.J. Discriminating healthy from tumor tissue in breast lumpectomy specimens using deep learning-based hyperspectral imaging. Biomed. Opt. Express 2022, 13, 2581–2604. [Google Scholar] [CrossRef]
- Jong, L.J.S.; Post, A.L.; Veluponnar, D.; Geldof, F.; Sterenborg, H.J.; Ruers, T.J.; Dashtbozorg, B. Tissue Classification of Breast Cancer by Hyperspectral Unmixing. Cancers 2023, 15, 2679. [Google Scholar] [CrossRef]
- Witteveen, M.; Sterenborg, H.J.; van Leeuwen, T.G.; Aalders, M.C.; Ruers, T.J.; Post, A.L. Comparison of preprocessing techniques to reduce nontissue-related variations in hyperspectral reflectance imaging. J. Biomed. Opt. 2022, 27, 106003. [Google Scholar] [CrossRef]
- Li, B.; Beveridge, P.; O’Hare, W.T.; Islam, M. The age estimation of blood stains up to 30 days old using visible wavelength hyperspectral image analysis and linear discriminant analysis. Sci. Justice 2013, 53, 270–277. [Google Scholar] [CrossRef]
- Collins, T.; Maktabi, M.; Barberio, M.; Bencteux, V.; Jansen-Winkeln, B.; Chalopin, C.; Marescaux, J.; Hostettler, A.; Diana, M.; Gockel, I. Automatic recognition of colon and esophagogastric cancer with machine learning and hyperspectral imaging. Diagnostics 2021, 11, 1810. [Google Scholar] [CrossRef]
- Maktabi, M.; Köhler, H.; Ivanova, M.; Jansen-Winkeln, B.; Takoh, J.; Niebisch, S.; Rabe, S.M.; Neumuth, T.; Gockel, I.; Chalopin, C. Tissue classification of oncologic esophageal resectates based on hyperspectral data. Int. J. Comput. Assist. Radiol. Surg. 2019, 14, 1651–1661. [Google Scholar] [CrossRef]
- Malegori, C.; Alladio, E.; Oliveri, P.; Manis, C.; Vincenti, M.; Garofano, P.; Barni, F.; Berti, A. Identification of invisible biological traces in forensic evidences by hyperspectral NIR imaging combined with chemometrics. Talanta 2020, 215, 120911. [Google Scholar] [CrossRef]
- Peñaranda, F.; Naranjo, V.; Lloyd, G.R.; Kastl, L.; Kemper, B.; Schnekenburger, J.; Nallala, J.; Stone, N. Discrimination of skin cancer cells using Fourier transform infrared spectroscopy. Comput. Biol. Med. 2018, 100, 50–61. [Google Scholar] [CrossRef]
- Pardo, A.; Real, E.; Krishnaswamy, V.; López-Higuera, J.M.; Pogue, B.W.; Conde, O.M. Directional kernel density estimation for classification of breast tissue spectra. IEEE Trans. Med. Imaging 2016, 36, 64–73. [Google Scholar] [CrossRef]
- Welch, A.J.; van Gemert, M.J. (Eds.) Optical-Thermal Response of Laser-Irradiated Tissue; Springer: Dordrecht, The Netherlands, 2011; Volume 2. [Google Scholar]
- Flock, S.T.; Patterson, M.S.; Wilson, B.C.; Wyman, D.R. Monte Carlo modeling of light propagation in highly scattering tissues. I. Model predictions and comparison with diffusion theory. IEEE Trans. Biomed. Eng. 1989, 36, 1162–1168. [Google Scholar] [CrossRef] [PubMed]
- Cubeddu, R.; Pifferi, A.; Taroni, P.; Torricelli, A.; Valentini, G. A solid tissue phantom for photon migration studies. Phys. Med. Biol. 1997, 42, 1971. [Google Scholar] [CrossRef]
- Kho, E.; Dashtbozorg, B.; Sanders, J.; Vrancken Peeters, M.J.T.; van Duijnhoven, F.; Sterenborg, H.J.; Ruers, T.J. Feasibility of ex vivo margin assessment with hyperspectral imaging during breast-conserving surgery: From imaging tissue slices to imaging lumpectomy specimen. Appl. Sci. 2021, 11, 8881. [Google Scholar] [CrossRef]
- Keresztes, J.C.; Koshel, R.J.; Chipman, R.; Stover, J.C.; Saeys, W. A cross-polarized freeform illumination design for glare reduction in fruit quality inspection. In Proceedings of the Optical Systems Design 2015: Illumination Optics IV, Jena, Germany, 7–8 September 2015; SPIE: Bellingham, WA, USA, 2015; Volume 9629, pp. 18–32. [Google Scholar]
- Nguyen-Do-Trong, N.; Keresztes, J.C.; De Ketelaere, B.; Saeys, W. Cross-polarised VNIR hyperspectral reflectance imaging system for agrifood products. Biosyst. Eng. 2016, 151, 152–157. [Google Scholar] [CrossRef]
- Rinnan, Å.; Van Den Berg, F.; Engelsen, S.B. Review of the most common pre-processing techniques for near-infrared spectra. Trac Trends Anal. Chem. 2009, 28, 1201–1222. [Google Scholar] [CrossRef]
- Barnes, R.; Dhanoa, M.S.; Lister, S.J. Standard normal variate transformation and de-trending of near-infrared diffuse reflectance spectra. Appl. Spectrosc. 1989, 43, 772–777. [Google Scholar] [CrossRef]
- Keresztes, J.C.; Goodarzi, M.; Saeys, W. Real-time pixel based early apple bruise detection using short wave infrared hyperspectral imaging in combination with calibration and glare correction techniques. Food Control 2016, 66, 215–226. [Google Scholar] [CrossRef]
- Claridge, E.; Hidović-Rowe, D. Model based inversion for deriving maps of histological parameters characteristic of cancer from ex-vivo multispectral images of the colon. IEEE Trans. Med. Imaging 2013, 33, 822–835. [Google Scholar] [CrossRef]
- Lai, M.; van der Stel, S.D.; Groen, H.C.; van Gastel, M.; Kuhlmann, K.F.; Ruers, T.J.; Hendriks, B.H. Imaging PPG for in vivo human tissue perfusion assessment during surgery. J. Imaging 2022, 8, 94. [Google Scholar] [CrossRef] [PubMed]
- Meleppat, R.K.; Ronning, K.E.; Karlen, S.J.; Kothandath, K.K.; Burns, M.E.; Pugh, E.N.; Zawadzki, R.J. In situ morphologic and spectral characterization of retinal pigment epithelium organelles in mice using multicolor confocal fluorescence imaging. Investig. Ophthalmol. Vis. Sci. 2020, 61, 1. [Google Scholar] [CrossRef] [PubMed]
- Ami, T.B.; Tong, Y.; Bhuiyan, A.; Huisingh, C.; Ablonczy, Z.; Ach, T.; Curcio, C.A.; Smith, R.T. Spatial and spectral characterization of human retinal pigment epithelium fluorophore families by ex vivo hyperspectral autofluorescence imaging. Transl. Vis. Sci. Technol. 2016, 5, 5. [Google Scholar]
- Pascolini, D.; Mariotti, S.P. Global estimates of visual impairment: 2010. Br. J. Ophthalmol. 2012, 96, 614–618. [Google Scholar] [CrossRef] [PubMed]
- Wong, W.L.; Su, X.; Li, X.; Cheung, C.M.G.; Klein, R.; Cheng, C.Y.; Wong, T.Y. Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: A systematic review and meta-analysis. Lancet Glob. Health 2014, 2, e106–e116. [Google Scholar] [CrossRef]
- Halicek, M.; Fabelo, H.; Ortega, S.; Callico, G.M.; Fei, B. In-vivo and ex-vivo tissue analysis through hyperspectral imaging techniques: Revealing the invisible features of cancer. Cancers 2019, 11, 756. [Google Scholar] [CrossRef]
- Jong, L.J.S.; Appelman, J.G.; Sterenborg, H.J.; Ruers, T.J.; Dashtbozorg, B. Spatial and Spectral Reconstruction of Breast Lumpectomy Hyperspectral Images. Sensors 2024, 24, 1567. [Google Scholar] [CrossRef] [PubMed]
- Stergar, J.; Hren, R.; Milanič, M. Design and validation of a custom-made laboratory hyperspectral imaging system for biomedical applications using a broadband LED light source. Sensors 2022, 22, 6274. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Jong, L.-J.S.; Post, A.L.; Geldof, F.; Dashtbozorg, B.; Ruers, T.J.M.; Sterenborg, H.J.C.M. Separating Surface Reflectance from Volume Reflectance in Medical Hyperspectral Imaging. Diagnostics 2024, 14, 1812. https://doi.org/10.3390/diagnostics14161812
Jong L-JS, Post AL, Geldof F, Dashtbozorg B, Ruers TJM, Sterenborg HJCM. Separating Surface Reflectance from Volume Reflectance in Medical Hyperspectral Imaging. Diagnostics. 2024; 14(16):1812. https://doi.org/10.3390/diagnostics14161812
Chicago/Turabian StyleJong, Lynn-Jade S., Anouk L. Post, Freija Geldof, Behdad Dashtbozorg, Theo J. M. Ruers, and Henricus J. C. M. Sterenborg. 2024. "Separating Surface Reflectance from Volume Reflectance in Medical Hyperspectral Imaging" Diagnostics 14, no. 16: 1812. https://doi.org/10.3390/diagnostics14161812