Abstract
In tumor surgery, the edges of the tumor can be visually observed using a fluorescent contrast agent and a fluorescent imaging device. By distinguishing it from normal tissues and blood vessels, it is possible to objectively judge the extent of resection while visually observing it during surgery, and it guarantees safe tumor resection based on more information. However, the main problem of such an imaging device is the specular reflection phenomenon. If specular reflection overlaps with important lesion locations, they are a major factor leading to diagnostic errors. Here, we propose a method to reduce specular reflection that occurs during tumor diagnosis using a linear polarization filter and fluorescent contrast agent. To confirm the effect of removing specular reflection, a self-made fluorescein sodium vial phantom was used, and the reliability of the results was increased using a large animal (pig) test. As a result of the experiment, it was possible to obtain an image in which specular reflection was removed by controlling the rotation angle of the filter by 90° and 270°, and the same results were confirmed in the phantom experiment and the animal experiment.
1. Introduction
The lesion classification and observation method using fluorescein (FL) sodium (yellow dye) is widely used in ophthalmology, dentistry, and oncology surgery fields. It is used in ophthalmology to identify inflammation of the eyeball. In dentistry, it is widely used to observe periodontal disease and inflammation. In the field of oncology surgery, it is widely used to distinguish the removal status of tumors or the location of tumors [,,]. During oncology surgery, the extent of resection of the tumor must be determined before surgery. It is crucial to remove the tumor to the maximum extent possible and minimize the damage to surrounding normal tissues and blood vessels. This is a method of increasing the 5-year survival rate of patients and preventing recurrence []. Therefore, the main aim of surgical operation is to excise the tumor safely and completely. However, the tumor is mixed with blood vessels and has the same color and shape. Therefore, it is difficult to distinguish and observe the tumor margin with the naked eye. This hinders the complete resection of the tumor by separating the tumor from the vascular boundary during surgical operation [,]. Therefore, to overcome these limitations, a fluorescence imaging device is used [,,,,]. This device can distinguish between tumors and blood vessels using a fluorescence contrast agent. This method enables one to visually check the boundary between the tumor and blood vessels. In addition, it can objectively determine the extent of resection during a surgical operation. Therefore, the tumor can be resected as safely as possible based on more information [,]. Therefore, there is a method for discriminating tumors and normal tissues through various fluorescence staining techniques using an imaging device. Representatively, the use of rhodamine fluorescence allows the selective monitoring of exogenous and endogenous lysosomal ONPP- in vivo using fluorescence emission properties at 733 nm []. BODIPY series has attracted considerable attention due to its excellent photophysical properties such as large molar extinction coefficient, high-fluorescence quantum yield, adequate redox potential, and good safety. In particular, it is being used as a fluorescent sensor, showing high sensitivity and selectivity to Hg (II) ions [,]. In addition, various synthetic methods available for the preparation of BODIPY dyes allow the incorporation of modifiable/efficient fluorescent groups. Various techniques have been developed to prepare novel fluorescent dyes due to their excellent electronic and spectral properties []. The use of the fluorescent material utilizes the secretion of specific proteins or peptides from tumor cells into the bloodstream. When proteins made specifically in tumor cells are degraded by various enzymes and released into the bloodstream, we can determine the pattern of proteins or peptides secreted through the blood. When a protein is analyzed by liquid chromatography/mass spectrometry (LC-MS), the relative amount of the target protein can be known, and through this, a specific pattern in cancer that is different from normal can be identified [].
However, the fluorescence imaging apparatus has a disadvantage in that specular reflection occurs in the captured image due to the light emitting diode (LED) light used in such devices. The specular reflection by the LED overlaps with the lesion location or obstructs the observation field. Therefore, the occurrence of specular reflection prevents accurate lesion observation. This is the main cause leading to diagnostic errors []. To address these problems, research methods for specular reflection suppression have been reported, but research cases are still lacking [,].
In the medical field, most approaches have attempted to minimize specular reflection by adjusting the direction angle of the camera. There are two methods of capturing the polarization effect of the camera: a method of irradiating the focal point of the LED in various directions and a method of controlling the focal length of the LED beam []; however, adjusting the direction angle and focal length of the LED beam is not easy []. In addition, the best tool for specular reflection suppression is a method of detecting specular reflection. These specular reflections are generated in the process of spatial transformation with red–green–blue (RGB) color functions for the brightness and color of the camera []. The detected specular reflection removes the reflection region through deconvolution analysis in the wavelength band. The color image lost due to specular reflection removal uses a separate function to restore the lost color []. This reflected wave removal process requires extensive data, calculations, and complex mathematical operations []. The method of collecting frames through continuous shooting requires the reference image to be trained in advance []. This method compares the interval between the actual shooting frames and the reference training image interval and calculates the sum and difference. Therefore, by removing the image for the calculated difference, the calculated value can be used to remove the reflected light []. However, this method requires a complex collection process for lesion data, normal tissue data, and data for learning reference images [].
Another method is to use a polarizing filter in the camera. In addition, there is a method that uses a sensor to automatically detect changes in the image, and it detects only the RGB values of the image [,,,]. However, the method of applying the polarizing filter reduces the shooting radius owing to material loss and provides a dark image. The RGB value detection method does not consider image loss and distortion due to material loss in the filter. Methods for suppressing specular reflection of photographed data require research to overcome the complex process of data collection and mathematical operation [,,,]. Another method of reducing specular reflection is a gradient image transmission method. In this way, the captured image may be set to have high pixels and specular reflection may be set to have low pixels. Therefore, the above method performs gradient mapping through pixel optimization []. A similar mapping method collects the high-pixel data for images and low-pixel data for specular reflection and subsequently learns these data [,]. This method induces gradient mapping such that only high pixels are selected. The selected pixels provide images with effectively reduced specular reflection [,]. This method requires complex analysis and algorithm design [].
This paper proposes a method for removing specular reflection in a fluorescence imaging device. To remove specular reflection, the linear polarization filter controls vertical and horizontal polarization through rotation. The polarized wave is adjusted to horizontal polarization through rotation control, and the rotation angle of the filter for horizontal polarization control becomes 90°. Therefore, the angle of vertical polarization and horizontal polarization feature a 90° difference.
2. Analysis of Fluorescence Emission and Specular Reflection Occurrence
As shown in Figure 1, the fluorescence imaging device acquires images through injection of a fluorescence contrast agent, irradiation with an external light source, and imaging. At this time, blood vessels or tumors are classified by color and observed through images. The purpose of using a fluorescence contrast agent is to observe status of blood vessel flow, remove the tumor through fluorescent staining, and follow up on the state of the tissue remaining after tumor resection [,,].
Figure 1.
Fluorescence imaging module using fluorescence contrast agent.
Fluorescence imaging devices are classified into fixed, pen, and handheld types, as shown in Table 1 [,]. These instruments are used to observe fluorescence images during surgery.
Table 1.
Types of fluorescence imaging diagnostics.
As shown in Figure 2, the device’s structural features include a built-in LED light to brightly illuminate a dark field of view around the imaging camera []. The observation method using a fluorescence contrast agent secures the field of view to effectively observe the tissue from the operating microscope, while the LED light is brightly lit on the tumor [,].
Figure 2.
Camera structure of fluorescence imaging device.
However, specular reflection in observational images is attributed to the influence of tissue density and mucosal moisture status. As shown in Figure 3, for the light () irradiated from the LED, according to Snell’s law, a part of the light () has a refraction angle () that is absorbed by the tissue, and the remaining light is reflected (). Therefore, η1 is equal to ( = ( = )) []. As a result, as in Equation (1), a difference between the incident angle () and reflection angle () occurs, resulting in specular reflection.
Figure 3.
Illustration of Snell’s law.
At this time, the reflected light () is generated in the form of diffuse reflection (), as shown in Figure 4. Depending on the angle of the irradiated light, it is reflected in various directions, and the reflected light is captured by the camera [,,].
Figure 4.
Diffused reflection resulting from the varying reflected specular ().
Thus, the specular reflection angle is changed from 0 to 180°, and it is called diffuse reflection () []. The specular reflection () is given by Equation (2). Accordingly, includes and , where , , and are the wavelength of diffuse reflection and the incident and reflection angles, respectively.
At this time, the intensity (Iηr) of the specular reflection () is strong, and the intensity (Iηdif) of the diffuse reflection () is weak, and the light spreads from 0 to 180°, as shown in Figure 5.
Figure 5.
Distribution of light intensity according to the angle of light generation.
Therefore, as shown in Figure 6, images acquired based on specular reflection generate white light during endoscopy, tumor observation, and blood circulation []. If such specular reflection occurs in an important lesion area of the image, it may interfere with the observation field and cause a diagnosis error [].
Figure 6.
Comparison of specular reflection between indocyanine green (ICG) and fluorescein (FL) sodium in fluorescence imaging.
Therefore, a filter is used to remove such specular reflection. There are several types of filters used, such as ultraviolet (UV) filters, skylight filters, polarizer (PL) filters, and neutral density (ND) filters []. UV and skylight filters are mainly used to reduce specular reflection caused by UV rays []. The PL filter is used to reduce diffuse reflection, and the ND filter is used to reduce specular reflection by uniformly reducing the amount of light to balance the color image in its entirety []. However, these filters are mainly suitable for shooting in bright natural environments. The PL filter is widely used because it shows excellent performance in terms of reducing light reflection []. However, PL filters have the disadvantage of darkening the background; this was first studied in phantom experiments and published in subsequent papers []. Therefore, if a PL filter is used in a state that only relies on LED light in a dark human body, light reflection is effectively reduced. However, the method of using the PL filter has limitations in securing the lesion field of view owing to the dark image []. Therefore, research to effectively remove specular reflection in a dark environment and observe the lesion in a bright field of view is necessary.
3. Elimination of Specular Reflections
The occurrence of specular reflections displayed in yellow in the microscopic image interferes with the accurate identification of surgical sites and lesions and is a factor limiting accurate surgery. To solve this problem, after analyzing the characteristics of polarization and Malus’ law for specular reflection simultaneously, the polarization direction of the incident light is controlled to remove the light previously observed as specular reflection, as shown in Figure 7, to obtain a clear image [].
Figure 7.
Images before and after the removal of specular reflection during colonoscopy.
After the camera is photographed the region of interest, the energy corresponding to the image includes vertical polarization (Vin) and horizontal polarization (Hin) [,]. Accordingly, the linearly polarized light () direction (z) is given by Equations (3) and (4) [].
If an image is acquired from a camera in an environment without a polarization filter, the images corresponding to the vertical (Vin) and horizontal (Hin) polarizations are incident on the camera, as shown in Figure 8 [,,]. Thus, the linearly polarized light () direction (z) corresponding to the imaging of the vertical polarization (Vin) and horizontal polarization (Hin) is expressed by Equation (5) [].
Figure 8.
Specular reflection due to diffuse reflection after incidence with vertical polarization and vertical polarization camera.
Incident waves to Vin and Hin through camera shooting have the property of diffuse reflection. At this time, the property of diffuse reflection includes the size of A2, as shown in Equation (6).
where is the angular frequency, that is, (). Accordingly, f is termed the frequency. Thus, (c is the velocity of light: 3 × 108 (m/s)) []. To suppress the diffuse reflection characteristics, the vertical polarization (Vin) must be removed. Therefore, in the method for removing the vertical polarization wave (Vin), the rotation angle should be controlled between the two types of the first filter (Filter1) and the second filter (Filter2), as shown in Figure 9. The first filter (Filter1) is fixed, and the second filter (Filter2) is rotated.
Figure 9.
Adjusting the rotation angle using the filter and placing the filter.
Thus, the filter can sufficiently remove the specular reflection. Therefore, the suppressed specular reflection () is expressed as Equation (7).
Filter1 is fixed as shown in Figure 10, and when the rotation direction angle (r1) is 0°, Vin and Hin incident on the filter have vertical polarization and horizontal polarization at P0. At this time, when Vin and Hin pass through Filter1, both Vin and Hin are changed to the horizontally polarized waves at P1. Assuming that the direction angle (r1) of Filter1 becomes 0° and the direction angle (r2) of Filter2 rotates, Vin and Hin passing through the filter are polarized as in Equations (8)–(11), affecting P3. Therefore, the specular reflection can be sufficiently removed.
Figure 10.
Specular reflection removal analysis through the adjustment of rotation angle with the polarizing filter.
Therefore, when the specular reflection intensity (Iref) is rotated, the specular reflection intensity (Iref) with respect to the direction angle (r2) of the filter is approximately 3/4 (π/4) when the phase angle (θ) decreases to 60° [].
For example, the intensity of specular reflection (Iref) is when the filter of Filter1 is 0° and the filter of Filter2 is 90°; the phase angle (θ) of the specular reflection intensity passing through the filter of Filter2 is the difference of 90° (θ = 90°).
Therefore, as shown in Table 2, the intensity of the current changes according to the rotation angle. As a result, Vin does not pass, and Hin passes. Therefore, the specular reflection intensity (IEP) for P3 is reduced by more than half compared with the specular reflection intensity (Iref) of P2, as shown in Table 3.
Table 2.
Change of current intensity according to the rotation angle.
Table 3.
Analysis of changes in the specular reflection intensity according to the rotation angle of the filter (F2).
From the table, assuming that Filter1 is fixed at 0°, Filter2 is sequentially rotated (r2) from 0 to 360°, and the specular reflection intensity decreases and increases repeatedly, as shown in the sine wave form in Figure 10. This phenomenon will continue to repeat itself. Therefore, when the rotation angle (r2) of Filter2 is 90° or 270°, the intensity of specular reflection becomes 0 mW/cm2, and a phenomenon wherein specular reflection occurs is removed. Furthermore, when the rotation angle (r2) is 0°, light (specular reflection, IEP) will pass through the second polarization filter (Filter2), as shown in Figure 11, and thus, the intensity of specular reflection will have the maximum value. Overall, the intensities for IEP and Iref are the same, and the intensities have an equilibrium relationship with each other.
Figure 11.
Changes in specular reflection intensity according to the rotation axis of the filter.
If the rotation axis (r2) of the second filter (Filter2) reaches 90°, IEP and Iref (Filter1 ≠ Filter2 = 90° difference of the filter) exhibit a cross relationship. Thus, IEP features a maximum value (IEP = 1), and Iref features a minimum value (Iref = 0). Therefore, the intensity of the specular reflection is diminished, and the image quality is increased. If the rotation angle (r2) of the filter deviates from 90° (<100°), IEP changes to the minimum value (IEP ≒ 0), and Iref changes to the maximum value (Iref ≒ 1). Finally, IEP and Iref feature the same value (IEP = Iref), and this phenomenon is repeated.
To summarize, the following is the method for maximally suppressing specular reflection: when the first filter (Filter1) is 0°, the second filter (Filter2) should be 90°. As a result, the polarized wave (p3) that has passed through Filter2 outputs only the polarized wave with reduced specular reflection (Hin = 0). The intensity of light loses its maximum value, and eventually, the intensity of the light starts to decrease gradually. When the rotation angle (r2) is 90° (270°), the intensity of the specular reflection (Iref = 0) becomes 0. If the rotation axis (r2) of the second filter (Filter2) reaches 90°, IEP and Iref (Filter1 ≠ Filter2 = 90° difference of the filter) exhibit a cross relationship. Thus, IEP features a maximum value (IEP = 1) and Iref features a minimum value (Iref = 0). Therefore, the intensity of the specular reflection is lost, and the image quality is increased. If the rotation angle (r2) of the filter deviates from 90⁰ (<100°), IEP changes to the minimum value (IEP ≒ 0), and Iref changes to the maximum value (Iref ≒ 1). Finally, IEP and Iref attain the same value (IEP = Iref), and this phenomenon is repeated.
4. Experiment Configuration
To realize the effect of removing specular reflection, this study employs two methods. The first method is an experiment using a fluorescein sodium substance vial. In this method, the specular reflection state is tested in a state in which one vial of fluorescein sodium is filled into a micro tube. The second method employs preclinical (animal testing) tests to obtain reliable results. The fluorescein sodium substance vial was manufactured in house, and the manufacturing method is introduced in Section 4.1. In addition, the preclinical trial preparation process is introduced in Section 4.2. Introducing the experimental results for specular reflection removal, Section 4.3 discusses the LED irradiation, camera shooting method, device configuration, and experimental preparation process.
4.1. Fluorescein Sodium Substance Vial Production
To obtain the results for the specular reflection removal effect, we make our own vials capable of fluorescence expression using fluorescein sodium (yellow dye). For vial fabrication, the material is prepared by mixing fluorescein sodium and normal saline, as shown in Figure 12. For 5.0 mg/mL dilution from fluorescein sodium (500 mg) and normal saline (100 mL), 0.8 mL is injected into a micro tube (1 mL) to develop a one-vial drug-based phantom that can be compared with the phantom. For the phantom experiment, five vials were prepared for easy comparative evaluation. As for the experimental method, the five vials are photographed under the condition that specular reflection occurs before the filter is applied, and the remaining five vials are observed after the filter is applied, and the specular reflection removal state is observed.
Figure 12.
Proposed manufacturing method of one-vial phantom using fluorescein sodium.
4.2. Preclinical Trial Preparation Procedure
A fluorescence contrast agent was used to obtain the experimental results for specular reflection removal images using phantom and animal experiments. The fluorescence contrast medium was fluorescein sodium, as shown in Figure 13a, and the fluorescein sodium (500 mg) reagent was prepared with the optimal concentration (5.0 mg/mL) of fluorescein sodium by dilution with normal saline (100 mL). Additionally, fluorescein sodium (500 mg/mL) was diluted with 100 mL of normal saline to ensure a dilution value of five times or more. Fluorescein sodium that satisfied the dilution produced an injection volume of 0.2–0.4 mL using a syringe. The fluorescein sodium (dilution) was injected (syringe: 0.2–0.4 mL) into the phantom, micro tube, and vein (for pre/clinical test).
Figure 13.
Phantom reagent preparation procedure (a) making for phantom (b) absorption spectrum of fluorescein sodium.
Figure 13b shows the measurement results for absorption (for emission of fluorescein sodium) spectrum of a vial phantom (see Figure 13a) using the spectrometer (Thorlabs OSA201C). From the figure, the measured result of the wavelength and absorption level were from 510 nm to 560 nm and 0.97 with an irradiate wavelength of 405 nm. This can be changed to a green color using external optical irradiation. Therefore, the yellow color was changed to a green color. The wavelength of the green color is 500 nm to 600 nm.
The experimental results obtained using vials were verified on animals for reliability testing. Large animals (pigs) were tested at the Animal center of Osong Medical Innovation Foundation (KBIO) after obtaining Animal Institutional Review Board (IRB) approval from the Animal Ethics Commission (KBIO-IACUC-2019-021). A typical male (farm) pig weighing 60 kg was used in this study. Fluorescein sodium (yellow dye) fluorescence contrast medium (concentration: 0.002 mg/kg) was injected intravenously (0.2–0.4 mL), as shown in Figure 14. Fluorescein sodium injected into a vein was combined with plasma protein, and fluorescein sodium circulated through blood vessels.
Figure 14.
Fluorescein sodium mechanism of action and emission wavelength band. (a) Fluorescence expression animal test (b) Fluorescence detection after injection. (c) The excitation and emission wavelength of fluorescein sodium.
Fluorescein sodium with an injection volume of 0.2–0.4 mL was irradiated with an external light source such as an LED or laser. Fluorescein sodium has an excitation wavelength of 405 nm and has a characteristic of emitting fluorescence with a wavelength of 510–560 nm. Therefore, when an external light source of 405 nm such as LED is irradiated to the fluorescein sodium, a fluorescence of 510–560 nm is emitted. When an image was acquired using a NIR camera suitable for the emission wavelength, the vein (shown in green) was adapted to the fluorescence expression wavelength band, and eventually, the blood flow phenomenon of the NIR band was observed in the fluorescence expression-based blood vessel [].
4.3. Experiment Device Configuration
To capture the effect of reducing specular reflection, the experimental apparatus was configured as shown in Figure 15. The experimental setup consisted of a camera, a linear polarized filter (LPF), and an LED. The results were obtained using a self-made fluorescein sodium mixing vial. The result of removing specular reflection was obtained by imaging and observation using a self-made handheld-type fluorescence surgical microscope. The handheld-type fluorescence surgical microscope had the following characteristics. The component devices included an LED, IR camera, LED light intensity control function, ON/OFF switch, power supply, and external monitor.
Figure 15.
Experimental device set up.
For accurate imaging, a self-made, handheld-type fluorescence surgical microscope was fixed in position using a clamp device. The working distance (WD) from the camera and the LED to the phantom was 3 cm, and the angle (θ) between the LED and the camera to focus the beam was approximately 15°. For the LED used in the experiment, the wavelength and output level of the light source were measured before use. Measurements were obtained using a spectrum meter and a power meter. As shown in Figure 16, the irradiation (λext) wavelength of the LED was 405 nm, and the irradiation power (Pext) was approximately 19.6 mW.
Figure 16.
Light-emitting diode wavelength and output level (a) output level (b) output wavelength.
Table 4 shows the main parameters of the light emitting diode (LED) used in the experiment.
Table 4.
LED main parameters.
LPF1 was connected to the front end of the LED, and the rotation angle (θ) was 0°. In addition, a long pass filter (cut on wavelength: 500 nm @ thorlabs FEL0500) that could pass only the emission wavelength (510–560 nm) and two LPFs (LPF1//LPF2) were connected in front of the camera head. At this time, the rotation angle θ of the LPF1 was 0° (unpolarized), and the rotation angle θ of the LPF2 could be rotated from 0 to 360° (unpolarized or polarized). The method of adjusting the polarization state for specular reflection was essentially the regulation of the rotation angle (θ) of the LPF (F2) to 90° (polarized). The self-made handheld-type fluorescence surgical microscope was manufactured using 3D printer technology. The main parameters of the camera used for the experiment are presented in Table 5.
Table 5.
Experimental device module parameters.
To utilize the linear polarized filter (Corning Polarcor™ Glass Polarizer), the wavelength band was 430–1100 nm. The diameter of the lens was 5.0 mm, and the thickness of the filter lens was 0.5 mm. The transmittance was 66%, the insertion loss was 1.8 dB, and the angle of the incidence beam was 5.0°.
5. Results and Discussion
Figure 17 shows the results of the experiment based on the fabrication of the fluorescein sodium liquid vial phantom. The first filter (Filter1) was fixed, and the second filter (Filter2) was rotated at regular intervals to capture the image. When the rotation angle (θ) of the filter was rotated to 30°, 90°, 120°, 180°, 210°, 270°, 300°, and 360°, the image with reduced specular reflection could be observed. In particular, when the rotation angle (θ) was 90° and 270°, the specular reflection was sufficiently reduced, and other results were analyzed differently depending on the rotation angle (θ) in the intensity of the specular reflected light. To obtain reliable results, this experiment was performed five times (without LPF and with LPF states), and consistent results were obtained.
Figure 17.
Result of fluorescein sodium vial phantom experiment with the LPF.
Figure 18 shows the results of a reflex removal experiment using a large animal (pig). As observed in the figure, the experimental results show the state of blood flow through the fluorescent sodium fluorescein. For fluorescence images, an LED mounted on a self-manufactured handheld fluorescence surgical microscope irradiated the picture, and image data were collected through NIR camera imaging. After that, the results of the imaging experiment could be observed through an external monitor. In addition, Figure 18 shows the entire tumor before fluorescein sodium injection in the without filter (without fluorescein sodium) section. At this time, it was confirmed that light reflection occurred, and the with filter (with fluorescein sodium) part comprised the same tumor (←tumor maker) as the without filter part, and the same part was photographed three times for reproducibility. At this time, in a state in which the tumor was partially removed, fluorescein sodium was injected, and fluorescence was stained. Therefore, it is the result of comparing and observing the fluorescence state (←tumor maker) when the tumor is present (←tumor) and the non-fluorescent state (←tumor√) when the tumor is removed. Therefore, the reason that the shape of the tumor in the without filter (without fluorescein sodium) and with filter (with fluorescein sodium) parts is inevitably different is that the difference between the state in which the tumor is not removed and the state in which the tumor is partially removed for the fluorescence expression test cannot be compared. When irradiated with a light source from the outside, the performance of the state in which fluorescence is not expressed in the removed tumor (←tumor√) and the state of fluorescence in the non-removed tumor (←tumor) was tested. At this time, it was confirmed that light reflection still occurred in the fluorescence-expressed tumor (←tumor), and because we used a filter to remove the light reflection, it was confirmed that the light reflection was sufficiently removed when three shots were taken.
Figure 18.
Result of the specular reflection removal experiment using large-animal experiment.
As a result of adjusting the rotation angle (θ) of the filter from 0° to 360°, when the rotation angles were 90° and 270°, a fluorescence image in which reflection was sufficiently removed was confirmed. Therefore, the same results as the experiments using the phantom were confirmed through animal experiments.
The fluorescein sodium used in the experiment has the property of having a 2-benzofurans compound that is dependent on the xanthene dye and is converted and circulated into various derivatives. Tumors have a fluorescence wavelength of 505–530 nm and a fluorescence expression phenomenon due to the occurrence of derivatives for fluorescein sodium []. In addition, the 405 nm LED used in this paper directly irradiates the tumor with a low power of less than 20 mW. Therefore, the 405 nm LED used in the medical field has no adverse effect on surrounding tissues due to its low power. For this reason, 405 nm LED is widely used in the medical field [,]. In particular, the visible light LED with wavelengths of 400 to 700 nm is widely used in the medical field, as they have been found to have excellent sterilization effects and to be harmless to the human body []. In particular, the use of visible light LED is recommended for fluorescent contrast agents such as fluorescence sodium to avoid adverse effects on human tissues [].
6. Conclusions
The main aim of surgery is to completely excise tumors. Since the tumor is mixed with normal tissues and blood vessels, complete resection of only the tumor is difficult. Therefore, a fluorescence imaging device is used to differentiate between the tumor and the vascular boundary. In the LED used for fluorescence imaging, some light is refracted by Snell’s law, and some light is reflected and photographed by the camera. The photographed specular reflection image may interfere with the observation field of an important lesion during the diagnosis process, which may cause a diagnosis error. In clinical diagnosis sites, most of the cameras adjust the orientation angle or the brightness of the LED to reduce specular reflections from the captured images. However, when the camera direction angle is adjusted, the lesion in the captured image may be distorted, or the shape observation angle may be changed. In addition, if the LED brightness is adjusted, the captured image is observed on a dark background. Therefore, the shooting result is corrected using image processing, which is time-consuming and inconvenient. A clear image for rapid and accurate diagnosis must be provided, and specular reflection must be removed to secure the observation field of the lesion. This study develops a method to effectively reduce the specular reflection of an image generated by a fluorescence imaging device, and this experiment effectively controls polarization based on the rotation angle of the filter. Specular reflection for vertical polarization is removed by adjusting the direction of the vertical polarization and horizontal polarization. Thereafter, the filter allows only the horizontally polarized light to pass through. This study enables securing the imaging results for the specular reflection removal effect using the phantom, and large animals are tested to ensure high reliability of the experimental results of the phantom and fluorescein sodium liquid. When comparing the results of the large animal test with the phantom and fluorescein sodium liquid test results, it was possible to confirm the reduction in the occurrence of specular reflection. The proposed method can remove specular reflections in real time in the operating room without additional software processing and correction processing. The proposed method can be integrated with all cameras, microscopes, and endoscopes, regardless of the size of the filter. In addition, such a method provides an excellent photographed image to the operator. Therefore, the lesion observation field can be secured through clear imaging results in the experiment without specular reflection, and accurate diagnosis results can be rapidly obtained. Therefore, this method can be applied to clinical diagnostic sites in the future, and this method is highly practical. The proposed method can be applied in the medical field through product design and clinical trials in the future.
Author Contributions
Design and experiment, S.L.; analysis and fabrication, K.Y.; and guidance and supervisor, J.K. and K.G.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2022-2017-0-01630) supervised by the IITP (Institute for Information & communications Technology Promotion), and by the Gachon University (GCU-202205980001), respectively.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are available upon request from the corresponding author. The data are not publicly available because of privacy and ethical restrictions.
Acknowledgments
Sangyun Lee and Kicheol Yoon equally contributed to this work. Sangyun Lee and Kicheol Yoon are the co-first (lead) authors. Kwang Gi Kim and Jungmin Kim equally contributed to the work. Kwang Gi Kim and Jungmin Kim are the co-corresponding authors. Large animals (pigs) were tested at the Animal center of Osong Medical Innovation Foundation (KBIO) after obtaining Animal Institutional Review Board (IRB) approval from the Animal Ethics Commission (KBIO-IACUC-2019-021).
Conflicts of Interest
The authors declare no conflict of interest.
References
- Salles Gonçalves Pais, A.; Oliveira Alves, V.; Sigrist De Martin, A.; Sanches Cunha, R.; Eduardo Fontana, C.; Eduardo da Silveira Bueno, C. Sodium fluorescein and cobalt blue filter coupled to a dental operating microscope to optimise root canal location in maxillary first molars. ENDO 2014, 8, 193–198. [Google Scholar]
- Chen, D.; Li, L.; Zhu, X.; Wu, L.; Ma, S.; Yan, J.; Yan, D. Diffusion tensor imaging with fluorescein sodium staining in the resection of high-grade gliomas in functional brain areas. World Neurosurg. 2019, 124, e595–e603. [Google Scholar] [CrossRef] [PubMed]
- Hosmann, A.; Millesi, M.; Wadiura, L.I.; Kiesel, B.; Mercea, P.A.; Mischkulnig, M.; Borkovec, M.; Furtner, J.; Roetzer, T.; Wolfsberger, S.; et al. 5-ALA Fluorescence is a Powerful Prognostic Marker During Surgery of Low-Grade Gliomas (WHO Grade II)—Experience at Two Specialized Centers. Cancers 2021, 13, 2540. [Google Scholar] [CrossRef] [PubMed]
- Sabel, M.; Knipps, J.; Neumann, L.M.; Kieslich, M.; Steiger, H.-J.; Rapp, M.; Kamp, M.A. Quantification of ALA-fluorescence induced by a modified commercially available head lamp and a surgical microscope. Neurosurg. Rev. 2018, 41, 1079–1083. [Google Scholar] [CrossRef]
- Deng, Z.; Yu, H.; Wang, N.; Alafate, W.; Wang, J.; Wang, T.; Du, C.; Wang, M. Impact of preoperative Karnofsky Performance Scale (KPS) and American Society of Anesthesiologists (ASA) scores on perioperative complications in patients with recurrent glioma undergoing repeated operation. J. Neurorestoratol. 2019, 7, 143–152. [Google Scholar] [CrossRef]
- Kim, H.R.; Lee, H.M.; Yoo, H.; Lee, S.H.; Kim, K.G. Review of Neurosurgical Fluorescence Imaging Systems for Clinical Application. J. Opt. Soc. Korea 2016, 20, 305–313. [Google Scholar] [CrossRef]
- Hadjipanayis, C.G.; Stummer, W. 5-ALA and FDA approval for glioma surgery. J. Neuro-Oncol. 2019, 141, 479–486. [Google Scholar] [CrossRef]
- Desmettre, T.; Devoisselle, J.; Mordon, S. Fluorescence Properties and Metabolic Features of Indocyanine Green (ICG) as Related to Angiography. Surv. Ophthalmol. 2000, 45, 15–27. [Google Scholar] [CrossRef]
- Hirche, C.; Engel, H.; Kolios, L.; Cognie, J.; Hünerbein, M.; Lehnhardt, M.; Kremer, T. An Experimental Study to Evaluate the Fluobeam 800 Imaging System for Fluorescence-Guided Lymphatic Imaging and Sentinel Node Biopsy. Surg. Innov. 2012, 20, 516–523. [Google Scholar] [CrossRef]
- Hong, N.Y.; Kim, H.R.; Lee, H.M.; Sohn, D.K.; Kim, K.G. Fluorescent property of indocyanine green (ICG) rubber ring using LED and laser light sources. Biomed. Opt. Express 2016, 7, 1637–1644. [Google Scholar] [CrossRef]
- Schebesch, K.M.; Proescholdt, M.; Höhne, J.; Hohenberger, C.; Hansen, E.; Riemenschneider, M.J.; Ullrich, W.; Doenitz, C.; Schlaier, J.; Lange, M.; et al. Sodium fluorescein–guided resection under the YELLOW 560 nm surgical microscope filter in malignant brain tumor surgery—A feasibility study. Acta Neurochir. 2013, 155, 693–699. [Google Scholar] [CrossRef] [PubMed]
- Kwon, S.Y.; Yoon, K.C.; Kim, K.G. Reduction of reflected light on fluorescence emission for indocyanine green. J. Eng. Sci. Med. Diagn. Ther. 2022, 5, 011004. [Google Scholar] [CrossRef]
- Jiao, J.; Fan, W.; Sun, J.; Satoshi, N. Highlight removal for camera captured documents based on image stitching. In Proceedings of the International Conference on Signal Processing, Chengdu, China, 6–10 November 2016. [Google Scholar]
- Lin, X.; Fan, M.; Li, N.; Yang, J.; Zhu, H.; Chen, B.; Zhu, J.; Zhang, D.; Wang, T.; Cui, X. Phosphorus-Substituted Rhodamines for Bioimaging of the Lysosomal Peroxynitrite in Vivo. Dye. Pigment. Int. J. 2022, 201, 110201. [Google Scholar] [CrossRef]
- Kursunlu, A.N.; Ozmen, M.; Güler, E. A Novel Fluorescent Chemosensor for cu (II) Ion: Click Synthesis of Dual-Bodipy Including the Triazole Groups and Bioimaging of Yeast Cells. J. Fluoresc. 2019, 29, 1321–1329. [Google Scholar] [CrossRef] [PubMed]
- Kursunlu, A.N.; Oguz, M.; Yilmaz, M. On/off Rhodamine-BODIPY-Based Fluorimetric/Colorimetric Sensor for Detection of Mercury (II) in Half-Aqueous Medium. IEEE Sens. J. 2019, 19, 2009–2015. [Google Scholar] [CrossRef]
- Kursunlu, A.N. Synthesis and Photophysical Properties of Modifiable Single, Dual, and Triple-Boron Dipyrromethene (Bodipy) Complexes. Tetrahedron Lett. 2015, 56, 1873–1877. [Google Scholar] [CrossRef]
- Goodwin, K.J.; Gangl, E.; Sarkar, U.; Pop-Damkov, P.; Jones, N.; Borodovsky, A.; Woessner, R.; Fretland, A.J. Development of a Quantification Method for Adenosine in Tumors by LC-MS/MS with Dansyl Chloride Derivatization. Anal. Biochem. 2019, 568, 78–88. [Google Scholar] [CrossRef]
- Wan, R.; Shi, B.; Duan, L.Y.; Tan, A.H.; Kot, A.C. Benchmarking single image reflection removal algorithm. In Proceedings of the International Conference on Computer Vision, Venice, Italy, 22–29 October 2017. [Google Scholar]
- Li, C.; Yang, Y.; He, K.; Lin, S.; Hopcroft, J.E. Single image reflection removal through cascaded refinement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019. [Google Scholar]
- Tchoulack, S.; Pierre Langlois, J.M.; Cheriet, F. A video stream processor for real-time detection and correction of specular reflections in endoscopic images. In Proceedings of the Circuits and Systems and TAISA Conference, Montreal, QC, Canada, 22–25 June 2008; pp. 49–52. [Google Scholar]
- Wang, J.; Eng, H.; Kam, A.H.; Yau, W. Specular reflection removal for human detection under aquatic environment. In Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Washington, DC, USA, 27 June–2 July 2004. [Google Scholar]
- Yamazaki, M.; Chen, Y.; Xu, G. Separating reflections from images using kernel independent component analysis. In Proceedings of the the 18th International Conference on Pattern Recognition, Hong Kong, China, 20–24 August 2006; Volume 3, pp. 194–197. [Google Scholar]
- Gonçalves, J.A.; Henriques, R. UAV photogrammetry for topographic monitoring of coastal areas. ISPRS J. Photogramm. Remote Sens. 2015, 104, 101–111. [Google Scholar] [CrossRef]
- So, H.-R.; Oh, S.-J.; Jin, G.-G. Modified geometric step-based box-counting method to estimate the complexity of Korean peninsula coastlines. J. Inst. Control. Robot. Syst. 2019, 25, 30–36. [Google Scholar] [CrossRef]
- Hodgson, A.; Kelly, N.; Peel, D. Unmanned aerial vehicles (UAVs) for surveying marine fauna: A dugong case study. PLoS ONE 2013, 8, e79556. [Google Scholar] [CrossRef]
- Ahn, J.; Nishida, Y.; Ishii, K.; Ura, T. A sea creatures classification method using convolutional neural networks. In Proceedings of the IEEE 18th International Conference on Control, Automation and Systems (ICCAS), PyeongChang, Korea, 17–20 October 2018. [Google Scholar]
- Han, B.-J.; Sim, J.-Y. Reflection removal using low-rank matrix completion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
- Han, B.-J.; Sim, J.-Y. Single image reflection removal using non-linearly synthesized glass images and semantic context. IEEE Access 2019, 7, 170796–170806. [Google Scholar] [CrossRef]
- Han, B.-J.; Sim, J.-Y. Glass Reflection Removal Using Co-Saliency-Based Image Alignment and Low-Rank Matrix Completion in Gradient Domain. IEEE Trans. Image Process. 2018, 27, 4873–4888. [Google Scholar] [CrossRef] [PubMed]
- Valli, D.; Belykh, E.; Zhao, X.; Gandhi, S.; Cavallo, C.; Martirosyan, N.L.; Nakaji, P.; Lawton, M.T.; Preul, M.C. Development of a simulation model for fluorescence-guided brain tumor surgery. Front. Oncol. 2019, 9, 748. [Google Scholar] [CrossRef] [PubMed]
- Goryaynov, S.A.; Widhalm, G.; Goldberg, M.F.; Chelushkin, D.; Spallone, A.; Chernyshov, K.A.; Ryzhova, M.; Pavlova, G.; Revischin, A.; Shishkina, L. The role of 5-ALA in low-grade gliomas and the influence of antiepileptic drugs on intraoperative fluorescence. Front. Oncol. 2019, 22, 423. [Google Scholar] [CrossRef]
- Hardian, R.F.; Hanaoka, Y.; Funato, F.; Agata, M.; Ito, K.; Horiuchi, T. Assessment of collateral venous flow using temporary clip placement at ICG videoangiography. Acta Neurochir. 2021, 163, 2533–2536. [Google Scholar] [CrossRef]
- Stummer, W.; Novotny, A.; Stepp, H.; Goetz, C.; Bise, K.; Reulen, H.J. Fluorescence-guided resection of glioblastoma muliforme utilizing 5-ALA-induced porphyrins: A prospective study in consecutive patients. J. Neurosurg. 2000, 96, 1003–1013. [Google Scholar] [CrossRef]
- Ramezani, S.; Parkhideh, A.; Bhattacharya, P.K.; Farach-Carson, M.C.; Harrington, D.A. Beyond colonoscopy: Exploring new cell surface biomarkers for detection of early, heterogenous colorectal lesions. Front. Oncol. 2021, 11, 1471. [Google Scholar] [CrossRef]
- Kim, S.; Ra, M.; Kim, W.-Y. Specular detection on glossy surface using geometric characteristics of specularity in top-view images. Sensors 2021, 21, 2079. [Google Scholar] [CrossRef]
- Zeng, J.; Chang, B.; Du, D.; Hong, Y.; Chang, S.; Zou, Y. A precise visual method for narrow butt detection in specular reflection workpiece welding. Sensors 2016, 16, 1480. [Google Scholar] [CrossRef]
- Yoon, K.; Seol, J.; Kim, K.G. Removal of specular reflection using angle adjustment of linear polarized filter in medical imaging diagnosis. Diagnostics 2022, 12, 863. [Google Scholar] [CrossRef]
- Islam, N.; Tahtali, M.; Pickering, M. Specular reflection detection and inpainting in transparent object through MSPLFI. Remote Sens. 2021, 13, 455. [Google Scholar] [CrossRef]
- Coemans, M.A.J.M.; Hzn, J.; Nuboer, J. The orientation of the E-vector of linearly polarized light does not affect the behaviour of the pigeon Columba livia. J. Exp. Biol. 1994, 191, 107–123. [Google Scholar] [CrossRef] [PubMed]
- Muheim, R. Behavioural and physiological mechanisms of polarized light sensitivity in birds. Philos. Trans. R. Soc. B 2011, 366, 763–771. [Google Scholar] [CrossRef]
- Trippe, S. Polarization and polarimetry: A review. J. Korean Astron. Soc. 2014, 47, 15–39. [Google Scholar] [CrossRef]
- Woźniak, W.A.; Kurzynowski, P.I.; Zdunek, M.A. Malus law—Interferometric interpretation. Opt. Appl. 2013, 43, 237–246. [Google Scholar]
- Monteiro, M.; Stari, C.; Cabeza, C.; Martí, A.C. The polarization of light and Malus’ Law using smartphones. Phys. Teach. 2017, 55, 264–266. [Google Scholar] [CrossRef]
- Rosi, T.; Onorato, P. Video analysis-based experiments regarding Malus law. Phys. Educ. 2020, 55, 045011. [Google Scholar] [CrossRef]
- Yoon, K.C. A Study on a New Triple-Split Ring Resonator with High-Q and μ-Negative Metamatrial for Microwave Circuit Applications. Ph.D. Thesis, Kwangwoon University, Seoul, Korea, 2011. [Google Scholar]
- Mohamcd, A.M.; Hassan, A.F. Improve solar cell energy conversion efficiency by using illuminescent dyes concentrators. J. Kufa-Phys. 2015, 7, 8–15. [Google Scholar]
- Yoon, K.-C.; Kim, K.G.; Lee, S.H. Design of a surgical pen-type probe for real-time indocyanine green fluorescence emission diagnosis. J. Med. Devices 2021, 15, 041009. [Google Scholar] [CrossRef]
- Christopoulos, T.K.; Diamandis, E.P. Fluorescence immunoassays. Hum. Pathol. 1984, 15, 112–116. [Google Scholar]
- Yoon, K.-C.; Kim, K.G. NIR irradiation based on low-power LED drive module design for fat reduction. BioMed Res. Int. 2021, 2021, 9992095. [Google Scholar] [CrossRef] [PubMed]
- Menendez-Montes, I.; Abdisalaam, S.; Xiao, F.; Lam, N.T.; Mukherjee, S.; Szweda, L.I.; Asaithamby, A.; Sadek, H.A. Mitochondrial fatty acid utilization increases chromatin oxidative stress in cardiomyocytes. Proc. Natl. Acad. Sci. USA 2021, 118, e2101674118. [Google Scholar] [CrossRef] [PubMed]
- Kumar, A.; Ghate, V.; Kim, M.-J.; Zhou, W.; Khoo, G.H.; Yuk, H.-G. Kinetics of bacterial inactivation by 405 nm and 520 nm light emitting diodes and the role of endogenous coproporphyrin on bacterial susceptibility. J. Photochem. Photobiol. B Biol. 2015, 149, 37–44. [Google Scholar] [CrossRef] [PubMed]
- Maclean, M.; MacGregor, S.J.; Anderson, J.G.; Woolsey, G. Inactivation of bacterial pathogens following exposure to light from a 405-nanometer light-emitting diode array. Appl. Environ. Microbiol. 2009, 75, 1932–1937. [Google Scholar] [CrossRef] [Green Version]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).