Next Article in Journal
Role of the Stress Index in Predicting Mortality among Patients with Traumatic Femoral Fractures
Previous Article in Journal
Insights into the Cardioprotective Effects of Pyridoxine Treatment in Diabetic Rats: A Study on Cardiac Oxidative Stress, Cardiometabolic Status, and Cardiovascular Biomarkers
Previous Article in Special Issue
OCT Angiography of the Retina and the Choroid in the Macula in Patients with Normal Tension Glaucoma and Primary Open Angle Glaucoma
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Robust Ultrafast Projection Pipeline for Structural and Angiography Imaging of Fourier-Domain Optical Coherence Tomography

Centre for Medical Engineering and Technology (CMET), School of Science and Engineering, University of Dundee, Dundee DD1 4HN, UK
*
Author to whom correspondence should be addressed.
Diagnostics 2024, 14(14), 1509; https://doi.org/10.3390/diagnostics14141509
Submission received: 5 June 2024 / Accepted: 11 July 2024 / Published: 12 July 2024
(This article belongs to the Special Issue Optical Coherence Tomography (OCT): State of the Art)

Abstract

:
The current methods to generate projections for structural and angiography imaging of Fourier-Domain optical coherence tomography (FD-OCT) are significantly slow for prediagnosis improvement, prognosis, real-time surgery guidance, treatments, and lesion boundary definition. This study introduced a robust ultrafast projection pipeline (RUPP) and aimed to develop and evaluate the efficacy of RUPP. RUPP processes raw interference signals to generate structural projections without the need for Fourier Transform. Various angiography reconstruction algorithms were utilized for efficient projections. Traditional methods were compared to RUPP using PSNR, SSIM, and processing time as evaluation metrics. The study used 22 datasets (hand skin: 9; labial mucosa: 13) from 8 volunteers, acquired with a swept-source optical coherence tomography system. RUPP significantly outperformed traditional methods in processing time, requiring only 0.040 s for structural projections, which is 27 times faster than traditional summation projections. For angiography projections, the best RUPP variation took 0.15 s, making it 7518 times faster than the windowed eigen decomposition method. However, PSNR decreased by 41–45% and SSIM saw reductions of 25–74%. RUPP demonstrated remarkable speed improvements over traditional methods, indicating its potential for real-time structural and angiography projections in FD-OCT, thereby enhancing clinical prediagnosis, prognosis, surgery guidance, and treatment efficacy.

1. Introduction

Optical coherence tomography (OCT) is a noninvasive imaging modality, utilizing the principles of low-coherence interferometry to generate high-resolution, three-dimensional visualizations of biological tissues [1,2,3,4]. The development of Fourier-domain OCT (FD-OCT) has broadened its scope by offering enhanced resolution, sensitivity, and scanning speed compared to time-domain OCT (TD-OCT) [5]. FD-OCT can be further divided into spectral-domain OCT (SD-OCT) and swept-source OCT (SS-OCT) [3,5]. The high sensitivity and stability of FD-OCT are more suitable for high-speed imaging compared to TD-OCT [5]. OCT-based angiography (OCTA) is an extended function of OCT imaging, which can provide detailed microvascular networks of tissue in vivo [6,7,8,9,10]. By utilizing OCT imaging’s high resolution and fast acquisition, OCTA can extract OCT signals’ variations caused by moving red blood cells [7]. Current clinical applications of OCTA predominantly revolve around ophthalmology, where OCTA has improved the diagnosis and monitoring of retinal diseases, including age-related macular degeneration, diabetic retinopathy, and vascular occlusions [6,9,11,12]. Besides ophthalmic applications, specialized probe designs extended its applications to other areas, such as dermatology and dentistry [13,14,15,16,17].
The fundamental scanning component of conventional OCT scans is the amplitude scan (A-scan or A-line), which represents the back-scattered light intensity across the depth at one location on the tissue surface [18]. While moving the scanning location along a line on the tissue surface, one brightness scan (B-scan or B-frame) as a 2D array can be formed by successively acquiring a number of A-lines. Hence, a cross-section or tomogram of the tissue can be presented as one B-frame [18,19]. A 3D volume of the OCT dataset can be achieved by moving the scanning location on two axes on a line-by-line basis, which can acquire a number of B-frames, forming a 3D volume [18,19]. OCTA datasets are in a 4D volume format with three spatial dimensions and one temporal dimension, which would only require an additional step of repeated scanning at the same location [6,7,20,21].
The projections of both OCT and OCTA are 2D matrixes generated from compressing the 3D volumes on the depth axis, which are often used in biomedical research [18,22,23,24,25,26,27,28,29]. However, generating OCT and OCTA projections from raw interference signals can be extremely time consuming [30,31], as explained below. The current method to generate OCT and OCTA projections for FD-OCT requires Fourier transform (FT) [32] firstly to transform the interference signals to intensity signals [24]. After applying FT to all A-line signals, the 3D volume data can be applied with projection algorithms, such as summation projection, to generate the structural OCT projections [29]. For OCTA projection, firstly the input would be 4D volumes. Then, angiography signals can be extracted from either the repeated cross-sectional frames (B-frames) or the whole 4D dataset by using OCTA reconstruction algorithms such as Speckle variance (SV) [33], A-scans eigen decomposition (aED) [20], B-scans eigen decomposition (bED) [21], and windowed eigen decomposition (wED) [30]. Since the temporal dimension is used for OCTA reconstruction, the data format would be in 3D volumes containing the angiography signals only. Lastly, the 3D OCTA data can generate the 2D OCTA projections by using projection algorithms [29].
The structural OCT projections can provide a comprehensive perspective on tissue microarchitecture with many applications including diagnostics, surgical guidance, data segmentation, and therapeutic monitoring [22,23,24,25,26]. The OCTA projection is an intuitive, commonly used method to present the 3D OCTA dataset although the projection process is a reduction in dimensionality [20,21,29,30,31,34]. The vasculature network can be quantitatively analyzed from the OCTA projections, including the vessel diameter, the vessel density, the vessel tortuosity, and other metrics that can be used for clinical research [27,28]. Therefore, OCTA projections can be used for many clinical applications including disease assessment, diagnosis, and image-guided surgery.
The current projection methods for FD-OCT as described above are often processed as one of the postprocessing steps, due to the long processing time [30,31]. Specifically, FT and the 3D angiography reconstruction are the main reasons for the slow processing. In addition, varied reconstruction algorithms can involve iterations on different levels. The clinical use of OCT or OCTA pursues a high efficiency from the start of the data acquisition to the output of results, which would not align with the slow projection methods. A real-time structural projection technique was developed, which would require modifications in the hardware setup, e.g., the laser source [35]. Wei et al. implemented a GPU-accelerated system to provide real-time OCTA projections [36]. However, the frame rate was only mentioned as 250 Hz at maximum, without mentioning the dataset size at this frame rate [36]. Although utilizing high-end computational hardware can reduce the processing time, an easy-to-deploy, robust, ultrafast projection pipeline can benefit clinical applications such as real-time diagnosis, image-guided surgeries, or treatments. Additionally, it can also serve as a guide for high-quality data acquisition.
This study proposes a novel, robust ultrafast projection pipeline (RUPP) for FD-OCT’s structural and angiography imaging. The RUPP does not require the FT process and only requires OCTA reconstruction on 2D arrays, which can reduce the processing time significantly. Therefore, the proposed pipeline can be used in many potential applications, such as real-time diagnosis, image-guided surgeries, and image-guided treatments.

2. Materials and Methods

2.1. Mathematics Explanations

The flow diagram for the proposed RUPP and the traditional projection methods is shown in Figure 1. A number of raw interference signals would be acquired by the FD-OCT systems. These signals are all of the A-lines in one acquisition, which can be allocated into K-X-Y-N dimensions, where K is the axis of wavenumbers, X and Y are the two lateral axes, and N is the repeated number in the temporal axis. The traditional pipelines to generate projections are shown in Figure 1 as well, in which the FT, 3D OCTA reconstruction and summation projection would be required.
On the other hand, the RUPP directly uses the electromagnetic interference signal from OCT acquisition without Fourier transform to generate structural projections first. For each A-line, the electromagnetic interference signal can be represented as E k , where k is the index of the interference wavenumbers. And the intensity signal of each A-line I ( z ) can be calculated by:
I z = F { E k } ,
where z is the index of the intensity signal and F is the symbol for Fourier transform. According to the Poisson summation formula, the summations of a signal before and after the Fourier transform are equal [37]. Although the Poisson summation formula can only be applied to the discrete digital signals that are periodic [37,38], the electromagnetic interference signals E k consist of multiple periodic sine/cosine signals with different frequency components, which would be transferred into different depths in the intensity signals I ( z ) . Therefore, the interference signals in FD-OCT can be considered periodic signals, and, as a result, the summations of the interference and intensity signals are equal. Since the summation of the intensity signals can be used to generate the structural projections, the summations of the interference signals, E k , can also generate structural projections, P r o j , which is shown as:
P r o j x , y = z = 1 Z I x , y z = k = 1 K E x , y k ,
where x and y are the coordinates of each A-line and Z and K are the total numbers of intensity depth index and interference wavenumbers in one A-line, respectively. Therefore, a simple summation of the interference signals can generate structural projections.
For OCTA projection, the same processes of structural projection generation are needed. By repeatedly scanning the same location, a stack of the structural projections can be provided as:
P r o j N = P r o j 1 , P r o j 2 , , P r o j N ,
where N is the number of repeated scans. An ensemble of samples from the same scanning location can be modeled as the sum of three components, a clutter component P r o j c mainly consisting of static tissue signal, an angiography component P r o j a , and noise P r o j n o i s e , which can be shown as:
P r o j N = P r o j c + P r o j a + P r o j n o i s e .
To extract P r o j a , several OCTA reconstruction algorithms can be used. The proposed pipeline utilized two algorithms, speckle variance (SV) [33] and ED [39]. As ED was reported as a superior algorithm to achieve theoretical maximum clutter suppression [6], ED was used firstly to extract the angiography component from the repeated projections. Because the clutter component is the dominant component, the signal correlation matrix C P r o j ^ can be estimated by:
C P r o j ^ = 1 / N P r o j P r o j H ,
where H is the Hermitian transpose operation. The eigenvectors and eigenvalues can be estimated through decomposition:
C P r o j ^ = M Λ M H = i = 1 N λ i e i e i H ,
where M is the unitary matrix of eigenvectors e 1 , e 2 , , e N and Λ is the diagonal matrix of eigenvalues λ 1 , λ 2 , , λ N that are sorted decreasingly. Then, the angiography component can be extracted by:
P r o j a = I d i = 1 r e i e i H P r o j N ,
where I d is the identity matrix and r is the number of removed eigenvectors. The number of eigenvectors that are removed can be set manually or automatically. In this study, r was set automatically to be the number of eigenvalues that were larger than the average of all eigenvalues, as those removed eigenvalues and corresponding eigenvectors represented the dominant component, which was the clutter component contributed by static tissue.
On the other side, as an efficient intensity-based OCTA reconstruction algorithm, SV was also utilized to extract the angiography component, P r o j a . SV [33] has a simplified process, which compares frames to the average image, as shown below:
P r o j a = 1 / N n = 1 N P r o j n P r o j m e a n 2 ,
where P r o j m e a n is the average of all stacked structural projections P r o j N and P r o j n is the n th structural projection in the stack.
To further improve efficiency, an optional down-sampling procedure can be added at the data acquisition stage when the targeted information of the acquisition is within the superficial depths. Specifically, the imaging depth of an OCT system is limited by the penetration depth of light, not the theoretical imaging depth of the system setup [40]. Shown in Figure 2 are examples of cross-sectional OCT (a) and OCTA (b) images. The deeper half of the imaging depth was highlighted with yellow dashed boxes. The useful information was often attenuated significantly at the deeper half of imaging depth due to the penetration depth of light in dermatological and oral tissue, regardless of the high imaging depth in air provided by the light source manufacturer.
Therefore, the deep region of the intensity signals consists of low-intensity signals or even just background noise, while the deep-intensity signals come from the high-frequency components of the interference signal [4,40]. As a result, the high-frequency components in the electromagnetic interference signal can be ignored during the projection generation step. For the Fourier transform in FD-OCT, the Nyquist–Shannon sampling theorem limits the highest frequency of the electromagnetic interference signal that can be converted [41,42]. Therefore, the down-sampling procedure on OCT interference signals can decrease the Nyquist frequency, which would act as a cut-off threshold for the OCT intensity signals. As a result, the theoretical imaging depth of OCT is reduced. In addition, down-sampling the interference signals would not require additional processing costs, as it can be applied during the data acquisition stage. When acquiring the interference signal, the data points can be saved into RAM, VAM, or other storage devices selectively, e.g., only odd-numbered data points being saved, which was applied in this study. As a result, the saved acquisition data would be already down-sampled, which can increase the computational efficiency in Equation (2).
To sum up, the proposed RUPP utilized the Poisson summation formula to skip the Fourier transform and to directly generate the structural projection images. Then, the repeated scans with OCTA reconstruction can provide the angiography projection results.

2.2. Experiment Setup and Participants

The suggested RUPP was assessed by applying the mentioned processing techniques to the data gathered from a swept-source OCT system. The light source of this system operated at a sweeping rate of 400 kHz, featuring a central wavelength of 1300 nm and a bandwidth of 100 nm. In total, 22 raw datasets were collected from the hand skin (9 datasets, 6 participants) and oral lip skin (13 datasets, 2 participants) of 8 healthy participants, which was reviewed and approved by the Research Ethics Committee of the University of Dundee (UOD-SSREC-RPG-BioEng-2022-001 and UOD-SSREC-RPG-BioEng-2022-003). All participants had to give their informed consent before entering the lab for the data collection and the informed consent of the participants was obtained for the data collected in this article. The collected data was anonymized and the participants’ identification was removed. The dimensions of each raw interference dataset for assessed techniques were 768 × 400 × 400 × 4 (K × X × Y × N in pixels). The RUPP and other traditional methods (aED [20], bED [21], wED [30], and traditional SV [33]) were applied to the datasets. Particularly, the RUPP was optimized by comparing between the RUPP using ED (RUPP-ED) and SV (RUPP-SV), additionally with or without the optional down-sampling. The software used for processing was MATLAB R2022b (The MathWorks, Inc., Natick, MA, USA), and the computational hardware consisted of a 12th Gen Intel® Core™ i9-12900K CPU (Intel Corporation, Santa Clara, CA, USA), an NVIDIA GeForce RTX 3060 GPU (NVIDIA Corporation, Santa Clara, CA, USA), 32 GB of DDR5 RAM (Samsung Electronics Co., Ltd., Suwon, Gyeonggi Province, Republic of Korea), and a Western Digital PC SN810 Solid-State Drive (Western Digital Corporation, San Jose, CA, USA).

2.3. Evaluation Methods

For the above comparisons, the peak signal-to-noise ratio (PSNR), structural similarity (SSIM) index, and processing time were used as the metrics. In the PSNR and SSIM computation, the input image is mathematically compared with the ground truth. However, for in-vivo studies, the ground-truth image is often hard to acquire. Therefore, the en-face projections generated from the high-repeated acquisitions were considered as the ground truth. Specifically, for structural projection generation, each A-line signal in the ground truth, I G T was calculated from the average value of multiple repeats, as in
I G T z = a v e r a g e I z N ,
where I N is a set of the N-repeated A-line signals, and a v e r a g e ( ) is to calculate the average value of the input. In this study, N is 12 for the ground truth datasets. Using the average values from repeated acquisition at the same location was shown to have a better performance on noise reduction of structural OCT projections [43]. After calculating all ground-truth A-lines, the structural projection ground truth can be generated using the same method, which was shown in Equation (2). On the other side, the ground-truth OCTA projection was generated from 12-repeated traditional wED pipeline [30] due to two reasons: (a) the traditional wED pipeline was proved to have outstanding imaging quality, especially when countering motion artifacts [30]; (b) 12 repeated acquisitions at the same locations with the ED algorithm can provide results with high performance on angiography extraction [44,45].
With the ground-truth OCT and OCTA projections generated, PSNR values can be derived from:
P S N R = 10 l o g 10 P r o j m a x i m u m 2 / M S E ,
where P r o j m a x i m u m represents the input image’s maximum value and M S E indicates the mean square error (MSE) between the input and ground-truth images [46,47]. The MSE [48] is determined by:
M S E = x = 1 X y = 1 Y P r o j x , y P r o j G T x , y 2 / X Y ,
where X and Y are the total numbers of data points on X-axis and Y-axis of projections, respectively, and P r o j G T is the ground-truth projection. Then, the SSIM index can be calculated by:
S S I M P r o j , P r o j G T = C l P r o j , P r o j G T α C c P r o j , P r o j G T β C s P r o j , P r o j G T γ ,
where C l , C c and C s , respectively, are the comparison measurements of luminance, contrast, and structure between the two input images, and α > 0 , β > 0 , γ > 0 , which are three weighted parameters of C l , C c , and C s , respectively [49].

3. Results

3.1. Structural Projections

The structural OCT projections among the traditional summation projection, RUPP without and with down-sampling were compared with the generated ground-truth structural OCT projections. Figure 3 shows an exemplary dataset, which includes the results generated by all three structural projection techniques.
To further evaluate the RUPP methods, the average PSNR and SSIM values were calculated from a total of 22 datasets. Figure 4 shows the relationship between PSNR (a), SSIM (b), and the processing time of the three aforementioned processing techniques.
Additionally, for accurate demonstration with standard deviations, Table 1 shows the PSNR and SSIM values compared to the processing time.

3.2. Angiography Projections

For OCTA projections, an extensive evaluation of RUPP angiography projection methods was conducted using a comprehensive approach that involved the application of the aforementioned various methods, namely wED, aED, bED, SV, RUPP-ED with and without down-sampling, and RUPP-SV with and without down-sampling to generate OCTA projections for comparison. The outcomes of these OCTA projection techniques were compared against the high-repeated ground truth, with three evaluation metrics, PSNR, SSIM, and processing time. Figure 5 shows an exemplary dataset of an oral ulcer lesion that was used by various OCTA projection generation techniques.
In total, 22 datasets were used to produce the average PSNR, SSIM, and processing time values for a robust and objective assessment, which is shown in Figure 6.
Additionally, for accurate demonstration with standard deviations, Table 2 shows the PSNR and SSIM values compared to the processing time.

4. Discussion

This study proposed a novel pipeline, RUPP, with variations for both OCT and OCTA projection generation applications. In addition, RUPP is easy to deploy and robust and can be applied to all FD-OCT systems. The RUPP can avoid the Fourier transform process, which would be required in FD-OCT systems. Therefore, the RUPP can significantly reduce the computational cost, which can enable the projection generation as a real-time process. With real-time OCT and OCTA projections, it would be possible to realize real-time diagnosis and surgeries and to improve data acquisition quality by accurate localization and avoiding artifacts. Although SD-OCT systems were not used in this study, theoretically RUPP would also apply to SD-OCT systems because RUPP directly processes the raw interference signals of FD-OCT.
Firstly, RUPP can generate structural OCT projections with extremely low computational costs. With 22 datasets on average, RUPP only took 0.076 s while the traditional summation projection method needed 1.76 s. RUPP reduced the processing time on the same datasets and hardware by 27 times. With the optional down-sampling technique, RUPP can almost halve the processing time, reducing it to 0.040 s, which is 44 times faster compared to the traditional method. For OCTA projections, this study compared eight methods including both traditional techniques and RUPP variations. The SV and ED algorithms were applied to the RUPP to generate OCTA projections. RUPP-SV with down-sampling achieved the fastest processing (reduced the processing time by 7518, 77, 46, and 33 times compared to the traditional wED, aED, bED, and SV techniques, respectively) while RUPP-SV without down-sampling preserved a higher imaging quality than RUPP-ED in terms of PSNR and SSIM values. With a realistic and practical data acquisition size, 768 × 400 × 400 × 4 (K × X × Y × N in pixels) without resorting to an artificially small data size to exaggerate performance benefits, RUPP-SV with down-sampling only required 0.15 s. With this low processing time, the real-time OCTA projection can be achieved or improved significantly. In addition, higher-end computing equipment and parallel processing can potentially further decrease the processing time. However, when not applying the optional down-sampling process, RUPP-ED would require less processing time than RUPP-SV, while RUPP-SV can achieve better imaging quality. Although ED was reported as a superior OCTA reconstruction algorithm in several studies [20,21,30], SV had better performance in terms of PSNR and SSIM values for the RUPP. The reason for ED’s low performance in imaging quality could be that ED is an OCTA reconstruction algorithm based on both the magnitude and phase of the input signals, yet there would be no phase information for the RUPP as the FT process is avoided.
The tradeoff between processing time and imaging quality can also be found for RUPP. The PSNR and SSIM values of RUPP had some decreases in general compared to the traditional projection methods. For structural projections, although the PSNR and SSIM values were, respectively, 41% and 25% lower than the traditional method, the projection results are visually acceptable for feature assessments, especially for the fingerprint on the fingertip in Figure 3. For the angiography projections, the most efficient variant, RUPP-SV with down-sampling, had a 45% and 74% lower PSNR and SSIM values compared to the best-performing traditional projection method, wED. However, the proposed RUPP, as an ultrafast algorithm, is designed for quick identification and localization of the region of interest or real-time diagnosis and treatment monitoring. From visual observation in Figure 5, the vessel structure and the boundary between the normal tissue and the oral ulcer lesion were still well preserved, meaning that RUPP still fits with the above purposes. The reason for low PSNR and SSIM values could be that the blood vessels in RUPP results were not fully solid (i.e., there were some small black “holes” inside vessels in Figure 5), which may preserve good vessel structures for visual observation but would not be friendly for pixel-wise evaluation methods like PSNR and SSIM. In addition, some processing methods like thresholding, erosion, and dilation [50] can potentially improve the RUPP’s imaging quality. Besides, an artificial neural network could be a method to enhance the quality of the vasculature image from the RUPP while maintaining a short processing time [44,51]. With RUPP’s compression on the raw interference signal, the depth information of the vasculature network would be lost. Although the traditional projections do not contain depth information either, the depth information can be extracted during the processing. However, RUPP results can serve as a guide and boundary detection during data acquisition. For example, alignment, registration, or operator-guided survey scans can benefit from RUPP’s fast processing. With only 0.040 and 0.15 s for structural and angiography imaging, RUPP has great potential for real-time projection imaging for FD-OCT. On the other hand, it is possible that the RUPP can be limited by the FD-OCT system’s hardware setup. The RUPP is purely on the software side, while OCT systems would require efficient integration between the software and hardware. For example, the optional down-sampling process may not be possible to deploy depending on the data acquisition device. However, this study provides a few variations of the RUPP, which can be deployed easily. This study can also serve as a guide for utilizing the RUPP in the most efficient way.

5. Conclusions

We proposed a novel RUPP for both structural and angiography projection generation, including a few variations for OCTA projections. This RUPP can be easily deployed to all FD-OCT systems. The key advantage of the RUPP is the extremely low processing time. For the structural projections, the RUPP required 27 times less processing time than the traditional projection method. For OCTA projections, RUPP-SV with down-sampling was the most efficient variation of the RUPP, which required up to 7518 times less processing time compared to traditional methods. Although the imaging quality was also decreased, the low processing time makes the RUPP have the significant potential to contribute to real-time structural and angiography projections, which in turn can be useful for real-time surgeries or treatments, quick prognosis, and data acquisition guidance.

Author Contributions

Conceptualization, T.Z.; methodology, T.Z.; software, T.Z.; validation, T.Z.; formal analysis, T.Z. and J.L.; investigation, T.Z. and J.L.; resources, Z.H. and C.L.; data curation, T.Z. and J.L.; writing—original draft preparation, T.Z.; writing—review and editing, J.L., Y.Z., Z.H., and C.L.; visualization, T.Z.; supervision, Z.H. and C.L.; project administration, C.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study was reviewed and approved by the Research Ethics Committee of the University of Dundee (UOD-SSREC-RPG-BioEng-2022-001 on 26/June/2023 and UOD-SSREC-RPG-BioEng-2022-003 on 25 August 2023).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this article are not publicly available due to ethical restrictions. They can be requested from the correspondence author at [email protected].

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Huang, D.; Swanson, E.A.; Lin, C.P.; Schuman, J.S.; Stinson, W.G.; Chang, W.; Hee, M.R.; Flotte, T.; Gregory, K.; Puliafito, C.A.; et al. Optical Coherence Tomography. Science 1991, 254, 1178. [Google Scholar] [CrossRef] [PubMed]
  2. Fujimoto, J.G.; Pitris, C.; Boppart, S.A.; Brezinski, M.E. Optical Coherence Tomography: An Emerging Technology for Biomedical Imaging and Optical Biopsy. Neoplasia 2000, 2, 9. [Google Scholar] [CrossRef]
  3. Tomlins, P.H.; Wang, R.K. Theory, Developments and Applications of Optical Coherence Tomography. J. Phys. D Appl. Phys. 2005, 38, 2519. [Google Scholar] [CrossRef]
  4. Fercher, A.F.; Drexler, W.; Hitzenberger, C.K.; Lasser, T. Optical Coherence Tomography—Principles and Applications. Rep. Prog. Phys. 2003, 66, 239. [Google Scholar] [CrossRef]
  5. Leitgeb, R.; Fercher, A.F.; Hitzenberger, C.K. Performance of Fourier Domain vs. Time Domain Optical Coherence Tomography. Opt. Express 2003, 11, 889–894. [Google Scholar] [CrossRef] [PubMed]
  6. Chen, C.-L.; Wang, R.K. Optical Coherence Tomography Based Angiography [Invited]. Biomed. Opt. Express 2017, 8, 1056–1082. [Google Scholar] [CrossRef] [PubMed]
  7. de Carlo, T.E.; Romano, A.; Waheed, N.K.; Duker, J.S. A Review of Optical Coherence Tomography Angiography (OCTA). Int. J. Retin. Vitr. 2015, 1, 1–15. [Google Scholar] [CrossRef] [PubMed]
  8. Spaide, R.F.; Fujimoto, J.G.; Waheed, N.K.; Sadda, S.R.; Staurenghi, G. Optical Coherence Tomography Angiography. Prog. Retin. Eye Res. 2018, 64, 1–55. [Google Scholar] [CrossRef] [PubMed]
  9. Gao, S.S.; Jia, Y.; Zhang, M.; Su, J.P.; Liu, G.; Hwang, T.S.; Bailey, S.T.; Huang, D. Optical Coherence Tomography Angiography. Investig. Ophthalmol. Vis. Sci. 2016, 57, OCT27–OCT36. [Google Scholar] [CrossRef]
  10. Zhang, A.; Zhang, Q.; Chen, C.-L.; Wang, R.K. Methods and Algorithms for Optical Coherence Tomography-Based Angiography: A Review and Comparison. J. Biomed. Opt. 2015, 20, 100901. [Google Scholar] [CrossRef]
  11. Jia, Y.; Bailey, S.T.; Hwang, T.S.; McClintic, S.M.; Gao, S.S.; Pennesi, M.E.; Flaxel, C.J.; Lauer, A.K.; Wilson, D.J.; Hornegger, J.; et al. Quantitative Optical Coherence Tomography Angiography of Vascular Abnormalities in the Living Human Eye. Proc. Natl. Acad. Sci. USA 2015, 112, E2395–E2402. [Google Scholar] [CrossRef] [PubMed]
  12. Hagag, A.M.; Gao, S.S.; Jia, Y.; Huang, D. Optical Coherence Tomography Angiography: Technical Principles and Clinical Applications in Ophthalmology. Taiwan J. Ophthalmol. 2017, 7, 115–129. [Google Scholar] [CrossRef] [PubMed]
  13. Liu, M.; Drexler, W. Optical Coherence Tomography Angiography and Photoacoustic Imaging in Dermatology. Photochem. Photobiol. Sci. 2020, 18, 945–962. [Google Scholar] [CrossRef] [PubMed]
  14. Ulrich, M.; Themstrup, L.; De Carvalho, N.; Manfredi, M.; Grana, C.; Ciardo, S.; Kästle, R.; Holmes, J.; Whitehead, R.; Jemec, G.B.E.; et al. Dynamic Optical Coherence Tomography in Dermatology. Dermatology 2016, 232, 298–311. [Google Scholar] [CrossRef] [PubMed]
  15. Tsai, M.-T.; Chen, Y.; Lee, C.-Y.; Huang, B.-H.; Trung, N.H.; Lee, Y.-J.; Wang, Y.-L. Noninvasive Structural and Microvascular Anatomy of Oral Mucosae Using Handheld Optical Coherence Tomography. Biomed. Opt. Express 2017, 8, 5001. [Google Scholar] [CrossRef] [PubMed]
  16. Le, N.M.; Song, S.; Zhou, H.; Xu, J.; Li, Y.; Sung, C.E.; Sadr, A.; Chung, K.H.; Subhash, H.M.; Kilpatrick, L.; et al. A Noninvasive Imaging and Measurement Using Optical Coherence Tomography Angiography for the Assessment of Gingiva: An in Vivo Study. J. Biophotonics 2018, 11, e201800242. [Google Scholar] [CrossRef] [PubMed]
  17. Zhang, T.; Shepherd, S.; Huang, Z.; Li, C.; Macluskey, M. Development of an Intraoral Handheld Optical Coherence Tomography-Based Angiography Probe for Multi-Site Oral Imaging. Opt. Lett. 2023, 48, 4857–4860. [Google Scholar] [CrossRef] [PubMed]
  18. Leitgeb, R.A. En Face Optical Coherence Tomography: A Technology Review [Invited]. Biomed. Opt. Express 2019, 10, 2177. [Google Scholar] [CrossRef] [PubMed]
  19. Rogers, J.A.; Dunne, S.; Jackson, D.A.; Podoleanu, A.G. Three Dimensional OCT Images from Retina and Skin. Opt. Express 2000, 7, 292–298. [Google Scholar] [CrossRef]
  20. Yousefi, S.; Zhi, Z.; Wang, R.K. Eigendecomposition-Based Clutter Filtering Technique for Optical Microangiography. IEEE Trans. Biomed. Eng. 2011, 58, 2316–2323. [Google Scholar] [CrossRef]
  21. Zhang, Q.; Wang, J.; Wang, R.K. Highly Efficient Eigen Decomposition Based Statistical Optical Microangiography. Quant. Imaging Med. Surg. 2016, 6, 557–563. [Google Scholar] [CrossRef] [PubMed]
  22. Wolff, B.; Matet, A.; Vasseur, V.; Sahel, J.A.; Mauget-Faÿsse, M. En Face OCT Imaging for the Diagnosis of Outer Retinal Tubulations in Age-Related Macular Degeneration. J. Ophthalmol. 2012, 2012, 542417. [Google Scholar] [CrossRef] [PubMed]
  23. Riazi-Esfahani, H.; Khalili Pour, E.; Fadakar, K.; Ebrahimiadib, N.; Ghassemi, F.; Nourinia, R.; Khojasteh, H.; Attarian, B.; Faghihi, H.; Ahmadieh, H. Multimodal Imaging for Paracentral Acute Maculopathy; the Diagnostic Role of En Face OCT. Int. J. Retin. Vitr. 2021, 7, 13. [Google Scholar] [CrossRef] [PubMed]
  24. Kostanyan, T.; Wollstein, G.; Schuman, J.S. OCT Technique—Past, Present and Future. In OCT in Central Nervous System Diseases: The Eye as a Window to the Brain; Springer: Cham, Switzerland, 2016; pp. 7–34. [Google Scholar] [CrossRef]
  25. Ji, Y.; Yang, S.; Zhou, K.; Rocliffe, H.R.; Pellicoro, A.; Cash, J.L.; Wang, R.; Li, C.; Huang, Z. Deep-Learning Approach for Automated Thickness Measurement of Epithelial Tissue and Scab Using Optical Coherence Tomography. J. Biomed. Opt. 2022, 27, 015002. [Google Scholar] [CrossRef] [PubMed]
  26. Zhang, Q.; Zheng, F.; Motulsky, E.H.; Gregori, G.; Chu, Z.; Chen, C.L.; Li, C.; De Sisternes, L.; Durbin, M.; Rosenfeld, P.J.; et al. A Novel Strategy for Quantifying Choriocapillaris Flow Voids Using Swept-Source OCT Angiography. Investig. Ophthalmol. Vis. Sci. 2018, 59, 203. [Google Scholar] [CrossRef] [PubMed]
  27. Ji, Y.; Yang, S.; Zhou, K.; Li, C.; Huang, Z. A Machine Learning Based Quantitative Data Analysis for Screening Skin Abnormality Based on Optical Coherence Tomography Angiography (OCTA). In Proceedings of the IEEE International Ultrasonics Symposium, IUS, Xi’an, China, 11–16 September 2021. [Google Scholar] [CrossRef]
  28. Gao, S.S.; Jia, Y.; Liu, L.; Zhang, M.; Takusagawa, H.L.; Morrison, J.C.; Huang, D. Compensation for Reflectance Variation in Vessel Density Quantification by Optical Coherence Tomography Angiography. Investig. Ophthalmol. Vis. Sci. 2016, 57, 4485–4492. [Google Scholar] [CrossRef] [PubMed]
  29. Wang, J.; Jia, Y.; Hwang, T.S.; Bailey, S.T.; Huang, D.; Hormel, T.T. Maximum Value Projection Produces Better En Face OCT Angiograms than Mean Value Projection. Biomed. Opt. Express 2018, 9, 6412–6424. [Google Scholar] [CrossRef]
  30. Zhang, T.; Zhou, K.; Rocliffe, H.R.; Pellicoro, A.; Cash, J.L.; Wang, W.; Wang, Z.; Li, C.; Huang, Z. Windowed Eigen-Decomposition Algorithm for Motion Artifact Reduction in Optical Coherence Tomography-Based Angiography. Appl. Sci. 2022, 13, 378. [Google Scholar] [CrossRef]
  31. Li, M.; Chen, Y.; Ji, Z.; Xie, K.; Yuan, S.; Chen, Q.; Li, S. Image Projection Network: 3D to 2D Image Segmentation in OCTA Images. IEEE Trans. Med. Imaging 2020, 39, 3343–3354. [Google Scholar] [CrossRef]
  32. Cooley, J.W.; Lewis, P.A.; Welch, P.D. The Finite Fourier Transform. IEEE Trans. Audio Electroacoust. 1969, 17, 77–85. [Google Scholar] [CrossRef]
  33. Jiang, J.; Mariampillai, A.; Yang, V.X.D.; Cable, A.; Standish, B.A.; Munce, N.R.; Leung, M.K.K.; Khurana, M.; Moriyama, E.H.; Wilson, B.C.; et al. Speckle Variance Detection of Microvasculature Using Swept-Source Optical Coherence Tomography. Opt. Lett. 2008, 33, 1530–1532. [Google Scholar] [CrossRef]
  34. Wang, R.K.; Jacques, S.L.; Ma, Z.; Hurst, S.; Hanson, S.R.; Gruber, A.; Fercher, A.; Drexler, W.; Hitzenberger, C.K.; Lasser, T.; et al. Three Dimensional Optical Angiography. Opt. Express 2007, 15, 4083–4097. [Google Scholar] [CrossRef] [PubMed]
  35. Biedermann, B.R.; Wieser, W.; Eigenwillig, C.M.; Palte, G.; Adler, D.C.; Srinivasan, V.J.; Fujimoto, J.G.; Huber, R. Real Time En Face Fourier-Domain Optical Coherence Tomography with Direct Hardware Frequency Demodulation. Opt. Lett. 2008, 33, 2556. [Google Scholar] [CrossRef]
  36. Wei, X.; Camino, A.; Pi, S.; Hormel, T.T.; Cepurna, W.; Huang, D.; Morrison, J.C.; Jia, Y. Real-Time Cross-Sectional and En Face OCT Angiography Guiding High-Quality Scan Acquisition. Opt. Lett. 2019, 44, 1431–1434. [Google Scholar] [CrossRef] [PubMed]
  37. Benedetto, J.J.; Zimmermann, G. Sampling Multipliers and the Poisson Summation Formula. J. Fourier Anal. Appl. 1997, 3, 505–523. [Google Scholar] [CrossRef]
  38. Fischer, J.V.; Srivastava, H.M. On the Duality of Discrete and Periodic Functions. Mathematics 2015, 3, 299–318. [Google Scholar] [CrossRef]
  39. Kruse, D.E.; Ferrara, K.W. A New High Resolution Color Flow System Using an Eigendecomposition-Based Adaptive Filter for Clutter Rejection. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2002, 49, 1384–1399. [Google Scholar] [CrossRef]
  40. Aumann, S.; Donner, S.; Fischer, J.; Müller, F. Optical Coherence Tomography (OCT): Principle and Technical Realization. In High Resolution Imaging in Microscopy and Ophthalmology; Springer: Cham, Switzerland, 2019; pp. 59–85. [Google Scholar] [CrossRef]
  41. Marvasti, F. Nonuniform Sampling: Theory and Practice. Springer: Berlin/Heidelberg, Germany, 2012. [Google Scholar]
  42. Shannon, C.E. Communication in the Presence of Noise. Proc. IRE 1949, 37, 10–21. [Google Scholar] [CrossRef]
  43. Liao, J.; Li, C.; Huang, Z. A Lightweight Swin Transformer-Based Pipeline for Optical Coherence Tomography Image Denoising in Skin Application. Photonics 2023, 10, 468. [Google Scholar] [CrossRef]
  44. Liao, J.; Yang, S.; Yang, S.; Zhang, T.; Li, C.; Huang, Z. Fast Optical Coherence Tomography Angiography Image Acquisition and Reconstruction Pipeline for Skin Application. Biomed. Opt. Express 2023, 14, 3899–3913. [Google Scholar] [CrossRef]
  45. Wang, R.K.; Zhang, A.; Choi, W.J.; Zhang, Q.; Chen, C.-L.; Miller, A.; Gregori, G.; Rosenfeld, P.J. Wide Field OCT Angiography Enabled by 2 Repeated Measurements of B-Scans. Opt. Lett. 2016, 41, 2330. [Google Scholar] [CrossRef] [PubMed]
  46. Fisher, R.A. Statistical Methods for Research Workers. In Breakthroughs in Statistics: Methodology and Distribution; Kotz, S., Johnson, N.L., Eds.; Springer: New York, NY, USA, 1992; pp. 66–70. ISBN 978-1-4612-4380-9. [Google Scholar]
  47. Kendall, M.G. The Advanced Theory of Statistics; Charles Griffin & Co., Ltd.: London, UK, 1946. [Google Scholar]
  48. Fürnkranz, J.; Chan, P.K.; Craw, S.; Sammut, C.; Uther, W.; Ratnaparkhi, A.; Jin, X.; Han, J.; Yang, Y.; Morik, K.; et al. Mean Squared Error. In Encyclopedia of Machine Learning; Springer: Boston, MA, USA, 2011; p. 653. [Google Scholar] [CrossRef]
  49. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [PubMed]
  50. van den Boomgaard, R.; van Balen, R. Methods for Fast Morphological Image Transforms Using Bitmapped Binary Images. CVGIP Graph. Models Image Process. 1992, 54, 252–258. [Google Scholar] [CrossRef]
  51. Liao, J.; Zhang, T.; Li, C.; Huang, Z. U-Shaped Fusion Convolutional Transformer Based Workflow for Fast Optical Coherence Tomography Angiography Generation in Lips. Biomed. Opt. Express 2023, 14, 5583–5601. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The processing flow diagram of the proposed RUPP (red solid box) and the traditional projection methods (blue dashed box) for FD-OCT structural and angiography imaging.
Figure 1. The processing flow diagram of the proposed RUPP (red solid box) and the traditional projection methods (blue dashed box) for FD-OCT structural and angiography imaging.
Diagnostics 14 01509 g001
Figure 2. An example of cross-sectional OCT (a) and OCTA (b) images. The deeper half of the imaging depth was highlighted with yellow dashed boxes.
Figure 2. An example of cross-sectional OCT (a) and OCTA (b) images. The deeper half of the imaging depth was highlighted with yellow dashed boxes.
Diagnostics 14 01509 g002
Figure 3. An example (fingertip) of structural OCT projections: (a) the ground truth generated from 12-repeat dataset; (b) traditional summation projection; (c) RUPP without down-sampling; (d) RUPP with down-sampling. (t: processing time in seconds; the processing time of RUPP variations are highlighted in red fonts; all red scale bars indicate 500 μm).
Figure 3. An example (fingertip) of structural OCT projections: (a) the ground truth generated from 12-repeat dataset; (b) traditional summation projection; (c) RUPP without down-sampling; (d) RUPP with down-sampling. (t: processing time in seconds; the processing time of RUPP variations are highlighted in red fonts; all red scale bars indicate 500 μm).
Diagnostics 14 01509 g003
Figure 4. Two plot figures of evaluation metrics over processing time: (a) PSNR and (b) SSIM over processing time. Note that the horizontal axes (processing time) are all in log scale.
Figure 4. Two plot figures of evaluation metrics over processing time: (a) PSNR and (b) SSIM over processing time. Note that the horizontal axes (processing time) are all in log scale.
Diagnostics 14 01509 g004
Figure 5. An example of OCTA projections imaging an oral ulcer lesion using various techniques: (a) the ground truth generated from 12-repeat dataset, (b) wED, (c) aED, (d) bED, (e) traditional SV, (f) RUPP-SV without down-sampling, (g) RUPP-ED without down-sampling, (h) RUPP-ED with down-sampling, and (i) RUPP-SV with down-sampling. (t: processing time in seconds; the processing time of RUPP variations are highlighted in red fonts; all red scale bars indicate 500 μm).
Figure 5. An example of OCTA projections imaging an oral ulcer lesion using various techniques: (a) the ground truth generated from 12-repeat dataset, (b) wED, (c) aED, (d) bED, (e) traditional SV, (f) RUPP-SV without down-sampling, (g) RUPP-ED without down-sampling, (h) RUPP-ED with down-sampling, and (i) RUPP-SV with down-sampling. (t: processing time in seconds; the processing time of RUPP variations are highlighted in red fonts; all red scale bars indicate 500 μm).
Diagnostics 14 01509 g005
Figure 6. Plot figures of evaluation metrics, (a) PSNR and (b) SSIM over processing time. (c,d) are the zoom-in plots of the dashed boxes in (a,b), respectively. Note that the horizontal axes (processing time) are all in log scale.
Figure 6. Plot figures of evaluation metrics, (a) PSNR and (b) SSIM over processing time. (c,d) are the zoom-in plots of the dashed boxes in (a,b), respectively. Note that the horizontal axes (processing time) are all in log scale.
Diagnostics 14 01509 g006
Table 1. Comparison among various structural OCT projection techniques.
Table 1. Comparison among various structural OCT projection techniques.
Projection Generation MethodsEvaluation Metrics
PSNRSSIMProcessing Time
(s)
Traditional summation projection31.45 ± 4.450.85 ± 0.081.76 ± 0.02
RUPP w/o DS a18.63 ± 4.030.64 ± 0.090.066 ± 0.0025
RUPP w/DS b18.49 ± 4.110.63 ± 0.090.040 ± 0.0054
a RUPP without down-sampling; b RUPP with down-sampling.
Table 2. Comparison among various OCTA projection techniques.
Table 2. Comparison among various OCTA projection techniques.
Projection Generation MethodsEvaluation Metrics
PSNRSSIMProcessing Time
(s)
wED20.98 ± 1.340.67 ± 0.0591139 ± 5.10
aED17.64 ± 2.250.57 ± 0.07611.59 ± 0.23
bED16.44 ± 1.290.47 ± 0.0857.01 ± 0.22
SV15.55 ± 1.720.46 ± 0.0954.97 ± 0.19
RUPP-SV w/o DS a11.61 ± 1.520.18 ± 0.0360.29 ± 0.0060
RUPP-ED w/o DS b11.23 ± 1.530.12 ± 0.0210.29 ± 0.0098
RUPP-ED w DS c11.23 ± 1.510.12 ± 0.0200.21 ± 0.0098
RUPP-SV w/DS d11.58 ± 1.510.17 ± 0.0360.15 ± 0.011
a RUPP-SV without down-sampling; b RUPP-ED without down-sampling; c RUPP-ED with down-sampling; d RUPP-SV with down-sampling.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, T.; Liao, J.; Zhang, Y.; Huang, Z.; Li, C. Robust Ultrafast Projection Pipeline for Structural and Angiography Imaging of Fourier-Domain Optical Coherence Tomography. Diagnostics 2024, 14, 1509. https://doi.org/10.3390/diagnostics14141509

AMA Style

Zhang T, Liao J, Zhang Y, Huang Z, Li C. Robust Ultrafast Projection Pipeline for Structural and Angiography Imaging of Fourier-Domain Optical Coherence Tomography. Diagnostics. 2024; 14(14):1509. https://doi.org/10.3390/diagnostics14141509

Chicago/Turabian Style

Zhang, Tianyu, Jinpeng Liao, Yilong Zhang, Zhihong Huang, and Chunhui Li. 2024. "Robust Ultrafast Projection Pipeline for Structural and Angiography Imaging of Fourier-Domain Optical Coherence Tomography" Diagnostics 14, no. 14: 1509. https://doi.org/10.3390/diagnostics14141509

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop