Automatic Segmentation and Visualisation of the Epirretinal Membrane in OCT Scans Using Densely Connected Convolutional Networks ^†

Abstract

The Epiretinal Membrane (ERM) is an ocular disease that appears as a fibro-cellular layer of tissue over the retina, specifically, over the Inner Limiting Membrane (ILM). It causes vision blurring and distortion, and its presence can be indicative of other ocular pathologies, such as diabetic macular edema. The ERM diagnosis is usually performed by visually inspecting Optical Coherence Tomography (OCT) images, a manual process which is tiresome and prone to subjectivity. In this work, we present a methodology for the automatic segmentation and visualisation of the ERM in OCT volumes using deep learning. By employing a Densely Connected Convolutional Network, every pixel in the ILM can be classified into either healthy or pathological. Thus, a segmentation of the region susceptible to ERM appearance can be produced. This methodology also produces an intuitive colour map representation of the ERM presence over a visualisation of the eye fundus created from the OCT volume. In a series of representative experiments conducted to evaluate this methodology, it achieved a Dice score of $0.826\pm 0.112$ and a Jaccard index of $0.714\pm 0.155$. The results that were obtained demonstrate the competitive performance of the proposed methodology when compared to other works in the state of the art.

1. Introduction

The Epiretinal Membrane (ERM) is an ocular disease that consists of scar tissue that is formed over the boundary between the retina and the vitreous body of the eye, an area known as the Inner Limiting Membrane (ILM). As the ERM appears over the retina, it may start to contract, exerting a traction and producing puckers or wrinkles over the underlying tissue. This may cause vision blurring, distortion, and metamorphopsia.

Several authors have approached the automatic detection of the ERM using Optical Coherence Tomography (OCT) images. In References [1,2], the authors identify the ILM layer using classical machine learning algorithms and local luminosity patterns; Lo et al. [3] proposes the use of a Residual Neural Network for the screening of ERM in cross-sectional OCT images, while, in Sonobe et al. [4], the authors compare the use of classical machine learning algorithms and deep learning for the detection of ERM, with deep learning outperforming the classical methods. These works, however, deal only with the screening of ERM, a simpler problem than its precise segmentation. In this regard, only Baamonde et al. [5,6] has approached the problem of segmenting the ERM in OCT images, using classical machine learning methods in this case.

In this work, we present an automatic methodology for the segmentation of the ERM in OCT volumes by using deep learning. This methodology consists of three phases, corresponding to the detection of the region of interest, the segmentation of the ERM via the classification of window samples of the ILM, and the visualisation and post-processing of the segmentation map [7]. This process produces a representation of the ERM presence and absence over the eye fundus in the form of a 2D colour map. This map can be used to aid clinicians in the detection and posterior removal of the ERM via pars plana vitrectomy.

2. Methodology

The ERM segmentation methodology consists of three steps. In the first one, the ILM is segmented using active contours [8]. The position of the ILM is modeled as a height value for every image column, since the retina appears as an irregular horizontal line in OCT images. The active contour models are allowed to contract downwards until they converge over the ILM. With the region of interest segmented, the ILM can be sampled via sliding window. The next step consists of sample classification. A Densely Connected Convolutional Neural Network [9] is then used to classify each of the $112\times 112$ pixel sliding window samples into either healthy or pathological. These classes are then assigned to the central pixel around which each sliding window was extracted, effectively producing a segmentation of each OCT scan. This process is illustrated in Figure 1. In the final step, all the slice segmentations are combined to produce a 2D preliminary segmentation map of the whole eye fundus. A post-processing step is then applied to this map in order to soften the boundary of the ERM and eliminate some misclassifications caused by image artifacts. This post-processed map is then overlaid on a reconstruction of the eye fundus to produce an intuitive visualisation of the ERM presence over the eye tissue, as illustrated in Figure 2.

Figure 1. The first two steps of the proposed methodology, producing a 2D segmentation of the ERM in a single OCT slice.

Figure 2. The final steps of the proposed methodology. Slice segmentations are stacked to form a map. This map is post-processed and overlaid on a reconstruction of the eye fundus.

3. Results and Conclusions

The proposed methodology was evaluated in terms of its ability to correctly segment the ERM, with preliminary maps achieving a Dice score of $0.800\pm 0.100$ and a Jaccard index of $0.676\pm 0.141$. When applying the post-processing stage, these results were improved up to $0.826\pm 0.112$ and $0.714\pm 0.155$. A comparison between the proposed methodology and the state-of-the-art proposal [6], which only takes into account ERM-positive eyes, can be found in Table 1. These results show that the proposed system is able to accurately segment the ERM, even surpassing the current state of the art before the application of the post-processing stage.

Table 1. Comparison of Dice and Jaccard indexes of the previous work and the deep learning method proposed in this work for the segmentation and post-processing stages.

		ERM-Positive Eyes Only
		Baamonde et al. [6]			Our Proposal
		Segmentation	Post-Processing		Segmentation	Post-Processing
Dice	Mean	0.670	0.780		0.810	0.833
	SD	$\pm 0.110$	$\pm 0.092$		$\pm 0.099$	$\pm 0.091$
Jaccard	Mean	0.515	0.649		0.689	0.725
	SD	$\pm 0.140$	$\pm 0.128$		$\pm 0.139$	$\pm 0.129$