Next Article in Journal
Pseudotype Neutralization Assays: From Laboratory Bench to Data Analysis
Previous Article in Journal
Practical Method for Isolation of Phage Deletion Mutants
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Benchmark

Fast PET Scan Tumor Segmentation Using Superpixels, Principal Component Analysis and K-Means Clustering

1
Erasmus+ Joint Master Program in Medical Imaging and Applications, University of Burgundy, 21000 Dijon, France
2
Erasmus+ Joint Master Program in Medical Imaging and Applications, UNICLAM, 03043 Cassino FR, Italy
3
Erasmus+ Joint Master Program in Medical Imaging and Applications, University of Girona, 17004 Girona, Spain
4
Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland
*
Author to whom correspondence should be addressed.
Methods Protoc. 2018, 1(1), 7; https://doi.org/10.3390/mps1010007
Submission received: 28 October 2017 / Revised: 21 December 2017 / Accepted: 8 January 2018 / Published: 19 January 2018

Abstract

:
Positron Emission Tomography scan images are extensively used in radiotherapy planning, clinical diagnosis, assessment of growth and treatment of a tumor. These all rely on fidelity and speed of detection and delineation algorithm. Despite intensive research, segmentation has remained a challenging problem due to the diverse image content, resolution, shape, and noise. This paper presents a fast positron emission tomography tumor segmentation method using superpixels. Principal component analysis is applied on the superpixels and their average value. The distance vector of each superpixel from the average is computed in the principal components coordinate system. Finally, k-means clustering is applied on the distance vector to recognize tumor and non-tumor superpixels. The proposed approach is implemented in MATLAB 2016A, and promising accuracy with execution time of 2.35 ± 0.26 s is achieved. Fast execution time is achieved since the number of superpixels, and the size of distance vector on which clustering was done are low compared to the number of pixels in the image.

1. Introduction

Positron emission tomography is a non-invasive nuclear medicine afunctional imaging method that images the distribution of biologically targeted radiotracers with high sensitivity. Positron emission tomography (PET) imaging provides detailed quantitative information about the number of diseases and is often used to evaluate cancer with segmentation as a principal role. Image contrast enhancement is an essential pre-processing stage in image segmentation [1]. For several years, great effort has been devoted to the study of image enhancement techniques; wavelet-contourlet transform [2], iterative denoising and partial volume correction [3], iterative deconvolution [4] have been among them.
Segmentation can be thought of as two consecutive processes: recognition and delineation. Recognition is determining where the targeted object is in the image, while the second process is defining the spatial extent of the recognized region [5]. It has been demonstrated that manual segmentation is time-consuming, labor intensive, operator dependent, subjective, and these make it less precise and reproducible [6,7]. In the recognition process, regions of high uptake of tracer are identified either manually or automatically [8].
Although the number of PET image segmentation publications has always been lower than both computerized tomography (CT) and magnetic resonance imaging (MRI) [6], there have been some publications; graph cut and locally connected conditional random field via energy minimization [9], binary and Gaussian filtering regularized level set method with capability of detecting weak tumor boundary [10]. In addition, k-means and fuzzy c-means clustering-based segmentation has been developed [11]; however, clustering was applied to image pixels directly and this is computationally demanding for large-sized images and/or, as the number of clusters is higher.
Principal component analysis (PCA)-based evaluation of internal statistics of image patches gives tremendous insight to recognizing patterns in an image [12], which is applied to detect salient objects in a natural image.
This paper presents the implementation of an unsupervised automatic PET image segmentation system to detect a tumor. Section 2 presents the mathematical formulation and implementation of proposed approach which contains, contrast enhancement superpixels, and PCA followed by k-means clustering to recognize the cancer superpixels. Section 3 is devoted to discussion and evaluation of the simulation results. Finally, Section 4 concludes the paper.

2. Implementation

The workflow of the proposed approach is divided into three stages: pre-processing, feature extraction and clustering, and segmentation; where the second step can be divided into three sub-steps, and the third step into two as shown in Figure 1.

2.1. Pre-Processing

Image enhancement is a subjective process and its goal is to make the image suitable for the next steps. In this paper, we have applied piecewise contrast enhancement. Upon extensive analysis of different images, we have found that piecewise linear stretching shown in Equation (1), improves the overall performance of our implementation. However, to apply this enhancement to other modality images, it might be needed to tune its parameter.
I e n h = {     I , i f   I   110 55 145 ( I 110 ) + 200 , O t h e r w i s e
where I is input image and Ienh is contrast enhanced image.

2.2. Feature Extraction

Feature extraction is a process of simplifying the content of a large set of data to describe it efficiently for the purpose of facilitating further processing (speed), storage requirement, and dimensionality reduction. In this paper, features are extracted using superpixels and PCA.
A superpixel is a group of pixels which are in close proximity and sharing similar intensity. The simple linear iterative clustering (SLIC) algorithm [13] is applied due to its fast computational time as stated in [14,15]. The size of a superpixel is the number of pixels belonging to that superpixel. The size of original superpixels extracted from SLIC is different as there is a large homogenous region in some part of the image resulting in large superpixels, while there might also be a small number of pixels near each other with similar pixel value in some region of the image. Generally, superpixels in the background and non-tumor part of the image will have a large number of pixels.
However, we need the size of superpixels to be the same to perform PCA. This problem is solved as follows:
(1)
We computed the average size of the superpixel as shown in Equation (2).
M   =   1 N i = 1 N n i
where N is the number of superpixels, and ni is the number of pixels in ith superpixel. Then, M is an average number of pixels per superpixel.
(2)
Then, the size of each superpixel is made same as that of the average one by padding some pixel value to the smaller size superpixel and removing some intensity value from the large size superpixels. Instead of appending random intensity values to smaller sized superpixels, we pad by repeating the last pixels value of the superpixel itself. Finally, the superpixel matrix is generated as shown in Equation (3)
S =   [ x 11 x 12 x 13 x 21 x 22 x 23 . . . .     . . x 1 N .     .   . x 2 N .     . . . . . . . . . x M 1 x M 2 x M 3 .     . . . .     . . . .     . . x M N ]
where each column represents a superpixel pixel, M is in Equation (2) and N is the number of superpixels.
As the goal is to detect pixel that belong to the cancer or tumor, and in PET images, pixels that belongs to tumor have distinct intensity due to high uptake of radioactive tracer; so we need a method that analyses the internal statistics and makes easy to differentiate the cancer superpixels. Principal component analysis is one of the novel methods to study internal statistics of data. In addition to that, PCA reduces the dimensional space of the data [16]. In our implementation, PCA of superpixels is done as follows:
(1)
Compute average superpixel.
S a =   1 N i = 1 N S i
where Si is the ith superpixel and Sa average superpixel.
(2)
Determine the covariance of superpixels (Cs)
C s =   1 N + 1 ( Y     Y a t ) ( Y     Y a t ) T
where Y is the superpixel matrix after average superpixel padding and Yat is the mean of transpose of Y.
(3)
Calculate the eigensuperpixels (eigenvectors) and eigenvalues of the covariance matrix
C s =   P Σ P T
where P is matrix with eigensuperpixels as column and Σ is diagonal matrix of eigenvalues, λ1, λ2, …, λN, where, λ1 ≥ λ2 ≥ λ3…≥ λN.
The magnitude of eigenvalue shows the variance of the data in the direction of its corresponding eigensuperpixel. For N superpixels in Equation (3) above, total variance of intensities of the M- dimensional superpixels can be computed in terms of eigenvalues from Equation (7).
V = k = 1 N λ k
where V is the total variance.
(4)
Project the superpixels onto eigensuperpixels that contain most of variance of the data. In Equation (6), the number of principal components is same as the number of superpixels. As stated in [17], the eigenvectors or principal components that contain at least 95% of the variance of superpixels can represent the whole image with confidence and this is computed as shown in Equation (8). It reduces the dimensional space, as most of the information is contained in the first two or three largest eigenvalues.
k = 1 K λ k   0.95
In our test images, 95% of the variance of superpixels was in the top two (K = 2) principal components, with most of them reducing M-dimensional superpixels to a 2D point. Once the dominant vectors are found, for feature extraction, the superpixel matrix is projected onto these vectors using Equation (9).
Y p r o j = P K T Y
where Pk is eigenvectors matrix that contains at least 95% of the variation in the image and Pproj is projection of superpixel matrix to Pk.
(5)
Calculate the distance of each superpixel to average superpixel. Computing distance should consider the distribution of superpixels in the principal component coordinate system [12]. To incorporate this concept, we computed the distance along the principal components. Mathematically, this will be computing L1 norm distance in the principal components coordinate system as shown in Equation (10) below.
D ( S i ) = | | S i | | 1
where S′i is coordinate of Si relative to Sa in the principal component coordinate system, and D is L1 norm distance.

2.3. Tumor Detection and Contouring

Currently, there are a variety of PET segmentation methods. The most commonly used method is fuzzy locally adaptive Bayesian (FLAB), classification/clustering, and a mixture of them. As stated in [6] there is a growing need for clustering-based methods as they have the capability of detecting tumors with a complex shape in heterogeneous PET images. In our work, after the distance vector is calculated in the principal components coordinate system, k-means clustering is applied. k-means is an algorithm that clusters a set of data based on a distance measure. This clusters superpixels as tumor and non-tumor, which is a binary classification using a minimization problem as shown in Equation (11). Then, morphological operations (erosion and dilation) are then applied to delineate the spatial scope of the tumor.
argmin C i = 1 2 X     C i D = argmin C i = 1 2 X     C i | | X μ i | | 2 2
where ci is the set of points that belong to cluster i, µi is center of ith cluster, X is distance vector extracted above and D is square of the Euclidean distance.

3. Result and Discussion

Figure 2a,b below shows the input image and enhanced image respectively. It can be clearly seen that contrast between tumor and non-tumor region of the image is enhanced.
For the input image in the figure, 692 superpixels were extracted and more than 95% of the variance of superpixels was contained in the top two eigensuperpixels. The scatter plot after the projection onto the top two dominant eigensuperpixels is plotted in Figure 3. In the figure, the principal component 1 is an eigensuperpixel with the highest eigenvalue or the component that constitutes the highest variance of superpixel intensities, while principal component 2 has the second highest eigenvalue among all eigensuperpixels. In the plot, high-dimensional superpixels are represented by a two-dimensional vector. From the scatter plot, it is evident that most of the superpixels are concentrated around the average superpixel (red asterik) as most parts of the image have similar pixel intensity distribution, while the superpixels that correspond to tumor are situated far from it. There are 693 points (692 superpixels + average superpixel) in the scatter plot.
Figure 4 illustrates L1 norm distance of superpixels along principal components coordinate system from average superpixel. It has superpixel index as horizontal axis and distance as a vertical axis. For the input image in Figure 2a is 233 pixels by 328 pixels, the distance is 692 dimension vector. If distance was computed from all pixels to average pixels intensity the result will be a 76424-dimensional vector, which needs larger memory and high computation time. As depicted in Figure 5, most of the superpixels are within L1 distance of 500, while 4 superpixels have a distance greater than 1500.
Figure 5a shows k-means clustering of distance vector in Figure 4. Superpixels with low distance are normal or non-tumor (represented by green dots). Superpixels extracted from tumor region (red asterisk) are far from average superpixel. In addition to that, heatmap of distance of superpixels from the average in the image space are shown in Figure 5b. The tumor area is shown in yellow color which is more distinguishable from the other superpixels and has large distance as depicted in the color bar. The internal statistics of the tumor superpixels is very different from the average; thus, the distance will be very large. The heatmap shows the probability that each pixel belongs to a tumor.
The final result of our segmentation algorithm for input image in Figure 2a is shown in the Figure 6. The tumor region is identified and delineated with good accuracy.
Table 1 contains information about the size of the input image, the number of superpixels, size of extracted features (distance) after PCA and total execution time of some test images. The size of extracted features and number of superpixels are much smaller than the number of pixels of the image. Implementation was done in MATLAB 2016A (MathWorks, Natick, MA, United States) using core i5-4210U CPU, 1.7 GHz. The main concern of the paper was to design a fast PET tumor segmentation. As it can be seen from the table, the execution time of our proposed approach is very fast due to the following reasons: first, there is usually a small number of superpixels compared with pixels numbers in the image. This will save a lot of time in the algorithms after superpixels are extracted. Second, PCA again further reduces the dimension of data which is the input to clustering. In addition to that, MATLAB vectorization capability has also been extensively exploited throughout our implementation. Figure 7 shows sample input and output images.
Our implementation can detect and contour tumors irrespective of their shape, location and number of tumors in the image.

4. Conclusions

The main goal of this paper was to implement a fast algorithm to segment tumor in PET scan images. Detailed explanation of the mathematical formulation and discussion of intermediate and final results were also presented. To speed up execution time of the segmentation algorithm, PCA was applied on superpixels extracted from the contrast enhanced image. PCA was applied to reduce dimensionality and to study the internal statistics of superpixels. The segmentation was done using k-means clustering. Our implementation is able to localize and delineate the tumor with satisfactory accuracy and small execution time.
The algorithm presented in this paper can be applied also in disciplines other than medicine to detect target areas that have distinctive internal statistics compared to the rest of the image. For a large sized image, the speed gained will be noticeable as a result of dimensionality reduction from superpixels and PCA.
Our algorithm has a promising result on PET scan images. Future work will aim at applying this analysis to CT and MRI images.

Acknowledgments

We thank Alain Lalande and Alexandre Cochet from University of Burgundy for kindly providing PET images for testing our implementation.

Author Contributions

Yeman Brhane Hagos conceived the original idea, implemented the experiment and wrote the report. Vu Hoang Minh has contributed in proposing the idea, implementing the work, and in writing literature review. Saed Khawaldeh has contributed in data collection, idea implementation, paper editing, revising, and formatting. Tajwar Abrar Aleef, and Usama Pervaiz have contributed in editing the paper and implementing the work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sun, C.-C.; Ruan, S.-J.; Shie, M.-C.; Pai, T.-W. Dnamic Contrast enhancement based on histogram specification. IEEE Trans. Consum. Electron. 2005, 51, 1300–1305. [Google Scholar]
  2. Hanzouli, H.; Lapuyade-Lahorgue, J.; Monfrini, E.; Delso, G.; Pieczynski, W.; Visvikis, D.; Hatt, M. PET/CT image denoising and segmentation based on a multi observation and a multi scale Markov tree model. In Proceedings of the Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), Seoul, Korea, 27 October–2 November 2013; pp. 1–4. [Google Scholar]
  3. Xu, Z.; Bagci, U.; Gao, M.; Mollura, D. Improved PET image quantification via iterative denoising and partial volume correction. J. Nucl. Med. 2015, 56, 1744. [Google Scholar]
  4. Slavine, N.; McColl, R.; Kulkarni, P. Iterative deconvolution method for preclinical PET/CT image enhancement: Application in imaging Alzheimer’s plaque deposition in ad transgenic mice. J. Nucl. Med. 2016, 57, 1985. [Google Scholar]
  5. Saha, P.K.; Udupa, J.K. Scalebased diffusive image filtering preserving boundary sharpness and fine structures. IEEE Trans. Med. Imaging 2001, 20, 1140–1155. [Google Scholar] [CrossRef] [PubMed]
  6. Foster, B.; Bagci, U.; Mansoor, A.; Xu, Z.; Mollura, D.J. A review on segmentation of positron emission tomography images. Comput. Boil. Med. 2014, 50, 76–96. [Google Scholar] [CrossRef] [PubMed]
  7. Zaidi, H.; El Naqa, I. Pet-guided delineation of radiation therapy treatment volumes: A survey of image segmentation techniques. Eur. J. Nucl. Med. Mol. Imaging 2010, 37, 2165–2187. [Google Scholar] [CrossRef] [PubMed]
  8. Bagci, U.; Udupa, J.K.; Yao, J.; Mollura, D.J. Co-segmentation of functional and anatomical images. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Berlin/Heidelberg, Germany, 2012; pp. 459–467. [Google Scholar]
  9. Nishio, M.; Kono, A.K.; Kubo, K.; Koyama, H.; Nishii, T.; Sugimura, K. Tumor segmentation on 18F FDG-PET images using graph cut and local spatial information. Open J. Med. Imaging 2015, 5, 174. [Google Scholar] [CrossRef]
  10. Zhang, K.; Zhang, L.; Song, H.; Zhou, W. Active contours with selective local or global segmentation: A new formulation and level set method. Image Vis. Comput. 2010, 28, 668–676. [Google Scholar] [CrossRef]
  11. Meena, A.; Raja, K. Segmentation of Alzheimer’s Disease in PET scan datasets using MATLAB. Int. J. Inf. Sci. Comput. arXiv 2012, arXiv:1302.6426. [Google Scholar]
  12. Margolin, R.; Tal, A.; ZelnikManor, L. What makes a patch distinct? In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013; pp. 1139–1146. [Google Scholar]
  13. Achanta, R.; Shaji, A.; Smith, K.; Lucchi, A.; Fua, P.; Susstrunk, S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Inell. 2010, 34, 2274–2282. [Google Scholar] [CrossRef] [PubMed]
  14. Wu, Z.; Hu, Z.; Fan, Q. Superpixel-based unsupervised change detection using multi-dimensional change vector analysis and Svm-based classification. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2012, 7, 257–262. [Google Scholar] [CrossRef]
  15. Tian, Z.; Liu, L.; Zhang, Z.; Xue, J.; Fei, B. A supervoxel-based segmentation method for prostate MR images. Med. Phys. 2016, 44, 558–569. [Google Scholar] [CrossRef] [PubMed]
  16. Chung, H.; Lu, G.; Tian, Z.; Wang, D.; Chen, Z.G.; Fei, B. Superpixel-based spectral classification for the detection of head and neck cancer with hyperspectral imaging. Proc. SPIE Int. Soc. Opt. Eng. 2016, 813–978. [Google Scholar] [CrossRef]
  17. Jackson, D.A. Stopping rules in principal components analysis: A comparison of heuristical and statistical approaches. Ecology 1993, 74, 2204–2214. [Google Scholar] [CrossRef]
Figure 1. Implementation overview. PET: Positron emission tomography; PCA: principal component analysis.
Figure 1. Implementation overview. PET: Positron emission tomography; PCA: principal component analysis.
Mps 01 00007 g001
Figure 2. Image before and after enhancement.
Figure 2. Image before and after enhancement.
Mps 01 00007 g002
Figure 3. Scatter plot of projection of superpixels of the enhanced image onto the principal components classification is small.
Figure 3. Scatter plot of projection of superpixels of the enhanced image onto the principal components classification is small.
Mps 01 00007 g003
Figure 4. Distance of superpixels from average superpixel.
Figure 4. Distance of superpixels from average superpixel.
Mps 01 00007 g004
Figure 5. Superpixel k-means clustering and Heat map plot. (a) Superpixel k-means clustering; (b) heat map plot.
Figure 5. Superpixel k-means clustering and Heat map plot. (a) Superpixel k-means clustering; (b) heat map plot.
Mps 01 00007 g005
Figure 6. Output image with tumor contoured.
Figure 6. Output image with tumor contoured.
Mps 01 00007 g006
Figure 7. Sample input and output images.
Figure 7. Sample input and output images.
Mps 01 00007 g007aMps 01 00007 g007b
Table 1. Size of images, superpixels, distance vector after Principal Component Analysis (PCA), and execution time.
Table 1. Size of images, superpixels, distance vector after Principal Component Analysis (PCA), and execution time.
SizeNo. SuperpixelsDistance Vector DimensionExecution Time (s)
Image 1233 × 3286926922.2
Image 2233 × 3285005002.4
Image 3681 × 5726606602.55

Share and Cite

MDPI and ACS Style

Hagos, Y.B.; Minh, V.H.; Khawaldeh, S.; Pervaiz, U.; Aleef, T.A. Fast PET Scan Tumor Segmentation Using Superpixels, Principal Component Analysis and K-Means Clustering. Methods Protoc. 2018, 1, 7. https://doi.org/10.3390/mps1010007

AMA Style

Hagos YB, Minh VH, Khawaldeh S, Pervaiz U, Aleef TA. Fast PET Scan Tumor Segmentation Using Superpixels, Principal Component Analysis and K-Means Clustering. Methods and Protocols. 2018; 1(1):7. https://doi.org/10.3390/mps1010007

Chicago/Turabian Style

Hagos, Yeman Brhane, Vu Hoang Minh, Saed Khawaldeh, Usama Pervaiz, and Tajwar Abrar Aleef. 2018. "Fast PET Scan Tumor Segmentation Using Superpixels, Principal Component Analysis and K-Means Clustering" Methods and Protocols 1, no. 1: 7. https://doi.org/10.3390/mps1010007

Article Metrics

Back to TopTop