Next Article in Journal
A Portable Stiffness Measurement System
Next Article in Special Issue
Vibration and Noise in Magnetic Resonance Imaging of the Vocal Tract: Differences between Whole-Body and Open-Air Devices
Previous Article in Journal
Study and Validation of Eavesdropping Scenarios over a Visible Light Communication Channel
Previous Article in Special Issue
Optical Methods in Fingerprint Imaging for Medical and Personality Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Micro-Droplet Detection Method for Measuring the Concentration of Alkaline Phosphatase-Labeled Nanoparticles in Fluorescence Microscopy

1
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
2
Emory University School of Medicine, Georgia Institute of Technology, Atlanta, GA 30329 USA
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(11), 2685; https://doi.org/10.3390/s17112685
Submission received: 1 October 2017 / Revised: 17 November 2017 / Accepted: 19 November 2017 / Published: 21 November 2017

Abstract

:
This paper developed and evaluated a quantitative image analysis method to measure the concentration of the nanoparticles on which alkaline phosphatase (AP) was immobilized. These AP-labeled nanoparticles are widely used as signal markers for tagging biomolecules at nanometer and sub-nanometer scales. The AP-labeled nanoparticle concentration measurement can then be directly used to quantitatively analyze the biomolecular concentration. Micro-droplets are mono-dispersed micro-reactors that can be used to encapsulate and detect AP-labeled nanoparticles. Micro-droplets include both empty micro-droplets and fluorescent micro-droplets, while fluorescent micro-droplets are generated from the fluorescence reaction between the APs adhering to a single nanoparticle and corresponding fluorogenic substrates within droplets. By detecting micro-droplets and calculating the proportion of fluorescent micro-droplets to the overall micro-droplets, we can calculate the AP-labeled nanoparticle concentration. The proposed micro-droplet detection method includes the following steps: (1) Gaussian filtering to remove the noise of overall fluorescent targets, (2) a contrast-limited, adaptive histogram equalization processing to enhance the contrast of weakly luminescent micro-droplets, (3) an red maximizing inter-class variance thresholding method (OTSU) to segment the enhanced image for getting the binary map of the overall micro-droplets, (4) a circular Hough transform (CHT) method to detect overall micro-droplets and (5) an intensity-mean-based thresholding segmentation method to extract the fluorescent micro-droplets. The experimental results of fluorescent micro-droplet images show that the average accuracy of our micro-droplet detection method is 0.9586; the average true positive rate is 0.9502; and the average false positive rate is 0.0073. The detection method can be successfully applied to measure AP-labeled nanoparticle concentration in fluorescence microscopy.

1. Introduction

Advances in microscopy and fluorescence tools have pushed the quantitative biological research for biomolecules at nanometer and sub-nanometer scales [1,2,3]. Among these fluorescence tools, nanoparticles on which alkaline phosphatase (AP) was immobilized (AP-labeled nanoparticles for short) [4] are widely used as signal markers for tagging biomolecules of interest due to their stabilization and convenience for operation. Covered with a specific antibody, the AP-labeled nanoparticle can label one target biomolecule and emit a fluorescent signal by catalyzing the corresponding substrates. Therefore, the biomolecular concentration can be directly obtained by measuring the AP-labeled nanoparticle concentration. Traditional methods for AP-labeled nanoparticle concentration measurement are to divide the amount of total fluorescent signals from the AP-labeled nanoparticles by the volume of solution in the fluorescence microscopy image. However, it is difficult to count AP-labeled nanoparticles directly from fluorescent images since AP-labeled nanoparticles are too small to detect and are closely clustered. To solve this problem, a widely-used technology called the droplet microfluidics technique has been used to encapsulate the individual AP-labeled nanoparticle in monodispersed micro-droplets [5]. Micro-droplets with a similar size are water-in-oil droplets, which can be used as micro-reactors to encapsulate and detect AP-labeled nanoparticles [6]. All the micro-droplets encapsulate fluorogenic substrates, but only a small portion of micro-droplets would carry AP-labeled nanoparticles. Only the micro-droplets encapsulating AP-labeled nanoparticles will emit remarkable fluorescent signals via the enzymatic reaction between the APs and the corresponding fluorogenic substrates within droplets. We call these micro-droplets fluorescent micro-droplets and the others empty micro-droplets. However, empty micro-droplets may emit weak fluorescent signals that result from a few APs scattered within the micro-droplet in practice. Since the process of encapsulating AP-labeled nanoparticles in micro-droplets follows a random Poisson distribution [6,7], the probability of occurrence of the micro-droplets encapsulating AP-labeled nanoparticles can be obtained via the percentage of the fluorescent micro-droplets. Therefore, we can detect the proportion of fluorescent micro-droplets to the overall micro-droplets to measure the AP-labeled nanoparticle concentration. To achieve this purpose, micro-droplet detection is necessary to analyze the AP-labeled nanoparticle concentration.
The micro-droplet detection usually consists of two steps: detection of the overall micro-droplets and detection of fluorescent micro-droplets. There are certain problems involved in the detection of the overall micro-droplets. The empty micro-droplets with weak luminance are hard to detect due to the weak difference between empty micro-droplets and their surroundings. The complex noise environment in the fluorescence images may also increase the difficulties of micro-droplet detection. There are two important types of noises: the intrinsic photon noises resulting from the random nature of photon emission and the background noises caused by the detector’s electronics [8]. Moreover, the additional noises like small bright speckles and vesicles could also impede subsequent droplet detection. Furthermore, there is still a tough issue that most micro-droplets are closely connected in the fluorescence images.
Traditional fluorescent target detection methods have been reported in the literature [9,10,11]. In [12], the authors provide a thorough comparative evaluation of the most frequently-used spot detection methods. The study shows the superiority of the multiscale variance-stabilizing transform (MSVST) detector method [13] and the H-dome-based detector (HD) method [14]. The MSVST method combines the red variance stabilizing transform (VST) with the isotropic undecimated wavelet transform [13,15] and performs well in filtering mixed-Poisson-Gaussian noises and in detecting fluorescent particles. However, the bright speckles and vesicles in the image may lead to the false detection of micro-droplets. Being different from MSVST, the HD method detects spots by extracting peaks with an amplitude higher than a given height, called domes, in a Laplace-of-Gaussian (LoG) filtered or Gaussian-filtered image. Because the amplitude of the peaks in micro-droplets varies in a large range, the HD method may not work well in micro-droplet detection. To overcome this drawback, Rezatofighi et al. [16] proposed an improved method called the maximum possible height-dome method (MPHD) to adaptively extract the dome. However, it may not perform well when both the bright speckles and closely-connected micro-droplets appear in the image. To further improve the detection performance, Jaiswal et al. [17] proposed a multi-scale spot-enhancing filter method (MSSEF) to calculate the binary map, which is obtained by iteratively applying a threshold to the LoG filtered image with scale changing. This method can significantly improve the detection performance on multiple closely-connected particles. However, since the selected threshold with respect to the mean and variance of the image may be inaccurate, it may not perform well on the micro-droplet detection. Besides, Basset et al. [18,19,20] proposed methods to select the optimal LoG scale or multiple scales corresponding to the different spot sizes in the image, but test results on fluorescent micro-droplet images proved the ineffectiveness of this method for the micro-droplet detection. As explained by Smal et al. [12], most current methods follow a common detection scheme, which consists of denoising the image, enhancing the spots and, finally, extracting the target spots in a binary map to further count the micro-droplets or estimate the positions. In addition, these methods perform ineffectively for the detection of closely-connected micro-droplets by implementing a connect-component analysis method. Recently, an automatic hotspots detection framework [21] was proposed to successfully detect active areas inside cells that show changes in their calcium concentration. However, this automatic segmentation of intracellular calcium concentration in individual video frames is about 80 % accurate and may not be suitable for precisely detecting a single active cell in the highly accurate concentration measurement. Therefore, there is a need to develop new approaches in order to improve the accuracy and robustness for detecting the micro-droplets.
To address these difficulties, we propose an overall micro-droplet detection method for fluorescent micro-droplet images (FMIs).

2. Methods

The proposed method includes the following steps: (1) The Gaussian filter first removes the noise in the red fluorescent micro-droplet image. (2) The contrast-limited adaptive histogram equalization (CLAHE) [22] method divides the whole filtered image into different blocks and adaptively adjusts the local histogram of each block to enhance the contrasts of the weak luminance regions of overall micro-droplets. (3) The red maximizing inter-class variance thresholding [23,24,25] method (OTSU) segments the enhanced image to get the binary map of the overall micro-droplets. (4) By performing on the segmented binary map, the circular Hough transform method (CHT) [26,27] perfectly detects the overall micro-droplets due to its advantage in detecting the micro-droplets that are closely connected with each other. With the combined strengths of CLAHE, OTSU thresholding and the CHT methods, our method shows significant performances on the overall micro-droplet detection. Finally, the fluorescent micro-droplet can be easily extracted via an intensity-mean-based thresholding segmentation method and be counted with the CHT method again. We have compared the performance of our method on FMIs with the performances of the state-of-the-art methods including MSVST [13], MPHD [16] and MSSEF [17]. The comparative results demonstrate that our method outperforms these state-of-the-art methods.

2.1. Overall Micro-Droplet Detection

Figure 1 shows the overview of the proposed method for overall micro-droplet detection. We begin by preprocessing an input image with a Gaussian filter. Then, CLAHE is performed on the local histogram of the filtered image to enhance the contrast of micro-droplets. After this image enhancement, the difference between micro-droplets and background increases, and an OTSU thresholding-based segmentation method is applied to obtain a binary map of the overall micro-droplets. Finally, the CHT method precisely detects the circular contour of the overall micro-droplets.

2.1.1. Noise Reduction with the Gaussian Filter

The main noise sources in fluorescence microscopy images are the shot noise occurring in the photon counting in the imaging process and the additive Gaussian noise created by the electron characteristics of detectors [8,12]. The shot noise of the photons results from the random nature of photon emission and can be modeled as Poisson noise [8,28] when there is only a handful of photons emitted, whereas the noise can be considered as Gaussian noise when the number of photons is sufficient.
In most situations, the noise in fluorescent micro-droplet images can be approximately considered as Gaussian noise. Therefore, we simply use a normal Gaussian filter to remove the noise. In Figure 2, the signal-to-noise radio (SNR) of the denoised image is enhanced compared to that of the original images. We can see that the noises are eliminated effectively in the zoomed version of filtered image I.

2.1.2. Contrast Limited Adaptive Histogram Equalization

In the filtered image, there are many micro-droplets with weak luminance. We then use the CLAHE [22] method to enhance the contrast of micro-droplets.
Firstly, the image I is divided into N N blocks (N is a user-defined constant, and N is by default set to 8) and local histogram of every block is calculated. Since the contrast amplification in the vicinity of a given pixel value is proportional to the histogram value at that pixel value, the local histogram is clipped at a predefined value T to limit the over-amplification of noise. The part of the histogram exceeding T is redistributed among all histogram bins to keep the area of the histogram unvarying. Then, histogram equalization uses the same transformation derived from the local histogram to transform all pixels in the block and enhance local contrasts. With these operations finished, we combine all the blocks together and apply bilinear interpolation to eliminate the block effect of images. Finally, the micro-droplets at low intensities are prominently enhanced. The output of this step is an enhanced image J, which is shown in Figure 3.

2.1.3. Maximizing inter-class Variance Thresholding Method

In Figure 3, the pixels in the enhanced image J can be grouped into two classes including background and micro-droplet pixels in terms of histogram distribution. Therefore, OTSU thresholding [23,24,25] is the most suited method to extract micro-droplets via histogram thresholding. The optimal threshold of this method is chosen by maximizing inter-class variance. The segmented binary map by the OTSU method effectively highlights the desired micro-droplets. However, there may be several falsely detected spots in the binary map due to the bright specks having a far smaller size than the micro-droplets in image J. In order to obtain accurate detection results, the morphological opening operation is used for post-processing to eliminate the influence of these abnormal spots. The output of this step is denoted as image K.

2.1.4. Circle Detection via Circular Hough Transform

After getting the segmented binary map, we must count the number of overall micro-droplets to achieve a final detection result. The traditional fluorescent spot detection algorithms are usually based on connected component analysis (CCA). CCA-based methods perform well on detecting isolated micro-droplets, but poorly on detecting closely-connected micro-droplets. With further observation of micro-droplets, we found that all the micro-droplets appear as round spots with a similar radius. Therefore, we can employ CHT [26,27] to detect the spots with radii in a certain range. Moreover, CHT is insensitive to deformation, rotation and scaling of the circle in the image such that it can perfectly detect the incomplete round micro-droplets and closely-connected micro-droplets with lower false detection and higher accuracy. Furthermore, it has a low computational complexity, and the only parameter we need to set is the radius range of micro-droplets.
The CHT algorithm contains the following two essential steps:
  • Accumulator array computation:
    The edge detection is carried out on the binary map to get an edge image (L). The edge pixels of L are designated as candidate pixels and are allowed to cast ‘votes’ in the accumulator array A(a), which represents the weight of the circle with a fixed radius and the center of the circle. Here, a = a , b , r . (a, b) represents the space location of pixels, and r is the radius of the expected circle. At the beginning, all the elements of A(a) are set to 0.
  • Center and radius estimation:
    For every pixel x of the fluorescence image, we accumulate all the units of A(a) that satisfy the function f ( x , a ) = 0 . f ( x , a ) is the analytical expression of circle:
    f ( x , a ) = ( x 1 a ) 2 + ( x 2 b ) 2 r 2
    Finally, the circular centers and radii are estimated by detecting the peaks in the accumulator array. We can get the number of micro-droplets by counting the centers of detected circles.
The overall micro-droplets can be detected with the method mentioned above. This method can accurately extract and count the overall micro-droplets on FMIs.

2.2. Fluorescent Micro-Droplet Detection

The fluorescent micro-droplets can be extracted by directly thresholding segmentation due to their high intensity and round shape. However, it is difficult to choose the segmental threshold (D) since the fluorescent micro-droplets in different images can appear to be very different in the fluorescence intensities. We collected the manually-segmented threshold of fluorescent micro-droplets and the intensity mean of the images. By analyzing the relationship of the manually-segmented threshold and the intensity mean of the image, we found that the segmental threshold has a significant linear correlation with the intensity mean of the image. Therefore, we model the relationship mentioned above with a linear fitting method and set up a linear function corresponding to the threshold D of the images:
D ( m ) = 1.3717 m + 0.0126
where m denotes the intensity mean of the image. After the binary map is obtained, the circular Hough transform (CHT) method (see the details in Section 2.1.4) is applied to count the fluorescent micro-droplets precisely. Figure 4 shows the detected result of this method.

2.3. Measurement of AP-Labeled Nanoparticle Concentration

Encapsulating AP-labeled nanoparticles delivered to the droplet-generation nozzle at random is a Poisson process. The probability of encapsulating k AP-labeled nanoparticles in a micro-droplet is then given by equation:
P ( k ) = e λ λ k k !
where λ is the average number of AP-nanoparticles per micro-droplet, e is the base of the natural logarithms, k is from natural numbers and k ! is the factorial of k.
After detecting the numbers of fluorescent and overall micro-droplets, we can obtain the probability P ( k 1 ) by directly computing the proportion of the fluorescent micro-droplets to the overall micro-droplets. Then, the average number of AP-nanoparticles per micro-droplet λ can be calculated according to Equations (3) and (4):
P ( k = 0 ) + P ( k 1 ) = 1
Finally, λ is converted to the average amount of substance n (in moles) of a single micro-droplet; the AP-labeled nanoparticle concentration c is then measured by dividing the average amount of substance n (in moles) by the average volume V of a single micro-droplet. The concentration unit is given by f M , which corresponds to 10 15 mol/L.

2.4. Evaluation

The performance of the overall micro-droplet detection method can be evaluated in the following aspects: (1) Visual evaluations: The visual evaluations firstly give an intuitive performance comparison overview for all the detection methods. (2) TPR and FPR: The true positive rate (TPR) represents the number of true positives (TP) divided by the number of targets in ground truth data, and the false positive rate (FPR) represents the number of the false positives (FP) divided by the number of backgrounds in ground truth data. These two metrics can reflect the detection capability of an algorithm from different perspectives. (3) ROC and F-measure: For the overall evaluation of the detection method, the receiver operating characteristic (ROC curve) is used as a graph metric to uncover the detection power with different TPRs. The area under ROC (AUC) is an estimate of the area under ROC, which indicates the predictive power of the detector. Detectors with higher AUC have better detection power. Furthermore, we computed the F-measure defined by the harmonic mean of precision and recall F = 2 P r e c R e c / ( P r e c + R e c ) . The precision metric P r e c is defined as P r e c = T P / ( T P + F P ) , and R e c is the index of recall defined as R e c = T P / ( T P + F N ) , where FN is the number of false negatives. The F-measure is a widely-used metric to measure the accuracy of the detection method. The higher F-measure score is related to the higher accuracy. (4) Overall number of micro-droplets detected: The purpose of our work is to precisely count micro-droplets. Therefore, the comparative results on the number of overall micro-droplets detected can directly reflect the superiority of our method.
The fluorescent micro-droplet detection method is evaluated by counting the number of fluorescent micro-droplets detected. We demonstrate the accuracy of this work via the relative error that is defined as the proportion of counting error to the true number counted manually. The counting error is the absolute value of the difference between the true number and the detected number. Low relative errors demonstrate high detection performances.
Finally, we calculate a test AP-labeled nanoparticle concentration with the results of micro-droplet detection and compute a reference concentration with the ground truth data. Then, we use the relative error again to compute the accuracy of our method for the AP-labeled nanoparticle concentration measurement. The comparative results of the test and the reference AP-labeled nanoparticle concentration further demonstrate the performance of our method.

2.5. Code

The source code for the proposed algorithm and associated MATLAB-based GUI are freely available on the author’s website, along with instructions for installation and use: http://www.escience.cn/people/bjqin/research.html.

3. Results

This section gives the evaluation of the proposed method on the FMIs acquired from the Nano Biomedical Research Center (NBRC) in Shanghai Jiao Tong University, China. All the FMIs are acquired using an inverted fluorescence microscope (Olympus IX73, Olympus Ltd., Tokyo, Japan) at 100-times magnification when the fluorescence is fully developed. The size of FMI in pixels is 1080 × 1920 , and the diameter of the micro-droplets in the image is approximately 30 μ m. The relative experiment details are demonstrated as below. The APs encapsulated in the micro-droplet are obtained from calf intestine. Both APs and AP-labeled nanoparticles were synthesized by NBRC. The substrate concentration employed was 5 mM, where mM represents 10 3 mol/L.

3.1. Overall Micro-Droplet Detection

Quantitative evaluations of our method and the state-of-the-art methods mentioned above were carried out on the FMIs. The FMI data consist of a total of fifteen test images. The ground-truth of the overall micro-droplets on the FMIs was manually segmented by two experts at NBRC.
The three methods’ parameters are set with the default parameters for achieving the best performances of these methods. As for our method, we set the stand variance σ of Gaussian filtering to one. The contrast enhancement threshold T is set to 0.05, and N is set to eight by default to make the CLAHE achieve the best performances. The search radius of circular Hough transform is set from 16 to 32. All the parameters of our method are set to make our method perform best.

3.1.1. Visual Evaluation

The visual evaluation of different methods is shown in Figure 5. We can see that the proposed method (Figure 5f) perfectly detects all the micro-droplets. Figure 5c also shows that MSVST may detect false micro-droplets. Moreover, Figure 5d,e demonstrates that MSSEF and MPHD may perform poorly on the overall micro-droplet detection.

3.1.2. TPR and FPR

The comparative evaluations of TPR and FPR are displayed in Figure 6. The TPR of our method is the highest TPR for all the test images, and the highest average TPR achieved by our method is 0.9502. The average FPR of our method is 0.0073. These performance metrics prove that the proposed method has achieved a satisfying micro-droplet detection compared with other methods.

3.1.3. ROC and F-Measure

The ROC curve in Figure 7 is created by plotting the TPR against the FPR at various threshold settings. Since the AUC is used to evaluate the detecting power of the method, we can use this metric to further reveal the advantage of our method. As shown in Figure 7, the AUC of the proposed method is the highest in all comparative methods. Therefore, we conclude that the proposed method has achieved the best micro-droplet detection performance.
The F-measure is usually used as a detection accuracy metric to evaluate the comprehensive performance of the detector. The higher F-measure corresponds to the better detection. The evaluation results of the F-measure are listed in Table 1. The best average detection accuracy 0.9586 is achieved by our micro-droplet detection method. This highest F-measure score verifies the superiority of the proposed method over other methods.

3.1.4. Detected Number of Overall Micro-Droplets

Table 2 shows the final number of micro-droplets detected with different methods. The true number of overall micro-droplets is acquired manually by two experts. Compared with other methods, the proposed method performs stably in detecting capability of the overall micro-droplets in all 15 images, and the detected error is less than two for all the images.

3.2. Fluorescent Micro-Droplet Detection

The detected results of fluorescent micro-droplets are shown in Table 3. The true number of fluorescent micro-droplets is obtained manually by two experts. For the total test images, the proposed method has obtained 100 percent detection accuracy for the thirteen test images with the relative errors in detecting the remaining two images achieving 6 . 25 % and 6 . 06 % . These detected results demonstrate the proposed method’s capability in accurately detecting the fluorescent micro-droplets.

3.3. AP-Labeled Nanoparticle Concentration Measurement

Compared with the reference concentration (Table 4), the test AP-labeled nanoparticle concentration calculated with the detected results of micro-droplets has been measured with high accuracy in most samples. The low relative errors in Table 4 further demonstrate the high performance of our method in the measurement of AP-labeled nanoparticle concentration. f M in Table 4 corresponds to 10 15 mol/L.

4. Discussion

The comparative evaluations demonstrated in Section 3 reveal the effectiveness of the proposed method for micro-droplet detection. With the precise micro-droplet detection, the AP-labeled nanoparticle concentration for the experimental analysis can be calculated accurately. However, it should be noted that the AP-labeled nanoparticle concentration measurement is sensitive to the results of micro-droplet detection. The results in Table 2, Table 3 and Table 4 show that a very slight micro-droplet detecting error may significantly increase the AP-labeled nanoparticle concentration measurement error. Therefore, there is certainly room for further improvement of the proposed method.

5. Conclusions

AP-labeled nanoparticle concentration measurement is of great importance for quantitative biomolecular analysis and measurement. Because the micro-droplet can encapsulate a single AP-labeled nanoparticle and be imaged in fluorescence microscope, the AP-labeled nanoparticle concentration measurement is usually calculated by accurately counting the fluorescent micro-droplets and the overall micro-droplets. This work proposes a micro-droplet detection method for high accuracy AP-labeled nanoparticle concentration measurement by precisely and robustly detecting the weakly luminescent empty micro-droplets that are closely clustered in the complex background noises. The comparative evaluations using the state-of-the-art methods have demonstrated that the proposed method has the best accuracy for micro-droplet detection and AP-labeled nanoparticle concentration measurement.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (21075082 and 61271320) and Medical Engineering Cross Fund of Shanghai Jiao Tong University (YG2014MS29). Baowei Fei was partially supported by NIH Grants CA156775, CA176684 and CA204254 and the Georgia Research Alliance Distinguished Scientists Award. The authors would like to thank all authors for opening source codes used in the experimental comparison in this work. We are thankful to the anonymous reviewers for their valuable comments that greatly helped to improve this paper.

Author Contributions

Rufeng Li and Binjie Qin conceived of and designed the experiments. Rufeng Li and Yibei Wang performed the experiments. Yibei Wang and Hong Xu analyzed the data. Rufeng Li, Baowei Fei and Binjie Qin wrote the paper. Hong Xu and Binjie Qin supervised the experiments.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Nketia, T.; Sailem, H.; Rohde, G.; Machiraju, R.; Rittscher, J. Analysis of live cell images: Methods, tools and opportunities. Methods 2017, 115, 65–79. [Google Scholar] [CrossRef] [PubMed]
  2. Specht, E.A.; Braselmann, E.; Palmer, A.E. A Critical and Comparative Review of Fluorescent Tools for Live-Cell Imaging. Annu. Rev. Physiol. 2017, 79, 93–117. [Google Scholar] [CrossRef] [PubMed]
  3. Qiang, Y.; Lee, J.Y.; Bartenschlager, R.; Rohr, K. Colocalization analysis and particle tracking in multi-channel fluorescence microscopy images. In Proceedings of the 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), Melbourne, Australia, 18–21 April 2017; pp. 646–649. [Google Scholar]
  4. Rissin, D.M.; Kan, C.W.; Campbell, T.G.; Howes, S.C.; Fournier, D.R.; Song, L.; Piech, T.; Patel, P.P.; Chang, L.; Rivnak, A.J.; et al. Single-molecule enzyme-linked immunosorbent assay detects serum proteins at subfemtomolar concentrations. Nat. Biotechnol. 2010, 28, 595–599. [Google Scholar] [CrossRef] [PubMed]
  5. Basova, E.Y.; Foret, F. Droplet microfluidics in (bio)chemical analysis. Analyst 2015, 140, 22–38. [Google Scholar] [CrossRef] [PubMed]
  6. Joensson, H.N.; Andersson Svahn, H. Droplet Microfluidics—A Tool for Single-Cell Analysis. Angew. Chem. Int. Ed. 2012, 51, 12176–12192. [Google Scholar] [CrossRef] [PubMed]
  7. Rissin, D.M.; Walt, D.R. Digital concentration readout of single enzyme molecules using femtoliter arrays and Poisson statistics. Nano Lett. 2006, 6, 520–523. [Google Scholar] [CrossRef] [PubMed]
  8. Thompson, R.E.; Larson, D.R.; Webb, W.W. Precise nanometer localization analysis for individual fluorescent probes. Biophys. J. 2002, 82, 2775–2783. [Google Scholar] [CrossRef]
  9. Kervrann, C.; Sorzano, C.O.S.; Acton, S.T.; Olivo-Marin, J.C.; Unser, M. A guided tour of selected image processing and analysis methods for fluorescence and electron microscopy. IEEE J. Sel. Top. Signal Process. 2016, 10, 6–30. [Google Scholar] [CrossRef]
  10. Wiesmann, V.; Franz, D.; Held, C.; Munzenmayer, C.; Palmisano, R.; Wittenberg, T. Review of free software tools for image analysis of fluorescence cell micrographs. J. Microsc. 2015, 257, 39–53. [Google Scholar] [CrossRef] [PubMed]
  11. Arena, E.T.; Rueden, C.T.; Hiner, M.C.; Wang, S.; Yuan, M.; Eliceiri, K.W. Quantitating the cell: Turning images into numbers with ImageJ. Wiley Interdiscip. Rev.: Dev. Biol. 2017, 6. [Google Scholar] [CrossRef] [PubMed]
  12. Smal, I.; Loog, M.; Niessen, W.; Meijering, E. Quantitative comparison of spot detection methods in fluorescence microscopy. IEEE Trans. Med. Imaging 2010, 29, 282–301. [Google Scholar] [CrossRef] [PubMed]
  13. Zhang, B.; Fadili, M.J.; Starck, J.L.; Olivo-Marin, J.C. Multiscale variance-stabilizing transform for mixed-Poisson-Gaussian processes and its applications in bioimaging. In Proceedings of the 2007 14th IEEE International Conference on Image Processing (ICIP 2007), San Antonio, TX, USA, 16–19 September 2007; Volume 6, p. VI-233. [Google Scholar]
  14. Smal, I.; Niessen, W.; Meijering, E. A new detection scheme for multiple object tracking in fluorescence microscopy by joint probabilistic data association filtering. In Proceedings of the 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI 2008), Paris, France, 14–17 May 2008; pp. 264–267. [Google Scholar]
  15. Mallat, S.G. A theory for multiresolution signal decomposition: The wavelet representation. IEEE Trans. Pattern Anal. Mach. Intell. 1989, 11, 674–693. [Google Scholar] [CrossRef]
  16. Rezatofighi, S.H.; Hartley, R.; Hughes, W.E. A new approach for spot detection in total internal reflection fluorescence microscopy. In Proceedings of the 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI 2012), Barcelona, Spain, 2–5 May 2012; pp. 860–863. [Google Scholar]
  17. Jaiswal, A.; Godinez, W.J.; Eils, R.; Lehmann, M.J.; Rohr, K. Tracking virus particles in fluorescence microscopy images using multi-scale detection and multi-frame association. IEEE Trans. Image Process. 2015, 24, 4122–4136. [Google Scholar] [CrossRef] [PubMed]
  18. Basset, A.; Boulanger, J.; Bouthemy, P.; Kervrann, C.; Salamero, J. SLT-LoG: A vesicle segmentation method with automatic scale selection and local thresholding applied to TIRF microscopy. In Proceedings of the 2014 IEEE 11th International Symposium on Biomedical Imaging(ISBI), Beijing, China, 29 April–2 May 2014; pp. 533–536. [Google Scholar]
  19. Basset, A.; Boulanger, J.; Salamero, J.; Bouthemy, P.; Kervrann, C. Adaptive spot detection with optimal scale selection in fluorescence microscopy images. IEEE Trans. Image Process. 2015, 24, 4512–4527. [Google Scholar] [CrossRef] [PubMed]
  20. Acosta, B.M.T.; Basset, A.; Bouthemy, P.; Kervrann, C. Multi-scale spot segmentation with selection of image scales. In Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA, 5–9 March 2017; pp. 1912–1916. [Google Scholar]
  21. Traore, D.; Rietdorf, K.; Al-Jawad, N.; Al-Assam, H. Automatic Hotspots Detection for Intracellular Calcium Analysis in Fluorescence Microscopic Videos. In Annual Conference on Medical Image Understanding and Analysis; Springer: Cham, The Netherlands, 2017; pp. 862–873. [Google Scholar]
  22. Zuiderveld, K. Contrast limited adaptive histogram equalization. In Graphics Gems IV; Academic Press Professional, Inc.: New York, NY, USA, 1994; pp. 474–485. [Google Scholar]
  23. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
  24. Ghaye, J.; Kamat, M.A.; Corbino-Giunta, L.; Silacci, P.; Vergeres, G.; Micheli, G.; Carrara, S. Image thresholding techniques for localization of sub-resolution fluorescent biomarkers. Cytom. Part A 2013, 83, 1001–1016. [Google Scholar] [CrossRef] [PubMed]
  25. Bartell, L.R.; Bonassar, L.J.; Cohen, I. A watershed-based algorithm to segment and classify cells in fluorescence microscopy images. arXiv, 2017; arXiv:1706.00815. [Google Scholar]
  26. Acharya, V.; Kumar, P. Identification and Red Blood Cell Automated Counting from Blood Smear Images using Computer Aided System. Med. Biol. Eng. Comput. 2017. [Google Scholar] [CrossRef] [PubMed]
  27. Jain, R.; Kasturi, R.; Schunck, B.G. Machine Vision; McGraw-Hill: New York, NY, USA, 1995; Volume 5. [Google Scholar]
  28. Zhu, F.; Qin, B.; Feng, W.; Wang, H.; Huang, S.; Lv, Y.; Chen, Y. Reducing Poisson noise and baseline drift in X-ray spectral images with bootstrap Poisson regression and robust nonparametric regression. Phys. Med. Biol. 2013, 58, 1739. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The framework of the proposed method for the overall micro-droplet detection.
Figure 1. The framework of the proposed method for the overall micro-droplet detection.
Sensors 17 02685 g001
Figure 2. Original fluorescent image with SNR (signal-to-noise radio) of 7.1789 and the denoised image with SNR of 7.7489. (a) Original image. (b) Denoised image (I). (c) Zoomed details of the original image. (d) Zoomed details of the denoised image.
Figure 2. Original fluorescent image with SNR (signal-to-noise radio) of 7.1789 and the denoised image with SNR of 7.7489. (a) Original image. (b) Denoised image (I). (c) Zoomed details of the original image. (d) Zoomed details of the denoised image.
Sensors 17 02685 g002
Figure 3. Intermediate results of contrast-limited adaptive histogram equalization (CLAHE) and OTSU on the overall micro-droplet detection: (a) Original image. (b) Enhanced image with CLAHE (J). (c) Binary map with OTSU (K).
Figure 3. Intermediate results of contrast-limited adaptive histogram equalization (CLAHE) and OTSU on the overall micro-droplet detection: (a) Original image. (b) Enhanced image with CLAHE (J). (c) Binary map with OTSU (K).
Sensors 17 02685 g003
Figure 4. Detection of fluorescent micro-droplets. (a) Original image. (b) Detection of fluorescent micro-droplets.
Figure 4. Detection of fluorescent micro-droplets. (a) Original image. (b) Detection of fluorescent micro-droplets.
Sensors 17 02685 g004
Figure 5. Comparative results of segmented binary maps of different methods: (a) Original image. (b) Ground truth. (c) Multiscale variance-stabilizing transform (MSVST). (d) Multiscale spot-enhancing filter method (MSSEF). (e) Maximum possible height-dome method (MPHD). (f) The proposed method.
Figure 5. Comparative results of segmented binary maps of different methods: (a) Original image. (b) Ground truth. (c) Multiscale variance-stabilizing transform (MSVST). (d) Multiscale spot-enhancing filter method (MSSEF). (e) Maximum possible height-dome method (MPHD). (f) The proposed method.
Sensors 17 02685 g005
Figure 6. Comparison of TPR and FPR obtained with MSVST, MSSEF, MPHD and the proposed methods on fluorescent micro-droplet images (FMIs).
Figure 6. Comparison of TPR and FPR obtained with MSVST, MSSEF, MPHD and the proposed methods on fluorescent micro-droplet images (FMIs).
Sensors 17 02685 g006
Figure 7. Comparison of the ROC curve obtained with MSVST, MPHD, MSSEF and the proposed methods.
Figure 7. Comparison of the ROC curve obtained with MSVST, MPHD, MSSEF and the proposed methods.
Sensors 17 02685 g007
Table 1. Comparison evaluation of the F-measure obtained with MSVST, MSSEF, MPHD and the proposed methods on FMIs.
Table 1. Comparison evaluation of the F-measure obtained with MSVST, MSSEF, MPHD and the proposed methods on FMIs.
SamplesMSVSTMSSEFMPHDThe Proposed Method
Image10.92040.74140.66400.9231
Image 20.93060.78890.72500.9674
Image 30.93480.81270.66100.9597
Image 40.92600.76780.65910.9656
Image 50.90750.80380.63920.9770
Image 60.93430.77370.73180.9677
Image 70.89450.76070.63110.9604
Image 80.89310.75640.61830.9663
Image 90.87920.75690.59460.9721
Image 100.88100.57750.61830.9402
Image 110.89990.60820.66530.9655
Image 120.84620.60440.58590.9186
Image 130.91770.65450.65860.9707
Image 140.92020.59540.65550.9692
Image 150.88310.63680.59870.9551
Average0.90460.70930.64710.9586
Table 2. Comparison evaluation of the overall number of detected micro-droplets.
Table 2. Comparison evaluation of the overall number of detected micro-droplets.
SamplesTrue NumberMSVSTMSSEFMPHDThe Proposed Method
Image116116393152161
Image 2222232142202222
Image 3221223142202221
Image 4223227135198222
Image 5219224149202218
Image 6229235152210229
Image 7250255150236249
Image 8239245149224240
Image 9245246141224245
Image 10381393155350381
Image 11372383159348372
Image 12381386175345381
Image 13347356166320349
Image 14414422175371412
Image 15358365164325357
Table 3. Comparison evaluation of the number of detected fluorescent micro-droplets.
Table 3. Comparison evaluation of the number of detected fluorescent micro-droplets.
SamplesTrue NumberDetected Number of Fluorescent Micro-DropletsRelative Error
Image121210.00%
Image 218180.00%
Image 318180.00%
Image 416176.25%
Image 513130.00%
Image 624240.00%
Image 727270.00%
Image 826260.00%
Image 9990.00%
Image 1036360.00%
Image 1128280.00%
Image 1230300.00%
Image 1333356.06%
Image 1432320.00%
Image 1531310.00%
Table 4. Comparison evaluation of the alkaline phosphatase (AP)-labeled nanoparticle concentration measurement.
Table 4. Comparison evaluation of the alkaline phosphatase (AP)-labeled nanoparticle concentration measurement.
SamplesTrue AP-Labeled Nanoparticle Concentration (fM)Test AP-Labeled Nanoparticle Concentration (fM)Relative Error
Image116.422216.42220.00%
Image 29.93569.93560.00%
Image 39.98259.98250.00%
Image 48.74839.36107.00%
Image 57.19057.22460.47%
Image 613.008813.00880.00%
Image 713.429113.48620.43%
Image 813.532713.47300.44%
Image 94.39764.39760.00%
Image 1011.662511.66250.00%
Image 119.19479.19470.00%
Image 129.63669.63660.00%
Image 1311.742112.41745.75%
Image 149.45249.50020.51%
Image 1510.642410.67360.29%

Share and Cite

MDPI and ACS Style

Li, R.; Wang, Y.; Xu, H.; Fei, B.; Qin, B. Micro-Droplet Detection Method for Measuring the Concentration of Alkaline Phosphatase-Labeled Nanoparticles in Fluorescence Microscopy. Sensors 2017, 17, 2685. https://doi.org/10.3390/s17112685

AMA Style

Li R, Wang Y, Xu H, Fei B, Qin B. Micro-Droplet Detection Method for Measuring the Concentration of Alkaline Phosphatase-Labeled Nanoparticles in Fluorescence Microscopy. Sensors. 2017; 17(11):2685. https://doi.org/10.3390/s17112685

Chicago/Turabian Style

Li, Rufeng, Yibei Wang, Hong Xu, Baowei Fei, and Binjie Qin. 2017. "Micro-Droplet Detection Method for Measuring the Concentration of Alkaline Phosphatase-Labeled Nanoparticles in Fluorescence Microscopy" Sensors 17, no. 11: 2685. https://doi.org/10.3390/s17112685

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop