Next Article in Journal
Autonomic Regulation of Facial Temperature during Stress: A Cross-Mapping Analysis
Previous Article in Journal
A CNN-LSTM Architecture for Marine Vessel Track Association Using Automatic Identification System (AIS) Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Quantitative Detection Algorithm for Multi-Test Line Lateral Flow Immunoassay Applied in Smartphones

1
Key Laboratory of Advanced Manufacturing and Automation Technology (Guilin University of Technology), Education Department of Guangxi Zhuang Autonomous Region, Guilin 541006, China
2
School of Information Science and Engineering, Guilin University of Technology, Guilin 541006, China
3
Guangxi Key Laboratory of Electrochemical and Magneto-Chemical Functional Materials, College of Chemistry and Bioengineering, Guilin University of Technology, Guilin 541004, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(14), 6401; https://doi.org/10.3390/s23146401
Submission received: 18 May 2023 / Revised: 28 June 2023 / Accepted: 12 July 2023 / Published: 14 July 2023
(This article belongs to the Section Biomedical Sensors)

Abstract

:
The traditional lateral flow immunoassay (LFIA) detection method suffers from issues such as unstable detection results and low quantitative accuracy. In this study, we propose a novel multi-test line lateral flow immunoassay quantitative detection method using smartphone-based SAA immunoassay strips. Following the utilization of image processing techniques to extract and analyze the pigments on the immunoassay strips, quantitative analysis of the detection results was conducted. Experimental setups with controlled lighting conditions in a dark box were designed to capture samples using smartphones with different specifications for analysis. The algorithm’s sensitivity and robustness were validated by introducing noise to the samples, and the detection performance on immunoassay strips using different algorithms was determined. The experimental results demonstrate that the proposed lateral flow immunoassay quantitative detection method based on image processing techniques achieves an accuracy rate of 94.23% on 260 samples, which is comparable to the traditional methods but with higher stability and lower algorithm complexity.

1. Introduction

The colloidal gold immunoassay is a highly specific and efficient immunological analysis technique that employs colloidal gold as a marker and integrates with nitrocellulose membrane chromatography [1]. This method yields results within minutes without the need for complex instruments or cumbersome procedures, making it ideal for on-site detection. Moreover, it offers high sensitivity and low cost, and has crucial applications in medical diagnosis [2], food safety [3], and environmental monitoring [4].
The traditional colloidal gold immunoassay [5] relies on visual interpretation by human eyes, based on the coloration of the test line and control line, and can only provide qualitative negative or positive results. Recently, the development of multi-test line and graded stepwise colloidal gold immunoassay methods has enabled semi-quantitative analysis based on the number of colored lines [6]. However, the visual assessment of these methods is often subjective and lacks accuracy, failing to meet the high precision requirements in applications such as tumor diagnosis [7] and drug concentration detection [8]. Subsequently, colorimetric methods [9] have been introduced to achieve quantitative analysis by comparing with known concentrations of standard substances. Yet, these methods also depend on visual interpretation, thus remaining prone to human errors. To eliminate errors from manual judgment, research has turned to reading devices to obtain the intensity or signal change of the lines. By extracting the characteristic information and comparing it with a known concentration standard curve, the concentration of the target substance can be obtained.
In recent years, researchers have increasingly studied the use of computer vision technology for immunoassay detection. However, graded LFIA strips present certain challenges, such as cross-interference [10] and peak overlap [11], which result in decreased detection accuracy and reliability. Therefore, developing efficient methods for processing the images of graded LFIA strips to improve quantitative accuracy and reliability is an important research direction and a promising way forward.
Image processing technology is a powerful tool for optimizing digital images [12]. Techniques such as removal of backgrounds and noise, enhancement of detection sensitivity and specificity, and segmentation of target bands can improve the image quality and quantification of graded LFIA strips. Deep learning algorithms [13], a machine learning method, can automatically recognize different test lines on an LFIA strip and perform classification and quantitative analysis. These technologies provide new ways and methods for analyzing and detecting graded LFIA strips, thereby improving detection accuracy and reliability. However, a substantial amount of data are required to train these algorithms and ensure validity.
Recent research studies have focused on developing novel technologies for the quantification of immunochromatographic assays. For example, Zeng et al. (2021) developed an image segmentation method that uses gold LFIA strips for quantitative analysis [14]. This method reduces image noise caused by environmental factors, solves problems with irregular and fuzzy boundaries between the control line and the test line, and improves recognition errors caused by shallow test lines. Han et al. (2020) proposed a low-cost, highly sensitive lateral flow biosensing platform based on soluble polymer mixtures [15], which is combined with a smartphone-based reader for high-performance point-of-care testing. Rong et al. (2020) integrated fluorescence lateral flow detection, detection boxes, and signal detection devices, resulting in a multi-channel LFIA quantitative reader that can be used for high-throughput screening of infectious diseases [16].
In this study, we developed an intelligent detection algorithm based on image processing techniques, with the following main contributions:
(1)
A dark box was designed to reduce the impact of ambient light on image acquisition, and differences in image quality obtained with different models of smartphone were compared.
(2)
An intelligent algorithm was developed that utilizes binarization to identify the darker control line and detects the test line through operations such as image denoising, pixel accumulation, and convolution.
(3)
Machine learning methods were employed to fit the relationship between feature values and concentration, thereby validating the accuracy of the algorithm. The algorithm’s effectiveness under various conditions was verified by adding noise to the images. Furthermore, a comparison of the current algorithm versus other detection algorithms, ranging from traditional algorithms to machine learning and deep learning approaches, was conducted.

2. Materials and Methods

2.1. Experimental Materials and Instruments

In normal human conditions, the concentration of serum amyloid A protein (SAA) is typically below 10 μg/mL. However, during inflammatory infections, SAA concentration can increase by 1000 times within the acute phase response (APR) period of 24 to 72 h. Given this characteristic, SAA was selected as the research subject for this study’s experiments. Lateral flow immunoassay quantitative detection requires materials and instruments that typically include the following: immunoassay test strips consist of a paper base, a probe, labeling agents, and other components. As shown in Figure 1, these strips utilize chemical reactions to convert target substances into visible color signals. Sample preparation involved using bovine serum albumin (BSA), which was purchased from Hefei Bomei Biotechnology Co. (Hefei, China) The SAA monoclonal antibody pair and SAA antigen used for labeling and capturing were obtained from Wuhan Huamei Biological Engineering Co. (Wuhan, China). Colloidal gold (25 nm) was synthesized in the laboratory, and glass cellulose membranes and polyvinyl chloride backing plates (PVC plates) were purchased from Shanghai Jining Biotechnology Co. (Shanghai, China).
In this study, we conducted experiments using SAA test strips. We prepared samples with different concentrations by diluting the standard solution 700 times. The concentrations included 0, 5, 10, 30, 50, 80, 100, 300, 500, 800, 1000, 1300, and 1500 μg/mL, totaling 260 samples. Each concentration had 20 samples. We chose such a wide concentration gradient to have more data points for better curve fitting and calibration when the samples’ color changed drastically. An example of samples at different concentrations is shown in Figure 2. The experiments were conducted at a temperature of 25 °C and a humidity of 50%. After adding the samples, we waited for 5 min before collecting the samples for feature extraction.
Thakur et al. (2021) investigated the impact of flash usage while capturing images with smartphones [17]. They found that enabling the flashlight resulted in a higher recognition accuracy as the built-in flashlight of smartphones reduced the impact of ambient light. However, different models of smartphone flashlights also exhibit variations, which can introduce errors that are difficult to correct. To control the lighting conditions impacting test strip detection, we utilized a dark box to provide a stable lighting environment, thus ensuring the accuracy and reproducibility of image acquisition. The dark box shell was made of plastic material, sealed internally, and colored using black dye. It features a black frosted glass surface as the platform for placing test strips, which is characterized by a low reflection of light. A white LED light (wavelength of 450 nm, color temperature of 3000 K, power of 4.8 watts/meter, luminous flux of 450 LM, and power supply of 12 V) was installed inside the dark box to replace the smartphone flashlight. This not only reduces the influence of natural light but also addresses the issue of different smartphone flashlight models. Both the test strips and the smartphone being used were inserted into the dark box, and the structure and usage of the dark box are demonstrated in Figure 3.
Three common smartphone models were selected for the experiments: Xiaomi 11, iPhone 12, and Huawei P30. The parameters of these three models are shown in Table 1. All three smartphones have a high camera performance and high popularity in China. Under consistent lighting, images were acquired using each smartphone to evaluate color value differences and to assess the practicality and applicability of the proposed detection method.

2.2. Experimental Procedure

To ensure high-quality and repeatable data, multiple factors were considered when preparing the samples. When using a smartphone to collect samples, a 20 cm shooting distance and a horizontal angle were used. The optimal shooting environment should have a humidity lower than 50% and a temperature range of 20 °C to 28 °C. Following sample collection, we utilized the OpenCV function library to preprocess the raw images for improving the accuracy of image feature values, applying steps such as noise reduction and contrast enhancement. Subsequently, smart algorithms were employed for feature value extraction, followed by mathematical fitting of the feature values with the test strip’s concentration. Support vector machine (SVM) [18] is an effective machine learning method that showed the best performance in the fitting process. With the model training complete, the proposed algorithm could then be used for recognition and quantitative analysis of new data. The overall process of lateral flow immunoassay quantitative detection is shown in Figure 4.

2.3. Algorithm Design

The overall flow of the algorithm is shown in Figure 5:
  • Step 1: Using threshold segmentation to find the control line
Control lines on immunochromatographic strips tend to be dark and stable, and in this case, a binarization method is used to find the control line with good results. To determine the sum of pixel values for each column in the image, the following formula is used:
S j = i = 1 h I i , j
where Sj is the sum of pixel values in the jth column, and Ii,j is the pixel value at position [i,j]. To obtain a threshold for binarization, the minimum pixel value in this one-dimensional image is added to an external value I = 30 (as determined from Figure 6 below). This result is then multiplied by the image height to yield the threshold:
T h r e s h o l d = ( M i n V a l u e + I ) H
where MinValue is the minimum pixel value in the one-dimensional image that changes according to the pixel value of the image; and i is an externally set value. The MinValue and I are added together and multiplied by H. The result is the binarized threshold, which is just enough to segment the control line at this point.
The left half of the image is horizontally flipped and then multiplied, mirroring the image for comparison. This process determines the width of the control line and obtains the position of the rightmost end of the control line. If the width of the control line is greater than 5 (a threshold set based on experimental experience to ensure algorithm performance and accuracy) and the numerical value of the rightmost end is greater than 0, the control line has successfully been segmented and detected. Subsequently, the width and position results are then output.
  • Step 2: Denoise processing
After zooming in on the image of the test strip taken by the smartphone, we noticed that there are noises between the lines. Unfortunately, these noises are not fully eliminated by threshold segmentation in areas where the test strip is lighter in color. To address this, we implemented a denoising algorithm. After several experiments, median filtering was selected as the optimal method, which could effectively remove noises while retaining the image edge and detail information, thus improving reliability and accuracy. The median filtering results are shown in Figure 7.
To binarize the image, the image pixel average is multiplied by a factor to determine the threshold, which is applied to the left half. This factor is reduced by 0.05, and pixel accumulation on the left half is used to calculate the signal-to-noise ratio (SNR). An SNR below 0.75 indicates significant remaining noise, which is addressed using morphological operations. The binarization results after noise removal are shown in Figure 8c.
  • Step 3: Use of convolution and binarization to locate test lines
When locating the control lines, the left half of the image is isolated and flipped horizontally. This flipped section is then subjected to dot-product operation with the initial unflipped region before the column vectors in the photo are summed into an array. A convolution operation is performed between this vector array and the result of the earlier dot-product operation:
D ( x , y ) = I _ l e f t ( x , y ) × I _ f l i p p e d ( x , y )
C ( K ) = D ( x , k ) × I _ c o l u m n ( x )
In these calculation processes, I_left(x,y) indicates the left half portion of I(x,y) image, adopting image values of I(x,y) on the image’s left side while setting all other values as 0. I_flipped(x,y) refers to a horizontal flip operation of I(x,y) image, specifically represented by I(width-x,y) wherein width is the image width. C(K) represents the k-th element in the convolution results. D(x,k) denotes the k-th column of symmetry detection image D(x,y). I_column(x) describes the x-th column of image I(x,y). The Σ sign signifies the summation operations.
Next, we binarize the image using the pixel mean multiplied by 1.5 (determined through repeated experimentation) as the threshold value for evaluation. Pixel values surpassing the determined threshold are reset to 0, while those below it are set to 1. Finally, we convert the input image into a matrix form and record the position within the end list, where there exist sudden color changes as indicated by the 0 to 1 transition points on the right-side markings of the test lines. These positions are similarly identified within the left markings of such test lines via the head list’s recording. The resulting outputs are illustrated in Figure 8d.
  • Step 4: Accurate Selection of Control and Test Lines
Based on the recorded color transition positions of the left and right portions of the control and test lines, we obtain two lists—head and end. Next, we compare the width measurements of the head versus the end lists. If they are similar in width, we traverse the end, identify specific points, and eliminate their respective values within the head and end lists. For the control lines, the values are reduced to their rightmost position, and the width is utilized as a reference point to help determine positioning within both head and end listings. Subsequently, we inspect the end locations, verifying whether the distance between the subsequent head and the current end positions falls two times below the input value. The positions within the end list are then deleted, and the corresponding values within the head list are shifted one place to the right. The purpose of this step is to further verify the authenticity of the test lines, and the final result is shown in Figure 8e.
  • Step 5: Further optimizing the location of test and control lines
Initially, if the length of the end list exceeds 4, additional lines require removal and further adjustment. Alternatively, if the length of the head list is 3 and meets specific size conditions, head(1) and end(1) values are removed. Additionally, further calculations are applied to the head and end lists beyond the first grouping. Lengthier lists are broadened by a factor that is three times the control line’s width, sorted in size order, and utilized for new value assignments within the head and end lists. If the length of the head list is 2 or 3, we take the midpoint reading of head(0), end(0), head(1), and end(1) to obtain new values as calculated according to established methodologies. Finally, the listings for the head and the end indicate the precise locations of the test and control lines within the input image, which are later incorporated into the original image, as shown in Figure 8f.
We extract four regions and apply Gaussian blur to them, calculating the maximum value within each area. Gaussian blur is computed using normal distribution mathematics to change every pixel in the image:
G ( r ) = 1 2 π σ 2 N e r 2 / ( 2 σ 2 )
In this process, r refers to the blur radius, while σ is the standard deviation of the normal distribution. We compare the maximum value to the average value of the remaining parts (ARG). If ARG is greater than the maximum value, we replace the maximum value with the average value. The four values from left to right represent the control line C, test line T1, test line T2, and test line T3, respectively.
The final calculated results for the four lines and the two lines’ read are as follows:
Y 1 = ( T 1 + T 2 + T 3 3 × A R G ) / C
Y 2 = ( T 1 A R G ) / C

2.4. Fitting Eigenvalues versus Concentration

As Y1 represents the reading value for the four lines, it better reflects the detection performance of the algorithm for multi-line test strips. Therefore, we extracted five sets of samples for the Y1 and concentration values, as shown in Table 2:
Support vector machine is a supervised learning model used for classification and regression analysis. Its core concept centers on finding hyperplanes that map sample features to high-dimensional spaces and segmenting them correspondingly. Employing SVM allows us to establish nonlinear relationships between feature values and concentration values.
Using SVM, we constructed an optimization problem to seek out the optimal hyperplane positioning that evenly segregates all data points while maintaining maximal distance from either side of the grouping. Data points within close proximity to the hyperplane are referred to as “support vectors”. Their role is to collectively define the decision boundary when classifying new data. The following equation clarifies this:
m i n w , b , ξ | | w | | 2 2 + C i ξ i
Here, w represents the weight vector and b refers to the bias term. ζ i indicates the distance between sample i and the hyperplane. The purpose of this equation is to minimize model complexity with regard to misclassifications while finding a segmentation hyperplane that classifies all training samples accordingly. The “soft margin” allows some points to be around or even exceeding the margin boundary to better fit the relationship between feature values and outcomes. C is a hyperparameter that regulates model complexity and penalizes wrong classifications. By training the appropriate model, we can fit the test sample data into it and predict their respective concentration values. It is noteworthy that SVM performs well when solving issues with small samples and nonlinear data distribution while demonstrating high reliability and stability. Therefore, combining the results from our experiments in this study, we opted to utilize an SVM algorithm for fitting feature values to concentration values to achieve optimal effects.
When using SVM to fit data, the goodness of fit, R2 value, is a commonly used statistical metric for evaluating the fitting performance of the model. The calculation of R2 is based on the total sum of squares, the regression sum of squares, and the residual sum of squares, where the regression sum of squares represents the ability of the fitted model to explain the variance in the data, the total sum of squares represents the total variance in the data, and the residual sum of squares represents the variance that the fitted model fails to explain. Therefore, the closer R2 is to 1, the stronger the explanatory power of the fitted model for the data, and the better the fit. The formula for calculating R2 is follows:
R 2 = 1 S S r e s S S t o t
Here, SSres stands for the residual sum of squares, and SStot represents the total sum of squares. The specific calculation formula is as follows:
S S t o t = i = 1 n ( y i y ¯ ) 2
S S r e s = i = 1 n ( y i f i ) 2
SStot has two main sources: (1) diverse input values xi leading to broad output values yi, and (2) random errors. fi denotes the value on the regression line.

3. Data Analysis and Discussion

3.1. Image Differences under Different Phones

We extracted a sample of 1000 μg/mL from the samples captured using Xiaomi 11, iPhone 12, and Huawei P30 smartphones during the same period. An example diagram is shown in Figure 9. To observe the overall pixel distribution, we calculated the histogram. Histogram of pictures is shown in Figure 10. By analyzing the histogram, we could observe differences in color distribution, contrast, and saturation among the three smartphones.
The histogram analysis showed minimal differences in color distribution, contrast, and saturation between the Xiaomi 11 and Huawei P30 smartphones. However, the images taken by the iPhone 12 smartphone show detection values earlier on the x-axis, with a less pronounced first histogram peak. This suggests that the iPhone 12 is capable of capturing low-light details, such as details in darker or shadowed areas, more effectively. Additionally, its image displays a more even overall brightness distribution. These differences may be attributed to various factors, including different image processing algorithms, camera sensors, and software optimization employed by each smartphone.

3.2. Results of Fitting

The fitted plot is shown in Figure 11. The R2 value of the fitting equation is 0.99492, indicating that the model has a strong explanatory power over the sample data. Additionally, we calculated the conventional residuals of the model, and the results are shown in the graph. These results suggest that the model has a good predictive performance and high reliability. These findings further validate the fitting model’s adaptiveness and accuracy to the sample data, providing a reliable foundation for subsequent data analysis.
This study utilized SVM to fit the sample data and calculated the R2 value as an evaluation index. The results indicate that the model has a strong explanatory power over the data, with a good fitting effect and an R2 value of 0.99492. Furthermore, by calculating the total sum of squares, the regression sum of squares, and the residual sum of squares, we found that the conventional residuals’ interval is within [−0.1, 0.1]. Fitting error parameter chart is shown in Figure 12. Subsequent analysis confirmed that computer vision technology holds wide application prospects in lateral flow immunoassay detection and can significantly improve detection accuracy and reliability. However, further exploration is necessary to enhance algorithm performance and stability to meet practical application needs.

3.3. Algorithm Performance Testing

To test the effectiveness and robustness of the algorithm, we designed a testing experiment. In this experiment, we divided 260 images into three categories: low, medium, and high concentrations (low concentration: 0–50 μg/mL, medium concentration: 80–500 μg/mL, and high concentration: 800–1500 μg/mL). We randomly applied salt-and-pepper noise, Gaussian noise, and Poisson noise to the images, as shown in Figure 13. Subsequently, we tested these noisy images using the algorithm proposed in this paper. At the same time, we tested the accuracy of the algorithm on the samples without any noise added. The test results are shown in Table 3.
After adding noises, the accuracy of the algorithm in detecting light-colored test strips with a low concentration drops from 88% to 71%. However, it still maintains a high accuracy for test strips with medium and high concentrations. This indicates that the algorithm performs better in detecting test strips with darker colors and higher concentrations. Despite the added noises, it still achieves an accuracy of 85% in detecting the test strips. This demonstrates the effectiveness of the algorithm, but further improvements are needed to enhance its ability to detect targets with low concentrations.
Traditional image processing and machine learning methods, like KNN, CNN, and U-net, are widely used to analyze and detect LFIA images, but they require large training data sets and are sensitive to parameter changes, thus limiting their practical use. To address these issues, this study proposed a quantitative detection method for LFIA images based on image processing technology, which combines multiple image processing techniques and mathematical methods to effectively optimize LFIA imaging, thereby improving the accuracy and reliability of detection. The specific performance of the proposed algorithm and other common algorithms is shown in Table 4.
A comparison was made on the performance of several algorithms in various applications. The KNN classifier developed by Hyun Jung Min et al. achieved an accuracy of 95.56% in the quantification of Salmonella LFIA images with a large sample size of 1500 [19]. Huang Lei et al., using convolutional neural network (CNN), achieved an accuracy of 92% when detecting images of performance-enhancing drugs with a small sample size of 120 [20]. Qi Qin et al. adopted the U-net algorithm in deep learning and achieved the highest accuracy of 97.46% with 942 samples [21]. Guanao Zhao et al. proposed a multi-strip detection algorithm using image processing, which achieved an accuracy of 94.5% [22]. Compared to traditional image processing algorithms, the accuracy is slightly lower than KNN and U-net but slightly higher than CNN with insufficient sample size. The proposed algorithm shows better performance in cases with smaller sample sizes. Additionally, the proposed algorithm can be trained faster and demonstrates more stable performance in fitting.

4. Conclusions

We developed an image processing-based quantitative lateral flow immunoassay detection method. A dark box was designed to control the lighting conditions, and the accuracy of the algorithm under different lighting conditions was analyzed. Different models of smartphones were used to take photos, and the differences in the images were compared. An intelligent smartphone algorithm was designed and applied to a mobile app. The algorithm focuses on intelligently finding the optimal threshold to segment images. This method first identifies the control line with the most distinct color and then uses various factors, such as pixel mutation position, control line position, and width, and actual design distance of the test strip as the discriminant factors to intelligently locate the lighter-colored test line. The algorithm achieves an accuracy rate of 94.23% when tested on 260 test strips. After extracting the characteristic values, a mathematical model based on SVM was selected to fit the characteristic values that best correlate with concentration, yielding an R2 value of 0.99492. To test the sensitivity, robustness, and effectiveness of the algorithm, the images were divided into three categories based on sample concentration, and random noise was added for testing. It was found that the proposed algorithm maintains an accuracy rate of over 90% for detecting medium-to-high-concentration test strips with darker colors, and there is a slight decrease in performance for low-concentration test strips, but the overall accuracy rate still reaches 85%. The detection algorithm proposed in this study was compared with popular neural network algorithms, such as KNN, CNN, and U-net, and traditional image processing algorithms. It was found that the proposed algorithm can achieve comparable accuracy to the neural network algorithms with a small sample size. It also exhibits higher stability and lower algorithm complexity.
However, there are still significant limitations to the algorithm proposed in this study. Only three models of smartphones were used in the study, and more lighting conditions need to be compared. The algorithm also needs to be adjusted when testing strips of different specifications. After adding noise to lighter-colored test strips for testing, it was found that the detection accuracy decreases significantly, and efforts need to be made to improve the accurate measurement of low-concentration test strips. This study focuses on a sample of 260 SAA immunoassay test strips, which is still insufficient, and more samples need to be added to increase persuasiveness.
Finally, this algorithm is currently suitable for personal rapid testing. However, in the future, it could be used in broader application scenarios, such as large-scale rapid testing in hospitals and community health centers, providing better technical support for disease prevention and control. In addition, the algorithm could also be applied to other types of detection, such as chemiluminescence assays [23] or enzyme-linked immunosorbent assays [24], with potential application prospects and development potential.

Author Contributions

Conceptualization, S.Z.; Methodology, X.J. and G.Y.; Software, X.J. and S.L.; Investigation, S.W. and L.C.; Writing—original draft preparation, X.J.; Writing—review and editing, H.P.; Supervision, S.Z.; Project administration, S.Z.; funding acquisition, H.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China (22064008), the Key Research and Development Program of Guilin (2020010323), and the Scientific Research and Technology Development Plan of Guilin (20210217-1).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Guilin University of Technology.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available from Xincheng Jiang upon request.

Acknowledgments

The authors express their gratitude to the reviewers for helping to improve this work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tran-Nguyen, T.S.; Ngo-Luong, D.T.; Nguyen-Phuoc, K.H.; Tran, T.L.; Tran-Van, H. Simultaneously targeting nitrocellulose and antibody by a dual-headed protein. Protein Expr. Purif. 2021, 177, 105764. [Google Scholar] [CrossRef]
  2. Gong, F.W.; Wei, H.X.; Li, Q.S.; Liu, L.; Li, B.F. Evaluation and Comparison of Serological Methods for COVID-19 Diagnosis. Front. Mol. Biosci. 2021, 8, 682405. [Google Scholar] [CrossRef] [PubMed]
  3. Fogaca, M.B.T.; Bhunia, A.K.; Lopes-Luz, L.; de Almeida, E.; Vieira, J.D.G.; Buhrer-Sekula, S. Antibody- and nucleic acid-based lateral flow immunoassay for Listeria monocytogenes detection. Anal. Bioanal. Chem. 2021, 413, 4161–4180. [Google Scholar] [CrossRef] [PubMed]
  4. Zhang, J.J.; Li, Y.; Chai, F.L.; Li, Q.Z.; Wang, D.; Liu, L.P.; Tang, B.Z.; Jiang, X.Y. Ultrasensitive point-of-care biochemical sensor based on metal-AlEgen frameworks. Sci. Adv. 2022, 8, eabo1874. [Google Scholar] [CrossRef] [PubMed]
  5. Dykman, L.A.; Bogatyrev, V.A. Gold nanoparticles: Preparation, functionalisation, applications in biochemistry and immunochemistry. Uspekhi Khimii 2007, 76, 199–213. [Google Scholar] [CrossRef]
  6. Anfossi, L.; Di Nardo, F.; Cavalera, S.; Giovannoli, C.; Baggiani, C. Multiplex Lateral Flow Immunoassay: An Overview of Strategies towards High-throughput Point-of-Need Testing. Biosensors 2018, 9, 2. [Google Scholar] [CrossRef] [Green Version]
  7. Wu, J.C.; Wu, G.J. METCAM Is a Potential Biomarker for Predicting the Malignant Propensity of and as a Therapeutic Target for Prostate Cancer. Biomedicines 2023, 11, 205. [Google Scholar] [CrossRef]
  8. Carrio, A.; Sampedro, C.; Sanchez-Lopez, J.L.; Pimienta, M.; Campoy, P. Automated Low-Cost Smartphone-Based Lateral Flow Saliva Test Reader for Drugs-of-Abuse Detection. Sensors 2015, 15, 29569–29593. [Google Scholar] [CrossRef] [Green Version]
  9. Chen, R.; Chen, X.R.; Zhou, Y.F.; Lin, T.; Leng, Y.K.; Huang, X.L.; Xiong, Y.H. “Three-in-One” Multifunctional Nanohybrids with Colorimetric Magnetic Catalytic Activities to Enhance Immunochromatographic Diagnosis. Acs Nano 2022, 16, 3351–3361. [Google Scholar] [CrossRef]
  10. Cheng, N.; Song, Y.; Zeinhom, M.M.A.; Chang, Y.C.; Sheng, L.; Li, H.L.; Du, D.; Li, L.; Zhu, M.J.; Luo, Y.B.; et al. Nanozyme-Mediated Dual Immunoassay Integrated with Smartphone for Use in Simultaneous Detection of Pathogens. Acs Appl. Mater. Interfaces 2017, 9, 40671–40680. [Google Scholar] [CrossRef]
  11. Wahab, M.F.; O’Haver, T.C. Wavelet transforms in separation science for denoising and peak overlap detection. J. Sep. Sci. 2020, 43, 1998–2010. [Google Scholar] [CrossRef]
  12. Qin, Q.; Wang, K.; Yang, J.C.; Xu, H.; Cao, B.; Wo, Y.; Jin, Q.H.; Cui, D.X. Algorithms for immunochromatographic assay: Review and impact on future application. Analyst 2019, 144, 5659–5676. [Google Scholar] [CrossRef]
  13. Turbe, V.; Herbst, C.; Mngomezulu, T.; Meshkinfamfard, S.; Dlamini, N.; Mhlongo, T.; Smit, T.; Cherepanova, V.; Shimada, K.; Budd, J.; et al. Deep learning of HIV field-based rapid tests. Nat. Med. 2021, 27, 1165–1170. [Google Scholar] [CrossRef]
  14. Zeng, N.Y.; Li, H.; Wang, Z.D.; Liu, W.B.; Liu, S.M.; Alsaadi, F.E.; Liu, X.H. Deep-reinforcement-learning-based images segmentation for quantitative analysis of gold immunochromatographic strip *. Neurocomputing 2021, 425, 173–180. [Google Scholar] [CrossRef]
  15. Han, G.R.; Koo, H.J.; Ki, H.; Kim, M.G. Paper/Soluble Polymer Hybrid-Based Lateral Flow Biosensing Platform for High-Performance Point-of-Care Testing. ACS Appl. Mater. Interfaces 2020, 12, 34564–34575. [Google Scholar] [CrossRef]
  16. Rong, Z.; Xiao, R.; Peng, Y.J.; Zhang, A.Y.; Wei, H.J.; Ma, Q.L.; Wang, D.F.; Wang, Q.; Bai, Z.K.; Wang, F.; et al. Integrated fluorescent lateral flow assay platform for point-of-care diagnosis of infectious diseases by using a multichannel test cartridge. Sens. Actuators B Chem. 2021, 329, 129193. [Google Scholar] [CrossRef]
  17. Thakur, R.; Maheshwari, P.; Datta, S.K.; Dubey, S.K.; Shakher, C. Machine Learning-Based Rapid Diagnostic-Test Reader for Albuminuria Using Smartphone. IEEE Sens. J. 2021, 21, 14011–14026. [Google Scholar] [CrossRef]
  18. Schlag, S.; Schmitt, M.; Schulz, C. Faster Support Vector Machines. J. Exp. Algorithmics 2021, 26, 1–21. [Google Scholar] [CrossRef]
  19. Min, H.J.; Mina, H.A.; Deering, A.J.; Bae, E. Development of a smartphone-based lateral-flow imaging system using machine-learning classifiers for detection of Salmonella spp. J. Microbiol. Methods 2021, 188, 106288. [Google Scholar] [CrossRef] [PubMed]
  20. Huang, L.; Tian, S.L.; Zhao, W.H.; Liu, K.; Ma, X.; Guo, J.H. Convolutional Neural Network for Accurate Analysis of Methamphetamine with Upconversion Lateral Flow Biosensor. IEEE Trans. Nanobioscience 2023, 22, 38–44. [Google Scholar] [CrossRef] [PubMed]
  21. Qin, Q.; Wang, K.; Xu, H.; Cao, B.; Zheng, W.; Jin, Q.H.; Cui, D.X. Deep Learning on chromatographic data for Segmentation and Sensitive Analysis. J. Chromatogr. A 2020, 1634, 461680. [Google Scholar] [CrossRef] [PubMed]
  22. Zhao, G.A.; Liu, S.J.; Guo, L.; Fang, W.T.; Liao, Y.J.; Rui, L.; Fu, L.S.; Wang, J.L. A customizable automated container-free multi-strip detection and line recognition system for colorimetric analysis with lateral flow immunoassay for lean meat powder based on machine vision and smartphone. Talanta 2023, 253, 123925. [Google Scholar] [CrossRef] [PubMed]
  23. Fang, B.L.; Xiong, Q.R.; Duan, H.W.; Xiong, Y.H.; Lai, W.H. Tailored quantum dots for enhancing sensing performance of lateral flow immunoassay. Trac-Trends Anal. Chem. 2022, 157, 116754. [Google Scholar] [CrossRef]
  24. Portilho, A.I.; Lima, G.G.; De Gaspari, E. Enzyme-Linked Immunosorbent Assay: An Adaptable Methodology to Study SARS-CoV-2 Humoral and Cellular Immune Responses. J. Clin. Med. 2022, 11, 1503. [Google Scholar] [CrossRef]
Figure 1. Test strip schematic diagram.
Figure 1. Test strip schematic diagram.
Sensors 23 06401 g001
Figure 2. Example of samples at different concentrations.
Figure 2. Example of samples at different concentrations.
Sensors 23 06401 g002
Figure 3. (a) Design drawing of the front of the dark box. (b) Design of the mobile phone slot. (c) Example diagram for collecting samples.
Figure 3. (a) Design drawing of the front of the dark box. (b) Design of the mobile phone slot. (c) Example diagram for collecting samples.
Sensors 23 06401 g003
Figure 4. The overall process of lateral flow immunoassay quantitative detection.
Figure 4. The overall process of lateral flow immunoassay quantitative detection.
Sensors 23 06401 g004
Figure 5. Overall flowchart of the algorithm.
Figure 5. Overall flowchart of the algorithm.
Sensors 23 06401 g005
Figure 6. Graph showing the reasons for choosing threshold value I.
Figure 6. Graph showing the reasons for choosing threshold value I.
Sensors 23 06401 g006
Figure 7. Median filtering principle and an example of the effect.
Figure 7. Median filtering principle and an example of the effect.
Sensors 23 06401 g007
Figure 8. (a) Original image; (b) grayscale image; (c) binarized image after denoising; (d) rough area partitioning; (e) fine area partitioning; and (f) final result image.
Figure 8. (a) Original image; (b) grayscale image; (c) binarized image after denoising; (d) rough area partitioning; (e) fine area partitioning; and (f) final result image.
Sensors 23 06401 g008
Figure 9. An example of the three phones shooting the same concentration.
Figure 9. An example of the three phones shooting the same concentration.
Sensors 23 06401 g009
Figure 10. Histogram of pictures taken by three smartphones.
Figure 10. Histogram of pictures taken by three smartphones.
Sensors 23 06401 g010
Figure 11. SVM fitting of feature values and concentrations.
Figure 11. SVM fitting of feature values and concentrations.
Sensors 23 06401 g011
Figure 12. Fitting error parameter chart.
Figure 12. Fitting error parameter chart.
Sensors 23 06401 g012
Figure 13. Example of adding salt-and-pepper noise, Gaussian noise, and Poisson noise to an image.
Figure 13. Example of adding salt-and-pepper noise, Gaussian noise, and Poisson noise to an image.
Sensors 23 06401 g013
Table 1. Camera parameters of the selected phones.
Table 1. Camera parameters of the selected phones.
Phone ModelCamera Pixels (Million)ApertureSensor Size (Inches)
Xiaomi 1110,800F/1.91/1.33
iPhone 1212,000F/1.61/1.76
Huawei P3040,000F/1.81/1.7
Table 2. Randomly selected five groups of sample reading values.
Table 2. Randomly selected five groups of sample reading values.
Concentration (μg/mL)0510305080100300500800100013001500
100.07740.12970.08730.17840.21870.40090.95961.00081.31421.49781.90401.7000
200.06260.08240.13430.14380.13480.34980.90691.27811.42341.44982.03192.0939
300.09270.06630.08290.12490.18570.28210.79581.31111.57781.46261.52541.6717
400.04770.03670.15860.15840.19920.33890.83531.07671.33731.63171.42841.6454
500.01160.03140.09670.13520.23750.68740.85990.92370.97651.19351.23171.3246
Table 3. Test accuracy for different concentrations.
Table 3. Test accuracy for different concentrations.
AccuracyLow-Concentration Samples (%)Medium-Concentration Samples (%)High-Concentration Samples (%)Total Accuracy (%)
No noise added8896.2510094.23
Noise added719097.585
Table 4. Performance of common algorithms.
Table 4. Performance of common algorithms.
AlgorithmAccuracy (%)Sample SizeGoodness of Fit
This paper94.12050.995
KNN95.5615000.960
CNN921200.987
U-net97.46942>0.9
Image Processing94.5N/A0.993
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, S.; Jiang, X.; Lu, S.; Yang, G.; Wu, S.; Chen, L.; Pan, H. A Quantitative Detection Algorithm for Multi-Test Line Lateral Flow Immunoassay Applied in Smartphones. Sensors 2023, 23, 6401. https://doi.org/10.3390/s23146401

AMA Style

Zhang S, Jiang X, Lu S, Yang G, Wu S, Chen L, Pan H. A Quantitative Detection Algorithm for Multi-Test Line Lateral Flow Immunoassay Applied in Smartphones. Sensors. 2023; 23(14):6401. https://doi.org/10.3390/s23146401

Chicago/Turabian Style

Zhang, Shenglan, Xincheng Jiang, Siqi Lu, Guangtian Yang, Shaojie Wu, Liqiang Chen, and Hongcheng Pan. 2023. "A Quantitative Detection Algorithm for Multi-Test Line Lateral Flow Immunoassay Applied in Smartphones" Sensors 23, no. 14: 6401. https://doi.org/10.3390/s23146401

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop