Next Article in Journal
The Effect of Combined Application of Biocontrol Microorganisms and Arbuscular Mycorrhizal Fungi on Plant Growth and Yield of Tomato (Solanum lycopersicum L.)
Previous Article in Journal
Little Brands, Big Profits? Effect of Agricultural Geographical Indicators on County-Level Economic Development in China
Previous Article in Special Issue
Recognition and Positioning of Strawberries Based on Improved YOLOv7 and RGB-D Sensing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Method for Peanut Seed Plumpness Detection in Soft X-ray Images Based on Level Set and Multi-Threshold OTSU Segmentation

1
College of Information and Technology & Smart Agriculture Research Institute, Jilin Agricultural University, Changchun 130118, China
2
Department of Biosystems and Agricultural Engineering, Oklahoma State University, Stillwater, OK 75078, USA
3
Institute of Facility Agriculture of Guangdong Academy of Agricultural Sciences, Guangzhou 510640, China
*
Author to whom correspondence should be addressed.
Agriculture 2024, 14(5), 765; https://doi.org/10.3390/agriculture14050765
Submission received: 11 April 2024 / Revised: 13 May 2024 / Accepted: 14 May 2024 / Published: 16 May 2024
(This article belongs to the Special Issue Sensing and Imaging for Quality and Safety of Agricultural Products)

Abstract

:
The accurate assessment of peanut seed plumpness is crucial for optimizing peanut production and quality. The current method is mainly manual and visual inspection, which is very time-consuming and causes seed deterioration. A novel imaging technique is used to enhance the detection of peanut seed fullness using a non-destructive soft X-ray, which is suitable for the analysis of the surface or a thin layer of a material. The overall grayscale of the peanut is similar to the background, and the edge of the peanut seed is blurred. The inaccuracy of peanut overall and peanut seed segmentation leads to low accuracy of seed plumpness detection. To improve accuracy in detecting the fullness of peanut seeds, a seed plumpness detection method based on level set and multi-threshold segmentation was proposed for peanut images. Firstly, the level set algorithm is used to extract the overall contour of peanuts. Secondly, the obtained binary image is processed by morphology to obtain the peanut pods (the peanut overall). Then, the multi-threshold OTSU algorithm is used for threshold segmentation. The threshold is selected to extract the peanut seed part. Finally, morphology is used to complete the cavity to achieve the segmentation of the peanut seed. Compared with optimization algorithms, in the segmentation of the peanut pods, average random index (RI), global consistency error (GCE) and variation of information (VI) were increased by 10.12% and decreased by 0.53% and 24.11%, respectively. Compared with existing algorithms, in the segmentation of the peanut seed, the average RI, VI and GCE were increased by 18.32% and decreased by 9.14% and 6.11%, respectively. The proposed method is stable, accurate and can meet the requirements of peanut image plumpness detection. It provides a feasible technical means and reference for scientific experimental breeding and testing grading service pricing.

1. Introduction

Plant seeds are important to agricultural production. It is essential to ensure the integrity and fullness of peanut seeds, as these qualities directly affect the germination percentage of the seeds and the quality of the harvest. Plumpness is an important index reflecting the vigor and potential productivity of the peanut seed [1]. However, the detection of peanut fullness mainly relies on manual shell cracking and visually inspecting the seeds. This method is simple but time-consuming and can cause peanut seed deterioration due to exposure to air. Hence, a fast, accurate and automated method for detecting the fullness of seeds occupying the peanut overall is desirable.
To address these challenges, our research employs a soft X-ray imaging technique. This non-destructive method allows for the internal inspection of seeds without causing damage, thereby preserving the vigor and potential productivity of the peanut seed [2,3,4]. It is also recommended by the International Association for Seed Testing (ISTA) for seed quality testing [5]. Pearson et al. successfully used X-ray imaging to detect insect-damaged sunflower seeds in the internal tissues [6]. Bianchini et al. used X-ray imaging technology to process the image with ROI and mean gray value to investigate internal tissues [7]. Medeiros et al. evaluated the potential of deep learning models based on convolutional neural networks (CNNs) in monitoring the quality of sea cabbage seeds using X-ray images [8]. The germination of healthy seeds was not affected by X-ray irradiation [9]. Therefore, internal research can be carried out without damage to the peanut image by X-ray. When processing the collected X-ray images, the main method is needed to segment peanut seed(s) from their shell and the background of the image. In many cases, the overall grayscale of the peanut is similar to the background, and the edge of the peanut shell and seed(s) is blurred. These can affect the results of the segmentation and lead to a low detection accuracy of the contour of peanut seeds. Luo et al. proposed a method that extracted the target region by threshold value and level set after manually extracting the region of interest [10]. When the target boundary is not obvious, the result is misclassified. Rehman et al. reported that the segmentation of CT image data is based on regional level set technology [11]. The target in the image has a clear edge, so the method is not applicable to the peanut image by X-ray. Feng et al. performed a method combining CNN and level set to segment the target part of the magnetic resonance image [12]. Neural network training requires a large amount of data, and too much time is required to prepare data, set experimental parameters and adjust model structure. Multi-threshold OTSU and Improved GWO can be used to extract target parts from images with similar pixel colors [13]. Multi-threshold OTSU and Improved ACO were used in X-ray image segmentation by Qin et al. [14]. Multi-threshold Otsu and Improved PSO are combined for segmentation by Wang et al. [15]. Therefore, multi-threshold OTSU is suitable for gray image segmentation.
A new method for detecting the kernel plumpness of peanut X-ray images based on level set [12] and multi-threshold segmentation was proposed (LSA-MOTSU). The level set algorithm is used to extract the overall contour of peanuts. The multi-threshold OTSU algorithm [13] is used for threshold segmentation. The threshold is selected to extract peanut seeds. Morphology is used to fill holes in the image. The aims of this research were as follows: (1) to achieve the segmentation of peanut seeds and peanut pods, (2) to propose a stable, accurate method for detecting kernel plumpness of peanut, (3) to provide a feasible technical means and reference for grading, scientific experimental breeding and estimating kernel weight.

2. Materials and Methods

2.1. The Principle of Image Segmentation

Capture of peanut lossless imaging is shown in Figure 1. Figure 1a shows the soft X-ray imaging system used for this study, which consists of an X-ray tube (XTFTM-5011, Oxford Instruments, X-ray Technologies, Inc., Scotts Valley, CA, USA), a solid-state digital X-ray camera (Shad-o-BoxTM 2048, Rad-Icon, Inc., Milpitas, CA, USA), a digital frame grabber (Imagenation® PXD 1000, Imagenation Corp., Minneapolis, MN, USA), a data acquisition and control card (Omega® DAQ 801 OM, Omega Engineering, Inc., Norwalk, CT, USA) and a personal computer with ShadoCam software Version 3.0.2 (Rad-icon Imaging, Corp., Milpitas, CA, USA). Figure 1b shows the capture of a peanut image.
The plumpness of the peanut was calculated from the collected X-ray images (Figure 2). Each image’s acquisition time is 2 s. However, the grayscale of the peanut shell in the images was light gray with low contrast to the background. The boundary of the peanut pod was often fuzzy, which led to errors in image segmentation for the peanut pod against the background.
In this study, a level set algorithm [16] was used to extract the overall contour of the peanut in an image. Then, a binary image was obtained and used to segment the peanut pod against the background using a morphology algorithm. After that, the multi-threshold OTSU algorithm [17] is used to find thresholds to extract peanut seed(s). The multi-threshold segmentation algorithm performs segmentation based on multiple thresholds generated by pixel value classification. As the edge and inner grayscale of the peanut seed(s) in X-ray images are not uniform, the extracted peanut pod image might have holes. A morphology algorithm was used to fill the holes and receive the images for seeds and the shell. The proposed method is stable and accurate. It satisfies the requirements of peanut image plumpness detection.
It provides a feasible technical means and reference for grading, scientific experimental breeding and estimating seed weight. Figure 3 shows the proposed framework for image segmentation.

2.2. Level Set Algorithm

It is difficult to find a precise surface to calculate the surrounding object. The level set algorithm (LSA) was proposed by Osher and Sethian in 1988 to model the changing shape of a flame based on thermodynamic equations [16]. Topological complexity and variations in moving frontiers can be handled naturally by treating the surface as a level set. LSA represents a closed plane curve as a continuous functional surface implicitly [1]. The advantage of LSA is the evolution of curves and surfaces can be calculated in a fixed coordinate system without knowing the exact parameters of the curves and surfaces [18]. It is advantageous for processing images with weak edge features. It describes the evolution curve of curvature correlation rate effectively based on gradient invariance [19,20]. Figure 4 shows the evolution of the LSA. Different colors represent different depths in the 3D surface image A in Figure 4a. When the surface a intersects the plane z = −3, the outline of the intersecting surface is obtained by level set in Figure 4c.
The closed curve is defined as a two-dimensional level set function, s ( x , y ) .
C = x , y , s ( x , y ) = c
After introducing the time variable t , the curve C ( t ) changing with time t , is obtained.
C ( t ) = x , y , s ( x , y , t ) = c
The derivative of the time-varying level set function s ( x , y , t ) = 0 with respect to t is shown in Equation (3).
d s d t = s t + s · x , y t = 0
Briefly describe x , y t , as in Equation (4).
x , y t = C t = V
The evolution formula of the curve is Equation (5).
s t = s · x , y t = s s s · V = s N · V = β s
β = N · V
where V represents movement speed of normal direction, N is taken as a negative sign, β represents moving velocity component of normal direction.
When s x , y is less than 0, x , y is inside the curve C ( t ) . When s x , y is greater than 0, x , y is outside the curve C ( t ) . And when s x , y is equal to 0, x , y is on the curve C ( t ) .
In an X-ray image, the contour of the peanut pod is continuously closed. And there is a slight grayscale difference between the contour and the background. The gray-level distribution inside the peanut pod is uneven, so it is difficult to use the threshold segmentation method to separate the peanut pods from the background. Hence, the level set algorithm is selected to extract the peanut contour.

2.3. OTSU Multi-Threshold Algorithm

The OTSU algorithm is an excellent, and the most frequently used, image threshold segmentation method. It is simple and not affected by the brightness and contrast of the image. But the original OTSU method uses a single threshold for segmentation. With one threshold, an image is divided into two classes. Any other details will no longer be distinguished. However, in many practical cases, this cannot satisfy the actual requirements. The results need to be further divided. The multi-threshold OTSU method is used to segment multiple classes at one time. Assuming there are m classes to be classified in an image X and the gray level is L, then, there are m 1 thresholds, k 1 , , k n , , k m 1 , which are used to divide the image X into m classes. These classes are represented as C 0 = 0,1 , , k 1 , , C n = k n + 1 , k n + 2 , , k n + 1 , , C m = { k m + 1 , k m + 2 , , L 1 } . The interclass variance is as follows:
σ = ω 0 ( μ 0 μ T ) 2 + + ω n ( μ n μ T ) 2 + + ω m 1 ( μ m 1 μ T ) 2
Among them,
ω 0 = i = 0 k i P i , , ω n = i = k n + 1 k n + 1 P i , , ω m 1 = i = k m 1 + 1 L 1 P i
μ 0 = i = 0 k i i P i ω 0 , , μ n = i = k n + 1 k n + 1 i P i ω n , , μ 0 = i = k m 1 + 1 L 1 i P i ω m 1
N = i = 0 L 1 N i
μ T = i = 0 L 1 i P i
where N is the total number of pixels in the grayscale image, n is the number of pixels in the same grayscale pixel i , ω i is the probability of the same grayscale pixel and μ is the pixel mean [21,22].
The thresholds k obtained by Equations (7)–(11) are the expected thresholds when σ reaches the maximum value. In the peanut X-ray images, the multi-threshold OTSU algorithm can divide the peanut pods into m classes according to the pixel gray value. Thus, the peanut seed(s) can be extracted.

2.4. Morphology Algorithm

Due to the similarity in pixel values of the peanut images, the segmented peanut images undergo the same detailed processing. In mathematics, when an image A is expanded or corroded by structural element B, they can be represented mathematically in Equations (12) and (13) [23].
A B = z B ^ z A φ
A B = z B z A c φ
where A is an image, B is a structural element, is expansion operation and is corrosion operation.
The contour of the peanut pod extracted by LSA has holes, which need to be filled to obtain the peanut pod. There are small pixels in the multi-threshold OTSU algorithm for threshold segmentation, so small areas need to be deleted to obtain the peanut seed(s).
Open and closed operations are combined operations of expansion and corrosion. Image A is corroded by a structural element B and, then, expanded by B. The open operation is used to smooth the outline of the object, breaking narrow connections and removing small protrusions.
A · B = A B B = B z B z A
A closed operation is the result of the image A being expanded by a structural element B and, then, corroded by B. Closing operations connect narrow gaps to form slender bends and fill holes smaller than the structural elements.
A B = A B B = B z B z A

2.5. Plumpness Calculation Method

The cross-section of the peanut is shown in Figure 5a. It is not feasible to calculate the peanut plumpness, layer by layer. On the basis of the peanut central axis, the peanut plumpness was calculated by taking the peanut section of 360 degrees as a circle, as shown in Figure 5b. The structure of the peanut is relatively symmetric; therefore, peanut plumpness is the plumpness of the cross-section in the central axis, as shown in Figure 5c.
Peanut plumpness is defined as the area ratio of the peanut seed(s) to pod. The areas can be replaced by the total number of pixels of the seed(s) and pod, respectively, as shown in Equation (16).
η = s 0 s = n 0 n
where S 0 is the actual area of peanut seed(s), S is the actual area of peanut pod, n 0 is the total number of pixels of peanut seed(s) and n is the total number of pixels of the peanut pod. η is the peanut plumpness.

2.6. Experiment Design for Image Collection and Method Validation

2.6.1. Experimental Preparation

An X-ray radiograph of the peanut pod was taken using a soft X-ray imaging system. The peanut seed and peanut pod were segmented by the image processing method. All the data analysis was performed with the software MATLAB R2010a. The MATLAB software was run on a laptop with CPU Intel (R) Core (TM) i5-8250 CPU @1.60 GHz 1.80 GHz, 7.89 GB available memory, Windows10 64-bit operating system.

2.6.2. Experimental Comparison Method

There are four mainstream methods used for segmentation at present, such as level set, level set and OTSU method [24], GWO (grey wolf optimizer) [25], DEGWO (Differential evolution grey wolf optimizer) [13] and PSO (Particle swarm optimization) [26]. To test the effectiveness of the method proposed, level set, GWO, DEGWO and PSO were compared with the improved level set algorithm based on OTSU and morphology.
To intuitively reflect the segmentation effects of LSA-MOTSU proposed in this paper, the six algorithms were used to segment 300 peanut images, and the result images were compared with the manual segmentation.

2.6.3. Artificial Segmentation Method

The peanut images were manually segmented by histogram detection in Adobe Photoshop CC software. The artificial segmentation method steps are as follows: Firstly, adjust the gray histogram of the color image, and set target (peanut pod or peanut seeds) to black. Secondly, open the histogram window, and adjust all channel views. Then, use the quick selection tool to select the peanut pod. Finally, obtain the pixel value directly from the software. The same procedure was applied to peanut seeds.

2.6.4. Experimental Assessment Method

The global consistency error (GCE), random index (RI) [27] and variation of information (VI) [28] are employed to assess the segmentation results. GCE assesses the consistency of segmentation relative to a ground truth. A lower GCE indicates fewer inconsistencies and higher segmentation fidelity. RI measures the similarity between the automated segmentation and the ground truth, accounting for chance agreement. Higher RI values suggest better accuracy. VI quantifies the amount of information lost or gained in the segmentation process relative to the true segmentation. Lower VI values indicate less information loss [29].
GCE is shown below.
E S 1 , S 2 , p q = R ( S 1 , p q ) \ R ( S 2 , p q ) R ( S 1 , p q )
G C E S 1 , S 2 = 1 n m i n i E S 1 , S 2 , p q , i E S 2 , S 1 , p q
where S 1 and S 2 represent segmentation result 1 and segmentation result 2, p q represents the pixel which is a specific query point, R ( S , p q ) represents the subset associated with the query point p q in segmentation S .
RI is shown below.
R I S , S = 1 [ 1 2 i j n i j 2 + j i n i j 2 n i j ] N 2
where n represents the number of pixels, i and j represent labels, i n i j represents the number of points with i in the S , j n i j represents the number of points with j in the S , N represents the total number of points.
VI is shown below.
V I C 1 , C 2 = H C 1 I C 1 , C 2 + H C 2 I C 1 , C 2
where C represents clustering, H C represents entropy of C , I C 1 , C 2 represents the mutual information between C 1 and C 2 .

3. Results

3.1. Image Segmentation

The image segmentation results with LSA-MOTSU are shown in Figure 6.
The peanut segmentation effect images of different methods are shown in Figure 7.
In the peanut pod part, there was a small difference between the six algorithms, but there were misjudgment pixels in GWO, DEGWO and PSO. As for the peanut seeds, LSA-MOTSU was able to completely segment peanut seeds. There were too many misjudgment pixels in the segmentation of peanut seeds by the LSA. There were partial misjudgment pixels in the peanut seed image by LSA-OTSU, GWO and DEGWO methods. The results of the segmentation of peanut seeds by PSO were more complete, but the accuracy of LSA-MOTSU was superior to that of PSO.
The result images of artificial segmentation are shown in Figure 8.

3.2. Experiment of the Peanut Plumpness

The peanut plumpness data results compared with the other five algorithms and artificial segmentation are shown in Table 1. The peanut pod and seed images are measured in pixels.
For LSA-MOTSU, although the pixel value of the peanut pod is less than that of GWO, DEGWO and PSO algorithms, the value of seeds is the closest to that of the artificial segmentation method.
The pixel value of the peanut pod of GWO, DEGWO and PSO algorithms are close to the artificial segmentation result. However, the results of peanut seed segmentation based on these algorithms are quite different from those of artificial segmentation.
Table 2 lists the assessment results of segmentation. The manual segmentation image is regarded as the gold standard image.
The peanut pod of the level set is over-extracted, resulting in no advantage compared with GWO, DEGWO and PSO.
As for the peanut pod, compared with LSA, LSA-OTSU, GWO, DEGWO and PSO, the LSA-MOTSU has the best detection effects in RI and VI.
For the 5 samples of 25 samples selected, the result image comparison diagram is shown in Table 3. Results of the peanut pod segmentation of 25 samples are shown in Table 4. The data with gray background indicates that LSA-MOTSU is more effective than other algorithms. -- indicates that the data result is equal. Table 4 presents the results of peanut overall segmentation based on 25 samples using various algorithms. Each column represents the evaluation metric results for the different algorithms used for segmentation. Compared to DEGWO, GWO and PSO algorithms, LSA-MOTSU, LSA-OTSU and LSA consistently demonstrate superior performance along with the highest RI values, signifying better agreement with the ground truth. Results of the peanut seed segmentation of 25 samples are shown in Table 5. The data with gray background indicates that LSA-MOTSU is more effective than other algorithms. -- indicates that the data result is equal. For the color deepening part in these tables, LSA-MOTSU has the best effects compared with others. LSA-MOTSU generally demonstrates competitive performance across all evaluation metrics, with relatively higher RI and lower VI values compared to other algorithms, indicating better segmentation accuracy and consistency. However, it shows mixed performance in GCE compared to other algorithms.
In conclusion, compared with other algorithms, the LSA-MOTSU algorithm had better effects and higher accuracy in the segmentation of peanut pods and seeds. Compared with DEGWO, GWO and PSO algorithms, in segmentation of the peanut pod, the average RI increased by 10.12%, 1.13% and 0.78%, respectively. Average GCE decreased by 0.53%, 0.11% and 0.09%, and average VI decreased by 24.11%, 5.15% and 2.85%. Compared with LSA-OTSU, LSA, DEGWO, GWO and PSO algorithms, in segmentation of the peanut seeds, the average RI increased by 4.18%, 18.32%, 5.11%, 2.32% and 3.93%, and the average VI decreased by 9.14%, respectively. Compared with LSA-OTSU, LSA and DEGWO, the average GCE decreased by 0.47%, 6.11% and 0.33%, respectively.

4. Discussion

4.1. LSA-MOTSU in Seed Plumpness Detection

The LSA-MOTSU method, designed for peanut seed plumpness detection using soft X-ray imaging, significantly improves the accuracy and efficiency of segmenting peanut seeds from pods. This is evident from the comparative results, where LSA-MOTSU outperforms other algorithms like LSA-OTSU, LSA, DEGWO, GWO and PSO in terms of the random index (RI), global consistency error (GCE) and variation of information (VI). These metrics collectively indicate a more precise segmentation, crucial for accurate plumpness detection, which, in turn, influences the assessment of seed quality and viability.

4.2. Advantages of the Method in This Paper

For the segmentation-based method in seed saturation detection, the detection is mainly based on the segmentation accuracy of seeds and pods, so it is more suitable for image acquisition with little difference in gray levels of the target area.
Pearson et al. [6] successfully used X-ray imaging to detect insect-damaged seeds in sunflowers, indicating the potential of this technology for internal damage assessment. In comparison, the LSA-MOTSU method focuses on the plumpness of peanut seeds, a slightly different application but similarly leveraging the non-destructive nature of X-ray imaging. Bianchini et al. [7] utilized ROI and mean gray value calculations for studying internal tissues, which primarily rely on simple statistical measures of image intensity. The LSA-MOTSU method, by incorporating advanced segmentation techniques like the level set and multi-threshold OTSU, provides a more nuanced analysis by accurately segmenting the peanut seeds from their pods, which could potentially be adapted for the more detailed internal analysis. Medeiros et al. [8] evaluated the use of convolutional neural networks (CNNs) with X-ray images for quality monitoring. While CNNs offer robust performance in image classification tasks, they require extensive data for training.
The automated approach of LSA-MOTSU not only reduces the time taken but also minimizes physical handling, thus preserving seed integrity and potentially enhancing the accuracy of seed viability assessments.

4.3. Deficiency and Prospect

The method proposed in this study achieved high accuracy in plumpness detection, but it still has certain limitations. The algorithm’s dependency on the quality of X-ray imaging and its calibration could pose limitations, especially in varied agricultural settings. Additionally, the segmentation performance might still be susceptible to errors when dealing with highly overlapping seeds or seeds with very subtle differences in grayscale values. Further research could focus on refining the LSA-MOTSU algorithm to enhance its robustness against varying seed morphologies and overlapping structures.
Future research could explore the integration of LSA-MOTSU with deep learning techniques, potentially enhancing its adaptability and accuracy. Such integration could address the data-intensive requirements of neural networks while benefiting from the precision of level set and OTSU methods.

5. Conclusions

For the purpose of scientific experimental breeding and testing grading service pricing, the peanut images obtained by soft X-rays were used to detect plumpness. The overall grayscale of the peanut was similar to the background, and the edge of the peanut seed was blurred, which would lead to inaccurate segmentation targets and low detection accuracy. In this paper, a new method for detecting the plumpness of the peanut seed based on level set and multi-threshold segmentation was proposed. The level set algorithm is used to extract the overall contour of peanuts. The multi-threshold OTSU algorithm is used for threshold segmentation. Morphology was used to complete the cavity. Therefore, the division of the peanut seed and peanut pod is realized.
In conclusion, compared with other algorithms, the LSA-MOTSU algorithm had a better effect and higher accuracy in the segmentation of peanut pods and seeds. Compared with DEGWO, GWO and PSO algorithms, in the segmentation of the peanut pod, the average RI increased by 10.12%, 1.13% and 0.78%, respectively. Average GCE decreased by 0.53%, 0.11% and 0.09%, and the average VI decreased by 24.11%, 5.15% and 2.85%. Compared with LSA-OTSU, LSA, DEGWO, GWO and PSO algorithms, in the segmentation of the peanut seeds, the average RI increased by 4.18%, 18.32%, 5.11%, 2.32% and 3.93%, and the average VI decreased by 9.14%, respectively. Compared with LSA-OTSU, LSA and DEGWO, the average GCE decreased by 0.47%, 6.11% and 0.33%, respectively.
The proposed method is stable and accurate. It satisfies the requirements of peanut image plumpness detection. It provides a feasible technical means and reference for grading, scientific experimental breeding and estimating seed weight.

Author Contributions

Conceptualization, N.W., Y.L. and G.Q.; methodology, N.W., Y.L. and G.Q.; software, Y.L.; validation, Y.L.; formal analysis, Y.L.; investigation, G.Q.; resources, Y.L.; data curation, Y.L.; writing—original draft preparation, Y.L.; writing—review and editing, N.W., Y.L. and G.Q.; visualization, G.Q.; supervision, Y.L.; project administration, N.W. All authors have read and agreed to the published version of the manuscript.

Funding

This article was supported by the National Natural Science Foundation of China (No. 42001256), Jilin Science and Technology Development Program Project (No. 20220402023GH) and also the Natural Science Foundation of Guangdong Province ((No. 2022A1515010391); the Scientific and Technological Innovation Strategic Program of Guangdong Academy of Agricultural Sciences (No. ZX202402); the Guangzhou Science and Technology Planning Project (202201010659); the Innovation Fund of Guangdong Academy of Agricultural Sciences (No. 202104); the Youth Training Program of Guangdong Academy of Agricultural Sciences (No. R2020QD-061); and the USDA-NIFA Hatch Projects OKL03169 and OKL03178.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The datasets in this study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Pramanik, S.; Banik, D.; Bhattacharjee, D.; Nasipuri, M.; Bhowmik, M.K.; Majumdar, G. Suspicious-Region Segmentation from Breast Thermogram Using DLPE-Based Level Set Method. IEEE Trans. Med. Imaging 2019, 38, 572–584. [Google Scholar] [CrossRef] [PubMed]
  2. Lee, D.; Kim, H.; Choi, B.; Kim, H.J. Development of a Deep Neural Network for Generating Synthetic Dual-Energy Chest X-ray Images with Single X-ray Exposure. Phys. Med. Biol. 2019, 64, 115017. [Google Scholar] [CrossRef] [PubMed]
  3. Gros, M.A.L.; Clowney, E.J.; Magklara, A.; Yen, A.; Markenscoff-Papadimitriou, E.; Colquitt, B.; Myllys, M.; Kellis, M.; Lomvardas, S.; Larabell, C.A. Soft X-ray Tomography Reveals Gradual Chromatin Compaction and Reorganization during Neurogenesis In Vivo. Cell Rep. 2016, 17, 2125–2136. [Google Scholar] [PubMed]
  4. Willner, M.; Viermetz, M.; Marschner, M.; Scherer, K.; Braun, C.; Fingerle, A.; Noël, P.; Rummeny, E.; Pfeiffer, F.; Herzen, J. Quantitative Three-Dimensional Imaging of Lipid, Protein, and Water Contents via X-ray Phase-Contrast Tomography. PLoS ONE 2016, 11, e0151889. [Google Scholar] [CrossRef] [PubMed]
  5. ISTA. International Rules for Seed Testing; The International Seed Testing Association: Wallisellen, Switzerland, 2019. [Google Scholar]
  6. Pearson, T.C.; Prasifka, J.; Brabec, D.; Haff, R.; Hulke, B. Automated Detection of Insect-Damaged Sunflower Seeds by X-ray Imaging. Appl. Eng. Agric. 2014, 30, 125–131. [Google Scholar]
  7. Bianchini, V.D.M.; Mascarin, G.M.; Silva, L.C.A.S.S.; Arthur, V.; Carstensen, J.M.; Boelt, B.; da Silva, C.B. Multispectral and X-ray images for characterization of Jatropha curcas L. seed quality. Plant Methods 2021, 17, 9. [Google Scholar] [CrossRef] [PubMed]
  8. Medeiros, A.D.D.; Bernardes, R.C.; Silva, L.J.D.; Freitas, B.A.L.D.; Dias, D.C.F.D.S.; Sliva, C.B.D. Deep Learning-based Approach using X-ray Images for Classifying Crambe abyssinica Seed Quality. Ind. Crops Prod. 2021, 164, 113378. [Google Scholar] [CrossRef]
  9. Nagaraju, A.; Babu, T.R.; Babu, B.S. Effects of X-ray Radiography on the Germination of Groundnut Seeds. Environ. Ecol. 2017, 35, 3660–3663. [Google Scholar]
  10. Luo, L.; Liu, S.; Tong, X.; Jiang, P.; Yuan, C.; Zhao, X.; Shang, F. Carotid Artery Segmentation Using Level Set Method with Double Adaptive Threshold (DATLS) on TOF-MRA Images. Magn. Reson. Imaging 2019, 63, 123–130. [Google Scholar] [CrossRef]
  11. Rehman, F.; Shah, S.I.A.; Riaz, M.N.; Gilani, S.O.; Faiza, R. A Region-Based Deep Level Set Formulation for Vertebral Bone Segmentation of Osteoporotic Fractures. J. Digit. Imaging 2020, 33, 191–203. [Google Scholar] [CrossRef]
  12. Feng, F.; Ashton-Miller, J.A.; Delancey, J.O.L.; Luo, J. Convolutional Neural Network-Based Pelvic Floor Structure Segmentation Using Magnetic Resonance Imaging in Pelvic Organ Prolapse. Med. Phys. 2020, 47, 4281–4293. [Google Scholar] [CrossRef]
  13. Liu, Y.; Sun, J.; Yu, H.; Wang, Y.; Zhou, X. An Improved Grey Wolf Optimizer Based on Differential Evolution and OTSU Algorithm. Appl. Sci. 2020, 10, 6343. [Google Scholar] [CrossRef]
  14. Qin, J.; Shen, X.; Mei, F.; Fang, Z. An Otsu multi-thresholds segmentation algorithm based on improved ACO. J. Supercomput. 2019, 75, 955–967. [Google Scholar] [CrossRef]
  15. Wang, C.; Yang, J.; Lv, H. Otsu Multi-Threshold Image Segmentation Algorithm Based on Improved Particle Swarm Optimization. In Proceedings of the 2019 IEEE 2nd International Conference on Information Communication and Signal Processing (ICICSP), Weihai, China, 28–30 September 2019; IEEE: Piscataway, NJ, USA, 2019. [Google Scholar]
  16. Osher, S.; Sethian, J.A. Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations. J. Comput. Phys. 1988, 79, 12–49. [Google Scholar] [CrossRef]
  17. Otsu, N. A Threshold Selection Method from Gray-Level Histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
  18. Huang, G.; Ji, H.; Zhang, W.; Zhu, Z. Adaptive Multilayer Level Set Method for Segmenting Images with Intensity Inhomogeneity. IET Image Process. 2019, 13, 1714–1724. [Google Scholar] [CrossRef]
  19. Mirzaaghaian, A.; Ramiar, A.; Ranjbar, A.A.; Warkiani, M.E. Application of Level-Set Method in Simulation of Normal and Cancer Cells Deformability within a Microfluidic Device. J. Biomech. 2020, 112, 110066. [Google Scholar] [CrossRef]
  20. Zhang, Y.; Wu, J.; Liu, Y.; Chen, Y.; Chen, W.; Wu, E.X.; Li, C.; Tang, X. A Deep Learning Framework for Pancreas Segmentation with Multi-Atlas Registration and 3D Level-Set. Med. Image Anal. 2021, 68, 101884. [Google Scholar] [CrossRef]
  21. Tan, Z.G.; Ou, J.P.; Zhang, J.; Shen, X.G. Depth Image Segmentation Algorithm Based on Multi-Feature Combination. Comput. Eng. Sci. 2018, 40, 97–102. [Google Scholar]
  22. Kayal, E.B.; Kandasamy, D.; Sharma, R.; Sharma, M.C.; Bakhshi, S.; Mehndiratta, A. SLIC-Supervoxels-Based Response Evaluation of Osteosarcoma Treated with Neoadjuvant Chemotherapy Using Multi-Parametric MR imaging. Eur. Radiol. 2020, 30, 3125–3136. [Google Scholar] [CrossRef]
  23. Gonzalez, R.C.; Woods, R.E.; Eddins, S.L. Digital Image Processing Using MATLAB; Prentice Hall: Upper Saddle River, NJ, USA, 2003. [Google Scholar]
  24. Zhao, Y.; Liu, S.; Hu, Z.; Bai, Y.; Shen, C.; Shi, X. Separate Degree Based Otsu and Signed Similarity Driven Level Set for Segmenting and Counting Anthrax Spores. Comput. Electron. Agric. 2020, 169, 105230. [Google Scholar] [CrossRef]
  25. Mirjalili, S.; Mirjalili, S.M.; Lewis, A. Grey Wolf Optimizer. Adv. Eng. Softw. 2014, 69, 46–61. [Google Scholar] [CrossRef]
  26. Eberhart, R.C.; Kennedy, J. A New Optimizer Using Particle Swarm Theory. In Proceedings of the Sixth International Symposium on Micro Machine and Human Science (MHS’95), Nagoya, Japan, 4–6 October 1995. [Google Scholar]
  27. Martin, D.; Fowlkes, C.; Tal, D.; Malik, J. A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics. In Proceedings of the IEEE International Conference on Computer Vision 2001, Vancouver, BC, Canada, 7–14 July 2001. [Google Scholar]
  28. Rand, W.M. Objective Criteria for the Evaluation of Clustering Methods. J. Am. Stat. Assoc. 1971, 66, 846–850. [Google Scholar] [CrossRef]
  29. Meila, M. Comparing clusterings by the variation of information. In Learning Theory and Kernel Machines, Proceedings of the 16th Annual Conference on Computational Learning Theory and 7th Kernel Workshop, COLT/Kernel 2003, Washington, DC, USA, 24–27 August 2003; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2003; Volume 2777, pp. 173–187. [Google Scholar]
Figure 1. Capture of peanut lossless imaging: (a) soft X-ray imaging system and (b) the capture of a peanut image.
Figure 1. Capture of peanut lossless imaging: (a) soft X-ray imaging system and (b) the capture of a peanut image.
Agriculture 14 00765 g001
Figure 2. X-ray image of a peanut pod.
Figure 2. X-ray image of a peanut pod.
Agriculture 14 00765 g002
Figure 3. The framework of the proposed segmentation method.
Figure 3. The framework of the proposed segmentation method.
Agriculture 14 00765 g003
Figure 4. Level set method evolution process: (a) random 3D curved surface image A, (b) image of the surface A intersecting the plane z =−3 and (c) the outline of an intersection surface.
Figure 4. Level set method evolution process: (a) random 3D curved surface image A, (b) image of the surface A intersecting the plane z =−3 and (c) the outline of an intersection surface.
Agriculture 14 00765 g004
Figure 5. Peanut fullness structure: (a) cross-section structure of peanut, (b) structure of peanut in central axis (the dashed line indicates the center position), and (c) the plumpness of a cross-section.
Figure 5. Peanut fullness structure: (a) cross-section structure of peanut, (b) structure of peanut in central axis (the dashed line indicates the center position), and (c) the plumpness of a cross-section.
Agriculture 14 00765 g005
Figure 6. The LSA-MOTSU result of the image segmentation process: (a) original X-ray image; (b) image after LSA; (c) image after morphology operations; (d) the segmented image of a peanut pod; (e) image after multi-threshold OTSU segmentation; (f) image of thresholds for peanut seeds; (g) image of peanut seeds after morphology operations.
Figure 6. The LSA-MOTSU result of the image segmentation process: (a) original X-ray image; (b) image after LSA; (c) image after morphology operations; (d) the segmented image of a peanut pod; (e) image after multi-threshold OTSU segmentation; (f) image of thresholds for peanut seeds; (g) image of peanut seeds after morphology operations.
Agriculture 14 00765 g006
Figure 7. Peanut segmentation effect images of different methods.
Figure 7. Peanut segmentation effect images of different methods.
Agriculture 14 00765 g007
Figure 8. The result images of artificial segmentation: (a) Image of peanut pod (b) Image of peanut seeds.
Figure 8. The result images of artificial segmentation: (a) Image of peanut pod (b) Image of peanut seeds.
Agriculture 14 00765 g008
Table 1. Comparison of peanut plumpness obtained with different methods.
Table 1. Comparison of peanut plumpness obtained with different methods.
MethodPeanut PodPeanut SeedPeanut Plumpness
LSA-MOTSU155,72196,0610.6160
LSA-OTSU155,72173,4910.4710
LSA155,721125,8250.8060
DEGWO163,45178,6710.4813
GWO165,65090,0640.5437
PSO166,29885,3030.5129
Artificial Segmentation166,133103,8350.6250
Table 2. Assessment results of segmentation.
Table 2. Assessment results of segmentation.
PartMethodRIGCEVI
Peanut podLSA-MOTSU1.06050.03330.3526
LSA-OTSU1.06050.03330.3526
LSA1.06050.03330.3526
DEGWO1.08470.03070.2654
GWO1.08940.03300.2612
PSO1.08950.03380.2636
Peanut kernelLSA-MOTSU1.05650.01530.2581
LSA-OTSU0.96960.00850.4520
LSA0.97280.03900.6217
DEGWO0.99160.00940.4027
GWO1.03870.01280.2955
PSO1.01930.01110.3395
Table 3. Comparison of images of 5 samples from 25 sample results.
Table 3. Comparison of images of 5 samples from 25 sample results.
Original ImagePeanut PodsPeanut Seeds
LSA-MOTSULSA-OTSULSADEGWOGWOPSOArtiLSA-MOTSULSA-OTSULSADEGWOGWOPSOArti
1Agriculture 14 00765 i001Agriculture 14 00765 i002Agriculture 14 00765 i003Agriculture 14 00765 i004Agriculture 14 00765 i005Agriculture 14 00765 i006Agriculture 14 00765 i007Agriculture 14 00765 i008Agriculture 14 00765 i009Agriculture 14 00765 i010Agriculture 14 00765 i011Agriculture 14 00765 i012Agriculture 14 00765 i013Agriculture 14 00765 i014Agriculture 14 00765 i015
2Agriculture 14 00765 i016Agriculture 14 00765 i017Agriculture 14 00765 i018Agriculture 14 00765 i019Agriculture 14 00765 i020Agriculture 14 00765 i021Agriculture 14 00765 i022Agriculture 14 00765 i023Agriculture 14 00765 i024Agriculture 14 00765 i025Agriculture 14 00765 i026Agriculture 14 00765 i027Agriculture 14 00765 i028Agriculture 14 00765 i029Agriculture 14 00765 i030
3Agriculture 14 00765 i031Agriculture 14 00765 i032Agriculture 14 00765 i033Agriculture 14 00765 i034Agriculture 14 00765 i035Agriculture 14 00765 i036Agriculture 14 00765 i037Agriculture 14 00765 i038Agriculture 14 00765 i039Agriculture 14 00765 i040Agriculture 14 00765 i041Agriculture 14 00765 i042Agriculture 14 00765 i043Agriculture 14 00765 i044Agriculture 14 00765 i045
4Agriculture 14 00765 i046Agriculture 14 00765 i047Agriculture 14 00765 i048Agriculture 14 00765 i049Agriculture 14 00765 i050Agriculture 14 00765 i051Agriculture 14 00765 i052Agriculture 14 00765 i053Agriculture 14 00765 i054Agriculture 14 00765 i055Agriculture 14 00765 i056Agriculture 14 00765 i057Agriculture 14 00765 i058Agriculture 14 00765 i059Agriculture 14 00765 i060
5Agriculture 14 00765 i061Agriculture 14 00765 i062Agriculture 14 00765 i063Agriculture 14 00765 i064Agriculture 14 00765 i065Agriculture 14 00765 i066Agriculture 14 00765 i067Agriculture 14 00765 i068Agriculture 14 00765 i069Agriculture 14 00765 i070Agriculture 14 00765 i071Agriculture 14 00765 i072Agriculture 14 00765 i073Agriculture 14 00765 i074Agriculture 14 00765 i075
Table 4. Results of peanut overall segmentation of 25 samples.
Table 4. Results of peanut overall segmentation of 25 samples.
RIGCEVI
LSA-MOTSULSA-OTSULSADEGWOGWOPSOLSA-MOTSULSA-OTSULSADEGWOGWOPSOLSA-MOTSULSA-OTSULSADEGWOGWOPSO
11.05551.05551.05550.92561.07741.07730.0590.0590.0590.02840.04350.04590.53230.53230.53230.85660.41030.4166
21.08141.08141.08141.03251.09321.09360.03960.03960.03960.02490.03270.03420.32860.32860.32860.47310.24510.2476
31.03191.03191.03190.91441.03961.03960.00210.00210.00210.0560.03310.03310.23240.23240.23240.96860.42310.4231
41.07661.07661.07660.08241.08931.08430.02170.02170.02170.01510.01860.02320.25060.25060.25060.2060.19730.2273
51.06921.06921.06921.07361.08441.08610.02490.02490.02490.01240.02150.0180.26640.26640.26640.21580.20260.1915
61.08061.08061.08061.04431.07931.07930.02020.02020.02020.02810.01760.01760.22870.22870.22870.37590.22190.2219
71.07161489321489320.98631.04831.04830.0251489321489320.01130.01990.01990.2681489321489320.48670.34070.3407
81.07841.07841.07841.0581.071.07340.0180.0180.0180.01070.01330.01660.21960.21960.21960.27530.24420.242
91.07651.07651.07651.07691.07971.07970.01580.01580.01580.01370.02020.02020.20360.20360.20360.20950.21880.2188
101.07981.07981.07980.97711.04041.04120.02580.02580.02580.0560.02210.02440.27050.27050.27050.71120.40130.404
111.08861.08861.08861.03280.98320.99560.01470.01470.01470.04340.0420.0420.16770.16770.16770.43220.69690.6295
121.07261.07261.07260.98861.08331.08340.01970.01970.01970.02550.01950.0180.250.250.250.58440.21590.2119
131.08971.08971.08970.98890.97821.02590.01770.01770.01770.07710.07160.00280.1970.1970.1970.65120.73160.2474
141.07991.07991.07991.06831.08321.08470.01860.01860.01860.01240.01610.01690.20930.20930.20930.23340.20120.1988
151.07671.07671.07671.02831.05491.05490.02270.02270.02270.04450.01760.01760.24890.24890.24890.47770.32170.3217
161.08381.08381.08381.08881.08941.08930.01770.01770.01770.01590.01690.01760.21250.21250.21250.19240.19350.1957
171.07521.07521.07521.07891.08441.08460.0180.0180.0180.01260.01510.01590.22990.22990.22990.20140.19340.1954
81.06751.06751.06751.05771.06391.07290.02390.02390.02390.0120.01340.01590.27740.27740.27740.28070.26630.2476
191.08061.08061.08060.93941.07971.07980.01720.01720.01720.02740.01640.0180.22060.22060.22060.86590.2260.2292
201.08161.08161.08160.91111.01171.01170.01920.01920.01920.06650.01530.01530.220.220.221.03220.44690.4469
211.08021.08021.08020.96751.05031.05770.01670.01670.01670.00770.01290.01430.20130.20130.20130.5280.29820.2804
221.08261.08261.08260.86051.07661.08160.01680.01680.01680.01970.01970.01980.18620.18620.18621.03630.2060.1855
231.07091.07091.07091.06231.07771.0790.01840.01840.01840.01030.01210.01530.25130.25130.25130.25970.21150.216
241.07341.07341.07341.07041.08051.08050.0190.0190.0190.01310.01840.01840.23610.23610.23610.23260.2190.219
251.05591.05591.05591.01431.07961.07960.04940.04940.04940.04680.03720.03720.48410.48410.48410.63380.34690.3469
Ave1.07441.07441.07440.97321.06311.06660.02240.02240.02240.02770.02350.02150.25570.25570.25570.49680.30720.2842
Increase------−0.1012−0.0113−0.0078------−0.0053−0.0011−0.0009------−0.2411−0.0515−0.0285
Table 5. Results of peanut kernel segmentation of 25 samples.
Table 5. Results of peanut kernel segmentation of 25 samples.
RIGCEVI
LSA-MOTSULSA-OTSULSADEGWOGWOPSOLSA-MOTSULSA-OTSULSADEGWOGWOPSOLSA-MOTSULSA-OTSULSADEGWOGWOPSO
11.07341.03450.85520.98571.04081.02790.00510.00550.09350.00230.00630.00490.13320.25071.02630.36330.23670.2657
21.05691.03930.87591.05531.05431.02720.01090.00820.08940.02780.0130.00670.24880.28791.09730.29440.2630.3151
31.07440.99390.9361.0211.0211.00650.02950.00120.04180.00560.00560.00240.28910.32850.70890.27490.27490.3016
41.06751.03270.90051.04191.05491.0270.00640.00390.06270.00520.010.00350.15170.2460.89610.22490.20280.2603
51.07281.02870.87371.00911.06011.03970.00890.00120.06925.86 × 10−40.00670.00230.14590.23840.95310.28810.17340.2132
61.04961.01550.91891.02911.02911.00250.00970.00380.04560.00580.00580.00280.23830.30990.82310.28110.28110.3393
71.07670.97110.87931.0341.03091.02640.00417.21 × 10−40.02620.02690.00450.00370.10060.34270.74420.25620.21910.2272
81.07231.04470.86391.03311.02611.01830.00750.00380.08270.0030.00260.00230.16050.22050.99560.24790.26480.2837
91.06751.03380.8811.01971.05761.03380.00510.00310.07450.00220.0060.00310.15490.23890.89010.27070.18760.2389
101.05831.01710.87381.03051.02431.01710.00580.00320.05910.00460.00390.00320.18510.28290.92480.25510.26790.2829
111.06921.04490.77871.02841.05761.05260.00460.00370.10830.00180.02320.00580.14060.20461.25010.24080.21190.19505
121.07140.96450.9090.97811.04541.03030.00583.11 × 10−40.06474.44 × 10−40.00260.00160.14030.4010.86970.36870.20310.2395
131.06541.02590.87171.05551.03650.98060.00510.00280.04790.01090.00390.07260.15460.24740.90480.19950.22560.7154
141.06451.02910.89711.03511.04921.03510.0070.00330.06480.0040.0060.0040.17680.25630.89150.24390.21450.2439
151.05491.03690.87521.03951.0251.01480.01560.00870.07920.02690.00620.00470.23560.2640.96820.3260.28760.3088
161.0461.01620.87841.04471.03941.02750.00980.00510.07140.0320.0110.0070.25120.310.97840.30610.27120.2882
171.05351.01070.88551.0261.04661.03240.0060.00260.07860.00390.00740.00460.21440.31110.95060.27830.23950.2648
181.06471.02420.87150.94391.01661.01660.00730.00340.08630.00170.0030.0030.18220.27660.9720.45670.29470.2947
191.03290.98540.85210.96671.02091.00770.00350.00420.09410.04320.02150.0090.25920.39211.07040.5940.34940.3521
201.05491.01140.87770.96381.01140.99660.01060.00250.06720.02630.00250.00210.21290.29650.92240.53720.29650.331
211.07291.03690.87520.95811.04571.03180.00570.00430.05954.78 × 10−40.00570.00360.13480.22620.89140.39140.20910.2363
221.04951.01160.91091.00121.04461.02620.00450.00270.05960.0210.00430.00330.19810.29160.83240.4270.21140.256
231.06631.0450.8651.04011.03481.0120.00540.00390.08860.00340.0030.00210.16340.22141.00780.23350.24650.304
241.04571.03320.91371.01141.04661.0180.00720.0060.04770.0040.00930.00440.2370.26460.81970.31130.24350.2966
251.05561.00460.83880.90841.0381.0470.01770.00470.07430.02930.03020.0140.22260.30891.0590.71960.29390.2344
Ave1.06151.01970.87831.01041.03831.02220.00840.00370.06950.01170.00820.00710.18930.28070.93790.33560.24680.2915
Increase--−0.0418−0.1832−0.0511−0.0232−0.0393--0.0047−0.0611−0.00330.00020.0013--−0.0914−0.7486−0.1463−0.0575−0.1022
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, Y.; Qiu, G.; Wang, N. A Novel Method for Peanut Seed Plumpness Detection in Soft X-ray Images Based on Level Set and Multi-Threshold OTSU Segmentation. Agriculture 2024, 14, 765. https://doi.org/10.3390/agriculture14050765

AMA Style

Liu Y, Qiu G, Wang N. A Novel Method for Peanut Seed Plumpness Detection in Soft X-ray Images Based on Level Set and Multi-Threshold OTSU Segmentation. Agriculture. 2024; 14(5):765. https://doi.org/10.3390/agriculture14050765

Chicago/Turabian Style

Liu, Yuanyuan, Guangjun Qiu, and Ning Wang. 2024. "A Novel Method for Peanut Seed Plumpness Detection in Soft X-ray Images Based on Level Set and Multi-Threshold OTSU Segmentation" Agriculture 14, no. 5: 765. https://doi.org/10.3390/agriculture14050765

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop