Next Article in Journal
Identification of Begomoviruses from Three Cryptic Species of Bemisia tabaci (Gennadius) (Hemiptera: Aleyrodidae) in Nepal
Next Article in Special Issue
DeepPaSTL: Spatio-Temporal Deep Learning Methods for Predicting Long-Term Pasture Terrains Using Synthetic Datasets
Previous Article in Journal
Biochar and Fertilization Effects on Weed Incidence in Winter Wheat
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design of and Experiment with Seedling Selection System for Automatic Transplanter for Vegetable Plug Seedlings

1
School of Mechanical Engineering, Shandong University of Technology, Zibo 255000, China
2
College of Engineering, China Agricultural University, Beijing 100083, China
3
Shandong Institute of Metrology, Jinan 250014, China
*
Author to whom correspondence should be addressed.
Agronomy 2021, 11(10), 2031; https://doi.org/10.3390/agronomy11102031
Submission received: 19 August 2021 / Revised: 25 September 2021 / Accepted: 27 September 2021 / Published: 9 October 2021
(This article belongs to the Special Issue AI and Agricultural Robots)

Abstract

:
In the process of vegetable plug seedling cultivation, packaging, and transportation, there may be missing, unhealthy or injured seedlings in the tray, which results in a missed planting or a low seedling survival rate after automatic transplanting. In this study, a seedling selection system with the function of seedlings identification, week seedlings elimination, and missing seedlings supplement was developed for an automatic transplanter. A plug seedling identification system based on a machine vision was used to detect vegetable plug seedlings based on the area characteristics of plug seedlings, stem leaves and plug bodies. The identification results were transmitted to a programmable logic controller (PLC), which controlled a nozzle to eliminate the unqualified seedlings from the conveyor belt lattice. When the empty conveyor belt lattice reaches the seedling throwing funnel, the rear conveyor belt lattice with the plug seedling is accelerated to ensure the continuity of seedlings supply. The adaptive fuzzy PID control algorithm was used to control the stepper motor of the conveyor belt to realize accurate seedling conveying and a seedling supplement. Using 30 days pepper plug seedlings as experimental seedlings, a comparative field experiment was carried out to evaluate the performance of the seedling selection system. The results showed that when the seedling selection system was turned on and the seedling extracting frequencies were 60, 80, and 100 plants/min, the success rates of plug seedling identification were 98.84%, 98.38%, and 96.99%, and the robust seedling rates were 98.05%, 97.78%, and 95.83%. The robust seedling rates were increased by 15.64%, 16.07%, and 13.89%, respectively, in contrast to turning off the seedling selection system.

1. Introduction

Vegetables are rich in nutrients, such as vitamins, minerals, and dietary fiber, which are essential for the human body. They are important food sources and economic crops all around the world [1,2]. Plug seedling cultivation and transplantation are important procedures for vegetable production. The quality of transplanting directly affects the vegetable yield, quality, and economic benefits. The application of an automatic transplanter can not only improve the transplanting efficiency and quality, but also reduce labor intensity and cost [3,4,5]. According to the mechanical industry standard experimental method in the People’s Republic of China Transplanter of dry land plant (JB/T 10291–2013), the transplanting qualified rate of the transplanter required is ≥90%, which means up to 10% of the land could be wasted, and there is also waste of fertilizers, pesticides, and water. During the transplanting process, the growth status of plug seedlings is detected in real time, and the unqualified seedlings (dead, weak, diseased, and injured seedlings) are eliminated, and only robust seedlings are planted, which can improve land utilization, reduce waste of resources, and meet the requirements of precision, automatic, and intelligent agriculture [6,7]. The research on seedling selection systems has important significance for automatic transplanting and further development of the vegetable industry [8,9].
During the seedling cultivation process in the greenhouse, there are unqualified seedlings in the seedling tray due to the seed quality, sowing precision, and environmental impact. Seedling selection in the seedling cultivation stage improves the quality of automatic transplanting [10]. Ryu [11] designed a robotic transplanter with a vision system for bedding plants. The vision system could identify empty cells and reduce transplanting time with the identification success rate of empty cells higher than 95%. Tong [12,13] presented a machine vision system to detect the state of seedlings in the plug tray by measuring the leaf area and to guide the manipulator to transplant the robust seedlings by locating empty and unhealthy seedling holes. The identification accuracy of seedling quality was higher than 95%. For the images of a plug tray, a skewness correction algorithm, based on the Canny operator and Hough transform, was proposed to improve the evaluation accuracy in 2018. Wang [14] presented a recognition and classifying system for diseased and shortage seedlings based on machine vision to realize automatic seedling selection in the process of transplanting. However, when the leaves of plug seedlings are covered by each other, it will make it difficult for the machine vision system to identify the state of seedlings from the top view of the tray. Yang [15,16] proposed a monocular vision-based information acquisition method of plug seedling transplanting fitness. When a plug seedling was grasped and rotated by a manipulator, multiple seedling images were taken by a camera. The fitness information of the perpendicularity and height of the seedlings was evaluated to filter out plug seedlings; however, the detection time of plug seedlings is longer, so the transplanting efficiency is low.
There are some studies on plug seedling identification in the automatic transplanting process field. Wu [8] and Xin [17] designed a detection and recognition device for plug seedlings using a photosensor, which could detect the lack of seedlings and controls the seedling picking device to skip the empty seedling holes. The seedling leakage rate of the transplanter was reduced by 12%. Shi [18] developed an automatic transplanter with a seedling selection function for corn paper plug seedlings. The seedling transporting and selecting transmission mechanism automatically eliminated paper pots with shortage seedlings or weak seedlings and accelerated seedling supplying to guarantee the uniformity of seedlings. Wei [19] designed an image acquisition and processing system of automatic transplanter for plug seedlings. A proximity sensor triggered the camera to capture the seedling image when the seedlings fell into the seedling guide tube, and only robust seedlings were planted. However, the system did not compensate for missing seedlings. There is little research on the system of eliminating inferior seedlings and compensating for missing seedlings based on machine vision in the field automatic transplanter.
The goal of this study is to develop a seedling selection system with multiple functions of seedling identification, weak seedling elimination and missing seedling supplement for an automatic transplanter of vegetable plug seedlings [20] to improve the quality of transplanting. The plug seedling states are identified by the comprehensive information of the stems, leaves, and plug bodies of the plug seedlings. The seedling conveyor device controlled by fuzzy PID is used to convey and replenish seedlings. The system performance was evaluated through a comparative field experiment.

2. Materials and Methods

2.1. Scheme of Seedling Selection System of Plug Seedling Automatic Transplanter

2.1.1. Overall Design of Automatic Transplanter

The automatic transplanter for vegetable plug seedlings is mainly composed of a rack, seedling extraction device, seedling conveyor device, empty tray recovery device, seedling division device, 2-row planting devices, pneumatic system, power distribution system, PLC control system, and seedling selection system, as shown in Figure 1A. The transplanting objects are vegetable plug seedlings in 72 (6 × 12) holes tray (Figure 1B). The seedling extraction device takes plug seedlings to the seedling conveyor device row by row, the seedling conveyor device puts plug seedlings into the seedling division device one by one through the seedling throwing funnel, and the seedling division device puts the plug seedlings into the left and right planting device for double row planting. The empty tray recovery device recovers the empty trays in real time. The seedling selection system is used to identify plug seedlings, eliminate weak seedlings, and compensate for missing seedlings in real time. The seedling selection system consists of an industrial camera (China, Daheng image, model: MER-131-75GC, CCD), two strip light sources (China, Lemons, OPT-L133037-W), a light box, a nozzle, a seedling conveyor belt (width: 220 mm), an industrial personal computer (IPC) equipped with plug seedling identification software, and PLC (Germany, Siemens, S7-200, 224xp), as shown in Figure 2. The light box is installed on the left side of the seedling conveyor device, and the strip light sources and camera are installed inside the light box. The angle of the light sources and the spatial position of the camera are adjustable. The seedling conveyor device is composed of a stepper motor, a seedling conveyor belt with multiple partition plate (height: 35 mm, thickness: 3 mm), driving roller, driven roller, and tension bearing pedestals. The adjacent two partition plates of the conveyor belt form a seedling lattice. The nozzle is set at the left of the light box and aligned with the seedling lattice.

2.1.2. Working Principle of the Seedling Selection System

The seedling extraction device puts the whole row of plug seedlings into the seedling lattices of the conveyor belt, as seen in Figure 2 (position a). The seedling lattices drive the plug seedlings into the light box (position b) in an orderly manner. The PLC control system triggers the camera to capture plug seedling images every three seedlings. The plug seedling identification software processes and detects the plug seedlings’ image, and sends the detection result to the PLC. Only the robust seedlings are sent to the seedling throwing funnel by the conveyor belt, and fall into the seedling division device. The unqualified seedlings detected by the plug seedling identification software are blown out from the seedling lattices (position c) by the high-pressure nozzle. When the empty lattices reach the seedling throwing funnel (position e), the conveyor belt accelerates, and the robust seedling in the rear seedling lattice (position d) is thrown into the seedling division device through the seedling throwing funnel to complete the seedling supplement. The working process of seedlings extracting and seedlings supplement of the transplanter is shown in Figure 3. The image processing algorithm should be simple and stable, so that the plug seedling identification software can run on an IPC, which is important for field operations.

2.1.3. Plug Seedling Identification Software

Plug seedling identification software is developed based on the following software: program development software laboratory virtual instrumentation engineering workbench (LabVIEW), vision acquisition module software (VAS), Halcon machine vision software. The LabVIEW can be used to build various measurement or control systems using its tools [21]. The Halcon provides an interactive programming environment (HDevelop) to write image processing algorithms and programs. In this paper, the human–machine interface and the main control program are built in the LabVIEW, and the image acquisition module is programmed with the usage of NI-IMAQ driver of VAS. The Halcon image processing library is used to develop plug seedling identification software to realize the characteristic extraction of plug seedlings, plug bodies and stem leaves. The camera communicates with the IPC through GigE Vision, and the PLC triggers the camera to collect images by means of an external trigger. The system of the plug seedling identification is shown in Figure 4.

2.2. Characteristic Extraction and Classifying of Plug Seedlings

The purpose of plug seedlings image processing is to classify plug seedlings according to the area characteristics of the plug seedlings, stem leaves and plug bodies. The image processing includes image acquisition, image cropping, threshold segmentation, morphological processing, and characteristic extraction. Due to the different characteristics of different vegetable seedling varieties (cabbage, pepper, cauliflower, etc.) and different ages of plug seedlings, the image processing parameters are different. Only the images of pepper plug seedlings with the seedling age of 30 days have been used as an example for analysis.

2.2.1. Image Acquisition and Segmentation

In order to improve identification efficiency, the PLC control system triggers the camera to capture images for every three seedlings. Image segmentation methods mainly include threshold segmentation [22,23], edge detection segmentation [24], and clustering algorithm segmentation [25]. Considering the reflection of the seedling conveyor belt, the mutual interference of the seedling leaves, the broken matrix in the seedling lattice, and the diverse shapes of the seedlings, a combination of threshold segmentation algorithm and morphology algorithm for image segmentation have been developed. The optimal threshold between foreground and background was obtained using the Otsu threshold segmentation algorithm according to the grayscale histogram [26,27], and morphological algorithms such as dilation, hole filling and erosion were used to improve the image segmentation effect.

2.2.2. Characteristic Extraction of Plug Seedlings

The plug seedling identification software crops the whole seedling image into three single plug seedling images (Width: 220) according to the whole seedling image size (Width×Height: 1280 × 1024) and the position of the plug seedlings in the image (Figure 5A). By comparing and analyzing the histogram of different color spaces of the seedling image, the S-channel image in the HSV space was chosen to separate the plug seedling area from the background by threshold segmentation of the histogram bimodal characteristics. The specific process of plug seedling extraction is as follows: convert the RGB images of a single plug seedling into R, G, and B single-channel images (Figure 5B), and then convert the R, G, and B single-channel images into the HSV color space (Figure 5C), perform Otsu threshold segmentation on the saturation S channel image to obtain plug seedlings region (Figure 5D), dilate the plug seedling area to form a connected region (Figure 5E), fill the hole in the connected region (Figure 5F), display all connected regions (Figure 5G), and select the largest connected region as the plug seedlings region (Figure 5H). The area of the plug seedling region Sseedling was calculated by the Halcon image processing function “Region Features ()”.

2.2.3. Characteristic Extraction of Plug Bodies

By comparing the images in each color space, the gray-scale characteristics of the plug in the H-channel image (Figure 6A) are more obvious. The H-channel image was masked to eliminate the background region that is close to the gray value of the plug. The basic region of the plug (Figure 6B) is obtained by the gray-histogram bimodal characteristics. All connected regions are labeled (Figure 6C) and the maximum connected region is selected as the plug region (Figure 6D). The area characteristic of the plug region Splug was calculated after the processing of morphological dilation (Figure 6E) and hole filling algorithms (Figure 6F).

2.2.4. Characteristic Extraction of Stems and Leaves

The excess green algorithm (L = 2G-R-B) is often used to segment the green region of the image from the background [27,28]. Considering that there are many interference factors of the seedling conveyor belt, the improved graying algorithm for the stem leaves segmentation is adjusted to (L’ = (G-R) * 10) according to the actual situation (Figure 7A). The binary image is obtained by threshold segmentation (Figure 7B), and all connected regions are labeled (Figure 7C). After eliminating holes and noises by dilation processing (Figure 7D), the area of the stem leaves region Sleaves was calculated by the Halcon function “Region Features ()” (Figure 7E).

2.2.5. Classification of Plug Seedlings

An array of three components was set to represent the growth information of three plug seedlings, respectively. The value of each array component was obtained by formula (1) according to the plug seedling value of Sseedling, Splug and Sleaves(pixels). The classifying standard of strong seedlings is based on NY/T 2119-2012 the general rules of vegetable plug seedling cultivation and vegetable transplantation. The values of each array component were determined by the following equation.
F ( x ) = { [ 0 ] , ( 45,200 < S s e e d l i n g ) [ 1 ] , ( 24,700 < S p l u g ,   S l e a v e s < 9600 ) [ 2 ] , ( S p l u g < 24,700 , 9600 < S l e a v e s ) [ 3 ] , ( S p l u g < 24,700 ,   S l e a v e s < 9000 )
where (0) means the seedling is classified as a robust seedling (Figure 8A); (1) means the seedling is classified as dead, weak, or injured seedlings (Figure 8B); (2) means the seedling is classified that the plug body is injured or loose (Figure 8C); and (3) means the seedling is classified as no seedling (Figure 8D). When the PLC receives the array component value of (1), (2) or (3) from the IPC, the seedling in the corresponding conveyor belt lattice is blown out as the unqualified seedling by the nozzle, and the seedling replenishment is performed.

2.3. Adaptive Fuzzy PID Control Algorithms for Seedling Conveyor Device

The seedling conveyor belt conveys plug seedlings orderly and replenishes seedlings missing for a long time and with high frequency. When the missing seedling is replenished, the conveying speed is accelerated. When the seedling conveyor belt stops, the seedling lattices just correspond to the seedling extracting device and the nozzle. Therefore, the seedling conveyor stepper motor requires a high repeated positioning for precision and stability. Fuzzy PID control technology can be used to control the stepper motor and to accelerate mechanical system response speed [29]. In this study, the adaptive fuzzy-PID control algorithm was used to achieve precise positioning control of seedling conveyance and seedling replenishment.

2.3.1. Precision Analysis of Seedling Conveyor Device

The seedling conveyor belt is driven by a stepping motor (86BYG250H, 2 phase hybrid, 12 N·m, 1.8°) through a synchronous belt to drive the seedling conveyor belt roll (Figure 2). The seedling conveyor belt moves forward for a seedling displacement (43 mm) by the stepping motor cycle once, and it moves two seedling displacements (86 mm) by the stepping motor acceleration when performing seedling replenishment. The encoder (Xinling, CHB38S-E-5000) sends corresponding speed pulses to the PLC to form a motor feedback control.
Calculation of conveyor belt displacement L
L = ψ d 2 i
Calculation of the pulses number N sent by the PLC
N = 2 i n L d θ
where d is the diameter of the conveyor belt on the roller, 94 mm; i is the transmission reduction ratio, 2; θ is the step angle of the stepper motor, 1.8°; n is the subdivision number; and ψ is the motor rotation angle.
Putting L = 86 mm and n = 1 into Equation (3) gives N = 116.55, rounded up N1 = 117, rounded error value ΔN = 0.45. Stepper motor accuracy is generally 3% ~ 5% of the step angle [30].
Calculation of total error value of the stepper motor:
Δθ = (ΔN + 5%) × θ
Putting ΔN and θ into Equation (4) gives Δθ = 0.09, and putting Δθ as ψ into Equation (2) to get the conveyor belt displacement error s1 = 0.037 mm. In order to ensure the accuracy of pot seedling conveying, the maximum positioning error allowed by the conveyor belt is s2 = ±1 mm. Based on the relation of |s1| < |s2|, the displacement error of the conveyor belt caused by the rotation error of the stepper motor is theoretically smaller than the setting error. However, in the field experiment, the mechanical characteristic was unstable and the non-linear errors may have been caused by transmission due to the complex and changeable environmental factors. Moreover, the signal to the solenoid valves or from the sensors may cause data loss or distortion because of electromagnetic interference. Continuous high-frequency intermittent rotation of the conveyor belt causes error accumulation. It is necessary to optimize the positioning algorithm of the stepper motor to improve the positioning precision and stability.

2.3.2. The Composition of Adaptive Fuzzy PID Control Algorithm

Conventional PID control is a classic control theory as a linear controller, which is widely used in industrial process control. The conventional PID algorithm is:
u ( k ) = K p e ( k ) + K i j = 0 k e ( j ) + K d Δ e ( k )
where the control quantity u(k) is composed of the linear addition of the proportional term K p e ( k ) , integral term K i j = 0 k e ( j ) , and differential term K d Δ e ( k ) . Kp, Ki, and Kd are proportional, integral, and differential coefficients, respectively. The selection of PID parameters directly affects the stability and responsiveness of the system.
When the control object has the characteristics of time-varying uncertainty, strong interference, and nonlinearity, the conventional PID control with fixed control parameters cannot achieve good control results. According to the actual error detection situation, the fuzzy PID controller selects the parameter correction values ΔKp, ΔKi, ΔKd in the fuzzy controller rule base for PID control to achieve the adaptive and high-precision control effect. The adaptive fuzzy PID feedback control block diagram of the seedling conveyor device is shown in Figure 9.

2.3.3. Implementation of Adaptive Fuzzy PID Control Algorithm

In the feedback control process of the stepper motor, the encoder detects the rotation angle of the driven roller. The position deviation e(k) and deviation change rate Δe(k) were used as the inputs of the fuzzy controller. Based on the fuzzy inference, ΔKp, ΔKi, ΔKd were deblurred as the outputs of the fuzzy controller. The basic domains of e(k), Δe(k), ΔKp, ΔKi, ΔKd are [−68, 68], [−17, 17], [−16, 16], [−10, 10], [−2, 2], perspective. Corresponding to the universe of input variables e(k) and Δe(k) to [−1, 1], the corresponding quantization factors are Ke = 0.0147, KΔe = 0.0588, The output variables ΔKp, ΔKi, ΔKd correspond to the domain [−1, 1], and the corresponding quantization factors are K1 = 0.0625, K2 = 0.1, K3 = 0.5. The 7-level position deviation e(k) was quantified by the fuzzy set {negative large, negative middle, negative small, zero offset, positive small, positive middle, positive large}, and recorded as {NL, NM, NS, ZO, PS, PM, PL}. The rate of change of the level 3 deviation value Δe(k) was quantified by the fuzzy set {negative, zero, positive} and recorded as {N, Z, P}. The 5-level parameter correction values ΔKp, ΔKi, ΔKd were quantified by the fuzzy set {negative large, negative small, zero, positive small, positive large}, and recorded as {NL, NS, ZO, PS, PL}.
The fuzzy control rules were determined by repeated experiments and expert experience. Based on the input values of the fuzzy controller (e(k), Δe(k)) and fuzzy control rules, the parameter correction values of the PID controller (ΔKp, ΔKi, ΔKd) were determined. The fuzzy PID parameter correction rules are shown in Table 1. The PID control parameters revised by the fuzzy controller are as follows:
{ K p = K p + Δ K p K i = K i + Δ K i K d = K d + Δ K d
where K p , K i , K d are PID basic parameters, Δ K p , Δ K i , Δ K d are online correction parameters.

3. Results and Discussion

3.1. Experiment Conditions

In the field transplanting experiment, the automatic transplanter was driven by a tractor (Luzhong, model: 604), and the frequency of taking seedlings was controlled by the throttles and the gear of the tractor. The plug seedlings used for the experiment were pepper seedlings, which were cultivated in the 72-hole tray. The age of the pepper seedlings used in the experiment was 30 days, and the water content of the plug was 50–70%, the seedling diameter was 2–3 mm, the seedling height was 120–140 mm, the seedling spread was 60–80 mm, and the robust seedling rate was 100%. The experiment prototype is shown in Figure 10A, and the experiment plug seedling is shown in Figure 10B.

3.2. Experiment Method and Index

Thirty-six tray seedlings were divided into two groups, and the seedling transplanting experiments were conducted turning on/off the seedling selection system with the fixed seedling extraction frequencies of 60, 80, and 100 seedlings/min. The experiment was repeated three times for each frequency, and two trays were extracted (144 seedlings) continuously each time. In order to test the identification effect of plug seedlings, the plug seedlings were manually treated before the comparative experiment. Each tray was randomly set with 9 non-adjacent unqualified seedlings, including three plug injured seedlings, three stem leaves injured seedlings, and three missing seedlings.
In the experiment, the success rate of plug seedling identification and the robust seedling rate were used as the experiment evaluation indexes. The success rate of plug seedling identification refers to the ratio of the number of correctly identified plants on the conveyor belt to the total number of plug seedlings in a single test; the robust seedling rate refers to the ratio of the number of robust seedling plants to the total number seedlings in the seedling division device.
Calculation of the success rates of plug seedling identification
F = Q P × 100 %
Calculation of the robust seedling rates
M = W V × 100 %
where Q is the number of correctly classified plug seedlings by the system and plants. P is the number of seedlings and holes in the trays in a single test, 144 plants (2 trays). W is the number of cups of seedling division device with robust seedlings, and plants. V is the number of total seedling cups of the seedling division device passing through the bottom of the seedling throwing funnel.

3.3. Results and Analysis

The comparative experiment result of seedlings extraction is shown in Table 2. The seedling selection system and the automatic vegetable transplanter operated at high speed and coordinated to complete the seedling transplanting operation. When the seedling extracting frequencies are 60, 80, and 100 plants/min without the seedling selection system, the average robust seedling rates are 82.4%, 81.71%, and 81.94%, respectively. When the seedling selection system is turned on with the seedling frequencies of 60, 80, 100 plants/min, the average success rates of plug seedling identification are 98.84%, 98.38%, and 96.99%, and the average robust seedling rates are 98.05%, 97.78%, and 95.83%, respectively. The experiment statistical results of seedlings extracting comparative experiment is shown in Figure 11. The success identification rate of plug seedlings does not change significantly, but the robust seedling rate has a downward trend with the increase of the seedling extracting frequency.

3.4. Discussion

When the seedling selection function is turned on, the main factors that affect the robust seedling rate are identification errors and failure to replenish seedlings. There are two cases of plug seedling identification errors: (1) there is no seedling in the seedling lattice, but some scattered substrates are left in the seedling lattice, and the leaves in the adjacent seedling lattices extend into the seedling lattice due to mutual entanglement or friction, which leads to the misjudgment of the plug seedling (Figure 12A); and (2) the robust seedlings in the lattice are inclined, parts of the stem leaves are located in the adjacent lattice, which are mistaken for dead, weak, or injured seedlings (Figure 12B). This can be improved from the following aspects: (1) properly increase the height of the conveyor belt lattice, so that the stem leaves of plug seedlings are confined to the seedling lattice as much as possible; (2) increasing the gap between the mechanical device and the plug seedlings on the conveyor belt to prevent the stem leaves of plug seedlings from interference and moving to the other lattice; and (3) controlling the age of seedlings to prevent them from disturbing the adjacent seedlings due to the excessive leaves spreading. Due to the torque limitation of the seedling conveyor motor and the inertia of the seedling convey device, when the speed of the division device cup is increased, the frequency of conveying seedlings is increased as well; the seedling conveyor belt cannot respond fast enough to replenish seedlings. The seedlings in conveyor belt lattices do not fall into the division device cups through the seedling funnel, which leads to the failure of the seedling replacement. Therefore, the frequency of extracting seedlings is limited to a reasonable range (≤100 plants/min) to improve the success rate of seedling replenishment.

4. Conclusions

  • The seedling selection system of automatic transplanter for vegetable plug seedlings was developed to realize the identification of plug seedlings, the elimination of unqualified seedlings and the replenishment of seedlings. It is composed of an IPC installed with plug seedling identification software, an industrial camera, two strip light sources, a light box, a PLC control system, a nozzle, and seedling conveyor device. With the cooperation of the PLC control system and the plug seedling identification software, all parts of the automatic transplanter coordinate and cooperate to complete the seedling extraction, plug seedling identification, unqualified seedling elimination, and seedling replenishment.
  • The plug seedling identification software was built by LabVIEW, VAS, and Halcon. The characteristics extraction algorithms for plug seedling, stem leaves, and plug body were designed using image processing, such as image cropping, segmentation, dilation, merging, and filling. The plug seedlings on the conveyor belt were identified and the result was sent from IPC to PLC to conduct real-time seedling elimination or seedling replenishment.
  • The adaptive fuzzy PID controller was designed to control the seedling conveyor belt. The controller revised the PID control parameters in real time based on the conveyor belt position deviation value e(k) and deviation value change rate Δe(k) to realize fast and accurate seedling conveyance and seedling replenishment.
  • Taking the seedling identification success rate and the robust seedling rate as the test indicators, the comparative field experiment of seedling transplanting was conducted on the seedling extracting frequencies of 60, 80, and 100 plants/min. The experimental results indicate that when the seedling selection system was turned on, the success rates of plug seedling identification were 98.84%, 98.38%, and 96.99%, respectively, and the robust seedling rates were 98.05%, 97.78%, and 95.83%, respectively. The robust seedling rates were increased by 15.64%, 16.07%, and 13.89%, in contrast to turning off the seedling selection system. In addition, the data of the comparative field experiment show that the growth rates of robust seedlings will decline with increasing seedling extracting frequencies, but the overall growth rates of robust seedlings reach more than 13%. This study provides a reference for the further improvement of transplanting quality of the automatic transplanter for vegetable plug seedlings.
With the application of information technology, sensor technology, control technology and other advanced technology to the fully automatic transplanter, the quality and speed of the automatic transplantation of vegetable plug seedlings will be further improved, which will be conducive to promoting the development of the vegetable industry.

Author Contributions

All authors contributed to the research. Conceptualization, Y.W., L.Z. and Y.T.; data curation, X.H., J.Z.; investigation, Z.F.; resources, Y.T.; software, X.H.; supervision, T.Y.; validation, J.Z.; writing, original draft, Y.W.; writing, review and editing, T.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National key R&D Program of China (2017YFD0701303).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is contained within the article.

Conflicts of Interest

We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

References

  1. Jin, X.; Che, J.; Chen, Y. Weed identification using deep learning and image processing in vegetable plantation. IEEE Access 2021, 9, 10940–10950. [Google Scholar] [CrossRef]
  2. Dong, Y.; Fu, Z.; Stankovski, S.; Wang, S.; Li, X. Nutritional Quality and Safety Traceability System for China’s Leafy Vegetable Supply Chain Based on Fault Tree Analysis and QR Code. IEEE Access 2020, 8, 161261–161275. [Google Scholar] [CrossRef]
  3. Yang, Q.; Xu, L.; Shi, X.; Ibrar, A.; Mao, H.; Hu, J.; Han, L. Design of seedlings separation device with reciprocating movement seedling cups and its controlling system of the full-automatic plug seedling transplanter. Comput. Electron. Agric. 2018, 147, 131–145. [Google Scholar] [CrossRef]
  4. Mao, H.; Han, L.; Hu, J.; Kumi, F. Development of a pincette-type pick-up device for automatic transplanting of greenhouse seedlings. Appl. Eng. Agric. 2014, 30, 547–556. [Google Scholar]
  5. Rahul, K.; Raheman, H.; Paradkar, V. Design and development of a 5R 2DOF parallel robot arm for handling paper pot seedlings in a vegetable transplanter. Comput. Electron. Agric. 2019, 166, 105014. [Google Scholar] [CrossRef]
  6. Schmoldt, D. Precision agriculture and information technology. Comput. Electron. Agric. 2001, 30, 5–7. [Google Scholar] [CrossRef]
  7. Hu, X.; Sun, L.; Zhou, Y.; Ruan, J. Review of operational management in intelligent agriculture based on the Internet of Things. Front. Eng. Manag. 2020, 7, 309–322. [Google Scholar] [CrossRef]
  8. Wu, J.; Zhang, X.; Jin, X.; Liu, Z.; Zhu, L.; Sun, X.; Zou, Z.; Liu, B. Design and experiment on transplanter pot seed-ling disk conveying and positioning control system. Trans. Chin. Soc. Agric. Eng. 2015, 31, 47–52. [Google Scholar]
  9. Zhou, S.; Shi, H.; Guo, L.; Guo, W.; Jin, H.; Zhou, J. Autonomous guidance for rice transplanter fusion of machine vision and global positioning system. In Proceedings of the 2018 ASABE Annual International Meeting, American Society of Agricultural and Biological Engineers, Detroit, MI, USA, 29 July–1 August 2018. [Google Scholar]
  10. Tai, Y.W. Machine vision assisted robotic seedling transplanting. Trans. ASAE 1994, 37, 661–667. [Google Scholar] [CrossRef]
  11. Ryu, K.; Kim, G.; Han, J. AE—Automation and Emerging Technologies: Development of a Robotic Transplanter for Bedding Plants. J. Agric. Eng. Res. 2001, 78, 141–146. [Google Scholar] [CrossRef]
  12. Tong, J.H.; Li, J.B.; Jiang, H.Y. Machine vision techniques for the evaluation of seedling quality based on leaf area. Biosyst. Eng. 2013, 115, 369–379. [Google Scholar] [CrossRef]
  13. Tong, J.; Shi, H.; Wu, C.; Jiang, H.; Yang, T. Skewness correction and quality evaluation of plug seedling images based on Canny operator and Hough transform. Comput. Electron. Agric. 2018, 155, 461–472. [Google Scholar] [CrossRef]
  14. Wang, Y.; Xiao, X.; Liang, X.; Wang, J.; Wu, C.; Chen, J. Plug hole positioning and seedling shortage detecting system on automatic seedling supplementing test-bed for vegetable plug seedlings. Trans. Chin. Soc. Agric. Eng. 2018, 34, 35–41. [Google Scholar]
  15. Yang, Z.; Zhang, W.; Li, W.; Chen, Y. Monocular vision-based method for direction adjustment of transplanting potted-seedling leaves. Trans. Chin. Soc. Agric. Eng. 2014, 30, 26–33. [Google Scholar]
  16. Yang, Z.; Zhang, W.; Wei, L.; Chen, Y.; Song, P. Information acquisition method of potted-seedling transplanting fitness using monocular vision. Trans. Chin. Soc. Agric. Eng. 2014, 30, 112–119. [Google Scholar]
  17. Xin, J.; Xinwu, D.; Jiangtao, J.; Zhitao, H.; Chuanhua, Y. Automatic detection and controlling system of pot seedlingsfor transplanters. Int. Agric. Eng. J. 2015, 24, 143–151. [Google Scholar]
  18. Tie, S. Development and test of automatic corn seedling transplanter. Nongye Gongcheng Xuebao Trans. Chin. Soc. Agric. Eng. 2015, 31, 23–30. [Google Scholar] [CrossRef]
  19. Wei, X.; Bao, S.; Liu, X.; Liu, C.; Mao, H. Design and Experiment on Potted-seedling Automatic Transplanter Control System for Motion Coordinating. Trans. Chin. Soc. Agric. Mach. 2016, 12, 1–7. [Google Scholar]
  20. Wen, Y.; Zhang, J.; Tian, J.; Duan, D.; Li, X. Design of a traction double-row fully automatic transplanter for vegetable plug seedlings. Comput. Electron. Agric. 2021, 182, 106017. [Google Scholar] [CrossRef]
  21. Chen, L.; Deng, Z.; Wang, Y.; Zhou, H. Design of interferometer direction finding experimental teaching system based on LabVIEW. Exp. Technol. Manag. 2020, 37, 143–146, 188. [Google Scholar]
  22. Bao, X.; Jia, H.; Lang, C. A Novel Hybrid Harris Hawks Optimization for Color Image Multilevel Thresholding Segmentation. IEEE Access 2019, 7, 76529–76546. [Google Scholar] [CrossRef]
  23. Vala, M.; Baxi, A. A Review on Otsu Image Segmentation Algorithm. Int. J. Adv. Res. Comput. Eng. Technol. 2013, 2, 387–389. [Google Scholar]
  24. Tang, H.; Wu, E.X.; Ma, Q.; Gallagher, D.; Perera, G.; Zhuang, T. MRI brain image segmentation by multi-resolution edge detection and region selection. Comput. Med. Imaging Graph. 2000, 24, 349–357. [Google Scholar] [CrossRef]
  25. Khan, M.F.; Aadil, F.; Maqsood, M.; Bukhari, S.; Hussain, M.; Nam, Y. Moth Flame Clustering Algorithm for Internet of Vehicle (MFCA-IoV). IEEE Access 2018, 7, 11613–11629. [Google Scholar] [CrossRef]
  26. Xu, X.; Xu, S.; Jin, L.; Song, E. Characteristic analysis of Otsu threshold and its applications. Pattern Recognit. Lett. 2011, 32, 956–961. [Google Scholar] [CrossRef]
  27. Zhang, G.; Wen, Y.; Tan, Y.; Yuan, T.; Zhang, J.; Chen, Y.; Zhu, S.; Duan, D.; Tian, J.; Zhang, Y. Identification of cabbage seedling defects in a fast automatic transplanter based on the maxiou algorithm. Agronomy 2020, 10, 65. [Google Scholar] [CrossRef] [Green Version]
  28. Woebbecke, D.M.; Meyer, G.E.; Von Bargen, K.; Mortensen, D.A. Color Indices for Weed Identification Under Various Soil, Residue, and Lighting Conditions. Trans. ASAE 1995, 38, 259–269. [Google Scholar] [CrossRef]
  29. Liu, J.; Cao, W.; Xu, H.; Tian, D.; Ouyang, Y. Adaptive fuzzy-PID control of accurate orientation for auto-detect seedling supply device. Trans. Chin. Soc. Agric. Eng. 2017, 33, 37–44. [Google Scholar]
  30. Wang, Q.; Cao, W.; Zhang, Z.; Zhang, P.; Wang, P. Location control of automatic pick-up plug seedlings mechanism based on adaptive Fuzzy-PID. Trans. Chin. Soc. Agric. Eng. 2013, 29, 32–39. [Google Scholar]
Figure 1. The automatic transplanter for vegetable plug seedling. (A) Structure of the automatic transplanter; (B) 72 holes Tray. 1. Electrical cabinet, 2. Seedling extraction device, 3. Seedling conveyor device, 4. Empty tray recovery device, 5. Machine vision unit, 6. Seedling division device, 7. Planting device, 8. Platform.
Figure 1. The automatic transplanter for vegetable plug seedling. (A) Structure of the automatic transplanter; (B) 72 holes Tray. 1. Electrical cabinet, 2. Seedling extraction device, 3. Seedling conveyor device, 4. Empty tray recovery device, 5. Machine vision unit, 6. Seedling division device, 7. Planting device, 8. Platform.
Agronomy 11 02031 g001
Figure 2. Schematic diagram of seedling selection system. (A) Schematic diagram; (B) physical picture. 1. seedling extraction device, 2. plug seedlings, 3. seedling conveyor belt lattice, 4. industrial camera, 5. light box, 6. strip light sources, 7. nozzle, 8. seedling throwing funnel, 9. IPC, 10. PLC, and 11. seedling division device. A is extracting seedling position, B is detecting position, C is eliminating position, D is the previous throwing position, E is throwing position.
Figure 2. Schematic diagram of seedling selection system. (A) Schematic diagram; (B) physical picture. 1. seedling extraction device, 2. plug seedlings, 3. seedling conveyor belt lattice, 4. industrial camera, 5. light box, 6. strip light sources, 7. nozzle, 8. seedling throwing funnel, 9. IPC, 10. PLC, and 11. seedling division device. A is extracting seedling position, B is detecting position, C is eliminating position, D is the previous throwing position, E is throwing position.
Agronomy 11 02031 g002
Figure 3. Work flow of transplanting and selecting selection.
Figure 3. Work flow of transplanting and selecting selection.
Agronomy 11 02031 g003
Figure 4. The system of the plug seedling identification.
Figure 4. The system of the plug seedling identification.
Agronomy 11 02031 g004
Figure 5. The process of extracting the characteristics of plug seedlings. (A) Image cropping; (B) converting RGB image to R, G, B single channel image; (C) converting RGB image to H, S, V single channel image; (D) Otsu segmentation; (E) dilating; (F) filling; (G) displaying all connected region; and (H) the largest connected region.
Figure 5. The process of extracting the characteristics of plug seedlings. (A) Image cropping; (B) converting RGB image to R, G, B single channel image; (C) converting RGB image to H, S, V single channel image; (D) Otsu segmentation; (E) dilating; (F) filling; (G) displaying all connected region; and (H) the largest connected region.
Agronomy 11 02031 g005
Figure 6. The process of extracting the area characteristics of plug body. (A) H-channel image; (B) mask processing; (C) displaying all connected area; (D) the largest connected region; (E) dilating; and (F) filling.
Figure 6. The process of extracting the area characteristics of plug body. (A) H-channel image; (B) mask processing; (C) displaying all connected area; (D) the largest connected region; (E) dilating; and (F) filling.
Agronomy 11 02031 g006
Figure 7. The process of extracting the area characteristics of stem leaves. (A) (G-R) * 10; (B) threshold processing; (C) displaying all connected regions; (D) dilation; and (E) the largest connected region.
Figure 7. The process of extracting the area characteristics of stem leaves. (A) (G-R) * 10; (B) threshold processing; (C) displaying all connected regions; (D) dilation; and (E) the largest connected region.
Agronomy 11 02031 g007
Figure 8. Plug seedlings of different classifications. (A) Robust seedling; (B) dead, weak or injured seedling; (C) the plug seedling with the injured plug body; and (D) no seedling.
Figure 8. Plug seedlings of different classifications. (A) Robust seedling; (B) dead, weak or injured seedling; (C) the plug seedling with the injured plug body; and (D) no seedling.
Agronomy 11 02031 g008
Figure 9. Block diagram of adaptive fuzzy-PID feedback control system.
Figure 9. Block diagram of adaptive fuzzy-PID feedback control system.
Agronomy 11 02031 g009
Figure 10. Comparative experiment of plug seedling field transplantation. (A) Experiment prototype; (B) plug seedlings.
Figure 10. Comparative experiment of plug seedling field transplantation. (A) Experiment prototype; (B) plug seedlings.
Agronomy 11 02031 g010
Figure 11. The experiment results of seedlings extracting comparative experiment.
Figure 11. The experiment results of seedlings extracting comparative experiment.
Agronomy 11 02031 g011
Figure 12. The situations of incorrect identification of plug seedlings. (A) Misidentified as no seedlings; (B) misidentified as seedlings.
Figure 12. The situations of incorrect identification of plug seedlings. (A) Misidentified as no seedlings; (B) misidentified as seedlings.
Agronomy 11 02031 g012
Table 1. Fuzzy PID parameter correction rules.
Table 1. Fuzzy PID parameter correction rules.
Correction
Parameter
e(k) SubsetNLNMNSZOPSPMPL
Δe(k) Subset
ΔKp, ΔKi, ΔKdNPL/NS/NSNL/PS/PLPL/PS/NLPS/PS/NSPL/PS/NLNL/PS/PSPL/NL/NS
ZPL/NS/NSNL/PS/PSPS/PS/NSPS/ZO/NSPS/PS/NSNL/PS/PLPS/NS/NS
PPS/NL/ZONL/PS/PLPL/PL/NLPS/PS/NSPS/PL/NLNL/PS/PSPL/NS/ZO
Table 2. Results table of seedlings extracting comparative experiment.
Table 2. Results table of seedlings extracting comparative experiment.
Extracting
Frequency
(plants/min)
Without Seedling
Selection System
With Seedling Selection System
Robust Seedling Number WRobust Seedling Rate M (%)Success Number QRobust Seedling Number WSuccess Rate F (%)Robust Seedling Rate M (%)
6011881.9414211898.6198.33
12083.3314311899.3198.33
11881.9414211798.6197.5
Average value118.6682.41142.33117.6698.8498.05
8011881.9414311999.3199.17
11781.2514111697.9296.67
11881.9414111797.9297.5
Average value117.6781.71141.67117.3398.3897.78
10011781.2513911596.5395.83
11982.6413911496.5395
11881.9414111697.9296.67
Average value11881.94139.6711596.9995.83
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wen, Y.; Zhang, L.; Huang, X.; Yuan, T.; Zhang, J.; Tan, Y.; Feng, Z. Design of and Experiment with Seedling Selection System for Automatic Transplanter for Vegetable Plug Seedlings. Agronomy 2021, 11, 2031. https://doi.org/10.3390/agronomy11102031

AMA Style

Wen Y, Zhang L, Huang X, Yuan T, Zhang J, Tan Y, Feng Z. Design of and Experiment with Seedling Selection System for Automatic Transplanter for Vegetable Plug Seedlings. Agronomy. 2021; 11(10):2031. https://doi.org/10.3390/agronomy11102031

Chicago/Turabian Style

Wen, Yongshuang, Leian Zhang, Xuemei Huang, Ting Yuan, Junxiong Zhang, Yuzhi Tan, and Zhongbin Feng. 2021. "Design of and Experiment with Seedling Selection System for Automatic Transplanter for Vegetable Plug Seedlings" Agronomy 11, no. 10: 2031. https://doi.org/10.3390/agronomy11102031

APA Style

Wen, Y., Zhang, L., Huang, X., Yuan, T., Zhang, J., Tan, Y., & Feng, Z. (2021). Design of and Experiment with Seedling Selection System for Automatic Transplanter for Vegetable Plug Seedlings. Agronomy, 11(10), 2031. https://doi.org/10.3390/agronomy11102031

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop