Next Article in Journal
Long-Term Impact of Genomic Selection on Genetic Gain Using Different SNP Density
Next Article in Special Issue
Design and Analysis of Pneumatic Downforce Regulating Device for No-Till Corn Planter
Previous Article in Journal
Towards a Real-Time Oil Palm Fruit Maturity System Using Supervised Classifiers Based on Feature Analysis
Previous Article in Special Issue
Effects of Conservation Tillage on Soil Properties and Maize Yield in Karst Regions, Southwest China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Application of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage

1
Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China
2
National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Agriculture 2022, 12(9), 1460; https://doi.org/10.3390/agriculture12091460
Submission received: 6 August 2022 / Revised: 11 September 2022 / Accepted: 12 September 2022 / Published: 14 September 2022

Abstract

:
There is an increasing demand for remote monitoring and management of agricultural machinery operation in conservation tillage. Considering the problems of large errors in detecting operation quality parameters, such as tillage depth and corn straw cover rate, in complex farmland environments, this paper proposes a tillage depth measurement method based on the dual attitude compound of a tractor body and three-point hitch mechanism with lower pull rod and an online measurement method based on K-means clustering of the corn straw cover rate on farmland surface. An operation monitoring terminal was developed for the remote collection of quality parameters of conservation tillage field operation. A remote monitoring system of agricultural machinery operation was constructed and applied over a large area. The field tests showed that the static mean error and root-mean-square error of this method were 0.16 and 0.67 cm for uphill and 0.36 and 0.57 cm for downhill, respectively. For the 28 and 33 cm tillage depth tests, the mean dynamic measurement errors of this method were 0.55 and 0.61 cm, and the root means square errors were 0.64 and 0.73 cm, respectively, and the coefficient of variation of tillage depth did not exceed 3%. The correlation coefficient between the corn straw cover rate detection algorithm based on K-means clustering and the manual image marking method reached 0.92, with an average error of 9.69%, and the accuracy filled the demand for straw cover rate detection. The detection accuracy of tillage depth and straw cover rate was high and thus provides an effective means of information technology support for the quality monitoring and production management of conservation tillage farming operations.

1. Introduction

Conservation tillage is one of the leading technologies for sustainable agricultural development, mainly through the implementation of no-tillage and straw mulching to control soil, wind, and water erosion and dust pollution and improve soil fertility and soil moisture storage capacity, and it has been promoted and developed in many countries [1,2,3]. Subsoiling operation, straw return, and no-till precision sowing are critical support technologies of conservation tillage. They are directly related to the quality of agricultural production operations, operational effectiveness, and operational management efficiency [4,5]. Therefore, the online monitoring and remote supervision of conservation tillage-related working conditions for the operation area are significant advancements to improve the efficiency of agricultural production. Based on advanced measurement and control technology, system analysis methods, and big data intelligent processing theory, it is essential to realize online sensing and remote monitoring of operation quality of critical links, such as deep pine and straw returning to fields [6,7].
Subsoiling operation and straw return are core components of conservation tillage. Accurate online detection of subsoiling operation tillage depth, intelligent detection of corn straw cover rate, and remote monitoring can improve the effectiveness of conservation tillage. The online detection of tillage depth has become a research hotspot. Yin proposed a tillage depth detection system based on the tractor three-point hitch mechanism with lower tie rod attitude measurement, which realized the real-time measurement of tillage depth of flat slope and micro-slope farmland [8]. However, the error in measuring tillage depth on the ground with a slope greater than 6° was significant. In a later study, Yin combined attitude sensors to collect the horizontal attitude data of the tractor’s lower pull rod and subsoiler [9]. This method could achieve real-time measurement of the tractor operation plowing depth of steeper slope farmland, with an average error of plowing depth detection of 0.45 cm. However, the calibration process for this method is complicated, the error compensation is difficult to determine, and the operation and maintenance requirements of the system are high. In addition, it is challenging to realize the quality online supervision for the subsoiling operation of many tractors based on the data platform, which is not conducive to promoting large area applications. Based on the sensor fusion approach, Kim et al. developed a tillage depth monitoring system consisting of a linear potentiometer (CLS1322, ActiveSensors, Christchurch, UK), inclinometer (SST141, Vigor Technology, Shanghai, China), and optical distance sensor (ODSL 9/C6-650-S12, Leuze electronic, Owen, Germany). However, the accuracy and stability of the tillage depth detection system in field trials have not been verified [10]. Bentaher et al. measured three orthogonal components of tillage force by three force sensors of the tractor suspension system to improve the tillage depth monitoring system [11]. However, the tillage depth value obtained by this method is relative, and changes in the structure of the farm implement can lead to changes in the conversion relationship. As shown above, most existing tillage depth monitoring methods and systems are based on the information of the three-point hitch mechanism and do not consider the influence of the tractor body on the tillage depth of the hooked implements or the influence of terrain with a steeper slope on the tillage depth measurement.
Straw is an important by-product of agricultural production. Straw returning to the field can prevent and control dust, water and soil loss, water storage and soil moisture conservation, and soil fertility. The corn straw coverage rate is an essential technical indicator for the effect of straw returning to the field and is a basis for the subsidy of straw returning to the field [12]. However, the corn straw coverage rate is mainly measured by artificial methods, such as the rope pulling method. The measurement data of the corn straw coverage rate are greatly affected by human subjective factors and have low efficiency.
Some scholars have used satellite remote sensing to select the short infrared band sensitive to straw cellulose and lignin to establish a large-scale monitoring system for straw coverage based on remote sensing [13,14]. However, this telemetry method monitors only a single parameter. It cannot achieve simultaneous monitoring of operational status, operational surface, and other quality parameters with the rest of conservation tillage, which limits the integration of remote sensing monitoring of straw cover and field agricultural machinery operation monitoring systems [15]. In addition, scholars have conducted studies using image processing methods [16]. Li et al. combined the entropy value of texture features with a back propagation neural network for straw cover detection [17,18]. Jafari et al. converted the images into different color fields for straw identification and achieved an error of 2.3%; however, the method was susceptible to interference from the camera angle and camera environment [19]. The above methods process straw return images offline without real-time monitoring [20,21,22]. In contrast, Liu et al. established a real-time monitoring method for corn straw cover rate based on image recognition of field operations, effectively supporting online monitoring of corn straw cover rate during straw return operations. However, a complete operational processing method from data collection, back transmission, storage analysis, quality evaluation, to specific physical systems has yet to be developed [23,24,25,26,27].
This paper proposes the methods of subsoiling operation tillage depth measurement and farmland surface corn straw cover rate detection under a complex farmland environment with the aim of meeting the operation quality and information management requirements of conservation tillage agricultural machinery widely used in Northeast China. We developed an operation monitoring terminal suitable for remote collection of quality parameters of conservation tillage field operation, constructed an operation monitoring and management system, and carried out the large-scale application for conservation tillage. The tillage depth measurement method effectively integrated the information of the tractor body and the lower pull rod of the three-point hitch mechanism, and the straw cover rate detection method took the K-means clustering theory as the core.

2. Overall Scheme of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage

The remote monitoring system for agricultural machinery operation in conservation tillage mainly consisted of a tillage depth detection device, a corn straw coverage rate detection unit, an operation monitoring terminal, and a service system for supervision and management of remote operation. The tillage depth detection device consisted of two attitude sensors and an agricultural equipment identification sensor. Among them, to collect attitude information of the tractor body and lower pull rod, two attitude sensors were installed, one in the tractor cab and the other in the lower pull rod. In addition, the basic structural parameters of the subsoiler were stored in the equipment identification sensor (AgChip Science and Technology (Beijing) Co., Ltd., Beijing, China). Finally, the information from the three sensors was integrated to obtain the status and tillage depth of the subsoiling operation. The straw cover detection and collection unit consisted of two groups of cameras. These groups were installed in the front counterweight block of the tractor and the back of the tractor cab roof, respectively. The two groups of cameras were connected to the monitoring terminal to obtain the image data of the farmland surface in front and behind the tractor operation direction. An operation online monitoring terminal was installed in the tractor cab. This terminal can analyze and integrate information, such as tillage depth data, image data, location information, operation speed, and operation status. The processing results can be displayed on the monitor terminal and transmitted to the service system for remote operation supervision and management in real-time through a 4G wireless network. The system can send, receive, parse, and store operation data from the monitoring terminal. The system can calculate the operation area and corn straw coverage rate that have reached the standard. In addition, the system can evaluate the quality of tillage operations and the amount of corn straw coverage rate for no-till seeding on the operating plots. The overall scheme of the system is shown in Figure 1.

3. Methods for Testing the Quality of Agricultural Machinery Operations in Conservation Tillage

3.1. Measuring Tillage Depth in Complex Terrain

Considering that tillage depth detection in slope and complex environments is easily affected by attitude change and vibration and that accuracy is difficult to guarantee, a tillage depth measurement method based on the body and lower pull rod of the three-point hitch mechanism was proposed. This method integrates dual attitude fusion and sensor data processing to solve the problem of slope tillage depth detection. Based on the dual attitude sensor (AgChip Science and Technology (Beijing) Co., Ltd., Beijing, China), this paper monitored the change of the attitude of the tractor body and its lower pull rod in real time. The geometry of the three-point hitch mechanism was combined to build a tillage depth monitoring model for subsoiling operation. Thus, the influence of the slope angle on tillage depth detection is reduced by the horizontal attitude of the tractor body to detect subsoiler operation depth under complex terrain.
Suspended subsoilers are used for field tillage under the traction of the tractor’s three-point hitch mechanism. The front end of the hitch mechanism’s lower pull rod and the tractor’s lower hitch point are hinged through a connecting unit, and the center link point is A. The other end is hinged to the subsoiler through a connecting unit, and the center point of the hinge is B. The front end of the upper pull rod is hinged with the upper hitch point of the tractor (China YTO Group Co., Ltd., Luoyang, China), and another end is hinged with the upper hitch point of the subsoiler. The rigid suspension unit holds the equipment rigidly to the tractor. The tractor controls the lifting arm through the hitch mechanism to adjust the working depth of the subsoiler. The tillage depth detection principle of the suspended subsoiler is shown in Figure 2.
When a tractor unit is placed on the open and flat ground, the vertical distance between the lower link point A and the horizontal plane is H 1 , the vertical distance between the lower hitch point B and the horizontal plane is H 2 , and the straight-line distance between the points A and B is the length L 1 of the tractor lower pull rod. When the tractor unit is operated on a tillage operation with a slope lower than 2°, as shown in Figure 2, the tractor unit’s operation depth H is calculated using Formula (1):
H = H 2 ( H 1 L 1 × s i n α )
where α is the angle between the centerline of the lower pull rod and the horizontal plane.
As the tractor’s three-point hitch mechanism and the subsoiler are rigidly connected, the angle β between the tractor’s forward direction and the horizontal plane is regarded as the slope angle of the operating plot when the tractor is operating in the tillage operation with a slope greater than 2°. The attitude rotation angle is specified, and the clockwise direction is positive, that is, the slope angle is positive for upslope and negative for downslope, as shown in Figure 3a,b. The following formula can be derived from the geometric relationship:
{ θ = α β H = H 2 ( H 1 L 1 × s i n θ )
where θ is the angle between the center line of the lower pull rod and the working ground of the tractor unit, α is angle between the center line of the lower pull rod and the horizontal plane, and β is the angle between the tractor’s forward direction and the horizontal plane.

3.2. Detection Method of Corn Straw Coverage Rate

Considering that straws in agricultural fields have various forms, and delicate straws are difficult to identify accurately, this study proposed a corn straw coverage rate detection algorithm based on K-means clustering according to machine vision technology. This method effectively solves the problem of traditional manual measurement methods, which are greatly influenced by subjective factors and have, thus, a low efficiency. Figure 4 shows the steps of the detection algorithm, which includes reading the original image of corn straw, denoising the image with a Gaussian filter, graying the image to separate straw from the soil background, calculating the number of soil background and straw pixel points based on the K-means clustering method, and finally, obtaining the calculation result of the corn straw coverage rate.
K-means clustering is a classical algorithm in machine learning unsupervised classification. There are two problems in the K-means clustering process: (1) the number of clusters and (2) the cluster center [19,28,29]. In this study, a camera was installed at the front of the tractor, and the corn straw images were taken by tilting the camera towards the ground. In the obtained corn straw images, the target and background were distinguishable. The target was straw, and the background was soil, so the number of clusters could be determined as 2. The initial clustering center was determined by a random method. Then, the distance between each sample point and the clustering center was calculated separately, and iteration was carried out after the new clustering center was determined. The clustering iteration continued until the clustering center no longer changed, meaning that the classification of straw and soil was completed. The corn straw coverage rate was calculated using Formula (3).
P C = C s t r a w C s t r a w + C s o i l × 100 %
where PC is the detection value of corn straw coverage rate, C s t r a w is the number of straw pixels, and C s o i l is the number of soil pixels.
To evaluate the detection algorithm of the corn straw coverage rate, the correlation coefficient and relative error were adopted. The correlation coefficient was used to evaluate the correlation between the results of corn straw coverage rate detection and the results of manual image labeling; the relative error was used to judge the error of this detection algorithm. The correlation coefficient and relative error were obtained by Formulas (4) and (5), respectively.
r = k = 1 n ( x 1 k x 1 ¯ ) ( x 2 k x 2 ¯ ) k = 1 n ( x 1 k x 1 ¯ ) 2 k = 1 n ( x 2 k x 2 ¯ ) 2
where r is correlation coefficient, x 1 is standard values of corn straw coverage rate, and x 2 is detection value of corn straw coverage rate.
E = P C F F × 100 %
where E is the relative error, PC is the detection value of corn straw coverage rate, and F is the standard value of corn straw coverage rate.
The camera installed on the front of the tractor was set at 45° for image capture. Before each operation, the lens was wiped once. Shading components were installed on the front of the camera to ensure that the collected images were not affected by dust, bright light, and other factors.
In the experimental process, to evaluate the accuracy of the results, the truth-value acquisition method of straw cover rate used in this paper was to mark and identify the images manually. Various shaped and tiny straws were accurately marked manually. The image was segmented by the binarization method, and the pixel points were calculated by a computer. This result was used as the truth-value of straw cover rate in the field to evaluate the accuracy of this algorithm. This truth-value acquisition method relies on manual labeling of the image, and the results were more accurate. Moreover, the images processed by the truth-value acquisition method could be guaranteed to correspond precisely with the images processed by the algorithm in this paper. The accurate matching of samples was achieved. Finally, the test results were evaluated by the correlation coefficient and mean error.

4. Research and Development of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage

4.1. Operation Monitoring Terminal

The operation monitoring terminal is the main component of the tillage depth online detection device and image data acquisition and processing. The terminal consists of a control and processing module, global navigation satellite system (GNSS) positioning module, 4G communication module, display and alarm module, storage module of data, etc. The control and processing module uses an ARM Cortex-M4 microprocessor (STMicroelectronics, Geneva, Switzerland), which receives and processes the data collected by the tillage depth detection device and the corn straw coverage rate detection. Based on this module, information, such as GNSS, tractor working conditions, and agricultural equipment structure, is integrated. The operation information is uploaded to the monitoring platform in real-time through the 4G network to complete the remote online monitoring of the operation. The terminal has a built-in trans-flash (TF) card and flash storage, which can save the operation and image data in real time. Moreover, the terminal is integrated with a display and alarm module, which will warn the driver when the operation quality is not qualified or the equipment is malfunctioning. The main hardware structure is shown in Figure 5.
The monitoring terminal is mainly responsible for the real-time online monitoring of the sensing, processing, and transmission of operational information. The sampling frequency is 50 Hz. It can realize functions such as timely acquisition, storage, and operation information analysis. The terminal’s functions mainly includes the driver of each hardware module, the reception and processing of GNSS data, processing and analysis of tillage depth data, acquisition and processing of straw image data, transmission of 4G wireless network data, and storage of local data. Among them, the data transmission of mobile communication is greatly affected by the signal; especially in the environment of field operation, there will often be no or weak signal, so the integrity of data transmission is the focus of the whole system. When the network signal is weak or interrupted, the current data are stored to avoid data loss during transmission. When the network signal returns, the saved data will be uploaded to the service system for supervision and management of remote operations, usually using the FIFO method. The main software flow of the monitoring terminal is shown in Figure 6.

4.2. A Service System for Remote Monitoring

The system was built using service-oriented architecture (SOA) technology and divided into infrastructure, data, service, business logic, and application presentation layers. The system provides access to business data for managing agricultural machinery, farmers, and agricultural machinery cooperatives in a browser/server mode. The overall architecture of the system is shown in Figure 7.
The infrastructure layer consists of servers, storage disk arrays, network devices, backup all-in-one machines, and system basic software. On the storage side of the basic data, the technology of disk array storage architecture is used to realize the storage of the basic data of users. On the backup side of the platform data, the technology of backup integration architecture is adopted. By storing and backing up critical data, such as basic databases, files, and operating systems, it meets the needs of data backup and disaster recovery.
The data layer consists of a base database cluster, a geographic information spatial database cluster, and a cache database cluster. The base database cluster adopts the cluster building scheme of MySQL Replication technology. It can meet the service requirements of agricultural machinery operation data storage and business data access. The PostGIS-based spatial database cluster can realize data storage functions, such as of agricultural machinery operation plots, operation locations, operation areas, operation omission areas, and operation overlapping areas. The cache database cluster was constructed in the Redis Cluster mode to meet data access needs during peak agricultural machinery operations.
The service layer contains two segments. On the one hand, it realizes the function of sending and receiving operation data and data queue buffering based on Socket technology. On the other hand, based on windows communication foundation (WCF) technology, the business interface and data transfer object (DTO) model are designed for modules such as the management of basic data, statistics of agricultural machinery operations, real-time monitoring of remote operations, playback of farm machinery operation trajectories, analysis of operation quality, analysis of operation area boundaries, and analysis of cross-area operations and management of user rights.
At the business logic level, the business interface based on the service layer realizes business functions such as parsing of agricultural machinery operation data, calculation of operation volume, entry of operation data, analysis of operation supervision, caching of operation data, encryption of data, compression of data, and map services.
The presentation layer mainly includes functional modules, such as real-time monitoring of operations, playback of historical trajectories, statistics of operation quantity, analysis of operation quality, analysis of operation area boundaries, and analysis of cross-area operations. The platform is rapidly deployed, upgraded, and maintained in B/S mode.

5. Experiments and Results Analysis

5.1. Tillage Depth Measurement Test and Result Analysis

To test the reliability and stability of the tillage depth detection system of the suspended subsoiler, a static calibration experiment was carried out in the Xiaotangshan National Experiment Station for Precision Agriculture, Changping District, Beijing, in August 2021. A Dongfanghong 1104 tractor (China YTO Group Co. Ltd., Luoyang, China) and Dahua Baolai 1S-230 subsoiler (Dahua Machinery Co., Ltd., Jining, China) were selected as test subjects. In October 2021, a Case 210 tractor (CNHI, New York, NY, USA) and 1S-360 subsoiler were used in 597 Farm, Baoqing County, Shuangyashan City, Heilongjiang Province, for field stability experiments. The experimental site is shown in Figure 8.
(1)
Error analysis of tillage depth detection at static state
The subsoiler unit was calibrated on the horizontal ground according to the detection model. Then, the tractor was parked on the slope at about 6°, and the tillage depth of the subsoiler was adjusted from small to large and then from large to small at 5-cm intervals in 10–35 cm sections. The output results of the detection system when going uphill and downhill were compared with the manual measurement data. The results of static tillage depth detection during uphill and downhill are shown in Table 1 and Table 2, Figure 9 and Figure 10.
The static average, maximum, minimum, and root means square error of the tillage depth detection system for the suspended subsoiler when going up the slope were 0.16, 1.40, 0.02, and 0.67 cm, respectively. The downhill static average error was 0.36 cm, the maximum error was 1.30 cm, the minimum error was 0.03 cm, and the root means square error was 0.57 cm.
(2)
Results analysis of tillage depth stability
Through the hydraulic suspension mechanism, the tractor dropped the subsoiler to the same fixed position during operation. On the 2° and 4° slopes, the tractor operated a stroke in the forward and return directions to measure the tillage depth data in real-time. A field experiment with 28-cm tillage depth was used as an example to demonstrate the process of signal processing. The sampling rate was 50 Hz. The measured data were converted and processed to obtain the measured data of tillage depth, as shown in Figure 11.
To ensure the usability and accuracy of the data, removal of the singular value, compensation of the singular data difference, and sliding average filtering were performed, as shown in Figure 12.
According to the actual tillage requirements, the tillage depths for this trial were set at about 28 and 33 cm, respectively. The results of the experiment with the tillage depth set at about 28 cm are shown in Figure 13.
The analysis of Figure 13 shows that the average tillage depth measured by the total stroke system was 28.28 cm, the average tillage depth measured manually was 27.73 cm, the mean error during dynamic tillage depth measurement was 0.55 cm, the root mean square error was 0.64 cm, the variation coefficient of tillage depth was 2.87%, and the stability coefficients of tillage depth for each stroke were 97.64%, 97.08%, 97.46%, and 97.44%, respectively.
The results of the experiment with the tillage depth set at about 33 cm are shown in the Figure 14.
Figure 14 shows that the average tillage depth measured by the total stroke system was 33.32 cm; the average tillage depth measured manually was 32.71 cm; the mean error during dynamic tillage depth measurement was 0.61 cm; the root mean square error was 0.73 cm; the variation coefficient of tillage depth was 2.21%; and the stability coefficients of tillage depth for each stroke were 97.75%, 97.95%, 97.77%, and 97.79%, respectively.
Therefore, the results of the comprehensive field experiments show that under complex terrains, such as unfluctuating farmland slope, weeds, crop residues, and ridges, the average error and root mean square error of static tillage depth detection were 0.36 and 0.62 cm, respectively. The average values of dynamic measurement errors were 0.55 and 0.61 cm, and the root mean square errors were 0.64 and 0.73 cm for the 28 and 33 cm tillage depth tests, and the variation coefficients of tillage depth did not exceed 3%. The calculation results of the proposed method were basically the same as the average error of 0.45 of the method proposed by Yin [9]; however, the validation test of the proposed method considered a larger field slope, and the device was simpler and easier to apply. Therefore, the tillage depth measurement method based on the body and the lower pull rod of the three-point hitch mechanism and the technology of dual attitude integration and sensor data processing could effectively solve the problem of slope tillage depth detection.

5.2. Corn Straw Cover Rate Detection Test and Result Analysis

In May 2022, 45 images were collected for the actual field validation of this algorithm in corn plots in Northeast China. The manual image tagging method was used to obtain the standard values of straw cover rate, which ranged from 5% to 85%, with the low straw cover rate (5–30%), medium straw cover rate (30–60%), and high straw cover rate (60–85%). In addition, the validation images included various sceneries. The identification of different gradients of the straw cover rate is shown in Figure 15.
The straw cover rate detection results corresponding to the experiment’s three levels were 9.66%, 31.35%, and 71.90%, which could accurately identify the straw and soil background. Correlation coefficient diagram of the straw coverage rate algorithm and artificial image labeling method is shown in Figure 16.
In summary, the correlation coefficient of the proposed algorithm and manual image tagging method for testing and validating different gradients of straw cover rate from 5% to 85% reached 0.92. The average error predicted by the proposed method was 9.69%, which was comparable to the 90% accuracy of the method proposed by Li et al., meeting the requirements for the rapid detection of the straw cover rate in the field [17,18]. In addition, the sources of error generation mainly included maize stalks, leaves, and rhizomes with different morphologies and location distributions. Particularly, maize rhizomes, which easily produce shadows, which are easily misidentified as straw classes, cause errors in straw and soil segmentation.

5.3. Main Functions Verification of the Remote Monitoring System

This section demonstrates the main functions of the remote monitoring system for conservation tillage agricultural machinery operation, which mainly includes the parts of real-time operation monitoring, track playback, operation quantity analysis, and operation quality analysis, as shown in Figure 17.
Figure 17a shows the machine operation position, operation task, and operation status of conservation tillage with an information update frequency of 0.5 Hz, which meets the requirement of real-time monitoring of conservation tillage. Figure 17b shows the machine operation trajectory for typical working conditions of conservation tillage and the captured images to assist in analyzing the operation status. Figure 17c shows the machine operation speed of conservation tillage and the image map’s distribution of sampling points.
For the operation quality analysis module of the remote monitoring system of conservation tillage, the tillage depth detection module was illustrated by a John Deere 554 tractor (John Deere Investments Ltd., Moline, IL, USA)with the license plate “Liao 11-40528”, and the straw cover rate detection module was illustrated by a Lovol 904 tractor (Weizhai Lovol Heavy Industry Co., Ltd., Weifang, China) with the license plate “Liao 11-50024”, as shown in Figure 18.
The operation quality analysis module of a remote monitoring system of conservation tillage agricultural machinery mainly included vehicle information, operation quantity information, operation quality information, and trajectory information. The green dots in the trajectory information represent tillage quality that meets the agronomic requirements, the red trajectory dots represent tillage quality that does not meet the agronomic requirements, and the gray trajectory dots represent no operation.
Figure 18a shows the data for the total subsoiling operation area, effective subsoiling operation area, and average tillage depth on 6 July 2022. The machine had a total subsoiling operation area of 98.47 ha, an effective subsoiling operation area of 98.27 ha, an area compliance rate of 99.8%, an average tillage depth of 34.40 cm, and an operation time of 4 h and 19 min on that working day. Figure 18b shows the total straw return area, effective straw return area, and straw cover rate on 26 April 2022. The machine had an area of 253.51 ha and an effective operating area of 238.75 ha, and the straw coverage of the plots ranged from 55–65%. Compared with the manual test, the accuracy of the analysis method was higher. Therefore, the remote monitoring system of agricultural machine operation constructed in this paper is oriented to conservation tillage. It realizes the information monitoring of operation quality and quantity and solves the problems of low efficiency and incomprehensiveness of traditional manual monitoring.

6. Conclusions

Aiming at the remote monitoring demand of agricultural machinery operation quality for conservation tillage, this paper developed a remote monitoring system of agricultural machinery operation for conservation tillage. The system included a tillage depth detection device, a straw cover rate detection unit, an operation monitoring terminal, and a remote operation supervision service system. The tillage depth detection device and straw cover rate detection unit adopted multi-attitude sensor fusion and machine vision methods to realize tillage depth and straw cover rate detection, respectively. The operation monitoring terminal adopted a high-performance embedded processor to realize multi-source information collection, analysis, storage, and remote transmission. The remote operation monitoring service system adopted service-oriented technology architecture. The system was oriented to conservation tillage and realized the information monitoring of operation quality and quantity, solving the problems of low efficiency and incomprehensiveness of traditional manual monitoring.
This paper systematically studied the operation quality analysis method of subsoiling operation and straw return in conservation tillage. Aiming at the problem that tillage depth detection in a slope environment is easily affected by attitude change and vibration, and the accuracy is difficult to guarantee, this paper proposed a tillage depth measurement method based on a body and three-point hitch mechanism lower pull rod of the tractor. This method integrated dual attitude fusion and sensor data processing to solve the subsoiling operation tillage depth detection in slope. For corn straw cover rate detection, an image processing algorithm based on K-means clustering was proposed, which solved the problem of subjective factors with significant influence and low efficiency of traditional manual measurement methods. Field tests showed that the system had a static mean error and root mean square error of 0.16 and 0.67 cm for uphill and 0.36 and 0.57 cm for downhill; the mean dynamic measurement errors of the 28 and 33 cm tillage depth tests were 0.55 and 0.61 cm, with root mean square errors of 0.64 and 0.73 cm, respectively. The coefficients of variation of tillage depth did not exceed 3%. The calculation results of the proposed method were basically the same as the average error of 0.45 of the method proposed by Yin [9]. The correlation coefficient between the straw cover rate detection algorithm and this paper’s manual image marking method reached 0.92, with an average error of 9.69%, which is comparable to the 90% accuracy of the method proposed by Li et al. in the existing study [17,18]. The remote monitoring service system of agricultural machinery operation has the functions of real-time operation monitoring, historical track playback, operation area statistics, operation quality analysis, and operation area boundary analysis. The detection accuracy can meet the requirements of real-time online monitoring of tillage depth and straw coverage rate under complex farming operation environments and has good anti-interference ability.
The conservation tillage agricultural machinery operation monitoring terminal and service system developed in this paper has been widely applied in Northeast China, realizing the remote monitoring of subsoiling and straw returning and forming the application mode of “Internet + agricultural machinery operation.” This research has played an essential role in ensuring the quality of conservation tillage operations, improving the standardization level of agricultural machinery operations and the protection and sustainable use of black land, and providing technical support for further improving the conservation tillage intelligence.

Author Contributions

Conceptualization, Z.M. and C.Z.; methodology, C.L., J.C., Z.M. and C.Z.; software, J.C., S.G., X.A. and Y.Y.; validation, J.C.; resources, Z.M. and Y.Y.; data curation, C.L. and J.C.; writing—original draft preparation, C.L., J.C. and Z.M.; writing—review and editing, C.L. and Z.M.; supervision, C.Z.; project administration, Y.Y., C.W. and H.L.; funding acquisition, Z.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 31971800) and National Key Research and Development Plan of China (Grant No. 2020YFB1709602).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data are presented in this article in the form of figures or tables.

Acknowledgments

We would like to thank the ”Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences” and “National Engineering Research Center for Information Technology in Agriculture”.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, Z. A Sustainable Development of Agriculture and Agricultural Mechanization in China. Trans. Chin. Soc. Agric. Mach. 2001, 32, 1–4+15. [Google Scholar]
  2. Luo, X.; Liao, J.; Hu, l.; Zang, Y.; Zhou, Z. Improving agricultural mechanization level to promote agricultural sustainable development. Trans. Chin. Soc. Agric. Eng. 2016, 32, 1–11. [Google Scholar] [CrossRef]
  3. Xue, P.; Han, X.; Wang, Y.; Wang, X. Can Agricultural Machinery Harvesting Services Reduce Cropland Abandonment? Evidence from Rural China. Agriculture 2022, 12, 901. [Google Scholar] [CrossRef]
  4. Zhang, H.; Zhou, S.; Wu, S.; Liao, F.; Li, L.; Gu, X.; Pi, X. Evaluation of land resources support capacity based on sustainable agriculture development needs in Jiangsu Province. Trans. Chin. Soc. Agric. Eng. 2009, 25, 289–294. [Google Scholar] [CrossRef]
  5. Wang, C.; Li, H.; He, J.; Wang, Q.; Lu, C.; Chen, L. State-of-the-Art and Prospect of Automatic Navigation and Measurement Techniques Application in Conversation Tillage. Smart Agric. 2020, 2, 41–55. [Google Scholar] [CrossRef]
  6. He, J.; Li, H.; Chen, H.; Lu, C.; Wang, Q. Research Progress of Conservation Tillage Technology and Machine. Trans. Chin. Soc. Agric. Mach. 2018, 49, 1–19. [Google Scholar] [CrossRef]
  7. Pittarello, M.; Chiarini, F.; Menta, C.; Furlan, L.; Carletti, P. Changes in Soil Quality through Conservation Agriculture in North-Eastern Italy. Agriculture 2022, 12, 1007. [Google Scholar] [CrossRef]
  8. Yin, Y.; Meng, Z.; Mei, H.; Luo, C. Study on tilling depth detection method based on attitude measurement for subsoiler. In Proceedings of the American Society of Agricultural and Biological Engineers Annual International Meeting 2015, New Orleans, LA, USA, 26–29 July 2015; American Society of Agricultural and Biological Engineers: New Orleans, LA, USA, 2015; pp. 1331–1336. [Google Scholar]
  9. Yin, Y.; Wang, C.; Meng, Z.; Chen, J.; Guo, S.; Qin, W. Operation Quality Measurement Method for Tilling Depth of Suspended Subsoiler. Trans. Chin. Soc. Agric. Mach. 2018, 49, 68–74. [Google Scholar] [CrossRef]
  10. Kim, Y.-S.; Kim, T.-J.; Kim, Y.-J.; Lee, S.-D.; Park, S.-U.; Kim, W.-S. Development of a Real-Time Tillage Depth Measurement System for Agricultural Tractors: Application to the Effect Analysis of Tillage Depth on Draft Force during Plow Tillage. Sensors 2020, 20, 912. [Google Scholar] [CrossRef]
  11. Bentaher, H.; Hamza, E.; Kantchev, G.; Maalej, A.; Arnold, W. Three-point hitch-mechanism instrumentation for tillage power optimization. Biosyst. Eng. 2008, 100, 24–30. [Google Scholar] [CrossRef]
  12. Li, J.; Lü, C.; Yuan, Y.; Li, Y.; Wei, L.; Qin, Q. Automatic recognition of corn straw coverage based on fast Fourier transform and SVM. Trans. Chin. Soc. Agric. Eng. 2019, 35, 194–201. [Google Scholar] [CrossRef]
  13. Tao, W.; Zhang, Y.; Xie, Z.; Wang, X.; Dong, Y.; Zhang, M.; Su, W.; Li, J.; Xuan, F. Intelligent Recognition of Corn Residue Cover Area by Time-Series Sentinel-2A Images. Spectrosc. Spectr. Anal. 2022, 42, 1948–1955. [Google Scholar] [CrossRef]
  14. Li, Z.; Wang, C.; Pan, X.; Liu, Y.; Li, Y.; Shi, R. Estimation of wheat residue cover using simulated Landsat-8 OLI datas. Trans. Chin. Soc. Agric. Eng. 2016, 32, 145–152. [Google Scholar] [CrossRef]
  15. Du, G.; Zhang, R.; Liang, C.A.; Hu, M. Remote sensing extraction and spatial pattern analysis of cropping patterns in black soil region of Northeast China at county level. Trans. Chin. Soc. Agric. Eng. 2021, 37, 133–141. [Google Scholar] [CrossRef]
  16. Li, H.; Li, H.; He, J.; Li, S. Measuring System for Residue Cover Rate in Field Based on Neural Network. Trans. Chin. Soc. Agric. Mach. 2009, 40, 58–62. [Google Scholar]
  17. Li, S.; Li, H. A Counting Method for Residue Cover Rate in Field Based on Computer Vision. J. Agric. Mech. Res. 2009, 31, 20–22+25. [Google Scholar]
  18. Jafari, A.; Asadi, V.; Rasekhi, R.; Moradi, M. Precise measurement of residue cover by means of image processing techniques. Int. J. Nat. Eng. Sci. 2011, 5, 53–56. [Google Scholar]
  19. Monowar, M.M.; Hamid, M.A.; Kateb, F.A.; Ohi, A.Q.; Mridha, M.F. Self-Supervised Clustering for Leaf Disease Identification. Agriculture 2022, 12, 814. [Google Scholar] [CrossRef]
  20. Ning, Y.; Wang, X.; Yang, Y.; Cao, X.; Wu, Y.; Zou, D.; Zhou, D. Studying the Effect of Straw Returning on the Interspecific Symbiosis of Soil Microbes Based on Carbon Source Utilization. Agriculture 2022, 12, 1053. [Google Scholar] [CrossRef]
  21. Yang, S.; Jia, B.; Yu, T.; Yuan, J. Research on Multiobjective Optimization Algorithm for Cooperative Harvesting Trajectory Optimization of an Intelligent Multiarm Straw-Rotting Fungus Harvesting Robot. Agriculture 2022, 12, 986. [Google Scholar] [CrossRef]
  22. Daughtry, C.S.T.; Hunt, E.R.; McMurtrey, J.E. Assessing crop residue cover using shortwave infrared reflectance. Remote Sens. Environ. 2004, 90, 126–134. [Google Scholar] [CrossRef]
  23. Liu, X.; Liu, H.; Wang, Q.; Gao, N.; Mei, H.; Wang, P. Method and test of straw coverage detection in farmland. J. Chin. Agric. Mech. 2021, 42, 203–208. [Google Scholar] [CrossRef]
  24. Liu, Y.; Sun, J.; Zhang, S.; Yu, H.; Wang, Y. Detection of straw coverage based on multi-threshold and multi-target UAV image segmentation optimization algorithm. Trans. Chin. Soc. Agric. Eng. 2020, 36, 134–143. [Google Scholar] [CrossRef]
  25. Liu, Y.; Wang, Y.; Yu, H.; Qin, M.; Sun, J. Detection of Straw Coverage Rate Based on Multi-threshold Image Segmentation Algorithm. Trans. Chin. Soc. Agric. Mach. 2018, 49, 27–35+55. [Google Scholar] [CrossRef]
  26. Liu, Y.; Zhang, S.; Yu, H.; Wang, Y.; Wang, J. Straw detection algorithm based on semantic segmentation in complex farm scenarios. Opt. Precis. Eng. 2020, 28, 200–211. [Google Scholar] [CrossRef]
  27. Li, X.; Wang, Y.; Fu, L. Monitoring lettuce growth using K-means color image segmentation and principal component analysis method. Trans. Chin. Soc. Agric. Eng. 2016, 32, 179–186. [Google Scholar] [CrossRef]
  28. Jambudi, T.; Gandhi, S. Analytical review of K-means based algorithms and evaluation methods. In Proceedings of the 12th International Conference on Advances in Computing, Control, and Telecommunication Technologies, ACT 2021, Hyderabad, India, 27–28 August 2021; Grenze Scientific Society: Hyderabad, India, 2021; pp. 479–486. [Google Scholar]
  29. Ouyang, C.T.; Liao, S.K.; Huang, Z.W.; Gong, Y.K. Optimization of K-means image segmentation based on manta ray foraging algorithm. In Proceedings of the 3rd International Conference on Electronic Communication and Artificial Intelligence, IWECAI 2022, Zhuhai, China, 14–16 January 2022; Institute of Electrical and Electronics Engineers, Inc.: Zhuhai, China, 2022; pp. 151–155. [Google Scholar]
Figure 1. Overall plan of the system.
Figure 1. Overall plan of the system.
Agriculture 12 01460 g001
Figure 2. Detection principle of suspended subsoiler tillage depth.
Figure 2. Detection principle of suspended subsoiler tillage depth.
Agriculture 12 01460 g002
Figure 3. Tillage depth detection of suspended subsoiler: (a) uphill operation and (b) downhill operation.
Figure 3. Tillage depth detection of suspended subsoiler: (a) uphill operation and (b) downhill operation.
Agriculture 12 01460 g003
Figure 4. Flow chart of corn straw coverage rate detection.
Figure 4. Flow chart of corn straw coverage rate detection.
Agriculture 12 01460 g004
Figure 5. Hardware structure of operation monitoring terminal.
Figure 5. Hardware structure of operation monitoring terminal.
Agriculture 12 01460 g005
Figure 6. Schematic diagram of the implementation process of the terminal function.
Figure 6. Schematic diagram of the implementation process of the terminal function.
Agriculture 12 01460 g006
Figure 7. Overall architecture of the system.
Figure 7. Overall architecture of the system.
Agriculture 12 01460 g007
Figure 8. Field experiments at 597 Farm: (a) testing site and (b) the condition of the soil after tillage.
Figure 8. Field experiments at 597 Farm: (a) testing site and (b) the condition of the soil after tillage.
Agriculture 12 01460 g008
Figure 9. Results analysis of tillage depth detection test of the suspended subsoiler when going uphill.
Figure 9. Results analysis of tillage depth detection test of the suspended subsoiler when going uphill.
Agriculture 12 01460 g009
Figure 10. Results analysis of tillage depth detection test of the suspended subsoiler when going downhill.
Figure 10. Results analysis of tillage depth detection test of the suspended subsoiler when going downhill.
Agriculture 12 01460 g010
Figure 11. Measured data of tillage depth.
Figure 11. Measured data of tillage depth.
Agriculture 12 01460 g011
Figure 12. Tillage depth data after processing.
Figure 12. Tillage depth data after processing.
Agriculture 12 01460 g012
Figure 13. Field test results of the tillage depth detection system under different slopes: (a) uphill slope angle is 2°, working speed is 2.80 m/s; (b) downhill slope angle −2°, working speed 2.97 m/s; (c) uphill slope angle 4°, working speed 2.76 m/s; (d) downhill slope angle −4°, working speed 2.78 m/s.
Figure 13. Field test results of the tillage depth detection system under different slopes: (a) uphill slope angle is 2°, working speed is 2.80 m/s; (b) downhill slope angle −2°, working speed 2.97 m/s; (c) uphill slope angle 4°, working speed 2.76 m/s; (d) downhill slope angle −4°, working speed 2.78 m/s.
Agriculture 12 01460 g013aAgriculture 12 01460 g013b
Figure 14. Field test results of tillage depth detection system under different slopes: (a) uphill slope angle 2°, working speed 2.19 m/s; (b) downhill slope angle −2°, working speed 2.44 m/s; (c) uphill slope angle 4°, working speed 2.62 m/s; (d) downhill slope angle −4°, working speed 2.37 m/s.
Figure 14. Field test results of tillage depth detection system under different slopes: (a) uphill slope angle 2°, working speed 2.19 m/s; (b) downhill slope angle −2°, working speed 2.44 m/s; (c) uphill slope angle 4°, working speed 2.62 m/s; (d) downhill slope angle −4°, working speed 2.37 m/s.
Agriculture 12 01460 g014aAgriculture 12 01460 g014b
Figure 15. Recognition effect of straw coverage rate with different gradients: original image of (a) low straw coverage rate; (c) medium straw coverage rate; (e) high straw coverage rate and algorithm recognition results of (b) low straw coverage rate; (d) medium straw coverage rate; (f) high straw coverage rate.
Figure 15. Recognition effect of straw coverage rate with different gradients: original image of (a) low straw coverage rate; (c) medium straw coverage rate; (e) high straw coverage rate and algorithm recognition results of (b) low straw coverage rate; (d) medium straw coverage rate; (f) high straw coverage rate.
Agriculture 12 01460 g015
Figure 16. Correlation coefficient diagram of the straw coverage rate algorithm and artificial image labeling method.
Figure 16. Correlation coefficient diagram of the straw coverage rate algorithm and artificial image labeling method.
Agriculture 12 01460 g016
Figure 17. Main interface of the remote monitoring system for conservation tillage agricultural machinery operation: (a) real-time monitoring interface; (b) trajectory playback interface; (c) working analysis interface.
Figure 17. Main interface of the remote monitoring system for conservation tillage agricultural machinery operation: (a) real-time monitoring interface; (b) trajectory playback interface; (c) working analysis interface.
Agriculture 12 01460 g017aAgriculture 12 01460 g017b
Figure 18. Operation quality analysis module of a remote monitoring system for conservation tillage agricultural machinery operation: (a) analysis results of tillage depth detection and (b) analysis results of corn straw coverage rate.
Figure 18. Operation quality analysis module of a remote monitoring system for conservation tillage agricultural machinery operation: (a) analysis results of tillage depth detection and (b) analysis results of corn straw coverage rate.
Agriculture 12 01460 g018
Table 1. Static test results of tillage depth detection of the suspended subsoiler when going uphill.
Table 1. Static test results of tillage depth detection of the suspended subsoiler when going uphill.
SampleSlope Angle (°)System Measurement (cm)Manual Measurement (cm)Relative Error (%)
15.2112.3010.901.40
26.0215.4815.50−0.02
35.0520.7820.300.48
45.2824.6925.30−0.61
55.7630.3730.60−0.23
66.5334.9035.40−0.50
75.7935.1435.80−0.66
85.8830.1730.70−0.53
96.1425.7025.200.50
105.1419.5120.40−0.89
115.3915.6215.400.22
125.419.4710.50−1.03
Table 2. Static test results of tillage depth detection of the suspended subsoiler when going downhill.
Table 2. Static test results of tillage depth detection of the suspended subsoiler when going downhill.
SampleSlope Angle (°)System Measurement (cm)Manual Measurement (cm)Relative Error (%)
1−6.9511.6010.301.30
2−6.9416.0215.700.32
3−7.2620.5820.400.18
4−7.0625.3325.300.03
5−7.0931.0530.400.65
6−6.6635.6735.80−0.13
7−6.7835.5335.100.43
8−6.4130.6630.200.46
9−6.5926.4225.401.02
10−7.0919.9120.90−0.99
11−6.7016.1015.200.90
12−6.9210.2110.100.11
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Luo, C.; Chen, J.; Guo, S.; An, X.; Yin, Y.; Wen, C.; Liu, H.; Meng, Z.; Zhao, C. Development and Application of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage. Agriculture 2022, 12, 1460. https://doi.org/10.3390/agriculture12091460

AMA Style

Luo C, Chen J, Guo S, An X, Yin Y, Wen C, Liu H, Meng Z, Zhao C. Development and Application of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage. Agriculture. 2022; 12(9):1460. https://doi.org/10.3390/agriculture12091460

Chicago/Turabian Style

Luo, Changhai, Jingping Chen, Shuxia Guo, Xiaofei An, Yanxin Yin, Changkai Wen, Huaiyu Liu, Zhijun Meng, and Chunjiang Zhao. 2022. "Development and Application of a Remote Monitoring System for Agricultural Machinery Operation in Conservation Tillage" Agriculture 12, no. 9: 1460. https://doi.org/10.3390/agriculture12091460

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop