Next Article in Journal
A Data-Driven Method for Water Quality Analysis and Prediction for Localized Irrigation
Next Article in Special Issue
Nutritional Monitoring of Rhodena Lettuce via Neural Networks and Point Cloud Analysis
Previous Article in Journal
Enhancing Dust Control for Cage-Free Hens with Electrostatic Particle Charging Systems at Varying Installation Heights and Operation Durations
Previous Article in Special Issue
A Performance Comparison of CNN Models for Bean Phenology Classification Using Transfer Learning Techniques
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Performance of Neural Networks in the Prediction of Nitrogen Nutrition in Strawberry Plants

by
Jamile Raquel Regazzo
1,*,
Thiago Lima da Silva
1,
Marcos Silva Tavares
1,
Edson José de Souza Sardinha
2,
Caroline Goulart Figueiredo
1,
Júlia Luna Couto
2,
Tamara Maria Gomes
2,
Adriano Rogério Bruno Tech
2 and
Murilo Mesquita Baesso
2
1
Luiz de Queiroz Higher School of Agriculture, University of São Paulo—USP, Piracicaba 13635–900, SP, Brazil
2
Faculty of Animal Science and Food Engineering, University of São Paulo—USP, Pirassununga 13418–900, SP, Brazil
*
Author to whom correspondence should be addressed.
AgriEngineering 2024, 6(2), 1760-1770; https://doi.org/10.3390/agriengineering6020102
Submission received: 19 April 2024 / Revised: 27 May 2024 / Accepted: 28 May 2024 / Published: 18 June 2024
(This article belongs to the Special Issue Application of Artificial Neural Network in Agriculture)

Abstract

:
Among the technological tools used in precision agriculture, the convolutional neural network (CNN) has shown promise in determining the nutritional status of plants, reducing the time required to obtain results and optimizing the variable application rates of fertilizers. Not knowing the appropriate amount of nitrogen to apply can cause environmental damage and increase production costs; thus, technological tools are required that identify the plant’s real nutritional demands, and that are subject to evaluation and improvement, considering the variability of agricultural environments. The objective of this study was to evaluate and compare the performance of two convolutional neural networks in classifying leaf nitrogen in strawberry plants by using RGB images. The experiment was carried out in randomized blocks with three treatments (T1: 50%, T2: 100%, and T3: 150% of recommended nitrogen fertilization), two plots and five replications. The leaves were collected in the phenological phase of floral induction and digitized on a flatbed scanner; this was followed by processing and analysis of the models. ResNet-50 proved to be superior compared to the personalized CNN, achieving accuracy rates of 78% and 48% and AUC of 76%, respectively, increasing classification accuracy by 38.5%. The importance of this technique in different cultures and environments is highlighted to consolidate this approach.

1. Introduction

Strawberry production (Fragaria × ananassa Duch., Rosaceae), worldwide, is led by China and the United States, but Brazil stands out as the 8th largest producer, with production reaching 197 thousand tons [1]. From 2011 to 2021, global acreage grew by 20%, and production increased by 44%. In Brazil, the strawberry area grew to 6.280 ha in the 2022/23 crop year, up from 2.500 ha in 2012 [2]. This rise highlights Brazil’s contribution to the global strawberry production scenario. Investments in research and new technologies have been made to meet this growing demand, with the aim of developing more productive varieties.
Nutritional management plays a fundamental role in crop development, making it a widely studied topic due to its direct influence on increasing productivity and fruit quality. Nitrogen is an essential element for plants, being the main constituent of chlorophyll, which is directly involved in photosynthetic activity. Therefore, the greenness of leaves is determined by the concentration of chlorophyll molecules [3]. Variations in green hues due to foliar nitrogen (N) content can result in class separation in an RGB image bank when it comes to computer vision. Thus, this pigment becomes essential in the context of precision agriculture because it serves as a basis for quantifying foliar N content [4,5,6]. A practical and quick way to determine the existence of nutrient deficiency in plants is through visual diagnosis. However, its accuracy is limited by the experience of the technician and it also requires a significant amount work in generating a prescription map to be used in localized management. As a result, new research is constantly emerging to estimate the ideal nutrient level in crops [7,8].
Several scientific studies and research efforts have highlighted the proven relationship between the concentration of green in the leaves, analyzed through computer vision, and the nitrogen content in plants [9,10,11,12]. In this context, nitrogen exerts a significant influence on plant growth, productivity and soil fertility [13]. Agricultural production, which is essential for global food security, relies largely on synthetic fertilizers that provide this key element [14]. Thus, studies on nitrogen strive to increase its efficiency of use.
With regard to the assessment of the nutritional status of plants, conventional approaches to assessing the nutritional status of plants are generally destructive, labor-intensive and require specific resources [15]. Considering the importance of strawberry cultivation and the need for more accessible, quick and efficient methods to determine nutritional status, there is an interest in the development of more effective methods [16].
In the field of precision agriculture, the application of predictive techniques, such as the use of nutrient sensors in plants, stands out [17], and remote sensing with drones in urban forest management has been developed [18]. In addition, there are approaches based on image processing and artificial intelligence, which stand out for their ability to identify nutritional deficiencies in crops in a non-invasive way. However, it is essential to improve N prediction techniques in order to ensure the necessary accuracy in agricultural decision-making, considering the complexity of the relationships between the availability of this element, plant growth, and fruit quality.
Among the AI (artificial intelligence) tools used for prediction and classification, deep learning has been applied in different areas, presenting satisfactory results in solving various problems. According to Ferentinos et al., [19], this feature refers to the use of artificial neural network architectures with multiple processing layers, distinguishing them from the more superficial approaches of traditional neural networks. Among the former class, the convolutional neural network (CNN) stands out among the deep learning algorithms and is widely used to extract features from images [20,21]. During image processing, CNNs allow the extraction of several characteristics, especially those related to color-based indices, which are relevant to nutritional applications. In the face of the challenge of accurately identifying nitrogen levels and the growing importance of precision agriculture for sustainable development, investing in innovative technologies is essential. Deep learning tools capable of handling RGB images can assist in nitrogen fertilization management in strawberry crops by classifying foliar nutritional status. This approach involves applying CNNs to process images and classify nitrogen levels in plants.
Therefore, the present study aimed to evaluate and compare the performance of two convolutional neural networks in the classification of leaf nitrogen levels in strawberry crops, based on RGB images. The analysis focused on performance metrics of the generated models, aiming to contribute to the advancement of knowledge and the practical implementation of more effective tools in the nutritional management of plantations.

2. Materials and Methods

An experiment was carried out to create an image bank, with strawberry cultivation as its theme. The experiment was carried out from August to December 2022 at the Faculty of Animal Science and Food Engineering (FZEA/USP), with strawberries (Fragaria × ananassa Duch., Rosaceae) of the San Andreas cultivar. The experiment took place in a 100 m2 greenhouse, with climate control provided by an evaporative air system, located at the “Fernando Costa” campus, in Pirassununga. The geographic coordinates of the location are approximately 21°57′25.2″ S, 47°27′13.7″ W, with an average altitude of 610 m above sea level. The region has a CWA climate, with well-defined seasons, one, rainy, from October to March, and the other, dry, from April to September, with an average annual rainfall of 1298 mm and an average temperature of 20.8 °C. The strawberry seedlings were transplanted in October 2022 to 30 pots, comprising three treatments and five replications, as each replication was divided into two plots. The treatments consisted of applying different doses of nitrogen fertilizers as follows: 50% of the recommended fertilization (FR), by Passos et al., 2013 (T1); 100% FR (T2), control; and 150% FR (T3) [22]. This methodology has been used by different researchers [23,24].
The image database was generated and organized to serve as a resource of extractable characteristics for classification, and these characteristics were used as input to the network and their vectors used in the training of computational classifiers based on deep learning methods, having the classes of the different N doses as the output or target attribute of the model.
To obtain parameters for comparison of the model, leaf chemical analysis was performed at the Laboratory of Agrarian/Soil Sciences of the Faculty of Animal Science and Food Engineering of the University of São Paulo, according to the methodology described in the manual of chemical analysis of soils, plants and fertilizers published by EMBRAPA [25].

2.1. Obtaining and Processing the Images

The indicative leaves of strawberries were collected on the third expanded leaf, and were selected for uniformity of age and stage of development in all treatments and replications, to ensure consistency in the comparative analyses. After collection, at the Laboratory of Agricultural Machinery and Precision Agriculture (LAMAP), of the Department of Biosystems Engineering of the University of São Paulo, the leaves were prepared to obtain the images. This step involved removing any excess dust or dirt by using a paper towel. With a high-resolution flatbed scanner (HP Scanjet 3800), the images of the sheets were scanned in RGB (red–green–blue) color, in JPG (Joint Photographic Experts Group) format and with a resolution of 1200 DPI (dots per inch).
Using a script developed in the Matlab© R2021b software, the scanned images of the strawberry leaves were cropped, automatically extracting blocks of 224 × 224 pixels and thus generating an image bank with specific areas of interest [26] for further processing. This procedure aimed to obtain images that would provide an ideal visualization of the patterns generated by the doses on the leaves, as exemplified in Figure 1. The image blocks were scaled to a standardized size, as required in the input of the ResNet architecture models [27].
After the completion of the automatic cropping stage, the manual selection of image blocks was performed to compose the database. During this process, each image block was checked to ensure the quality and integrity of the data to be used. The selection followed specific criteria, requiring that the image of each block be completely filled by a region of the leaf, i.e., without characteristics of visible leaf damage or injury. This approach ensured the presence of only the areas relevant for analysis in each block. In addition, blocks that presented noise, such as white background or dirt on the leaf, were excluded, since such imperfections could interfere with the subsequent classification process. After manual selection, 50 blocks of images were chosen for each vessel, totaling 500 blocks per treatment. With three treatments analyzed, the final dataset consisted of 1500 blocks of images.
With the definition of the dataset, a script was developed in the Matlab© R2021b software to generate the classifier models of the fertilized nitrogen dosage, using two different CNN architectures, one customized and the other based on ResNet-50, respectively, as described in Table 1 and Table 2.
The personalized CNN architecture is designed as a sequential model, with four layers of two-dimensional convolution (2D convolutional) using different numbers and sizes of filters. These layers form the basis of a CNN model, being responsible for extracting characteristics from the input data [28]. In the case of images, convolution layers allow one to learn visual patterns (such as colors, shapes, and textures), from the simplest to the most complex, successively [29]. Using the Rectified Linear Unit activation function in the convolution layers allows you to better deal with non-linearity issues at a lower computing cost [28]. The adoption of rectangular filters (3 × 7 and 7 × 3) in the second and third convolution layers aimed to capture possible vertical and horizontal patterns. Following each convolution layer is a normalization layer (Batch Normalization), which speeds up training, decreases overfitting and optimizes the learning process [30]. After the first and second normalization layers is a subsampling layer (2D MaxPooling), which is used to reduce the dimensionality of the activation maps, saving computing resources while preserving the most relevant data [28]. Finally, there is the output (Fully Connected), or classification layer. The softmax activation function used in this layer transforms its neurons into probabilities assigned to each class, effectively turning the model into a classifier.
The other CNN architecture adopted for this study was based on ResNet-50, as described in Table 2. A convolutional neural network proposed by He et al. [31], it consists of 50 layers, of which 49 are convolutional. Addressing the complexity of deep network training, ResNet-50 introduces the “identity shortcut connection”, allowing one to skip one or more layers to form residual blocks. In addition, to optimize computational efficiency, the ResNet-50 utilizes a “bottleneck design” structure, reducing the number of parameters and operations on each residual block [31].
The ResNet-50 architecture allows the loading of a pre-trained version with more than one million images from the ImageNet database. This makes it possible to classify images into 1000 categories. With an image input of 224 × 224 pixels, this pre-trained neural network provides comprehensive representations for a variety of natural images, allowing you to reuse learned visual patterns in applications involving other categories of images. This technique of reusing learned knowledge, called learning transfer, has become a common practice, as it accelerates the training process, saves computational resources, and helps in the generalization and convergence capacity of new models, being especially useful in situations where the database of the problem addressed is insufficient for learning [32]. Table 2 shows the elements of the 50-layer ResNet architecture.

2.2. Analysis of the Models

To evaluate the reliability of the model, the K-fold cross-validation technique was used, in which the dataset is divided into distinct groups [33]. In this study, we opted for a five-fold cross-validation (K = 5), which entails dividing the dataset into five different groups. Each of these groups served as a test set in five independent iterations. This means that in each iteration, a different group was used for validation, while the other four (or K − 1) were employed for model training. At the end of the five iterations, the average precision was calculated, which then served as the final measure of the model’s performance. During the cross-validation process, 80% of the images were used for training, which is equivalent to 1200 blocks of images. The remaining group, consisting of 20% of the images (300 images) was designated as a validation and test set to evaluate the performance of the model. This training and testing procedure was repeated five times, ensuring that each group would be used once as a test set. This strategy ensures that all images in the dataset are used for both training and testing, providing a more robust and reliable assessment of the model’s performance.
For the model, we took into account the configurations, as shown in Table 3, in training the neural networks in which the hyperparameters are inserted, since they are responsible for defining how the model will be trained, and, consequently, how it will be able to perform the task for which it was designed [34].
For both the personalized convolutional neural network and ResNet-50, the number of epochs used was 10. In a comparative study, Too et al. [35] considered the fine-tuning of deep learning models for plant disease identification, and compared the behaviors for 10 and 30 epochs, observing that ResNet-50 and ResNet 101 work properly with fewer iterations, and, in addition, after fine-tuning, the models using 10 epochs obtained an accuracy above 90%.
Table 4 summarizes the formulas of the performance metrics and their expressions used in the present study.
The area under the curve (AUC) reflects the performance of a classifier, illustrating how the true positive rate (recall/sensitivity) varies as the false positive rate (inverted specificity) changes [36]. This analysis provides insights into the model’s ability to distinguish between classes in different decision-making contexts. Models with an AUC close to 1.0 are considered highly effective in classification tasks [37], thus highlighting the fundamental relevance of this metric in evaluating model performance.

3. Results and Discussion

3.1. Foliar Chemical Analysis

Figure 2 shows the boxplot test for the values of leaf nitrogen concentration in strawberry leaves in the flower induction stage. N concentrations ranged from 19.4 g kg−1 to 33.3 g kg−1. The T1 (50% of the N dose) and T2 (100% of the N dose) treatments exhibit quite similar median and mean values, while the T3 treatment (150% of the N dose) shows a higher trend.

3.2. Analysis of the Models

The confusion matrix evaluates the correspondence between the output predicted by the model and the desired output, and then calculates the classification accuracy for each class in a specific class, thus revealing the strengths and weaknesses of the model [38]. The rating rate using personalized CNN was 48.1%, while for ResNet-50 it was 78.1%. Analysis of the matrices for the personalized CNN and ResNet-50 models, as described in Figure 3, reveals distinct patterns in the classification capacity of the treatments (T1, T2, and T3). For personalized CNN, the performance was not satisfactory in view of the fact that the model got more wrong than it got right. Strategies could be explored to improve the outcome of the model, such as optimizing the hyperparameters, including filter size, number of layers and learning rate [39]. As for ResNet-50, it performed better, as it extracts patterns from more complex spectral features [40]; the rate of correct answers was higher in this model, reaching 78% accuracy. For both networks, T1 was the one with the highest rate of correct answers, with 60.2% and 84.4%, respectively, for the personalized CNN and ResNet-50; this was possibly due to the symptom of nutritional deficiency, expressed as a uniform chlorosis, which allowed the model to classify more assertively.
Table 5 shows the performance of the classifiers in discriminating the different N doses (T1 = 50%, T2 = 100%, and T3 = 150%) in the phenological stage of floral induction based on neural networks. These metrics provide different perspectives on the model’s performance and help in the overall understanding of its effectiveness.
The generated models used 1200 excerpts from the database for training. The customized CNN model achieved a mean accuracy of 48%, an unsatisfactory performance in distinguishing between the 50%, 100% and 150% treatments, as confirmed by the lower recall values and precision values of these classes. Possibly, the personalized CNN had an unsatisfactory performance due to the complexity of the standards expressed by the treatments, making categorization difficult, given this structure and the configuration of the CNN, in addition to the lack of generalization in relation to negative samples.
The best performance in the classification presented was with the use of ResNet-50 for the dose of 50% N, with an accuracy of 84%. For the T2 and T3 treatments, the accuracy, recall and F1-score metrics showed better results than those of the personalized CNN, but they are similar to each other. This suggests that the leaves in these treatments exhibited less variation in color intensity and distribution, making the classification of models more costly.
A comparison of the AUC analyses is shown in Figure 4. First, for the customized CNN, the result was not satisfactory for floral induction, remaining within a range of 0.57 to 0.64, except for T1. As the phenological stage of the plant advances, an increase in leaf chlorosis can be observed due to differences in nitrogen concentration between the treatments. The coloration of the plant’s leaf can be influenced in a variety of ways, depending on the availability of nitrogen. In nitrogen deficiency, leaves tend to become paler, yellowish, or light greenish, due to the reduction in chlorophyll synthesis, which is responsible for the green coloration of leaves, and excess nitrogen can lead to a very dark green color of leaves and excessive vegetative growth [41].
The analysis of the metrics highlighted that ResNet-50 had higher values in all metrics, especially in specificity, ranging from 64% to 69%, while personalized CNN had lower specificity, ranging from 41% to 44%.
The comparison between the architectures revealed that ResNet-50 achieved superior accuracy, standing out for its ability to identify distinct patterns, in contrast to the custom CNN, which had lower performance due to its lower capacity for learning and generalization. These results corroborate the findings of previous studies, such as those of Costa et al. [42], which achieved 86.6% recall when applying ResNet-50 for detection of defects in tomatoes, reinforcing the efficiency of this architecture in predicting adequate fertilization rates in strawberry plants.
The superior classification performance of the model using ResNet-50 may be related to the characteristics presented in this convnet. In this architecture, there are blocks with convolutional layers in sequence and a separate parallel identity layer [43], which can result in a more precise extraction of color or texture features from plant leaf images [44]. In the ResNet-50 used, the technique of transfer learning, combined with pre-training on large datasets, was applied, which conferred an essential generalization capacity for classifying different nitrogen concentrations in strawberry leaves [45]. In addition, the application of residuals to the convolutions, a differential of ResNet-50, allows the network to learn residual differences in the image features, optimizing the model’s training.

4. Conclusions

The study focused on comparing the performance of convolutional neural network architectures in classifying the nitrogen status of strawberry leaves. The results highlighted the better performance of the Resnet-50 architecture compared to the custom CNN in the specific task of classifying nitrogen status in strawberry leaves by handling RGB images. Evaluating the two main performance analysis metrics of the models, it was found that Resnet-50, with total accuracy = 78% and AUC T1 = 0.76, T2 = 0.63 and T3 = 0.61, outperformed the custom CNN with total accuracy = 48% and AUC T1 = 0.96, T2 = 0.90 and T3 = 0.91. An increase of 38.5% was achieved with ResNet-50 when compared to the custom CNN. By offering a more accurate and efficient approach to nutritional status detection, Resnet-50 demonstrated its potential for improving monitoring processes, standing out in this work as an important tool in precision agriculture. Additionally, it is suggested that further studies explore image preprocessing techniques and fine-tuning, such as adjustments to model hyperparameters, regularization and data augmentation techniques, to further optimize the accuracy and effectiveness of the classification model. These initiatives have the potential to elevate Resnet-50 to a new level of performance, consolidating its role as an essential tool in precision agriculture. Thus, this research offers important practical knowledge for the efficient management of agricultural crops, promoting a more sustainable approach to modern agriculture. Finally, further field research involving other crops is recommended for the validation of this approach.

Author Contributions

Conceptualization, J.R.R., T.L.d.S. and E.J.d.S.S.; methodology, J.R.R., T.L.d.S., T.M.G., C.G.F. and E.J.d.S.S.; software, J.R.R., T.L.d.S., M.S.T. and E.J.d.S.S.; validation, J.R.R., T.L.d.S. and M.M.B.; formal analysis, J.R.R., T.L.d.S., M.S.T. and E.J.d.S.S.; resources, J.R.R.; data curation, J.R.R., T.L.d.S., M.S.T. and E.J.d.S.S.; writing—original draft preparation, J.R.R., T.L.d.S., M.S.T. and A.R.B.T.; writing—review and editing, J.R.R., T.L.d.S., M.S.T., E.J.d.S.S., T.M.G. and M.M.B.; visualization, J.R.R., J.L.C., C.G.F. and A.R.B.T.; supervision, J.R.R. and M.M.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Council for Scientific and Technological Development (Conselho Nacional de Desenvolvimento Científico e Tecnológico—CNPQ)—Funding Code 001, by Coordination for the Improvement of Higher Education Personnel (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—CAPES)—Brazil (Funding Code 001) and the Luiz de Queiroz Agricultural Studies Foundation (Fundação de Estudos Agrários Luiz de Queiroz—FEALQ).

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. FAO. World’s Area Harvested and Production Quantity (2021); Faostat—Food and Agriculture Organization of the United Nations: Roma, Italy, 2021. [Google Scholar]
  2. Hernández-Martínez, N.R.; Blanchard, C.; Wells, D.; Salazar-Gutiérrez, M.R. Current State and Future Perspectives of Commercial Strawberry Production: A Review. Sci. Hortic. 2023, 312, 111893. [Google Scholar] [CrossRef]
  3. Zhou, Z.; Struik, P.C.; Gu, J.; van der Putten, P.E.L.; Wang, Z.; Yin, X.; Yang, J. Enhancing Leaf Photosynthesis from Altered Chlorophyll Content Requires Optimal Partitioning of Nitrogen. Crop Environ. 2023, 2, 24–36. [Google Scholar] [CrossRef]
  4. Jamali, M.; Bakhshandeh, E.; Emadi, M. Effects of Water Source and Technology on Energy Use and Environmental Impacts of Rice Production in Northern Iran. Water Resour. Res. 2022, 58, e2021WR031546. [Google Scholar] [CrossRef]
  5. Shah, S.H.; Angel, Y.; Houborg, R.; Ali, S.; McCabe, M.F. A Random Forest Machine Learning Approach for the Retrieval of Leaf Chlorophyll Content in Wheat. Remote Sens. 2019, 11, 920. [Google Scholar] [CrossRef]
  6. Taha, M.F.; Mao, H.; Wang, Y.; ElManawy, A.I.; Elmasry, G.; Wu, L.; Memon, M.S.; Niu, Z.; Huang, T.; Qiu, Z. High-Throughput Analysis of Leaf Chlorophyll Content in Aquaponically Grown Lettuce Using Hyperspectral Reflectance and RGB Images. Plants 2024, 13, 392. [Google Scholar] [CrossRef] [PubMed]
  7. Bakhoum, G.S.; Tawfik, M.M.; Kabesh, M.O.; Sadak, M.S. Potential Role of Algae Extract as a Natural Stimulating for Wheat Production under Reduced Nitrogen Fertilizer Rates and Water Deficit. Biocatal. Agric. Biotechnol. 2023, 51, 102794. [Google Scholar] [CrossRef]
  8. Bakhoum, G.; Sadak, M.; Badr ELSayed, E. Influence of Boron and/or Potassium Accompanied by Two Irrigation Systems on Chickpea Growth, Yield and Quality under Sandy Soil Conditions. Egypt. J. Chem. 2022, 165, 103–117. [Google Scholar] [CrossRef]
  9. Ali, M.M.; Al-Ani, A.; Eamus, D.; Tan, D.K.Y. Leaf Nitrogen Determination Using Non-Destructive Techniques–A Review. J. Plant Nutr. 2017, 40, 928–953. [Google Scholar] [CrossRef]
  10. Bi, K.; Niu, Z.; Xiao, S.; Bai, J.; Sun, G.; Wang, J.; Han, Z.; Gao, S. Non-Destructive Monitoring of Maize Nitrogen Concentration Using a Hyperspectral LiDAR: An Evaluation from Leaf-Level to Plant-Level. Remote Sens. 2021, 13, 5025. [Google Scholar] [CrossRef]
  11. Li, R.; Wang, D.; Zhu, B.; Liu, T.; Sun, C.; Zhang, Z. Estimation of Nitrogen Content in Wheat Using Indices Der-ived from RGB and Thermal Infrared Imaging. Field Crops Res. 2022, 289, 108735. [Google Scholar] [CrossRef]
  12. Zhou, X.; Kono, Y.; Win, A.; Matsui, T.; Tanaka, T.S.T. Predicting Within-Field Variability in Grain Yield and Protein Content of Winter Wheat Using UAV-Based Multispectral Imagery and Machine Learning Approaches. Plant Prod. Sci. 2021, 24, 137–151. [Google Scholar] [CrossRef]
  13. Soilueang, P.; Jaikrasen, K.; Chromkaew, Y.; Buachun, S.; Yimyam, N.; Sanjunthong, W.; Kullachonphuri, S.; Wicharuck, S.; Mawan, N.; Khongdee, N. Dynamics of Soil Nitrogen Availability Following Conversion of Natural Forests to Various Coffee Cropping Systems in Northern Thailand. Heliyon 2023, 9, e22988. [Google Scholar] [CrossRef] [PubMed]
  14. Nyamangara, J.; Kodzwa, J.; Masvaya, E.N.; Soropa, G. The Role of Synthetic Fertilizers in Enhancing Ecosystem Services in Crop Production Systems in Developing Countries. In The Role of Ecosystem Services in Sustainable Food Systems; Academic Press: New York, NY, USA, 2020; pp. 95–117. [Google Scholar] [CrossRef]
  15. Cheng, W.; Sun, D.W.; Pu, H.; Wei, Q. Chemical Spoilage Extent Traceability of Two Kinds of Processed Pork Meats Using One Multispectral System Developed by Hyperspectral Imaging Combined with Effective Variable Selection Methods. Food Chem. 2017, 221, 1989–1996. [Google Scholar] [CrossRef] [PubMed]
  16. Liu, Y.; Li, J. Comparing the Effectiveness of Two Convolutional Neural Networks Methods on Fault Diagnosis. In Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS), Liuzhou, China, 19–21 June 2020; pp. 350–354. [Google Scholar] [CrossRef]
  17. Podar, D.; Maathuis, F.J.M. Primary Nutrient Sensors in Plants. iScience 2022, 25, 104029. [Google Scholar] [CrossRef] [PubMed]
  18. Wavrek, M.T.; Carr, E.; Jean-Philippe, S.; McKinney, M.L. Drone Remote Sensing in Urban Forest Management: A Case Study. Urban For. Urban Green. 2023, 86, 127978. [Google Scholar] [CrossRef]
  19. Ferentinos, K.P. Deep Learning Models for Plant Disease Detection and Diagnosis. Comput. Electron. Agric. 2018, 145, 311–318. [Google Scholar] [CrossRef]
  20. Teng, J.; Zhang, D.; Lee, D.J.; Chou, Y. Recognition of Chinese Food Using Convolutional Neural Network. Multimed. Tools Appl. 2019, 78, 11155–11172. [Google Scholar] [CrossRef]
  21. Shin, J.; Chang, Y.K.; Heung, B.; Nguyen-Quang, T.; Price, G.W.; Al-Mallahi, A. A Deep Learning Approach for RGB Image-Based Powdery Mildew Disease Detection on Strawberry Leaves. Comput. Electron. Agric. 2021, 183, 106042. [Google Scholar] [CrossRef]
  22. Passos, F.; Trani, P. Calagem e Adubação do Morangueiro; Instituto Agronômico (IAC): Botafogo, Brazil, 2013.
  23. Jia, Z.; Zhang, J.; Jiang, W.; Wei, M.; Zhao, L.; Li, G. Different Nitrogen Concentrations Affect Strawberry Seedlings Nitrogen Form Preferences through Nitrogen Assimilation and Metabolic Pathways. Sci. Hortic. 2024, 332, 113236. [Google Scholar] [CrossRef]
  24. Li, Q.; Liu, L.; Zhao, P.; Zhao, Q.; Wu, M.; Liu, J.; Cheng, C.; Li, L. Insights into the Promoting Effects of Water-Soluble Amino Acid Fertilizers on Strawberry Fruit Quality under Nitrogen Reduction Treatment. Sci. Hortic. 2024, 329, 112978. [Google Scholar] [CrossRef]
  25. da Silva, F.C. Manual de Análises Químicas de Solos, Plantas e Fertilizantes; EMBRAPA: Rio de Janeiro, Brazil, 2009; Available online: https://www.infoteca.cnptia.embrapa.br/infoteca/bitstream/doc/330496/1/Manual-de-analises-quimicas-de-solos-plantas-e-fertilizantes-ed02-reimpressao-2014.pdf (accessed on 18 April 2024).
  26. Zaitoun, N.M.; Aqel, M.J. Survey on Image Segmentation Techniques. In Procedia Computer Science; Elsevier: Amsterdam, The Netherlands, 2015; Volume 65, pp. 797–806. [Google Scholar] [CrossRef]
  27. Shaukat, K.; Luo, S.; Varadharajan, V. A Novel Deep Learning-Based Approach for Malware Detection. Eng. Appl. Artif. Intell. 2023, 122, 106030. [Google Scholar] [CrossRef]
  28. Taye, M.M. Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions. Computation 2023, 11, 52. [Google Scholar] [CrossRef]
  29. Yamashita, R.; Nishio, M.; Do, R.K.G.; Togashi, K. Convolutional Neural Networks: An Overview and Application in Radiology. Insights Imaging 2018, 9, 611–629. [Google Scholar] [CrossRef]
  30. Ioffe, S.; Szegedy, C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. PMLR 2015, 37, 448–456. [Google Scholar]
  31. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015. [Google Scholar]
  32. Alzubaidi, L.; Zhang, J.; Humaidi, A.J.; Al-Dujaili, A.; Duan, Y.; Al-Shamma, O.; Santamaría, J.; Fadhel, M.A.; Al-Amidie, M.; Farhan, L. Review of Deep Learning: Concepts, CNN Architectures, Challenges, Applications, Future Directions. J. Big Data 2021, 8, 53. [Google Scholar] [CrossRef]
  33. Arabameri, A.; Blaschke, T.; Pradhan, B.; Pourghasemi, H.R.; Tiefenbacher, J.P.; Bui, D.T. Evaluation of Recent Advanced Soft Computing Techniques for Gully Erosion Susceptibility Mapping: A Comparative Study. Sensors 2020, 20, 335. [Google Scholar] [CrossRef]
  34. Choi, J.H.; Kim, D.; Ko, M.S.; Lee, D.E.; Wi, K.; Lee, H.S. Compressive Strength Prediction of Ternary-Blended Concrete Using Deep Neural Network with Tuned Hyperparameters. J. Build. Eng. 2023, 75, 107004. [Google Scholar] [CrossRef]
  35. Too, E.C.; Yujian, L.; Njuki, S.; Yingchun, L. A Comparative Study of Fine-Tuning Deep Learning Models for Plant Disease Identification. Comput. Electron. Agric. 2019, 161, 272–279. [Google Scholar] [CrossRef]
  36. Harrison, M. Machine Learning—Guia de Referência Rápida: Trabalhando com Dados Estruturados em Python; Novatec Editora: São Paulo, Brazil, 2019; Volume 1. [Google Scholar]
  37. Nawaz, M.; Nazir, T.; Javed, A.; Tawfik Amin, S.; Jeribi, F.; Tahir, A. CoffeeNet: A Deep Learning Approach for Coffee Plant Leaves Diseases Recognition. Expert. Syst. Appl. 2024, 237, 121481. [Google Scholar] [CrossRef]
  38. Kaya, Y.; Gürsoy, E. A Novel Multi-Head CNN Design to Identify Plant Diseases Using the Fusion of RGB Images. Ecol. Inform. 2023, 75, 101998. [Google Scholar] [CrossRef]
  39. Smith, S.; Elsen, E.; De, S. On the Generalization Benefit of Noise in Stochastic Gradient Descent. In Proceedings of the 37th International Conference on Machine Learning, Virtual, 13–18 July 2020; Singh, A.H.D., III, Ed.; Proceedings of Machine Learning Research. PMLR: New York, NY, USA, 2020; Volume 119, pp. 9058–9067. [Google Scholar]
  40. Reddy, S.R.G.; Varma, G.P.S.; Davuluri, R.L. Resnet-Based Modified Red Deer Optimization with DLCNN Classifier for Plant Disease Identification and Classification. Comput. Electr. Eng. 2023, 105, 108492. [Google Scholar] [CrossRef]
  41. Asad, M.A.U.; Guan, X.; Zhou, L.; Qian, Z.; Yan, Z.; Cheng, F. Involvement of Plant Signaling Network and Cell Metabolic Homeostasis in Nitrogen Deficiency-Induced Early Leaf Senescence. Plant Sci. 2023, 336, 111855. [Google Scholar] [CrossRef] [PubMed]
  42. da Costa, A.Z.; Figueroa, H.E.H.; Fracarolli, J.A. Computer Vision Based Detection of External Defects on Tomatoes Using Deep Learning. Biosyst. Eng. 2020, 190, 131–144. [Google Scholar] [CrossRef]
  43. Ramos-Ospina, M.; Gomez, L.; Trujillo, C.; Marulanda-Tobón, A. Deep Transfer Learning for Image Classification of Phosphorus Nutrition States in Individual Maize Leaves. Electronics 2023, 13, 16. [Google Scholar] [CrossRef]
  44. Wan, S.; Chang, S.-H.; Peng, C.-T.; Chen, Y.-K. A Novel Study of Artificial Bee Colony with Clustering Technique on Paddy Rice Image Classification. Arab. J. Geosci. 2017, 10, 215. [Google Scholar] [CrossRef]
  45. Ibarra-Pérez, T.; Jaramillo-Martínez, R.; Correa-Aguado, H.C.; Ndjatchi, C.; Martínez-Blanco, M.d.R.; Guerrero-Osuna, H.A.; Mirelez-Delgado, F.D.; Casas-Flores, J.I.; Reveles-Martínez, R.; Hernández-González, U.A. A Performance Comparison of CNN Models for Bean Phenology Classification Using Transfer Learning Techniques. AgriEngineering 2024, 6, 841–857. [Google Scholar] [CrossRef]
Figure 1. Example of the image bank formed by strawberry leaf cleavage blocks.
Figure 1. Example of the image bank formed by strawberry leaf cleavage blocks.
Agriengineering 06 00102 g001
Figure 2. Foliar concentration of N in strawberry plants at the flower induction stage.
Figure 2. Foliar concentration of N in strawberry plants at the flower induction stage.
Agriengineering 06 00102 g002
Figure 3. Confusion matrix between neural network-based models for classification of nitrogen doses in strawberry floral induction. In green (main diagonal) are the true positives of each class. In salmon, horizontally there are false negatives, and vertically the false positives. In light and dark gray are accuracies and errors by classes and total respectively.
Figure 3. Confusion matrix between neural network-based models for classification of nitrogen doses in strawberry floral induction. In green (main diagonal) are the true positives of each class. In salmon, horizontally there are false negatives, and vertically the false positives. In light and dark gray are accuracies and errors by classes and total respectively.
Agriengineering 06 00102 g003
Figure 4. The AUC curves show the comparisons of the performance of the models as to personalized CNN and ResNet-50.
Figure 4. The AUC curves show the comparisons of the performance of the models as to personalized CNN and ResNet-50.
Agriengineering 06 00102 g004
Table 1. Personalized CNN architecture for leaf nitrogen level prediction.
Table 1. Personalized CNN architecture for leaf nitrogen level prediction.
LayersSettings
2D Convolutional256 filters with size 5 × 5, activation by ReLU
Batch NormalizationDefault
2D MaxPoolingSize pooling = 2 × 2, stride = 2
2D Convolutional128 filters with size 3 × 7, activation by ReLU
Batch NormalizationDefault
2D MaxPoolingSize pooling = 2 × 2, stride = 2
2D Convolutional128 filters with size 7 × 3, activation by ReLU
Batch NormalizationDefault
2D Convolutional32 filters with size 3 × 3, activation by ReLU
Batch NormalizationDefault
Fully Connected3 neurons, activation by softmax
Table 2. CNN ResNet-50 architecture for leaf nitrogen level prediction.
Table 2. CNN ResNet-50 architecture for leaf nitrogen level prediction.
Layer NameOutput Size50 Layers
conv1112 × 1127 × 7, 64, stride 2
conv2_x56 × 563 × 3 max pool, stride 2
1 × 1 ,   64 3 × 3 ,   64 1 × 1 ,   256 × 3
conv3_x28 × 28 1 × 1 ,   128 3 × 3 ,   128 1 × 1 ,   512 × 4
conv4_x14 × 14 1 × 1 ,   256 3 × 3 , 256 1 × 1 , 1024 × 6
conv5_x7 × 7 1 × 1 ,   512 3 × 3 ,   512 1 × 1 ,   2048 × 3
1 × 1Average pool, 3-d fc, softmax
Table 3. Training options used in the convolutional model.
Table 3. Training options used in the convolutional model.
Number of times10
Mini-lot size8
Option for data scramblingevery-epoch
Positive scaling of the initial learning rate0.0001
Table 4. Description of performance evaluation metrics.
Table 4. Description of performance evaluation metrics.
MetricFormulaDescription
Accuracy A c c = T P + T N T P + T N + F P + F N The overall efficiency of a model.
Sensitivity or Recall S e = T P T P + F N The efficiency of a model as to positive samples.
Specificity S p = T N T N + F P The efficiency of a model as to negative samples.
Precision P r e = T P T P + F P The proportion of actual positives out of all positives predicted by the model.
F1-score F 1 s c o r e = 2     P r e     S e P r e + S e The harmonic mean between precision and sensitivity.
G-mean G m e a n = r e c a l l s p e c i f i c i t y Maximum accuracy in each of the classes.
TP: true positive; TN: true negative; FN: false negative; FP: false positive; Pre: accuracy; Se: sensitivity.
Table 5. Personalized CNN convolutional neural networks and ResNet-50 performance metrics.
Table 5. Personalized CNN convolutional neural networks and ResNet-50 performance metrics.
Personalized CNN (%)ResNet-50 (%)
MetricsT1T2T3T1T2T3
Accuracy484848787878
Sensitivity604440847377
Specificity425052758179
Precision343129636564
Recall604440847377
F1-score443634726970
G-mean504746807778
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Regazzo, J.R.; Silva, T.L.d.; Tavares, M.S.; Sardinha, E.J.d.S.; Figueiredo, C.G.; Couto, J.L.; Gomes, T.M.; Tech, A.R.B.; Baesso, M.M. Performance of Neural Networks in the Prediction of Nitrogen Nutrition in Strawberry Plants. AgriEngineering 2024, 6, 1760-1770. https://doi.org/10.3390/agriengineering6020102

AMA Style

Regazzo JR, Silva TLd, Tavares MS, Sardinha EJdS, Figueiredo CG, Couto JL, Gomes TM, Tech ARB, Baesso MM. Performance of Neural Networks in the Prediction of Nitrogen Nutrition in Strawberry Plants. AgriEngineering. 2024; 6(2):1760-1770. https://doi.org/10.3390/agriengineering6020102

Chicago/Turabian Style

Regazzo, Jamile Raquel, Thiago Lima da Silva, Marcos Silva Tavares, Edson José de Souza Sardinha, Caroline Goulart Figueiredo, Júlia Luna Couto, Tamara Maria Gomes, Adriano Rogério Bruno Tech, and Murilo Mesquita Baesso. 2024. "Performance of Neural Networks in the Prediction of Nitrogen Nutrition in Strawberry Plants" AgriEngineering 6, no. 2: 1760-1770. https://doi.org/10.3390/agriengineering6020102

APA Style

Regazzo, J. R., Silva, T. L. d., Tavares, M. S., Sardinha, E. J. d. S., Figueiredo, C. G., Couto, J. L., Gomes, T. M., Tech, A. R. B., & Baesso, M. M. (2024). Performance of Neural Networks in the Prediction of Nitrogen Nutrition in Strawberry Plants. AgriEngineering, 6(2), 1760-1770. https://doi.org/10.3390/agriengineering6020102

Article Metrics

Back to TopTop