Developing Forest Road Recognition Technology Using Deep Learning-Based Image Processing
Abstract
:1. Introduction
2. Materials and Methods
2.1. Image Collection
2.2. Image Dataset Composition and Annotation
2.3. YOLOv8 Segmentation
2.4. Deep Learning Training
2.5. Deep Learning Evaluation Methods
- = the number of true positives (correct detections);
- = the number of true negatives (correct rejection);
- = the number of false positives (false detection);
- = the number of false negatives (miss);
- = the number of classes or categories, and;
- = APi is the average precision (AP) for class i.
2.6. Image-Based Forest Road Center Extraction Algorithm
3. Results
3.1. Results of the Trained YOLOv8-Based Model
3.2. Results of the Image-Based Forest Road Center Extraction Algorithm
3.3. Verification of Image-Based Forest Road Center-Extraction Algorithm
4. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Marchi, E.; Chung, W.; Visser, R.; Abbas, D.; Nordfjell, T.; Mederski, P.S.; McEwan, A.; Brink, M.; Laschi, A. Sustainable Forest Operations (SFO): A New Paradigm in a Changing World and Climate. Sci. Total Environ. 2018, 634, 1385–1397. [Google Scholar] [CrossRef] [PubMed]
- Higman, S.; Mayer, J.; Bajo, E.; Judd, N.; Nusbaum, R. Manual de Silvicultura Sostenible Una Guía Práctica Para Administradores de Bosques Tropicales Sobre La Implementación de Nuevos Estándares; Earthscan Publ.: London, UK, 2005; ISBN 9781844071180. [Google Scholar]
- Klenner, W.; Arsenault, A.; Brockerhoff, E.G.; Vyse, A. Biodiversity in Forest Ecosystems and Landscapes: A Conference to Discuss Future Directions in Biodiversity Management for Sustainable Forestry. For. Ecol. Manag. 2009, 258, S1–S4. [Google Scholar] [CrossRef]
- Karlsson, L.; Bergsten, U.; Ulvcrona, T.; Elfving, B. Long-Term Effects on Growth and Yield of Corridor Thinning in Young Pinus Sylvestris Stands. Scand. J. For. Res. 2013, 28, 28–37. [Google Scholar] [CrossRef]
- Schweier, J.; Magagnotti, N.; Labelle, E.R.; Athanassiadis, D. Sustainability Impact Assessment of Forest Operations: A Review. Curr. For. Rep. 2019, 5, 101–113. [Google Scholar] [CrossRef]
- Schulze, E.D.; Bouriaud, O.; Irslinger, R.; Valentini, R. The Role of Wood Harvest from Sustainably Managed Forests in the Carbon Cycle. Ann. For. Sci. 2022, 79, 17. [Google Scholar] [CrossRef]
- Billingsley, J.; Visala, A.; Dunn, M. Robotics in Agriculture and Forestry. In Springer Handbook of Robotics; Springer: Berlin/Heidelberg, Germany, 2008; pp. 1065–1077. [Google Scholar] [CrossRef]
- Hellström, T.; Lärkeryd, P.; Nordfjell, T.; Ringdahl, O. Autonomous Forest Vehicles: Historic, Envisioned, and State-of-the-Art. Int. J. For. Eng. 2009, 20, 31–38. [Google Scholar] [CrossRef]
- Visser, R.; Obi, O.F. Automation and Robotics in Forest Harvesting Operations: Identifying near-Term Opportunities. Croat. J. For. Eng. 2021, 42, 13–24. [Google Scholar] [CrossRef]
- La Hera, P.; Mendoza-Trejo, O.; Lindroos, O.; Lideskog, H.; Lindbäck, T.; Latif, S.; Li, S.; Karlberg, M. Exploring the Feasibility of Autonomous Forestry Operations: Results from the First Experimental Unmanned Machine. J. Field Robot. 2024, 41, 942–965. [Google Scholar] [CrossRef]
- Lei, G.; Yao, R.; Zhao, Y.; Zheng, Y. Detection and Modeling of Unstructured Roads in Forest Areas Based on Visual-2D Lidar Data Fusion. Forests 2021, 12, 820. [Google Scholar] [CrossRef]
- Nakagomi, H.; Fuse, Y.; Nagata, Y.; Hosaka, H.; Miyamoto, H.; Yokozuka, M.; Kamimura, A.; Watanabe, H.; Tanzawa, T.; Kotani, S. Forest Road Surface Detection Using LiDAR-SLAM and U-Net. In Proceedings of the 2021 IEEE/SICE International Symposium on System Integration, SII 2021, Iwaki, Fukushima, Japan, 11–14 January 2021; pp. 727–732. [Google Scholar] [CrossRef]
- Çalışkan, E.; Sevim, Y. Forest Road Detection Using Deep Learning Models. Geocarto Int. 2022, 37, 5875–5890. [Google Scholar] [CrossRef]
- Buján, S.; Guerra-Hernández, J.; González-Ferreiro, E.; Miranda, D. Forest Road Detection Using LiDAR Data and Hybrid Classification. Remote Sens. 2021, 13, 393. [Google Scholar] [CrossRef]
- Dabbiru, L.; Sharma, S.; Goodin, C.; Ozier, S.; Hudson, C.R.; Carruth, D.W.; Doude, M.; Mason, G.; Ball, J.E. Traversability Mapping in Off-Road Environment Using Semantic Segmentation. In Proceedings of the Autonomous Systems: Sensors, Processing, and Security for Vehicles and Infrastructure 2021, Online, 12–17 April 2021; Volume 11748, pp. 78–83. [Google Scholar] [CrossRef]
- Guimarães, P.P.; Arce, J.E.; Lopes, E.d.S.; Fiedler, N.C.; Robert, R.C.G.; Seixas, F. Analysis of Fuel Consumption Sensitivity in Forestry Road Transport. Floresta 2019, 49, 155–162. [Google Scholar] [CrossRef]
- Venanzi, R.; Latterini, F.; Civitarese, V.; Picchio, R. Recent Applications of Smart Technologies for Monitoring the Sustainability of Forest Operations. Forests 2023, 14, 1503. [Google Scholar] [CrossRef]
- Yakovenko, N.; Guseynova, N.; Kolotushkin, A. A Forest Management System Based on Sustainable Development. BIO Web Conf. 2024, 93, 01008. [Google Scholar] [CrossRef]
- Abdelsalam, A.; Happonen, A.; Karha, K.; Kapitonov, A.; Porras, J. Towards Autonomous Vehicles and Machinery in Mill Yards of the Forest Industry: Technologies and Proposals for Autonomous Vehicle Operations. IEEE Access 2022, 10, 88234–88250. [Google Scholar] [CrossRef]
- Hellström, T.; Johansson, T.; Ringdahl, O. Development of an Autonomous Forest Machine for Path Tracking. In Springer Tracts in Advanced Robotics; Springer: Berlin/Heidelberg, Germany, 2006; Volume 25, pp. 603–614. [Google Scholar] [CrossRef]
- Leidenfrost, H.T.; Tate, T.T.; Canning, J.R.; Anderson, M.J.; Soule, T.; Edwards, D.B.; Frenzel, J.F. Autonomous navigation of forest trails by an industrial-size robot. Trans. ASABE 2013, 56, 1273–1290. [Google Scholar]
- Fleischmann, P.; Kneip, J.; Berns, K. An Adaptive Detection Approach for Autonomous Forest Path Following Using Stereo Vision. In Proceedings of the 2016 14th International Conference on Control, Automation, Robotics and Vision, ICARCV 2016, Phuket, Thailand, 13–15 November 2016. [Google Scholar] [CrossRef]
- Etezadi, H.; Eshkabilov, S. A Comprehensive Overview of Control Algorithms, Sensors, Actuators, and Communication Tools of Autonomous All-Terrain Vehicles in Agriculture. Agriculture 2024, 14, 163. [Google Scholar] [CrossRef]
- Guimarães, N.; Pádua, L.; Marques, P.; Silva, N.; Peres, E.; Sousa, J.J. Forestry Remote Sensing from Unmanned Aerial Vehicles: A Review Focusing on the Data, Processing and Potentialities. Remote Sens. 2020, 12, 1046. [Google Scholar] [CrossRef]
- Archana, R.; Jeevaraj, P.S.E. Deep Learning Models for Digital Image Processing: A Review. Artif. Intell. Rev. 2024, 57, 11. [Google Scholar] [CrossRef]
- Dutta, A.; Zisserman, A. The VIA Annotation Software for Images, Audio and Video. In Proceedings of the MM 2019-Proceedings of the 27th ACM International Conference on Multimedia, Nice, France, 21–25 October 2019; pp. 2276–2279. [Google Scholar] [CrossRef]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You Only Look Once: Unified, Real-Time Object Detection. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 779–788. [Google Scholar] [CrossRef]
- Terven, J.; Córdova-Esparza, D.M.; Romero-González, J.A. A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS. Mach. Learn. Knowl. Extr. 2023, 5, 1680–1716. [Google Scholar] [CrossRef]
- What Is YOLOv8? The Ultimate Guide. 2024. Available online: https://blog.roboflow.com/whats-new-in-yolov8/ (accessed on 1 July 2024).
- Wang, C.Y.; Mark Liao, H.Y.; Wu, Y.H.; Chen, P.Y.; Hsieh, J.W.; Yeh, I.H. CSPNet: A New Backbone That Can Enhance Learning Capability of CNN. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 14–19 June 2020; pp. 1571–1580. [Google Scholar] [CrossRef]
- Giusti, A.; Guzzi, J.; Cireşan, D.C.; He, F.-L.; Rodríguez, J.P.; Fontana, F.; Faessler, M.; Forster, C.; Schmidhuber, J.; Di Caro, G.; et al. A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots. IEEE Robot. Autom. Lett. 2015, 1, 661–667. [Google Scholar] [CrossRef]
Image Collection Dates | Meteorological Conditions | ||
---|---|---|---|
Temperature (°C) | Humidity (%) | Average Cloud Cover (1/10) | |
11 September 2023 | 26.2 | 76 | 7 |
13 September 2023 | 25.9 | 91 | 3 |
16 October 2023 | 25.9 | 62 | 0 |
Hardware | Type |
---|---|
CPU | AMD Ryzen 7 3700X @ 3.6 GHz × 16 |
Memory | 64 GB |
GPU | NVIDIA GeForce RTX2080 Ti × 2 |
Approach | Precision | Recall | F1-Score | mAP |
---|---|---|---|---|
YOLOv8 | 0.966 | 0.917 | 0.941 | 0.963 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Lee, H.-S.; Kim, G.-H.; Ju, H.S.; Mun, H.-S.; Oh, J.-H.; Shin, B.-S. Developing Forest Road Recognition Technology Using Deep Learning-Based Image Processing. Forests 2024, 15, 1469. https://doi.org/10.3390/f15081469
Lee H-S, Kim G-H, Ju HS, Mun H-S, Oh J-H, Shin B-S. Developing Forest Road Recognition Technology Using Deep Learning-Based Image Processing. Forests. 2024; 15(8):1469. https://doi.org/10.3390/f15081469
Chicago/Turabian StyleLee, Hyeon-Seung, Gyun-Hyung Kim, Hong Sik Ju, Ho-Seong Mun, Jae-Heun Oh, and Beom-Soo Shin. 2024. "Developing Forest Road Recognition Technology Using Deep Learning-Based Image Processing" Forests 15, no. 8: 1469. https://doi.org/10.3390/f15081469