Next Article in Journal
Socio-Spatial ‘Tabula Rasa’ and Punctual Preservation: The Case Study of Measurable Compensation in Lijiao Village
Next Article in Special Issue
Input–Output Efficiency of the Beijing–Tianjin Sandstorm Source Control Project and Influencing Factors
Previous Article in Journal
Influencing Factors in MOOCs Adoption in Higher Education: A Meta-Analytic Path Analysis
Previous Article in Special Issue
GEF Innovative Forest Management Plan—Taking Grassland Forest Farm in Fengning County as an Example
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Classification of Transmission Line Corridor Tree Species Based on Drone Data and Machine Learning

1
College of Forestry, Beijing Forestry University, Beijing 100083, China
2
Beijing Key Laboratory of Precision Forestry, Beijing Forestry University, Beijing 100083, China
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(14), 8273; https://doi.org/10.3390/su14148273
Submission received: 8 May 2022 / Revised: 28 May 2022 / Accepted: 7 June 2022 / Published: 6 July 2022
(This article belongs to the Special Issue Managing Forest and Plant Resources for Sustainable Development)

Abstract

:
Tree growth in power line corridors poses a threat to power lines and requires regular inspections. In order to achieve sustainable and intelligent management of transmission line corridor forests, a transmission line corridor tree barrier management system is needed, and tree species classification is an important part of this. In order to accurately identify tree species in transmission line corridors, this study combines airborne LiDAR (light detection and ranging) point-cloud data and synchronously acquired high-resolution aerial image data to classify tree species. First, individual-tree segmentation and feature extraction are performed. Then, the random forest (RF) algorithm is used to sort and filter the feature importance. Finally, two non-parametric classification algorithms, RF and support vector machine (SVM), are selected, and 12 classification schemes are designed to perform tree species classification and accuracy evaluation research. The results show that after using RF for feature filtering, the classification results are better than those without feature filtering, and the overall accuracy can be improved by 3.655% on average. The highest classification accuracy is achieved when using SVM after combining a digital orthorectification map (DOM) and LiDAR for feature filtering, with an overall accuracy of 85.16% and a kappa coefficient of 0.79.

1. Introduction

Excessive growth of trees around the transmission line corridor tends to obstruct transmission lines. Therefore, trees that grow to a height that threatens transmission lines need to be regularly inspected and removed [1]. In order to achieve sustainable and smart management of forests in transmission line corridors, trees in transmission line corridors are not cut down all at once, but systematically through the establishment of a transmission line corridor tree barrier management system. By inputting tree obstruction information into the information base, a model of tree growth is created to facilitate inquiries about tree obstruction hazards, so that planned felling can be developed. Therefore, it is important to know the tree species. With the continuous development of remote-sensing technology, tree species classification has also been applied to transmission line corridors. However, most of the data sources used in the research on tree species classification of transmission line corridors are single data sources [2], and the classification accuracy is not sufficient to effectively prevent hidden dangers caused by trees in these corridors. The classification of tree species based on multi-source remote sensing has advantages in other fields [3,4,5,6,7], so this study considers using multi-source unoccupied aerial vehicle (UAV) data to classify tree species in transmission line corridors to improve classification accuracy.
Machine learning (ML) algorithms can be used to solve the non-linear sample classification problem of tree species classification. Many scholars have used ML to identify or classify tree species [8,9,10,11]. For instance, Franklin et al. [12] used the multi-spectral data obtained by drones combined with ML algorithms to classify deciduous tree species, with an overall classification accuracy of 78%. Ahmed et al. [13] placed three multispectral cameras on a UAV and used the acquired data to identify Sequoia; the results showed that the identification accuracy was as high as 89%. Chan et al. [14] compared the classification accuracy of different classification algorithms based on hyperspectral data, and the results showed that the classification accuracy of AdaBoost classification and random forest (RF) classification algorithm was almost the same (close to 70%); the difference was less than 1%, which was higher than that of the neural network classifier that has an overall accuracy of 63.7%. Puttonen et al. [15] collected LiDAR data and hyperspectral data at the same time based on the Sensei system of the Finnish Geodetic Institute to classify coniferous and broad-leaved species. The results show that the classification accuracy using only spectral features was 90.5%, while the overall accuracy of classification combined with spectral and structural features reached 95.8%. Considering airborne hyperspectral and LiDAR data obtained at the same time and the support vector machine (SVM) classifier, Liu Yijun et al. [16] classified the dominant tree species in the Pu’er Mountain experimental area forest. The results showed that the overall accuracy of the fusion data classification reached 80.54%, compared with only using spectral information. In summary, the preceding research shows that using multi-source remote-sensing data combined with ML can enable effective identification of tree species. In the past, studies on tree species classification used remote-sensing images with a low-resolution rate, and most of them used a single data source. However, using multiple remote-sensing data sources and ML algorithms to classify tree species represents a research hotspot [2,17,18,19,20]. In addition, relatively few studies have been conducted on the classification of tree species in transmission line corridors.
Accurate spatial information on tree species is essential for forestry management and is crucial for sustainable management of forest resources and effective monitoring of species diversity, which can help solve a wide variety of application problems faced by forestry management. In this study, experiments were conducted to address the issue of how to improve the accuracy and efficiency of forest species classification using remote sensing technology. On the one hand, the complementary effect of the superior features of airborne LiDAR point clouds and DOMs (digital orthophoto maps) is realized, and the classification accuracy of woody species is improved by feature screening. In addition, various classification methods are analyzed and compared, which has important theoretical significance. On the other hand, this helps to obtain finer tree species information of the transmission channel more accurately and quickly and provides a reference basis for the tree obstacle potential management system. It is of great practical significance for establishing tree growth models, as well as querying and timely cleaning of tree barrier hazards in transmission line corridors.
This study fully utilizes the advantages of machine classification algorithms in high-dimensional feature classification and solves the problem of low classification accuracy of tree species in transmission line corridors. First, the vertical information provided by the LiDAR data and the horizontal information provided by the DOM are combined to segment the canopy and extract the canopy features. Then, the RF algorithm is used in feature selection. Finally, the RF and SVM algorithms are used to classify tree species, and the high-precision classification of tree species in the transmission line corridor is achieved.

2. Materials and Methods

2.1. Study Area

The study area is located in the northeastern part of Chizhou city, Anhui Province, with an altitude between 1.8 m and 112.2 m. The geographical position is 117°46′–117°56′ east longitude and 30°39′–30°41′ north latitude. It has a warm and humid subtropical monsoon climate with four distinct seasons, sufficient rainfall, annual average temperature of 16.5 °C, annual average precipitation of 1400–2200 mm, a long period of sunshine, a short frost-free period, and approximately 40 rainy days. The study area is rich in vegetation types. The dominant tree species include broad-leaved tree species such as fir, bamboo, maple, and oak, mainly in middle-aged and mature forests. The specific location of the study area is shown in Figure 1.

2.2. Aerial Image and LiDAR Data

The data used in this study include airborne LiDAR point-cloud data and synchronized high-resolution digital orthophotos. The flight time was June 2016, under clear weather conditions with good visibility. The airborne LiDAR point-cloud data were collected using the Optech ALTM Galaxy system. The parameters are shown in Table 1. The downlink channel of one of the towers in the study area was selected as the test area. The original LiDAR point-cloud data and orthophotos of the specific study area are shown in Figure 2 and Supplementary Materials File S1.

2.3. Methods

This study combines the horizontal characteristics of the DOM and the vertical characteristics of LiDAR data and selects ML algorithms to classify the tree species around the transmission line corridor. The main steps are as follows: (1) LiDAR point-cloud data are used to generate a CHM (canopy height model). (2) The watershed algorithm is used in CHM-based single wood segmentation. (3) The RF algorithm is used to select the best feature combination for individual-tree species classification and analyze and compare the impact of feature se-lection on tree species classification. (4) A classification scheme is designed, the effect of multi-source UAV data in individual-tree species classification is studied, and the ability of different non-parametric learning algorithms is evaluated to classify tree species at the individual tree level. The technical process is shown in Figure 3.

2.3.1. Data Preprocessing

In this study, the LiDAR point cloud data are already classified point clouds. The point clouds of extraneous objects on the ground such as transmission lines and tower bases are removed before the segmentation of individual tree canopies is performed. Only vegetation points and ground points in the point cloud are retained. The ground points in the classified point cloud data are used as feature points to perform interpolation operations to construct a DEM. The first echo points of vegetation points are interpolated, and the difference operation is performed to construct a DSM. The interpolation method uses Triangulation Irregular Network Interpolation (TIN), which constructs triangles from a series of points. The advantage of the TIN method is its ability to preserve surface details in topographically complex areas. The difference operation is performed on the generated DSM and DEM raster data to obtain the canopy height model after elevation normalization. There are black or gray invalid holes in the original CHM caused by abnormal changes in height, which will affect tree vertex detection and tree crown sketching. In this study, the median filter in the smoothing filter is selected for smoothing, a new CHM is generated, and the invalid value of the optimized CHM image is filled.

2.3.2. Individual-Tree Canopy Segmentation

Before individual-tree canopy segmentation, point clouds of irrelevant objects on the ground such as transmission lines and tower bases are removed, and only vegetation points and ground points in the point cloud are retained, thus improving the accuracy of tree segmentation.
Watershed segmentation algorithm is a mathematical morphology segmentation method based on topology theory proposed by Vincent [21]. This algorithm considers image segmentation according to the composition of the watershed and has a good response to weak edges. It is one of the most common segmentation methods. In this paper, the watershed segmentation algorithm is used to segment the single tree canopy for CHM, the Gaussian smoothing factor is 1, and the smoothing window used is 5 × 5.

2.3.3. Feature Extraction

In this study, three types of features are extracted based on DOM: spectral, textural, and geometric features. Thereafter, point cloud and CHM features are extracted based on LIDAR point clouds. The detailed list is shown in Table 2, Table 3, Table 4, Table 5 and Table 6.

2.3.4. Feature Selection Based on the RF Algorithm

A large number of features bring about the problem of redundancy. Even a classifier that is not sensitive to dimensionality decreases the classification accuracy, and feature screening can solve this problem [22]. This study selects the RF algorithm for feature screening because the RF algorithm can sort the importance of variables before classification [23]. The most important features to participate in the classification must be retained to solve the problem of excessive original features. The specific steps are the following:
First, the Gini index is calculated for each node k in each tree:
G k = 2 p k ^ ( 1 p k ^ )
G k represents the Gini index at node k. p k ^ represents the estimated value of the probability that the sample belongs to any class at node k.
The importance of a node is determined by the amount of change in the Gini index before and after the node is split:
I Δ k = G k G k 1 G k 2
G k 1 and G k 2 represent the child nodes generated by G k . For each tree in the forest, the preceding criteria are used to recursively generate I Δ k .
Finally, samples and variables are randomly selected to generate a forest. It is assumed that the forest produces a total of T trees.
In the forest, if the variable X i appears M times in the t-th tree, then the importance of the variable X i in the t-th tree is
I i t = j = 1 M I Δ j
Then, the variable importance of X i in the entire forest is
I i = 1 n t = 1 T I i t
Finally, the variables are selected according to the importance of the variables.

2.3.5. Tree Species Classification Based on Machine Learning

According to field survey data, the main tree species in the study area are paulownia, oak, fir, moso bamboo, maple poplar, and others. The final classification system is divided into four categories, namely, paulownia, oak, fir, and other tree species (including bamboo, maple poplar, shrubs, and other relatively small tree species).
The RF algorithm integrates a large number of trees into a forest, avoiding the one-sidedness and inaccuracy caused by the classification of a single decision tree, while the SVM does not require large samples and has great advantages in high-dimensional feature recognition. Therefore, this study applies RF and SVM in tree species classification.
The main steps of RF-based tree species classification are the following: (1) Random samples are created. Each time with replacement, n samples are drawn from the original sample set, and k extractions are performed in total. (2) A decision tree is established. In each process of generating a decision tree, from the D features in the feature space, d (d < D) features are selected to form a new feature set, and the new feature set is used to generate a decision tree. (3) The generated k decision trees are combined, and the classification results of multiple decision trees are selected to obtain the final classification category.
The tree species classification process based on SVM is transforms the non-linear sample space into a linear space through the kernel function to realize the division of samples. In this study, the kernel function chooses the radial basis function [24], which is expressed as
k x , x i = exp x x i 2 δ 2
In the formula, x and x i refer to the unknown vector and the support vector, respectively, and δ is the width of the function.
Based on the segmented image objects and the extracted features, 12 combinations are formed. These twelve combination schemes are shown in Table 7. When DOM is used, schemes I and II are unfeatured screening that use RF and SVM classifiers, respectively, whereas schemes III and IV are featured screening that use RF and SVM classifiers, respectively, after selection. When LiDAR is used, schemes Ⅴ and Ⅵ are unfeatured screening that use RF and SVM classifiers, respectively, whereas schemes Ⅶ and Ⅷ are featured screening that use RF and SVM classifiers, respectively, after selection. When LiDAR and DOM are used, schemes Ⅸ and Ⅹ are unfeatured screening that use RF and SVM classifiers, respectively, whereas schemes Ⅺ and Ⅻ are featured screening that use RF and SVM classifiers, respectively, after selection.

2.3.6. Accuracy Evaluation Indicators

In this study, stratified sampling is used to randomly select 40% of the data from each tree species for inspection. A total of 232 training samples and 155 test samples are available in the sample plots.
After obtaining the tree species classification results of different schemes, we need to verify the correctness to evaluate the effect of the individual-tree species classification of each scheme. The stratified sampling method is adopted, and the verification samples are selected through a combination of field investigation and visual interpretation. Constructing a confusion matrix is a common method to quantify classification accuracy [25]. In addition, MAE is selected for metrics in this study [26,27,28]. The indicators used to measure are shown in Table 8.
x i i is the number of samples that were correctly classified. x i + is the total number of samples classified into class i. x + i is the total number of samples in class i in the reference samples. r is the total number of classes. N denotes the total number of samples drawn. y i is the actual expected output, and y i ^ is the model prediction.

3. Results

3.1. Optimized CHM Extraction Results

Due to the small canopy width, the use of a 3 × 3 filter window can retain the original information to the greatest extent. This study uses a 3 × 3 filter window to perform median smoothing filtering of the original CHM raster data. Comparing the local effect map of the median filter algorithm (Figure 4), we find many discontinuously distributed low values at the edge of the canopy in the original image. The image after median filtering is smoother, and invalid values in the image can also be removed effectively. Therefore, the median filter is selected to smooth the CHM data to reduce the impact of invalid values on accuracy. As shown in the final canopy height model in Figure 5, as the height of the canopy increases, and the image shows a brightness change from black to white. Figure 4b shows a partial demonstration of Figure 5.

3.2. Individual Tree Segmentation Results

The optimized CHM is segmented by the watershed segmentation algorithm. In combination with the field survey, the optimized results of partial tree crown segmentation and selected samples are shown in Figure 6.

3.3. Feature Screening Results

In this study, the RF algorithm is used to sort and filter the importance of a feature set composed of five types of 160 features based on DOM and LiDAR point-cloud data extraction. In total, 15 and 13 features were retained by RF screening when using only LiDAR and DOM, respectively, and 18 features were retained by feature screening after combining the two types of data. The ranking of the importance of the features retained after screening is shown in Figure 7. Analysis of feature importance revealed that the spectral mean and standard deviation scores for each band in the spectral features were the most stable and contributed the most, whether the classification was performed using only DOM or DOM combined with LiDAR. The texture features also have important contributions in the classification, where the contrast and correlation are the top ranked features in importance among the texture features. In the combination of DOM and LiDAR, point-cloud features, CHM features and geometric features all have more important roles in the classification.

3.4. Classification Results and Accuracy Evaluation of Individual Tree Species

According to the results of the previous individual tree crown segmentation and feature extraction, the individual tree species are classified based on the designed four schemes, and the classification algorithm is implemented using Python. Samples are selected through a combination of field investigation and visual interpretation. Then, 60% of the data are selected as the training set for training the model, and 40% of the verification data are used to test the model reliability. After the tree species classification results are obtained, the test samples are selected to evaluate the accuracy of the results, and the best classification scheme is determined after analysis and comparison. The classification accuracy is shown in Table 9. The results of classifying trees according to the scheme 12 with the highest overall accuracy are shown in Figure 8.

3.5. Results Analysis

Analysis of the accuracy of the scenarios based on the data in Table 9 shows that:
(1)
When using DOM only, scheme Ⅲ had the highest classification accuracy with an overall accuracy of 79,35%, Kappa coefficient of 0.71, and MAE of 0.29. After feature selection, the accuracy of both classifiers improved. The classification schemes with feature selection improved the accuracy of classification using RF and SVM by 5.16% and 1.93%, respectively, compared to the schemes without feature selection.
(2)
When using LiDAR only, none of the classification results of schemes Ⅴ–Ⅷ were very good, and none of the overall accuracies reached 55%. For this study area, the effect of using LiDAR only for tree species classification was not satisfactory.
(3)
When using the combination of DOM and LiDAR for classification, scheme 12 had the best classification results, with an overall accuracy of 85.16% and a Kappa coefficient of 0.79. The accuracy of classification using RF and SVM improved by 3.23% and 6.45%, respectively, after feature selection compared to that in the scheme without feature selection.
(4)
In terms of tree species, Paulownia was more affected by feature selection, and in most cases, PA, UA improved after feature selection. Oak and fir were more affected by feature selection when LiDAR and DOM were combined for classification, and there was a significant improvement in PA and UA. The classification accuracy of other tree species was not ideal due to more internal species, and it may be necessary to classify other tree species into several more detailed categories in order to improve the accuracy.

4. Discussion

4.1. The Impact of Feature Screening on Classification

Feature screening is very important for classification research. Feature screening can reduce multicollinearity among features and improve computational efficiency and classification accuracy. The results show that the accuracy and Kappa coefficient of RF and SVM classification improved after feature screening, and RF feature screening achieved good results in both RF and SVM classification. Therefore, the RF signature screening is reliable. Using multispectral and LiDAR data for classification, Pham et al. [29] explored the role of RF signature screening for classification. When the multi-source data were combined, the AO after RF screening reached 85.4%, and the Kappa coefficient was 0.81, which were 0.05 and 0.07 higher than those without feature screening, which is very similar to the results of this study.

4.2. The Impact of the Classification Algorithm on the Accuracy

For this study, when DOM was combined with LiDAR for classification, the SVM algorithm was more accurate after feature filtering. This may be because the SVM model can solve high-dimensional problems well and is better for machine learning in the case of small samples. The RF algorithm has been shown to overfit in some noisy classification or regression problems.

4.3. Contribution of Different Features to Classification

When DOM was combined with LiDAR for classification, intensity and height features were extracted from LiDAR, spectral and texture features are extracted from DOM, and the performance of these features was evaluated. The results show that the spectral features contributed the most to the classification. Among them, the green band was very important in distinguishing tree species, probably because of the different pigment contents of different tree species; the contents of chlorophyll, carotenoid, anthocyanin, and lutein are closely related to the reflectance of the green band. Texture features also contributed greatly, such as the contrast and correlation within the convolution kernel. Texture features are global features that can describe the surface properties of the scene corresponding to the image area, so they have great potential for classification. The LiDAR point cloud features provided three-dimensional information of trees for classification. The first echo intensity features and height features of LiDAR data were sensitive to canopy conditions, well represented the tree canopy structure and morphological features, and contributed greatly to tree species classification.

4.4. Effect of Observation Season on the Classification Accuracy

Huaipeng Liu [30] classified urban tree species based on four seasons of RedEdge-MX data, and the results showed that among the four seasons of the year, the classification of tree species based on spring data was the best. The accuracy of tree species classification can be improved by combining data from two, three, and four seasons. Other studies on tree species classification were conducted in summer or autumn and also achieved good accuracy, very similar to the results of the present study [31,32]. In future studies, more data from different periods will be applied to the study of tree species classification so that the relationship between seasons and the accuracy of tree species classification can be discussed in more depth.

5. Conclusions

To solve the problem of tree species classification in transmission line corridors, this study used multi-source UAV data and ML methods to effectively overcome the problem of low tree species classification accuracy and realized the extraction and classification of individual trees in transmission line corridors. The results show that feature selection is an important task in classification research on tree species. After feature screening, the accuracy and kappa coefficient of RF and SVM classification improved. Thus, RF feature screening achieved good results in both RF and SVM classification, which shows that this type of feature screening is reliable.
During the experiment, the extraction of features was the most important, and the contribution of various features to the classification results was different. The research results show that spectral features contributed the most to classification. In addition, texture features played a very important role in classification, such as the correlation and contrast in the convolution kernel of the green band and blue band. The features extracted from LiDAR data were used to supplement the 3D information of the individual tree and were also indispensable in the classification. The research results show that the first echo intensity feature and height feature of LiDAR data also had a high contribution to the classification. In future research, more data sources will be selected to achieve large combinations so that more effective features can be extracted to distinguish tree species. This will provide important information for the establishment of an intelligent early warning system for tree barriers in transmission line corridor areas, thus enabling sustainable management of forest resources and effective monitoring of species diversity in these corridors.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/su14148273/s1, File S1: Data.

Author Contributions

Conceptualization, X.L. and R.W.; methodology, X.L.; software, X.L.; validation, X.L., R.W. and X.C.; formal analysis, X.L.; investigation, X.L., X.C., Y.L. and Y.D.; resources, R.W.; data curation, Y.L. and Y.D.; writing-original draft preparation, X.L.; writing-review and editing, X.L.; visualization, X.C. and Y.L.; supervision, R.W.; project administration, R.W.; funding acquisition, R.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China: ‘biomass precision estimation model research for large-scale region based on multi-view heterogeneous stereographic image pair of forest’ (Grant No. 41971376).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We acknowledge the financial support from the National Natural Science Foundation of China: ‘biomass precision estimation model research for large-scale region based on multi-view heterogeneous stereographic image pair of forest’ (Grant No. 41971376). We are sincerely grateful for the efforts of Ruirui Wang, Xingwang Chen, Yiran Li, Yunshan Duan, and other colleagues for their help in field and laboratory studies.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chao, M. Research on Feature Extraction Method of Power Line Corridor Based on Multiple Remote Sensing Data; WuHan University: Wuhan, China, 2010. [Google Scholar]
  2. Hao, G.; Xuefeng, Z.; Zandong, Z.; Shengqiang, Z. Transmission line corridor scene classification based on high-resolution remote sensing images. J. Wuhan Univ. 2014, 47, 712–716. [Google Scholar]
  3. Chong, H.; Chenchen, Z.; Qingsheng, L.; He, L.; Xiaomei, Y.; Gaohuan, L. Refined identification of typical tropical plantation tree species based on multi-features of optical and radar images. For. Sci. 2021, 57, 80–91. [Google Scholar]
  4. Jiaqi, Y. Research on Stand Type Identification Based on Airborne Hyperspectral and Lidar Data; Northeast Forestry University: Harbin, China, 2021. [Google Scholar]
  5. Yinghui, Z.; Dali, Z.; Zhen, Z. Classification of single tree species based on nonparametric classification algorithm and multi-source remote sensing data. J. Nanjing For. Univ. 2019, 43, 103–112. [Google Scholar]
  6. Yufeng, J. Research on Interspecific Classification of Mangroves Based on High-Resolution Multi-Source Remote Sensing Images; Shandong Agricultural University: Taian, China, 2021. [Google Scholar]
  7. Rottensteiner, F.; Trinder, J.; Clode, S.; Kubik, K. Using the Dempster–Shafer method for the fusion of LIDAR data and multi-spectral images for building detection. Inf. Fusion 2005, 6, 283–300. [Google Scholar] [CrossRef]
  8. Chen, G.; Weng, Q.; Hay, G.J.; He, Y. Geographic object-based image analysis (GEOBIA): Emerging trends and future opportunities. Gisci. Remote Sens. 2018, 55, 159–182. [Google Scholar] [CrossRef]
  9. Franklin, S.E.; Ahmed, O.S.; Williams, G. Northern Conifer Forest Species Classification Using Multispectral Data Acquired from an Unmanned Aerial Vehicle. Photogramm. Eng. Remote Sens. 2018, 55, 159–182. [Google Scholar] [CrossRef]
  10. Sun, H.; Deng, T.; Yanchao, L.I. Image segmentation algorithm based on the improved watershed algorithm. J. Harbin Eng. Univ. 2014, 35, 857–864. [Google Scholar]
  11. Buddenbaum, H.; Schlerf, M.; Hill, J. Classification of coniferous tree species and age classes using hyperspectral data and geostatistical methods. Int. J. Remote Sens. 2005, 26, 5453–5465. [Google Scholar] [CrossRef]
  12. Franklin, S.E.; Ahmed, O.S. Deciduous tree species classification using object-based analysis and machine learning with unmanned aerial vehicle multispectral data. Int. J. Remote Sens. 2018, 39, 5236–5245. [Google Scholar] [CrossRef]
  13. Ahmed, O.S.; Shemrock, A.; Chabot, D.; Dillon, C.; Williams, G.; Wasson, R.; Franklin, S.E. Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle. Int. J. Remote Sens. 2017, 38, 2037–2052. [Google Scholar] [CrossRef]
  14. Chan, C.W.; Paelinckx, D. Evaluation of Random Forest and Adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sens. Environ. 2008, 112, 2999–3011. [Google Scholar] [CrossRef]
  15. Puttonen, E.; Jaakkola, A.; Litkey, P.; Hyypp, J. Tree Classification with Fused Mobile Laser Scanning and Hyperspectral Data. Sensors 2011, 11, 5158–5182. [Google Scholar] [CrossRef] [PubMed]
  16. Yijun, L.; Yong, P.; Shengxi, L.; Wen, J.; Bowei, C.; Luxia, L. Merged Airborne LiDAR and Hyperspectral Data for Tree Species Classification in Puer’s Mountains Area. For. Sci. Res. 2016, 29, 407–412. [Google Scholar]
  17. Kou, W.; Dong, J.; Xiao, X.; Hernandez, A.J.; Qin, Y.; Zhang, G.; Chen, B.; Lu, N.; Doughty, R. Expansion dynamics of deciduous rubber plantations in Xishuangbanna, China during 2000–2010. Gisci. Remote Sens. 2018, 55, 905–925. [Google Scholar] [CrossRef]
  18. Qiong, W.; Ruofei, Z.; Wenji, Z.; Kai, S.; Liming, D. Land-cover classification using GF-2 images and airborne lidar data based on Random Forest. Int. J. Remote Sens. 2018, 40, 2410–2426. [Google Scholar]
  19. Xiaoqin, W.; Miaomiao, W.; Shaoqiang, W.; Yundong, W. Vegetation Information Extraction Based on UAV Remote Sensing in Visible Light Band. Chin. J. Agric. Eng. 2015, 31, 152–157. [Google Scholar]
  20. Hong, G.; Zhang, A.; Zhou, F.; Brisco, B. Integration of optical and synthetic aperture radar (SAR) images to differentiate grassland and alfalfa in Prairie area. Int. J. Appl. Earth Obs. Geoinf. 2014, 28, 12–19. [Google Scholar] [CrossRef]
  21. Vincent, L.; Soille, P.J. Watersheds in Digital Spaces. IEEE Trans. Pattern Anal. Mach. Intell. 1991, 13, 583–598. [Google Scholar] [CrossRef] [Green Version]
  22. Pal, M. Feature Selection for Classification of Hyperspectral Data by SVM. IEEE Trans. Geosci. Remote Sens. 2010, 48, 2297. [Google Scholar] [CrossRef] [Green Version]
  23. Mei, H.; Zhu, Y. K-anonymous feature optimization based on the importance of random forest features. Comput. Appl. Softw. 2020, 37, 266–270. [Google Scholar]
  24. Mountrakis, G.; Im, J.; Ogole, C. Support vector machines in remote sensing: A review. ISPRS J. Photogramm. 2011, 66, 247–259. [Google Scholar] [CrossRef]
  25. Congalton, R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 1991, 37, 35–46. [Google Scholar] [CrossRef]
  26. Hs, A.; Eh, B.; Aeka, C.; Es, D.; Omeb, E. Deep Learning model and Classification Explainability of Renewable energy-driven Membrane Desalination System using Evaporative Cooler. Alex. Eng. J. 2022, 61, 10007–10024. [Google Scholar]
  27. Shams, M.Y.; Elzeki, O.M.; Abouelmagd, L.M.; Hassanien, A.E.; Salem, H. HANA: A Healthy Artificial Nutrition Analysis model during COVID-19 Pandemic. Comput. Biol. Med. 2021, 135, 104606. [Google Scholar] [CrossRef]
  28. Hs, A.; Aeka, B.; Es, C.; Omed, E. Predictive modelling for solar power-driven hybrid desalination system using artificial neural network regression with Adam optimization. Desalination 2022, 522, 115411. [Google Scholar]
  29. Pham, L.T.H.; Brabyn, L.; Ashraf, S. Combining QuickBird, LiDAR, and GIS topography indices to identify a single native tree species in a complex landscape using an object-based classification approach. Int. J. Appl. Earth Obs. Geoinf. 2016, 50, 187–197. [Google Scholar] [CrossRef]
  30. Liu, H. Classification of urban tree species using multi-features derived from four-season RedEdge-MX data. Comput. Electron. Agric. 2022, 194, 106794. [Google Scholar] [CrossRef]
  31. Mäyrä, J.; Keski-Saari, S.; Kivinen, S.; Tanhuanpää, T.; Hurskainen, P.; Kullberg, P.; Poikolainen, L.; Viinikka, A.; Tuominen, S.; Kumpula, T.; et al. Tree species classification from airborne hyperspectral and LiDAR data using 3D convolutional neural networks. Remote Sens. Environ. 2021, 256, 112322. [Google Scholar] [CrossRef]
  32. Zhou, X.; Zhang, X. Individual Tree Parameters Estimation for Plantation Forests Based on UAV Oblique Photography. IEEE Access 2020, 8, 96184–96198. [Google Scholar] [CrossRef]
Figure 1. Location of the study area.
Figure 1. Location of the study area.
Sustainability 14 08273 g001
Figure 2. Data sources: (a) point-cloud data graph in the study area and (b) digital orthophoto map of the study area.
Figure 2. Data sources: (a) point-cloud data graph in the study area and (b) digital orthophoto map of the study area.
Sustainability 14 08273 g002
Figure 3. Technical process of tree species classification.
Figure 3. Technical process of tree species classification.
Sustainability 14 08273 g003
Figure 4. CHM in study area: (a) before optimization and (b) after optimization.
Figure 4. CHM in study area: (a) before optimization and (b) after optimization.
Sustainability 14 08273 g004
Figure 5. Optimized canopy height model of the study area.
Figure 5. Optimized canopy height model of the study area.
Sustainability 14 08273 g005
Figure 6. Sample crown in the study area.
Figure 6. Sample crown in the study area.
Sustainability 14 08273 g006
Figure 7. Results of feature selection by RF and importance ranking: (a) DOM extraction feature sorting results, (b) LiDAR extraction feature sorting results and (c) DOM and LiDAR extraction feature sorting results.
Figure 7. Results of feature selection by RF and importance ranking: (a) DOM extraction feature sorting results, (b) LiDAR extraction feature sorting results and (c) DOM and LiDAR extraction feature sorting results.
Sustainability 14 08273 g007
Figure 8. Classification results of tree species.
Figure 8. Classification results of tree species.
Sustainability 14 08273 g008
Table 1. The parameters of airborne remote sensing system platform.
Table 1. The parameters of airborne remote sensing system platform.
DOMLiDAR
Ground resolution0.1 mWavelength 1064 nm
Focal length35 mmLaster beam divergence0.25 mrad
Maximum point density93 pts/m2
Minimum point density0.6 pts/m2
Table 2. Spectral features.
Table 2. Spectral features.
Spectral FeaturesFeature DescriptionSymbolic Representation
MeanAverage pixel value of an object in a certain bandRmean, Gmean, Bmean 1
Standard deviationDegree of dispersion of the gray value of pixels in the object areaRstd, Gstd, Bstd 2
1 Rmean, Gmean, and Bmean represent the mean values of the red, green, and blue bands, respectively. 2 Rstd, Gstd, and Bstd represent the standard deviation of each band of red, green, and blue, respectively.
Table 3. Texture features.
Table 3. Texture features.
Texture FeaturesFeature DescriptionSymbolic Representation
HomogeneityHomogeneity of the imageRhom3 (5,7,9,11),
Ghom3 (5,7,9,11),
Bhom3 (5,7,9,11) 3
ContrastQuality of image sharpness and depth of texture groovesRcon3 (5,7,9,11),
Gcon3 (5,7,9,11),
Bcon3 (5,7,9,11) 3
DifferenceTexture feature of the local image areaRdis3 (5,7,9,11),
Gdis3 (5,7,9,11),
Bdis3 (5,7,9,11) 3
Information entropyRandomness measure of all informationRent3 (5,7,9,11),
Gent3 (5,7,9,11),
Bent3 (5,7,9,11) 3
Second orderUniformity of gray distribution of image and thickness of textureRsec3 (5,7,9,11),
Gsec3 (5,7,9,11),
Bsec3 (5,7,9,11) 3
CorrelationSimilarity of image gray levelsRcor3 (5,7,9,11),
Gcor3 (5,7,9,11),
Bcor3 (5,7,9,11) 3
3 These symbolic represent the texture characteristics of each of the red, green, and blue bands at different window sizes.
Table 4. Geometric features.
Table 4. Geometric features.
Geometric FeaturesFeature DescriptionSymbolic Representation
AreaArea of segmented objectArea
PerimeterPerimeter of segmented objectPerimeter
Area perimeter ratioRatio of area of segmented object to perimeterA_P
Table 5. Point-cloud features.
Table 5. Point-cloud features.
Point-Cloud FeaturesFeature DescriptionSymbolic Representation
Cumulative height percentileCalculation of cumulative height percentile at 10% interval and calculation of its values at 25% and 75% intervalsH1, H10, H20, H25, H30, H40, H50, H60, H70, H75, H80, H90, H99 4
Height percentileCalculation of height percentile at 10% intervals and calculation of its values at 25% and 75% intervalsHP1, HP10, HP20, HP25, HP30, HP40, HP50, HP60, HP70, HP75, HP80, HP90, HP99 5
Cumulative intensity percentileCalculation of cumulative echo intensity percentile at 10% interval and calculation of its values at 25% and 75% intervalsINT1, INT10, Int20, Int25, Int30, Int40, Int50, Int60, Int70, Int75, Int80, Int90, Int99 6
Intensity percentileCalculation of the percentile of echo intensity at 10% interval and calculation of its values at 25% and 75% intervalsIntP1, IntP10, IntP20, IntP25, IntP30, IntP40, IntP50, IntP60, IntP70, IntP75, IntP80, IntP90, IntP99 7
Mean intensityMean intensity of all echoesINTmean
Intensity standard deviationIntensity standard deviation of all echoesINTstd
Intensity varianceIntensity variance of all echoesINTvar
4 These symbols represent the cumulative height percentile at different heights. 5 These symbols represent the height percentile at different heights. 6 These symbols represent the cumulative intensity percentile at different heights. 7 These symbols represent the intensity percentile at different heights.
Table 6. CHM features.
Table 6. CHM features.
CHM FeaturesFeature DescriptionSymbolic Representation
MeanMean height of divided tree canopyHmean
MaximumMaximum height of divided tree canopyHmax
MinimumMinimum height of split canopyHmin
Standard deviationStandard deviation of height of divided tree canopyHstd
VarianceDivision of height variance of canopyHvar
SlopeDivision of the slope of the canopyHslope
Table 7. Classification scheme.
Table 7. Classification scheme.
SchemeFeature SelectType of DataClassifier
INoDOMRF
IINoDOMSVM
IIIYesDOMRF
IVYesDOMSVM
VNoLiDARRF
VINoLiDARSVM
VIIYesLiDARRF
VIIIYesLiDARSVM
IXNoDOM, LiDARRF
XNoDOM, LiDARSVM
XIYesDOM, LiDARRF
XIIYesDOM, LiDARSVM
Table 8. Evaluation index of classification accuracy.
Table 8. Evaluation index of classification accuracy.
Evaluation IndexCalculation FormulaIndicator Description
user accuracy, UA U A = x i i x i + Ratio of number of samples correctly classified into category i to the total number of samples in category i in the classification result, which reflects the reliability of a certain category being correctly identified
producer accuracy, PA P A = x i i x + i Ratio of the number of correct classifications of a category to the total number of that category in the reference sample
overall accuracy, OA O A = i = 1 r x i i N Proportion of correctly classified samples to the total sample, reflecting the consistency between the classification results and the actual features
Kappa coefficient K = N i = 1 r x i i i = 1 r x i + x + i N 2 i = 1 r x i + x + i A precision statistic used to determine the matching degree between the actual feature category and classification result, which can weaken the influence of sample selection on the accuracy verification
MAE M A E = 1 N i = 1 N y i y i ^ Measure of the difference between the predicted and actual values of the model.
Table 9. Evaluation of classification accuracy.
Table 9. Evaluation of classification accuracy.
SchemeAccuracy (%)PaulowniaoakfirOther Tree SpeciesOA (%)KappaMAE
IPA70.0087.5066.6769.4474.190.660.39
UA77.7876.3672.3471.43
IIPA60.0083.3364.7172.2271.610.600.42
UA75.0067.8073.3374.29
IIIPA80.0089.5864.7177.7879.350.710.29
UA88.8974.1478.2684.85
IVPA55.0085.4270.5975.0073.540.630.41
UA84.6277.3671.4367.50
VPA55.0070.8345.1047.2252.260.340.74
UA55.0057.6352.2753.13
VIPA55.0056.2554.9036.1150.970.390.73
UA52.3855.1044.4459.10
VIIPA45.0066.6743.1455.5653.550.360.69
UA50.0051.6152.3860.61
VIIIPA35.0058.7045.1077.7854.840.390.71
UA58.3358.7056.1056.00
IXPA80.0083.3376.4780.5680.000.730.36
UA72.7378.4373.58100.00
XPA75.0081.2584.3169.4478.210.700.30
UA83.3382.9872.8880.65
XIPA90.0085.7574.5186.1183.230.770.23
UA85.7177.7882.6191.18
XIIPA85.0085.4286.2783.3385.160.790.21
UA89.4789.1380.0085.71
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, X.; Wang, R.; Chen, X.; Li, Y.; Duan, Y. Classification of Transmission Line Corridor Tree Species Based on Drone Data and Machine Learning. Sustainability 2022, 14, 8273. https://doi.org/10.3390/su14148273

AMA Style

Li X, Wang R, Chen X, Li Y, Duan Y. Classification of Transmission Line Corridor Tree Species Based on Drone Data and Machine Learning. Sustainability. 2022; 14(14):8273. https://doi.org/10.3390/su14148273

Chicago/Turabian Style

Li, Xiuting, Ruirui Wang, Xingwang Chen, Yiran Li, and Yunshan Duan. 2022. "Classification of Transmission Line Corridor Tree Species Based on Drone Data and Machine Learning" Sustainability 14, no. 14: 8273. https://doi.org/10.3390/su14148273

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop