1. Introduction
In the context of the transformation of the global energy structure toward low carbon and the continuous optimization of energy consumption, the demand for renewable energy has continuously grown [
1,
2,
3]. With its abundant resources, environmental protection, a high degree of automatic operation and management, and a continuous reduction in electricity costs, wind energy has become one of the most widely developed and applied renewable energy sources. However, wind turbine blades (WTBs) can suffer severe damage due to atmospheric oxidation, strong wind loads, air corrosion, gravel erosion, material fatigue, snow and ice cover, etc. [
4,
5]. Damaged blades can then catastrophically fail due to the extent of damage. Rotating blades suffer from such damage, which gradually expands due to centrifugal force, resulting in more serious secondary damage [
6].
The manual periodic inspection method has been widely adopted for defect detection in wind farms [
7]. In this method, the blade surface is observed with the eyes or a telescope to judge the health of the WTBs. However, regular manual inspection can often not be performed in time, poses safety hazards for the inspector, and requires professional skills, which restrict the operation and maintenance of WTBs [
8,
9].
The structural health monitoring methods of WTBs in the literature can be categorized into two classes: non-contact and contact measurement [
8,
10]. For instance, Wang et al. [
11] used unmanned aerial vehicles (UAVs) to collect WTB images, accomplishing WTB defect recognition and location through image noise reduction processing and Haar-like feature extraction, and used a cascade classifier to analyze the features. Yang et al. [
12] proposed a non-destructive ultrasonic testing technology that could detect blade damage through guided waves and had strong positioning ability. Naderi et al. [
13] developed a data-driven non-linear approach by using only frequency response data to detect and isolate a fault. Jiang et al. [
14] proposed an improved and fast independent component analysis (ICA) algorithm that reduced the quantity of the required sensors and provided practical data support for blade damage location. However, these studies have shortcomings, such as requiring wind turbine shutdown, poor real-time performance, and contact measurement, which hinder operation in practice. These studies were also data-driven and resource-intensive; additionally, the construction of a diverse defect datasets is difficult. To resolve the issues caused by the lack of information owing to the limited number of available fault data samples, some fault diagnosis methods based on a small sample size have been proposed. Su et al. [
15] proposed a wind turbine gearbox diagnosis method based on improved generative adversarial networks (GANs) to achieve fault classification and diagnosis with a small sample. Liu et al. [
16] developed an artificial intelligence (AI)-based method that was trained by a large amount of GAN-generated fault data to defect wind turbine defects. In [
17], Guo et al. proposed a new unsupervised small sample defect detection model that can accurately extract defect contours without any postprocessing, and its accuracy was high. Most methods are based on samples generated through generative adversarial networks. Because extracting defect information from wind turbine blades is difficult, signal processing is another challenge [
18,
19,
20]. Researchers [
21] used a short-time Fourier transform and smoothing techniques to analyze real-time spectrograms and the rotor speed. In [
22], the authors traced vital signs from vibration signals through statistical modeling and used various tree-based algorithms for classification. In [
23], they used a spectrogram and deep learning ensemble to investigate unknown vibration moments. Therefore, signal processing to monitor wind turbine blade structural health is important and meaningful.
As such, in this study, we developed a WTB health monitoring and warning system based on acoustic feature analysis to judge and provide early warnings of wind turbine blade damage. This system requires less labor and places no demands on the sensor arrangement on the blades, and so does not affect the normal operation of the wind turbine. The system consists of a microphone, a signal acquisition and communication module, an optical network, and a central monitoring server. The signals collected by the front end of the acoustic signal acquisition are sent to the monitoring central server for saving and processing through the optical network. After obtaining the characteristic vector of the acoustic signal, it is sent to the artificial neural network for the classification and identifying faulty signals. Users can remotely log onto the server, view the acoustic features in real time, and listen to the original acoustic signals. The system is shown in
Figure 1.
Collecting a large number of blade defect signals is difficult; in this study, we designed a wind turbine blade defect detection system based on model-agnostic meta-learning (MAML) for small sample sizes, which is both highly accurate and fast. We obtained WTB signals from two wind farms at different directions and heights, which we used to study the mechanisms through which defects occur in wind turbine blades. We extracted the octave characteristics by a 1/6 octave, which we used to train the artificial neural network based on model-agnostic meta-learning (MAML-ANN). We then used the well-trained MAML-ANN to determine the status of the WTBs. The experimental results indicated that the proposed method was more accurately able to detect WTB faults, and does not experience problems such as slow convergence or falling into local optimal solutions, and has a high recognition rate with a small sample size. Moreover, MAML-ANN can be extended to large amounts of data.
3. Results
3.1. Data Acquisition
To detect WTB defects, we went to two wind farms (Dawu and Diaoyutai) to collect the acoustic WTB signals. Selecting the location of the microphone in a harsh natural environment is difficult because the background noise can affect the analysis of the acoustic signals. In our experiment, we acquired the acoustic signals from different directions and heights, as shown in
Table 1 and
Figure 7. To verify the performance at different positions, we used the short-time Fourier algorithm to observe the defect information.
Because the collected acoustic signals contained a large amount of low-frequency wind noise, the defect information had low contrast on the time–frequency map. Therefore, we considered the time–frequency map above 1 kHz to facilitate the observation of the defect information. As shown in
Figure 8, at the same height, the behind placement had the best ability to capture defects, front was second best, and the side placement was the worst. In the same direction, the ability to capture defects at different heights was similar because the microphones were directional. Therefore, the placement had a considerable influence on the signal-capturing ability of the microphone, whereas height had no influence. So, we decided to acquire signals at location B.
3.2. Acoustic Feature Extraction
Next, we analyzed three different types of WTB acoustic signals to to achieve WTB defect detection, including the detection of normal status, cracks, and imbalance. The original acoustic signals and spectrograms of the different types are shown in
Figure 9. As the acoustic signals show no notable characteristics, the different types of defects could not be distinguished in the time domain. Hence, we analyzed the acoustic signals of the different types using spectrograms. For normal signals, the spectrogram of each blade is the same as the other two. Compared with the normal signals, periodic crack information occurs in the spectrogram of crack signals, as shown in the yellow box in
Figure 9d, which is due to cracks in the WTB. The unbalanced WTB signals also indicate a defect. A spectrogram of unbalanced signals is presented in
Figure 9f, where the spectrogram of blade 1 is stronger than that of the other two.
As the acoustic signals showed no remarkable characteristics, we could not distinguish the different types of defects in the time domain. Hence, we used octave to extract defect information from the frequency domain. The order in the octave feature extraction algorithm must be carefully selected. The common orders are 1/3, 1/6, 1/12, 1/24, and so on. Different orders have different spectral resolutions, and their ability to describe spectral changes is different. In our experiment, we tried three orders, 1/3, 1/6, and 1/12, and discussed the performance of feature extraction and WTB defect detection of the different orders. As shown in
Figure 10, the 1/3-octave features were sparse over the whole frequency. Within the defect frequency range of 10 kHz∼12.5 kHz, the interval of the frequency bands was too large to effectively extract the frequency change in the defect information. The characteristics of the 1/6 octave were relatively uniform over the whole spectrum, and the defect information was effectively extracted (capture the law of defect changes). Although the characteristics of the 1/12 octave could effectively obtain the defect information in the acoustic signal, the features were dense in the spectrum. This not only led to the complexity in the follow-up model but was also sensitive to changes in the natural environment. Finally, we selected 1/6 as octave order.
We analyzed the acoustic signals of different types of defects with the 1/6 octave, as shown in
Figure 11. The 1/6-octave characteristics of the normal acoustic signals were similar to a power function. Compared with the normal signals, we observed an apparent protrusion in the crack signals at a specific frequency band (10∼12.5 kHz). For unbalanced signals, the octave features showed no obvious defect information, such as protrusion, but the characteristic octave curve was different, similar to a linear function. Therefore, the octave used in this study could effectively extract information regarding WTB defects, which is convenient for subsequent model training.
However, in the early stages of WTB damage, distinguishing defect information is challenging. This poses challenges for the detection of WTB defects: the traditional defect detection methods are unable to cope with this complex situation. For data visualization, we adopted PCA to reduce the feature dimensions from 31 to 3, preserving 84.5% of the feature information. As shown in
Figure 12, most of the normal and abnormal samples could be effectively separated, but the boundary between classes was complex. With the rapid development of the new generation of artificial intelligence, ANN has provided opportunities to create new approaches to achieve defect detection. Nevertheless, the traditional ANN can be extremely easily overfit with complex boundaries and imbalanced classes. Therefore, we used MAML to solve the problem of small sample size and class imbalance to fit these complex boundaries.
3.3. Hyperparameter Selection
We obtained a large amount of data to verify the effectiveness of MAML-ANN. We collected a total of 2705 samples for the normal, crack, and unbalanced states, and the time length of each sample was 10 s. We divided all data into three parts, which were a training set (normal, 300 samples; abnormal, 300 samples), a validation set (normal, 51; abnormal, 199), and a testing set (normal, 264; abnormal, 1591). The percentages of normal, crack, and unbalance samples in dataset were 22.7%, 62.2%, and 15.1%, respectively. The shallow MAML-ANN we used in this experiment consisted of an input layer, three hidden layers, and an output layer, for which the number of neurons was M, (256, 128, 64), and 2, respectively. M was determined by the number of input data points. The hidden layer contained three layers, with 256, 128, and 64 neurons. The two was determined by the number of classes (normal and abnormal).
The selection of hyperparameters strongly impacted the performance of MAML-ANN. We analyzed the k-shot, q-shot, and batch size in this experiment. As shown in
Figure 13, we discussed the performance of the model under different k-shot, q-shot, and batch size values. We considered 50 as an inflection point. When we had fewer than 50 data, MAML-ANN could not effectively distinguish samples from the different classes because the data size was too small. However, the accuracy rapidly increased as the data size increased. When the data size was greater than 50, the performance of the MAML-ANN can be slightly improved with the number of samples increasing. We verified that the training method could quickly learn the correlation function of each class of feature data in the case of small sample. By comparing and analyzing the effects of different hyperparameters, we found that changes in k-shot had no effect. The accuracy with a q-shot of two first increased and then decreased. When the q-shot was five, the accuracy was 2% higher on average than with a q-shot of two. The fluctuations in accuracy were 1.96% and 0.75% with q-shots of two and five, respectively. The latter was 38.3% of the former. In addition, when the batch size was four or eight, the accuracy was about 3.5% higher than when the batch size was two.
Considering the running time and other factors, we set the k-shot of the tasks to two, q-shot to five, batch size to four, and the learning rate to 0.0005, as shown in
Table 2. To prevent overfitting in the training process, we added a dropout layer.
3.4. Performance of MAML-ANN
- (1)
Comparison between MAML-ANN and traditional ANN
The performance evolution as a function of training iteration of MAML-ANN and traditional ANN is illustrated in
Figure 14. In
Figure 15, the results of MAML-ANN and traditional ANN are thoroughly analyzed for different data sizes. In general, the performance of MAML-ANN was better than that of traditional ANN. For traditional ANN, the accuracy slowly increased with the growth in data size. Overfitting occurred during the training process, and reached a stable state at around 100 epochs, indicating traditional ANN had fallen into a local optimum. Additionally, the average interval of accuracy for the normal and abnormal observations for different data sizes was higher than that of MAML-ANN, by about twice. This means that the model trended to one of the classes. The convergence of MAML-ANN was faster than that of traditional ANN, to produce a better model. Because the task was random, the accuracy showed certain volatility during the training process, which helped the model avoid the local optimum and find the global optimum. Moreover, this randomness caused the performance of the model to sharply deteriorate, but MAML-ANN could quickly adjust to a new and better solution. Overfitting also occurred in MAML-ANN. With the increase in epochs, the accuracy on the training and testing sets diverged. In addition, the overfitting gradually disappeared with the increase in data size, indicating MAML-ANN is still useful for large amounts of data. In summary, MAML-ANN produced a huge improvement of about 10% compared with traditional ANN. It not only has accurate performance when the sample size is small, but also showed good generalization performance with large amounts of data, and does not suffer from the problem of the training process falling into the local optimal solution.
Figure 16 and
Figure 17 show the confusion matrix and F1 score of MAML-ANN and traditional ANN for different data sizes. The TP and TN of MAML-ANN were both higher than those of traditional ANN for the same data size. The precision was approximately 10% higher, indicating the performance of MAML-ANN was better than that of traditional ANN. The recall was approximately 20% higher, which means the confidence in the predicted label was strong.
- (2)
Recognition speed
To successfully apply MAML-ANN to a wind turbine blade defect monitoring system, the running time must meet the system requirements. The monitoring time interval of the wind turbine blade defect detection system is 5 min, and the signal acquisition time is 1 min. Therefore, the time from feature extraction to model judgment output results is less than 4 min. According to the test, the defect detection algorithm requires approximately 0.7 s for a 10 s signal, so it takes approximately 4.2 s for a 1 min signal, which is far less than the requirements of the system. It can be embedded into a wind turbine blade defect monitoring system.
4. Discussion
Our study has several limitations, especially the diversity of dataset. The types and degrees of WTB defects are diverse, but constructing a complete dataset is challenging. The dataset we constructed mainly contained normal, cracked, and unbalanced samples, but did not contain lightning strikes. This will result in poor performance for samples not included in the database. However, our method involved training the initial model parameters such that the model had maximal performance on new defects after a few gradient steps with a small amount of data. Furthermore, our proposed method is scalable. For wind turbine blade defect detection, the single-modal defect detection method can only detect some defects well, but cannot detect all defects. The use of multimodal defect detection, such as acoustics, vision, infrared, etc., is the future development trend. Our proposed scheme can be well-integrated with other detection schemes to achieve multimodal defect detection.
5. Conclusions
In our study, we designed and experimentally tested an acoustic detection method based on MAML. The results showed that the proposed method can very accurately detect defects in WTBs. To verify our method, we collected signals from WTBs on wind farms and discussed the impact of different directions and heights of sensor placement on data acquisition. We explored the performance of feature extraction in different octaves, from which we selected the 1/6 octave. Finally, we analyzed the characteristics of the three defect types (normal, crack, and imbalance) in detail and verified the performance of MAML-ANN. Compared with traditional ANN, MAML-ANN performed better and achieving a defect detection accuracy of 94.1% when the sample size was only 50. Moreover, MAML-ANN has a fast convergence speed and can automatically search for the global optimal solution. The method also performed well with a larger data sample, indicating the MAML-ANN is suitable for small as well as large sample sizes. Our proposed method offers an attractive option to improve the detection of WTB defects from small sample sizes, and reduces the labor cost for WTB data collection.
In the future, we will study the defect detection method for wind turbine blades from two aspects: first, we want to obtain acoustic signals through artificially produce damage. Second, we want to try tree-based algorithms [
30] for WTB defect detection.