A Semi-Supervised Approach for Partial Discharge Recognition Combining Graph Convolutional Network and Virtual Adversarial Training
Abstract
:1. Introduction
2. PD Graph Signals
3. Semi-Supervised Recognition Approach for PD Faults Combining GCN and VAT
3.1. Principle of GCN
3.1.1. GCN Layers
3.1.2. SAGPool Layer
3.2. Semi-Supervised Training Based on VAT
3.2.1. Overview of Semi-Supervised Training
3.2.2. VAT and Loss Functions
3.3. Algorithm Flow
4. Transformer PD Experiment
4.1. Data Collection
4.2. PRPD and Preprocessing
5. Discussion
5.1. GCN Structure and Graph Signal Parameters
5.2. Effectiveness Analysis of the Semi-Supervised PD Recognition
5.3. Ablation Experiment
5.4. Comparison with Traditional PD Recognition Approaches
5.5. Field Case Analysis
6. Conclusions
- A PD graph signal and the GCN are introduced to PD recognition. This approach can autonomously acquire the node information and topology association of PRPD and diagnose fault types. This approach demonstrates superior advantages over the CNN-based approach, particularly in scenarios characterized by limited sample sizes.
- A semi-supervised framework is constructed by further integrating VAT into GCN. The findings from ablation experiments indicate that this framework effectively improves the PD recognition rate by 5.83% to 10.83% with the support of unlabeled samples.
- Compared to traditional approaches based on SVM, BPNN, and CNN, the proposed approach attains enhancements of 12.12%, 14.72%, and 6.14%, respectively, in recognition rate when dealing with limited labeled training data. This advancement reduces the reliance on the PD category information during the training process of common DL models.
- For on-site detection data, the proposed approach can still obtain superior PD recognition performance and help to reduce the time and labor costs of manually labeling on-site PD faults.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Liu, F.; Du, J.; Shi, Y.; Zhang, S.; Wang, W.; Xiao, M.A. Localization of Dual Partial Discharge in Transformer Windings Using Fabry–Pérot Optical Fiber Sensor Array. Energies 2024, 17, 2537. [Google Scholar] [CrossRef]
- Sekatane, P.M.; Bokoro, P. Time Reversal vs. Integration of Time Reversal with Convolution Neural Network in Diagnosing Partial Discharge in Power Transformer. Energies 2023, 16, 7872. [Google Scholar] [CrossRef]
- Candela, R.; Mirelli, G.; Schifani, R. PD Recognition by Means of Statistical and Fractal Parameters and A Neural Network. IEEE Trans. Dielectr. Electr. Insul. 2000, 7, 87–94. [Google Scholar] [CrossRef]
- Mas’ud, A.A.; Albarracín, R.; Ardila-Rey, J.A.; Muhammad-Sukki, F.; Illias, H.A.; Bani, N.A.; Munir, A.B. Artificial Neural Network Application for Partial Discharge Recognition: Survey and Future Directions. Energies 2016, 9, 574. [Google Scholar] [CrossRef]
- Karimi, M.; Majidi, M.; Mirsaeedi, H.; Arefi, M.M.; Oskuoee, M. A Novel Application of Deep Belief Networks in Learning Partial Discharge Patterns for Classifying Corona, Surface, and Internal Discharges. IEEE Trans. Ind. Electron. 2019, 67, 3277–3287. [Google Scholar] [CrossRef]
- Dai, J.; Song, H.; Sheng, G.; Jiang, X. Dissolved Gas Analysis of Insulating Oil for Power Transformer Fault Diagnosis with Deep Belief Network. IEEE Trans. Dielectr. Electr. Insul. 2017, 24, 2828–2835. [Google Scholar] [CrossRef]
- Duan, L.; Hu, J.; Zhao, G.; Chen, K.; He, J.; Wang, S.X. Identification of Partial Discharge Defects Based on Deep Learning Method. IEEE Trans. Power Deliv. 2019, 34, 1557–1568. [Google Scholar] [CrossRef]
- Balouji, E.; Hammarström, T.; McKelvey, T. Classification of Partial Discharges Originating from Multilevel PWM Using Machine Learning. IEEE Trans. Dielectr. Electr. Insul. 2022, 29, 287–294. [Google Scholar] [CrossRef]
- Peng, X.; Yang, F.; Wang, G.; Wu, Y.; Li, L.; Li, Z.; Bhatti, A.A.; Zhou, C.; Hepburn, D.M.; Reid, A.J. A Convolutional Neural Network-Based Deep Llearning Methodology for Recognition of Partial Discharge Patterns from High-voltage Cables. IEEE Trans. Power Deliv. 2019, 34, 1460–1469. [Google Scholar] [CrossRef]
- Song, H.; Dai, J.; Sheng, G.; Jiang, X. GIS Partial Discharge Pattern Recognition via Deep Convolutional Neural Network Under Complex Data Source. IEEE Trans. Dielectr. Electr. Insul. 2018, 25, 678–685. [Google Scholar] [CrossRef]
- Ziraki, N.; Bosaghzadeh, A.; Dornaika, F. Semi-supervised Learning for Multi-View Data Classification and Visualization. Information 2024, 15, 421. [Google Scholar] [CrossRef]
- Zhang, J.; You, S.; Liu, A.; Xie, L.; Huang, C.; Han, X.; Li, P.; Wu, Y.; Deng, J. Winter Wheat Mapping Method Based on Pseudo-Labels and U-Net Model for Training Sample Shortage. Remote Sens. 2024, 16, 2553. [Google Scholar] [CrossRef]
- Miyato, T.; Maeda, S.-i.; Koyama, M.; Ishii, S. Virtual Adversarial Training: A Regularization Method for Supervised and Semi-supervised Learning. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 41, 1979–1993. [Google Scholar] [CrossRef] [PubMed]
- Kipf, T.N.; Welling, M. Semi-supervised Classification with Graph Convolutional Networks. arXiv 2016, arXiv:1609.02907. [Google Scholar] [CrossRef]
- Jiménez-Aparicio, M.; Hernández-Alvidrez, J.; Montoya, A.Y.; Reno, M.J. Embedded, Real-time, and Distributed Traveling Wave Fault Location Method Using Graph Convolutional Neural Networks. Energies 2022, 15, 7785. [Google Scholar] [CrossRef]
- Zhang, D.; Stewart, E.; Entezami, M.; Roberts, C.; Yu, D. Intelligent Acoustic-based Fault Diagnosis of Roller Bearings Using a Deep Graph Convolutional Network. Measurement 2020, 156, 107585. [Google Scholar] [CrossRef]
- Manoj, B.; Chakraborty, A.; Singh, R. Complex Networks: A Networking and Signal Processing Perspective, 1st ed.; Mechanical Industry Press: Beijing, China, 2018; pp. 10–38. [Google Scholar]
- Shuman, D.I.; Narang, S.K.; Frossard, P.; Ortega, A.; Vandergheynst, P. The Emerging Field of Signal Processing on Graphs: Extending High-dimensional Data Analysis to Networks and Other Irregular Domains. IEEE Signal Process. Mag. 2013, 30, 83–98. [Google Scholar] [CrossRef]
- Defferrard, M.; Bresson, X.; Vandergheynst, P. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering, In Proceedings of Conference and Workshop on Neural Information Processing Systems, Barcelona, Spain, 5–10 December 2016.
- Zhang, S.; Wang, J.; Yu, S.; Wang, R.; Han, J.; Zhao, S.; Liu, T.; Lv, J. An Explainable Deep Learning Framework for Characterizing and Interpreting Human Brain States. Med. Image Anal. 2023, 83, 102665. [Google Scholar] [CrossRef]
- Lee, J.; Lee, I.; Kang, J. Self-attention graph pooling. Statistics 2019, 3, 3–10. [Google Scholar]
- Szegedy, C.; Zaremba, W.; Sutskever, I.; Bruna, J.; Erhan, D.; Goodfellow, I.; Fergus, R. Intriguing Properties of Neural Networks. In Proceedings of the International Conference on Learning Representations, Banff, AB, Canada, 14–16 April 2014. [Google Scholar]
- IEC 60270; Partial Discharge Measurement. IEC: Geneva, Switzerland, 2000.
- Wang, Y.; Yan, J.; Yang, Z.; Jing, Q.; Wang, J.; Geng, Y.J.H.V. GAN and CNN for imbalanced partial discharge pattern recognition in GIS. High Volt. 2022, 7, 452–460. [Google Scholar] [CrossRef]
- Barrios, S.; Buldain, D.; Comech, M.P.; Gilbert, I.; Orue, I. Partial Discharge Classification Using Deep Learning Methods—Survey of Recent Progress. Energies 2019, 12, 2485. [Google Scholar] [CrossRef]
- Liang, H.; Ju, T.; Chao, L.; Zhang, X.X. Pattern Recognition for Partial Discharge Based on Multi-feature Fusion Technology. High Volt. Eng. 2015, 41, 947–955. [Google Scholar] [CrossRef]
Hyperparameter | Range |
---|---|
g-l | 3–1, 6–2, 12–4 |
Number of Iterations | 50, 100, 200 |
Learning Rate | 1 × 10−2, 1 × 10−3, 1 × 10−4 |
Hidden Layer Size | 32, 64, 128 |
Weight Decay Coefficient | 1 × 10−3, 1 × 10−4 and 5 × 10−4 |
Approach | Labeled Samples | Unlabeled Samples | Pseudo-Labels | VAT | ||
---|---|---|---|---|---|---|
xl | Labels | xul | Labels | |||
LS model | √ | √ | ||||
AS model | √ | √ | √ | √ | ||
PL model | √ | √ | √ | √ | ||
Proposed model | √ | √ | √ | √ | √ |
PD Type | Statistical Features + SVM/% | Image Moment Features + BP/% | PRPD Matrix + CNN/% | Graph Signal + GCN/% | Proposed Approach/% | |||||
---|---|---|---|---|---|---|---|---|---|---|
Rate | Average | Rate | Average | Rate | Average | Rate | Average | Rate | Average | |
Tip | 83.46 | 84.36 | 81.10 | 81.94 | 89.76 | 88.74 | 90.55 | 89.57 | 96.06 | 95.84 |
Surface | 84.68 | 79.03 | 87.10 | 87.90 | 94.35 | |||||
Gap | 81.25 | 82.14 | 87.50 | 88.39 | 94.64 | |||||
Floating | 88.03 | 85.47 | 90.60 | 91.45 | 98.29 |
PD Type | Statistical Features + SVM/% | Image Moment Features + BP/% | PRPD Matrix + CNN/% | Graph Signal + GCN/% | Proposed Approach/% | |||||
---|---|---|---|---|---|---|---|---|---|---|
Rate | Average | Rate | Average | Rate | Average | Rate | Average | Rate | Average | |
Tip | 78.74 | 81.22 | 76.38 | 78.62 | 85.83 | 83.83 | 89.76 | 87.20 | 92.91 | 93.34 |
Surface | 83.06 | 76.61 | 81.89 | 86.29 | 92.74 | |||||
Gap | 75.89 | 78.57 | 82.14 | 82.14 | 91.96 | |||||
Floating | 87.18 | 82.91 | 85.47 | 90.60 | 95.73 |
PD Type | Internal Inspection | Count | Approach | Results | |||
---|---|---|---|---|---|---|---|
Point | Surface | Gas | Floating | ||||
Surface | Creepage discharge along the insulating paper | 9 | Proposed | 0 | 9 | 0 | 0 |
CNN | 2 | 5 | 1 | 1 | |||
Gap | Bulges and bubbles on insulating cardboard | 15 | Proposed | 0 | 2 | 13 | 0 |
CNN | 0 | 3 | 12 | 0 | |||
Floating | Loose nuts on transformers or reactors | 23 | Proposed | 0 | 0 | 6 | 17 |
CNN | 1 | 0 | 8 | 14 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhang, Y.; Yu, Y.; Zhang, Y.; Liu, Z.; Zhang, M. A Semi-Supervised Approach for Partial Discharge Recognition Combining Graph Convolutional Network and Virtual Adversarial Training. Energies 2024, 17, 4574. https://doi.org/10.3390/en17184574
Zhang Y, Yu Y, Zhang Y, Liu Z, Zhang M. A Semi-Supervised Approach for Partial Discharge Recognition Combining Graph Convolutional Network and Virtual Adversarial Training. Energies. 2024; 17(18):4574. https://doi.org/10.3390/en17184574
Chicago/Turabian StyleZhang, Yi, Yang Yu, Yingying Zhang, Zehuan Liu, and Mingjia Zhang. 2024. "A Semi-Supervised Approach for Partial Discharge Recognition Combining Graph Convolutional Network and Virtual Adversarial Training" Energies 17, no. 18: 4574. https://doi.org/10.3390/en17184574
APA StyleZhang, Y., Yu, Y., Zhang, Y., Liu, Z., & Zhang, M. (2024). A Semi-Supervised Approach for Partial Discharge Recognition Combining Graph Convolutional Network and Virtual Adversarial Training. Energies, 17(18), 4574. https://doi.org/10.3390/en17184574