An Automatic Jet Stream Axis Identification Method Based on Semi-Supervised Learning
Abstract
:1. Introduction
- 1.
- In addressing the challenges of limited generalization ability and the difficulty of obtaining many high-quality samples for identifying jet stream axes in atmospheric wind fields, a new semi-supervised automatic identification method has been proposed based on a semi-supervised approach. This method aims to accurately capture the shape of the jet stream area while aligning more consistently with wind direction.
- 2.
- The issue of excluding high-quality samples from the dataset is tackled within the framework of consistency learning. This paper proposes an innovative semi-supervised learning methodology that amalgamates consistency learning with self-training techniques for jet stream area identification, also called segmentation.
- 3.
- Addressing the challenge of model training deterioration due to low-confidence pseudo-labels within self-training methodologies, this study proposes a strategy predicated on feature perturbations for the filtration of high-confidence pseudo-labels. Empirical analyses substantiate that the proposed approach significantly enhances the efficacy of semi-supervised learning paradigms.
2. Methods
2.1. Overall Plan
2.2. Data Preprocessing
2.3. Semi-Supervised Method Structure
2.4. Screening for High-Confidence Pseudo-Labels
Algorithm 1 High-Confidence pseudo-label screening with multiple perturbations |
|
2.5. Loss Function
3. Experiments
3.1. Dataset
3.2. Experimental Setup
3.3. Ablation Study
3.4. Comparison with State-of-the-Art Methods
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Stendel, M.; Francis, J.; White, R.; Williams, P.D.; Woollings, T. The jet stream and climate change. In Climate Change; Elsevier: Amsterdam, The Netherlands, 2021; pp. 327–357. [Google Scholar]
- Zhang, H.; Huang, J.; Zhao, Y. Automatic identification of low-level jet streams using Doppler weather radar data. Sci. Technol. Perspect. 2013, 2, 36–37. [Google Scholar]
- Jin, H.; Gu, S.; Wang, S.; Niu, L.; Liu, W. Discussion on automatic identification of low-level gale axes by Doppler radar. J. Nanjing Meteorol. Inst. 2008, 31, 702–710. [Google Scholar]
- Wang, P.; Wang, Q.; Wang, D. Research on low-level jet stream identification and automatic jet stream axes mapping method. Meteorology 2018, 44, 952–960. [Google Scholar]
- Molnos, S.; Mamdouh, T.; Petri, S.; Nocke, T.; Weinkauf, T.; Coumou, D. A network-based detection scheme for the jet stream core. Earth Syst. Dyn. 2017, 8, 75–89. [Google Scholar] [CrossRef]
- Gan, J.; Chai, H.; Hu, W.; Shu, H.; Luo, F.; He, T.; Yin, Q.; Lai, R. A method for calculating jet streamlines in atmospheric wind field. J. Sichuan Univ. (Nat. Sci. Ed.) 2020, 57, 1084–1089. [Google Scholar]
- Diao, C. Automatic Identification of Low-Level Jet Streams Based on MICAPS Wind Field Information. Master’s Thesis, Tianjin University, Tianjin, China, 2016. [Google Scholar]
- Lu, Z.; Diao, C.; Lu, H.; Jia, H. Automatic identification and mapping of low-level jet streams based on MICAPS wind field information. Comput. Eng. Appl. 2017, 53, 230–234. [Google Scholar]
- Long, J.; Shelhamer, E.; Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015; pp. 3431–3440. [Google Scholar]
- Chen, L.-C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV), 2018, Munich, Germany, 8–14 September 2018; pp. 801–818. [Google Scholar]
- Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18; Springer: Berlin/Heidelberg, Germany, 2015; pp. 234–241. [Google Scholar]
- Zhou, Z.; Rahman Siddiquee, M.M.; Tajbakhsh, N.; Liang, J. Unet++: A nested u-net architecture for medical image segmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4; Springer: Berlin/Heidelberg, Germany, 2018; pp. 3–11. [Google Scholar]
- Badrinarayanan, V.; Kendall, A.; Cipolla, R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 2481–2495. [Google Scholar] [CrossRef] [PubMed]
- Cao, H.; Wang, Y.; Chen, J.; Jiang, D.; Zhang, X.; Tian, Q.; Wang, M. Swin-unet: Unet-like pure transformer for medical image segmentation. In Computer Vision— ECCV 2022 Workshops; Springer: Berlin/Heidelberg, Germany, 2022; pp. 205–218. [Google Scholar]
- Learning, S.-S. Semi-Supervised Learning. CSZ2006. 2006. Available online: https://debategraph.org/Details.aspx?nid=305594 (accessed on 5 September 2024).
- Yun, S.; Han, D.; Oh, S.J.; Chun, S.; Choe, J.; Yoo, Y. Cutmix: Regularization strategy to train strong classifiers with localizable features. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October–2 November 2019; pp. 6023–6032. [Google Scholar]
- Chen, Y.; Ouyang, X.; Zhu, K.; Agam, G. Complexmix: Semi-supervised semantic segmentation via mask-based data augmentation. In Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA, 19–22 September 2021; pp. 2264–2268. [Google Scholar]
- Olsson, V.; Tranheden, W.; Pinto, J.; Svensson, L. Classmix: Segmentation-based data augmentation for semi-supervised learning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA, 3–8 January 2021; pp. 1369–1378. [Google Scholar]
- Ouali, Y.; Hudelot, C.; Tami, M. Semi-supervised semantic segmentation with cross-consistency training. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 12674–12684. [Google Scholar]
- Chen, X.; Yuan, Y.; Zeng, G.; Wang, J. Semi-supervised semantic segmentation with cross pseudo supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021; pp. 2613–2622. [Google Scholar]
- Amini, M.-R.; Feofanov, V.; Pauletto, L.; Hadjadj, L.; Devijver, E.; Maximov, Y. Self-training: A survey. arXiv 2022, arXiv:2202.12040. [Google Scholar]
- Tarvainen, A.; Valpola, H. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In Proceedings of the Advances in Neural Information Processing Systems 30, Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
- Yu, L.; Wang, S.; Li, X.; Fu, C.-W.; Heng, P.-A. Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation. In Medical Image Computing and Computer Assisted Intervention—MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22; Springer: Berlin/Heidelberg, Germany, 2019; pp. 605–613. [Google Scholar]
- Qiao, S.; Shen, W.; Zhang, Z.; Wang, B.; Yuille, A. Deep co-training for semi-supervised image recognition. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 135–152. [Google Scholar]
Methods | IoU (%) | Dice (%) | Pre (%) |
---|---|---|---|
U-Net | 40.81 | 53.57 | 58.34 |
Swin-UNet | 50.24 | 64.12 | 61.52 |
ST | 56.71 | 69.42 | 63.36 |
CPS | 58.15 | 74.11 | 67.73 |
Ours | 68.85 | 79.00 | 78.90 |
Screening Pseudo-Labels | IoU (%) | Dice (%) | Pre (%) |
---|---|---|---|
60.26 | 72.45 | 69.05 | |
✓ | 68.85 | 79.00 | 78.90 |
Improvement | 8.59 | 6.55 | 9.85 |
Methods | IoU (%) | Iou Deviation with Ours (%) | Dice (%) | Dice Deviation with Ours (%) | Pre (%) | Pre Deviation with Ours (%) |
---|---|---|---|---|---|---|
U-Net | 53.81 | 15.04 | 65.25 | 13.75 | 63.26 | 15.64 |
UNet++ | 60.30 | 8.55 | 72.03 | 6.97 | 70.37 | 8.53 |
DeepLabv3+ | 60.44 | 8.41 | 73.46 | 5.54 | 71.19 | 7.71 |
SegNet | 63.26 | 5.59 | 76.18 | 2.82 | 73.73 | 5.17 |
Swin-UNet | 66.54 | 2.31 | 77.48 | 1.52 | 76.91 | 1.99 |
Ours | 68.85 | 0.00 | 79.00 | 0.00 | 78.90 | 0.00 |
Proportion of Labeled Data | Methods | IoU (%) | Dice (%) | Pre (%) |
---|---|---|---|---|
5% | MT | 49.50 | 64.40 | 55.12 |
UAMT | 53.09 | 67.46 | 61.75 | |
DCT | 47.78 | 62.74 | 51.99 | |
CPS | 51.64 | 65.62 | 58.69 | |
Ours | 55.23 | 66.81 | 65.34 | |
10% | MT | 49.95 | 64.11 | 57.82 |
UAMT | 54.69 | 69.13 | 61.72 | |
DCT | 50.68 | 65.77 | 56.36 | |
CPS | 54.54 | 68.90 | 60.90 | |
Ours | 60.68 | 74.06 | 68.53 | |
20% | MT | 52.79 | 68.32 | 59.16 |
UAMT | 55.14 | 70.48 | 63.81 | |
DCT | 51.29 | 65.11 | 57.72 | |
CPS | 55.12 | 71.23 | 62.81 | |
Ours | 63.52 | 77.43 | 74.46 | |
30% | MT | 53.96 | 68.03 | 60.71 |
UAMT | 55.52 | 71.72 | 66.41 | |
DCT | 56.71 | 71.39 | 66.16 | |
CPS | 58.15 | 74.11 | 67.73 | |
Ours | 68.85 | 79.00 | 78.90 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Gan, J.; Liao, T.; Qu, Y.; Bai, A.; Wei, P.; Gan, Y.; He, T. An Automatic Jet Stream Axis Identification Method Based on Semi-Supervised Learning. Atmosphere 2024, 15, 1077. https://doi.org/10.3390/atmos15091077
Gan J, Liao T, Qu Y, Bai A, Wei P, Gan Y, He T. An Automatic Jet Stream Axis Identification Method Based on Semi-Supervised Learning. Atmosphere. 2024; 15(9):1077. https://doi.org/10.3390/atmos15091077
Chicago/Turabian StyleGan, Jianhong, Tao Liao, Youming Qu, Aijuan Bai, Peiyang Wei, Yuling Gan, and Tongli He. 2024. "An Automatic Jet Stream Axis Identification Method Based on Semi-Supervised Learning" Atmosphere 15, no. 9: 1077. https://doi.org/10.3390/atmos15091077
APA StyleGan, J., Liao, T., Qu, Y., Bai, A., Wei, P., Gan, Y., & He, T. (2024). An Automatic Jet Stream Axis Identification Method Based on Semi-Supervised Learning. Atmosphere, 15(9), 1077. https://doi.org/10.3390/atmos15091077