Deep Learning-Based End-to-End Carrier Signal Detection in Broadband Power Spectrum
Abstract
:1. Introduction
- We propose an end-to-end deep CNN-based model for carrier signal detection in the broadband power spectrum, so-called SCN. Without prior knowledge and post-processing, the SCN directly achieves the detection results;
- We conducted several experiments to demonstrate the superiority of our proposed method compared with other existing methods. Additionally, the model scale and the amount of training simulation samples on the performance of the proposed method are investigated.
2. Problem Description
2.1. The Core Task of Carrier Signal Detection Problem
2.2. The End-to-End Detection Process
3. Methodology
3.1. SCN Architecture
- The Residual backbone
- The FPN Neck
- The Regression Network Head
3.2. SCN Training Targets and Loss Function
3.3. SCN Inference Details
4. Experiments
4.1. Data Preparation
4.2. Model Training
4.3. Evaluation Results
- SCN Model scale influence
- The effect comparison of the training set amounts
- Complexity comparison
4.4. Performance Comparison to Other Methods
5. Discussion and Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Appendix A
References
- Henttu, P.; Aromaa, S. Consecutive mean excision algorithm. In Proceedings of the IEEE Seventh International Symposium on Spread Spectrum Techniques and Applications, Prague, Czech Republic, 2–5 September 2002; Volume 2, pp. 450–454. [Google Scholar]
- Saarnisaari, H. Consecutive mean excision algorithms in narrowband or short time interference mitigation. In Proceedings of the PLANS 2004. Position Location and Navigation Symposium (IEEE Cat. No.04CH37556), Monterey, CA, USA, 26–29 April 2004; pp. 447–454. [Google Scholar]
- Escbbach, R.; Fan, Z.; Knox, K.T.; Marcu, G. Threshold modulation and stability in error diffusion. IEEE Signal Process. Mag. 2003, 20, 39–50. [Google Scholar] [CrossRef]
- Saarnisaari, H.; Henttu, P. Impulse detection and rejection methods for radio systems. In Proceedings of the IEEE Military Communications Conference, 2003. MILCOM 2003, Boston, MA, USA, 13–16 October 2003; Volume 2, pp. 1126–1131. [Google Scholar]
- Keane, H.G. A new approach to frequency line tracking. In Proceedings of the 1991 Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers ACSSC, Pacific Grove, CA, USA, 4–6 November 1991; Volume 2, pp. 808–812. [Google Scholar]
- Mustafa, H.; Doroslovacki, M.; Deng, H. Algorithms for emitter detection based on the shape of power spectrum. In Proceedings of the Conference on Information Sciences and Systems CISS, The Johns Hopkins University, Baltimore, MD, USA, 12–14 March 2003; pp. 808–812. [Google Scholar]
- Vartiainen, J.; Lehtomaki, J.J.; Saarnisaari, H. Double-threshold based narrowband signal extraction. In Proceedings of the 2005 IEEE 61st Vehicular Technology Conference VTC, Stockholm, Sweden, 30 May–1 June 2005; Volume 2, pp. 1288–1292. [Google Scholar]
- Vartiainen, J. Localization of multiple narrowband signals based on the FCME algorithm. In Proceedings of the Nordic Radio Symposium NRS, Oulu, Finland, 16–18 August 2004; Volume 1, p. 5. [Google Scholar]
- Kim, J.; Kim, M.; Won, I.; Yang, S.; Lee, K.; Huh, W. A biomedical signal segmentation algorithm for event detection based on slope tracing. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; pp. 1889–1892. [Google Scholar]
- LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef] [PubMed]
- Simeone, O. A Very Brief Introduction to Machine Learning with Applications to Communication Systems. IEEE Trans. Cogn. Commun. Netw. 2018, 4, 648–664. [Google Scholar] [CrossRef] [Green Version]
- Chen, M.; Challita, U.; Saad, W.; Yin, C.; Debbah, M. Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial. IEEE Commun. Surv. Tutor. 2019, 21, 3039–3071. [Google Scholar] [CrossRef] [Green Version]
- Luong, N.C.; Hoang, D.T.; Gong, S.; Niyato, D.; Wang, P.; Liang, Y.-C.; Kim, D.I. Applications of Deep Reinforcement Learning in Communications and Networking: A Survey. IEEE Commun. Surv. Tutor. 2019, 21, 3133–3174. [Google Scholar] [CrossRef] [Green Version]
- O’Shea, T.; Hoydis, J. An Introduction to Deep Learning for the Physical Layer. IEEE Trans. Cogn. Commun. Netw. 2017, 3, 563–575. [Google Scholar] [CrossRef] [Green Version]
- Morozov, O.A.; Ovchinnikov, P.E. Neural Network Detection of MSK Signals. In Proceedings of the 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop, Marco Island, FL, USA, 4–7 January 2009; pp. 594–596. [Google Scholar]
- Li, Y.; Wang, B.; Shao, G.; Shao, S.; Pei, X. Blind Detection of Underwater Acoustic Communication Signals Based on Deep Learning. IEEE Access 2020, 8, 204114–204131. [Google Scholar] [CrossRef]
- Yuan, Y.; Sun, Z.; Wei, Z.; Jia, K. DeepMorse: A Deep Convolutional Learning Method for Blind Morse Signal Detection in Wideband Wireless Spectrum. IEEE Access 2019, 7, 80577–80587. [Google Scholar] [CrossRef]
- Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention; Springer: Munich, Germany, 2015; Volume 9351, pp. 234–241. [Google Scholar]
- Shelhamer, E.; Long, J.; Darrell, T. Fully Convolutional Networks for Semantic Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 640–651. [Google Scholar] [CrossRef] [PubMed]
- He, K.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask R-CNN. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 2980–2988. [Google Scholar]
- Huang, H.; Li, J.Q.; Wang, J.; Wang, H. FCN-Based Carrier Signal Detection in Broadband Power Spectrum. IEEE Access 2020, 8, 113042–113051. [Google Scholar] [CrossRef]
- Lin, M.; Zhang, X.; Tian, Y.; Huang, Y. Multi-Signal Detection Framework: A Deep Learning Based Carrier Frequency and Bandwidth Estimation. Sensors 2022, 22, 3909. [Google Scholar] [CrossRef] [PubMed]
- Lin, T.Y.; Dollár, P.; Girshick, R.; He, K.; Hariharan, B.; Belongie, S. Feature Pyramid Networks for Object Detection. In Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, 21–26 July 2017; pp. 936–944. [Google Scholar]
- Law, H.; Deng, J. Cornernet: Detecting objects as paired keypoints. In Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 734–750. [Google Scholar]
- Zhou, X.; Wang, D.; Krähenbühl, P. Objects as points. arXiv 2019, arXiv:1904.07850. [Google Scholar]
- Proakis, J.G.; Manolakis, D.G. Digital Signal Processing: Principles, Algorithms and Applications, 3rd ed.; Prentice-Hall: Hoboken, NJ, USA, 1996; pp. 910–913. [Google Scholar]
- Welch, P. The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 1967, 15, 70–73. [Google Scholar] [CrossRef] [Green Version]
- He, K.M.; Zhang, X.Y.; Ren, S.Q.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 26 June–1 July 2016; pp. 770–778. [Google Scholar]
- Woo, S.H.; Park, J.; Lee, J.Y.; Kweon, I.S. CBAM: Convolutional Block Attention Module. In Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 3–19. [Google Scholar]
- Chollet, F. Xception: Deep Learning with Depthwise Separable Convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 1800–1807. [Google Scholar]
- Maas, A.L.; Hannun, A.Y.; Ng, A.Y. Rectifier nonlinearities improve neural network acoustic models. In Proceedings of the International Conference Machine Learning (ICML), Atlanta, GA, USA, 16–21 June 2013; p. 3. [Google Scholar]
- Cao, Z.; Simon, T.; Wei, S.-E.; Sheikh, Y. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 7291–7299. [Google Scholar]
- Lin, T.Y.; Goyal, P.; Girshick, R.; He, K.; Dollár, P. Focal Loss for Dense Object Detection. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 318–327. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Proceedings of the 33rd Conference Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 8–14 December 2019. [Google Scholar]
- Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014, 15, 1929–1958. [Google Scholar]
- Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
- Loshchilov, I.; Hutter, F. SGDR: Stochastic Gradient Descent with Warm Restarts. arXiv 2016, arXiv:1608.03983. [Google Scholar]
- Goutte, C.; Gaussier, E. A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation. In Advances in Information Retrieval; Springer: Berlin/Heidelberg, Germany, 2005; pp. 345–359. [Google Scholar]
- Howard, A.G.; Zhu, M.; Chen, B.; Kalenichenko, D.; Wang, W.; Weyand, T.; Andreetto, M.; Adam, H. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv 2017, arXiv:1704.04861. [Google Scholar]
- Szegedy, C.; Liu, W.; Jia, Y.; Sermanet, P.; Reed, S.; Anguelov, D.; Erhan, D.; Vanhoucke, V.; Rabinovich, A. Going Deeper with Convolutions. In Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 7–12 June 2015; pp. 1–9. [Google Scholar]
- Tan, M.X.; Le, Q.V. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; pp. 6105–6114. [Google Scholar]
Implement Library | PyTorch 1.10.0 |
Hardware Platform | 2 GeForce RTX 3080Ti GPU, Intel(R) Bronze 3204 CPU |
Operation System | Ubuntu 20.04 |
Model Input Length | 32,768 |
Batch Size | 32 |
Training Epochs | 150 |
Dropout Probability | 0.3 |
Optimizer | Adam |
Learning Rate Strategy | Cosine Annealing Warm Restarts, initial value 2 × 105, T_0 = 10, T_mult = 2 |
AP | AR | F-Score | |
---|---|---|---|
Double-Thresholds | 77.64% | 68.21% | 72.62% |
Slope Tracing | 89.18% | 88.63% | 88.90% |
SigdetNet with DiceLoss | 95.64% | 98.82% | 97.20% |
SigdetNet with FocalLoss | 98.01% | 98.79% | 98.40% |
FCN-Based 1 | 90.29% | 89.47% | 89.88% |
FCN-Based 2 | 92.56% | 93.71% | 93.13% |
FCN-Based 3 | 93.09% | 93.88% | 93.48% |
FCN-Based 4 | 94.62% | 95.66% | 95.14% |
FCN-Based 5 | 95.65% | 97.39% | 96.51% |
FCN-Based 6 | 97.89% | 97.49% | 97.69% |
FCN-Based 7 | 98.32% | 98.13% | 98.22% |
FCN-Based 8 | 98.30% | 97.43% | 97.86% |
FCN-Based 9 | 98.23% | 97.66% | 97.94% |
FCN-Based 10 | 98.26% | 97.56% | 97.91% |
FCN-Based 11 | 98.20% | 97.25% | 97.72% |
FCN-Based 12 | 98.10% | 97.70% | 97.90% |
FCN-Based 13 | 98.26% | 97.89% | 98.07% |
SCN-6× | 98.35% | 43.09% | 59.93% |
SCN-7× | 99.27% | 60.59% | 75.25% |
SCN-8× | 99.70% | 82.01% | 89.99% |
SCN-9× | 99.75% | 94.55% | 97.08% |
SCN-10× | 99.45% | 96.99% | 98.21% |
SCN-11× | 99.84% | 99.12% | 99.48% |
SCN-12× | 99.73% | 98.59% | 99.15% |
SCN-13× | 99.88% | 99.08% | 99.48% |
Time Cost/ms | FLOPs/M | Parameters/K | |
---|---|---|---|
SigdetNet with FocalLoss | 15.32 | 909.97 | 297.52 |
FCN-Based 1 | 2.01 | 6.29 | 16.03 |
FCN-Based 2 | 3.32 | 7.86 | 25.44 |
FCN-Based 3 | 3.49 | 8.65 | 34.85 |
FCN-Based 4 | 4.78 | 9.04 | 44.26 |
FCN-Based 5 | 5.24 | 9.24 | 53.66 |
FCN-Based 6 | 5.71 | 9.34 | 63.07 |
FCN-Based 7 | 6.14 | 9.39 | 72.48 |
FCN-Based 8 | 6.46 | 9.41 | 81.89 |
FCN-Based 9 | 7.23 | 9.42 | 91.3 |
FCN-Based 10 | 7.93 | 9.43 | 100.7 |
FCN-Based 11 | 9.11 | 9.43 | 110.11 |
FCN-Based 12 | 9.71 | 9.44 | 119.52 |
FCN-Based 13 | 12.28 | 9.44 | 128.93 |
SCN-6× | 8.98 | 12,923.99 | 3312.23 |
SCN-7× | 10.25 | 13,338.22 | 4120.42 |
SCN-8× | 11.45 | 13,545.35 | 4928.61 |
SCN-9× | 12.85 | 13,648.92 | 5736.8 |
SCN-10× | 14.36 | 13,700.71 | 6544.99 |
SCN-11× | 16.7 | 13,726.62 | 7353.19 |
SCN-12× | 16.83 | 13,739.58 | 8161.38 |
SCN-13× | 18.69 | 13,746.07 | 8969.57 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Huang, H.; Wang, P.; Wang, J.; Li, J. Deep Learning-Based End-to-End Carrier Signal Detection in Broadband Power Spectrum. Electronics 2022, 11, 1896. https://doi.org/10.3390/electronics11121896
Huang H, Wang P, Wang J, Li J. Deep Learning-Based End-to-End Carrier Signal Detection in Broadband Power Spectrum. Electronics. 2022; 11(12):1896. https://doi.org/10.3390/electronics11121896
Chicago/Turabian StyleHuang, Hao, Peng Wang, Jiao Wang, and Jianqing Li. 2022. "Deep Learning-Based End-to-End Carrier Signal Detection in Broadband Power Spectrum" Electronics 11, no. 12: 1896. https://doi.org/10.3390/electronics11121896
APA StyleHuang, H., Wang, P., Wang, J., & Li, J. (2022). Deep Learning-Based End-to-End Carrier Signal Detection in Broadband Power Spectrum. Electronics, 11(12), 1896. https://doi.org/10.3390/electronics11121896