Next Article in Journal
Multi-Source SAR-Based Surface Deformation Monitoring and Groundwater Relationship Analysis in the Yellow River Delta, China
Previous Article in Journal
Prediction Aerospace Software to Detect Solar Activity and the Fast Tracking of Solar Activity Using Remote Sensing Instruments in Orbit
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Knowledge Graph-Driven CNN for Radar Emitter Identification

School of Electronic Engineering, Xidian University, Xi’an 710071, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(13), 3289; https://doi.org/10.3390/rs15133289
Submission received: 1 June 2023 / Revised: 15 June 2023 / Accepted: 24 June 2023 / Published: 27 June 2023

Abstract

:
In recent years, the rapid development of deep learning technology has brought new opportunities for specific emitter identification and has greatly improved the performance of radar emitter identification. The most specific emitter identification methods, based on deep learning, have focused more on studying network structures and data preprocessing. However, the data selection and utilization have a significant impact on the emitter recognition efficiency, and the method to adaptively determine the two parameters by a specific recognition model has yet to be studied. This paper proposes a knowledge graph-driven convolutional neural network (KG-1D-CNN) to solve this problem. The relationship network between radar data is modeled via the knowledge graph and uses 1D-CNN as the metric kernel to measure these relationships in the knowledge graph construction process. In the recognition process, a precise dataset is constructed based on the knowledge graph according to the task requirement. The network is designed to recognize target emitter individuals from easy to difficult by the precise dataset. In the experiments, most algorithms achieved good recognition results in the high SNR case (10–15 dB), while only the proposed method could achieve more than a 90% recognition rate in the low SNR case (0–5 dB). The experimental results demonstrate the efficacy of the proposed method.

Graphical Abstract

1. Introduction

Radar emitter identification is the most crucial part of our electronic reconnaissance (ER) [1]. It is a technology used to identify the type of radar transmitting this signal in real-time by analyzing the radar signal obtained by radar reconnaissance [2]. According to the accuracy of radar identification, radar emitter identification can be subdivided into radar type identification, radar model identification and individual radar identification. Specific radar emitter identification is the most significant and complicated part of radar emitter identification.
Up to now, the development of radar emitter identification has undergone three distinct phases. In the first stage of radar emitter identification, parameter matching based on the radar database predominates [3,4,5]. This method identifies the target radar by comparing the parameters of the target signal to the data in the database. In the second stage, the identification method based on the expert database is the most prevalent [6,7,8,9]. Compared with the parameter matching method, the radar experts combine historical reconnaissance information and expert knowledge to form the expert database. The expert system-based identification method is more accurate than the parameter matching method. However, constructing the expert database requires a significant amount of labor from domain experts. In the third stage of radar emitter identification, the “feature extraction and classifier” model predominates [10,11,12,13,14]. Various methods of feature extraction and classification can be combined to create various emitter identification methods. Numerous early works focused on developing more effective feature extraction algorithms, including the fast Fourier transform [14], the short-time Fourier transform [11], the square integral bispectrum transform [12], and Hilbert–Huang transform [13]. With the introduction of deep learning in 2006 [15,16,17], artificial intelligence technology has ushered in vigorous development in various fields, providing a new choice for the design of emitter classifiers.
However, the “feature extraction and intelligent classifier” recognition methods primarily focus on the numerical improvement of recognition accuracy via changing the network structure and preprocessing methods, ignoring the profound influence of sample selection on emitter recognition. The radar individual emitter data drives the specific emitter identification algorithms based on intelligent methods, and reasonable data mining and configuration can accomplish the identification task more effectively. Nowadays, intelligent identification algorithms often select data blindly, evenly distribute data or select data based on the human experience. Data quality is different, and there is often a relationship between the data. For different identification tasks, the selection of data is different. Blind selection and average distribution selection methods are often unsatisfactory. In addition, the manual selection method necessitates a manual analysis of the new task scene, as this is often oriented to specific radar individuals. Likewise, the relationship between data is also not considered. Existing data selection methods are not ideal for data utilization and are incapable of analyzing radar data from the past to form helpful knowledge to support data selection. The identification task can be efficiently completed with reasonable data selection based on different task scenes. It is necessary to reasonably extract and quantify the relationship between radar data to form available knowledge. In this paper, the knowledge graph technology provides a solution for describing the relationship between radar data, which is a technology for constructing the relationship network between things [18].
Knowledge graphs vary in form in different fields [19,20,21,22,23]. In this paper, we use the symbolic network concept to model the relationship between radar data. At the same time, the intelligent emitter recognition algorithm is selected as the objective function to measure the relationship between radar data. The relationship between radar data is transformed into the intelligent space by the intelligent recognizer to measure and form the radar emitter knowledge graph. Finally, this paper performs the recognition experiment on several datasets in some given specific scenes. The precise dataset is constructed by analyzing and utilizing the radar emitter knowledge graph. We combine the obtained dataset with a one-dimensional convolution neural network (1D-CNN) to complete the specific radar emitter identification task. The results of this experiment are positive.
The study of this paper has made the following contributions:
  • A knowledge graph model of a radar emitter is proposed and measures the relationship between radar data in the model.
  • A mechanism is proposed to construct the precise dataset based on the radar emitter knowledge graph.
  • A new method of specific emitter identification is proposed based on the 1D-CNN to identify the emitter on the precise intermediate frequency (IF) radar dataset.
The paper is organized as follows. In Section 2, the fundamental problems of radar emitter identification, the specific emitter identification technology and knowledge graph technology are introduced. In Section 3, the proposed problems are defined. The measurement model of the radar emitter knowledge graph in intelligent space is introduced. Furthermore, a method based on the radar knowledge graph and the one-dimensional convolution neural network (KG-1D-CNN) is proposed. In Section 4, experiments are conducted to verify the proposed method, including the experimental settings, experimental model introduction, experimental result display and analysis. Finally, the conclusion and future work are provided.

2. Related Work

2.1. Specific Emitter Identification

Radar emitter identification is an essential part of electronic reconnaissance [1], which aims to obtain the type and model of the target radar and even identify the individual radar by analyzing the received signal. Most early radar emitter identification algorithms are parameter matching and based on radar parameters measured by an information processing system. Later, the expert database method that integrates professional knowledge is developed. These methods have fast recognition speeds and high reliability in identifying targets contained in the expert database. However, (1) the initial investment is significant, and (2) the unknown target of the expert database cannot be identified. In addition, it is complicated to identify new system radars whose parameters change fast. The development of signal analysis technology has promoted the progress of emitter identification technology. Time-frequency analysis was widely used in the feature extraction of emitter signals [24,25]. It amplified the different characteristics between radar emitter signals by transforming radar signals into the transform domain. Using features with significant differences can identify different radar emitters—the research of L. Li [24] and L.B. Yang [25] show that this method is very effective. Therefore, the “feature extraction + classifier” method is still the mainstream emitter identification method nowadays.
With the deepening of research on machine learning and deep learning technologies, these technologies have also been well applied in emitter identification. Compared with the traditional radar emitter identification algorithm, the intelligent technology-based radar emitter identification method has a superior anti-noise ability and generalization [11,13,14]. Most of the early intelligent emitter recognition algorithms are based on the mode of “preprocessing + feature extraction + intelligent classifier”. Different preprocessing methods, feature extraction methods and classifiers have been combined to produce different recognition algorithms. Z. Xiao combines the short-time Fourier transform and k-means algorithm to obtain a novel spectrum feature used to identify the radar emitter with the convolutional neural network [26]. Baldini. G uses the general linear chirplet transform and the convolutional neural network to achieve SEI [27]. Y. Xiao uses fast Fourier transform (FFT) and the convolution neural network to identify the target with the ADS-B signal [14]. Moreover, Y. Pan expresses the radar signal by the Hilbert–Huang transform and grayscale image and uses the deep residual networks to identify the radar emitter [13]. With the development of deep learning technology, the ability of the network to extract features is constantly improving, and some hidden features are difficult to extract by traditional signal analysis methods, while they can be well extracted by the deep learning-based method. Therefore, the emitter recognition algorithm began to integrate the work of feature extraction and classifiers into the deep learning network and yet only preprocessed the radar signal slightly. M. Zhu uses the deep learning network to extract new signal features for SEI [10]; P. Man uses the convolutional neural network with a relation computer block to identify radar emitters [28]. Kevin. M uses convolutional neural networks to identify RF device fingerprinting in cognitive communication networks [29].
The proposed method chooses the end-to-end emitter identification model to reduce the loss of fingerprint features of data. To conclude, the research so far shows that the subtle information loss greatly impacts the specific emitter recognition; however, it may have little influence on emitter-type identification and model identification when based on the parameters. Then, the end-to-end emitter identification model appears, which assigns the network the responsibilities of data preprocessing, feature extraction and classification identification. It realizes the end-to-end emitter identification from data to the identification result. It effectively avoids the loss of information and reduces the complexity of the process caused by intermediate processing. This paper also chooses this model.

2.2. LFM Radar Signal

In the process of constructing the knowledge graph in this article, the IF data sample set of the specific radar emitter is used as the research object. The information transmission of radar is dependent on the signal. The linear frequency modulation (LFM) signal is the most typical and widely used radar signal. This article uses the LFM signal as the information carrier. This section mainly analyzes the characteristics of the LFM signal in the time and frequency domains.
As the name implies, the instantaneous frequency of the LFM signal changes linearly with time. Furthermore, the mathematical expression of the LFM signal is as follows:
s ( t ) = A r e c t ( t τ ) e j ( 2 π f 0 t + π α t 2 + φ 0 ) ,   0 < t < τ
r e c t ( t τ ) = 1 , 0 , t / τ < 1 o t h e r
where A is the pulse amplitude; r e c t ( t ) is the rectangular impulse function; τ is the pulse width; f 0 is the initial frequency of the signal; α is the frequency modulation slope of the signal; φ 0 is the initial phase of the signal, which is 0 generally.

2.3. Characteristic Analysis of Radar Signal

In a radar signal processing system, the modulation of the radar signal is divided into intentional modulation and unintentional modulation. Intentional modulation is a feature that is actively added to a signal. In contrast, unintentional modulation is the modulation inadvertently added to the signal by uncontrollable factors, such as hardware and system mixing. The radar fingerprint feature is an essential basis for the individual identification of modern radars and belongs to unintentional modulation. There are still some fixed, unique, subtle differences for the same model or even the same batch of radar emitter. These differences are named radar emitter fingerprint features. The inherent defects of each part of the radar transmitter hardware and the mixing operation of the signal by the exciter add subtle features to the radar signal. These subtle features are unique and are called “fingerprint features”. Given the differences between various components of the radar emitter transmitter, mainly the oscillator and the pulse modulator, the features of unintentional modulation can be reflected in the amplitude, frequency and phase of the signal. In this section, the features of the signal envelope and phase noise are analyzed from the aspects of causes and features [30,31].

2.3.1. Envelope Features

In radar signal processing, radar signals can be described as follows:
z ( t ) = a ( t ) e j [ 2 π f 0 t + φ ( t ) ]
where, a ( t ) is the envelope of the signal.
The ideal radar envelope should approximate the rectangle; therefore, the radar system uses the rectangular impulse function more. However, the radar envelope will be distorted to certain degrees due to radar receiver components, passband limits of the radar receiver, space transmission conditions, noise and other influences. The distortion of the radar envelope mainly includes the features of rising edge, falling edge and undulation at the top of the envelope. The main feature parameters that describe the envelope include the pulse width, rising edge time of the envelope, falling edge time of the envelope, the angle between the rising edge and falling edge of the envelope, pulse-top fluctuation of the envelope, location of the envelope peak, the number of envelope peaks, and the inflexion point of the envelope.
In this paper, six envelope parameters are considered for the radar data simulation: pulse width, the rising edge of the envelope, the falling edge of the envelope, pulse-top fluctuation of the envelope, the peak of the envelope and the inflexion point of the top.

2.3.2. Phase Noise Characteristics

The instability of the radar transmitter hardware, the changes in impedance and reactance in the circuit, the thermal effect of components, and the system noise will affect the signal phase, which is embodied as the frequency offset of the signal in the frequency domain. Compared with other reasons, the nonlinear effect of the oscillating circuit is the most crucial cause of phase noise [32]. Therefore, this paper mainly analyzes the phase noise produced by the oscillator.
The oscillator’s phase noise is mainly composed of thermal noise, shot noise, and the frequency modulation and phase modulation parts of flicker noise. The noise with f m 3 characteristics is generated by the frequency modulation of flicker noise, corresponding to the part of the first section in Figure 1. The noise with f m 2 characteristics is usually generated by the frequency modulation of thermal noise and shot noise, corresponding to the part of the second section, as shown in Figure 1. The noise with f m 1 characteristics is generated by the phase modulation of flicker noise, corresponding to the part of the third section in Figure 1. The phase modulation of thermal noise and shot noise produces white noise, which has f m 0 characteristics corresponding to the constant part of Figure 1. Since the carrier frequency’s offset f m of different radar individuals is different, the corresponding phase noise will have individual differences. Radar individuals can be identified by analyzing the phase noise of radar individuals. Since the LFM signal is the research object of this paper, the phase noise model of the LFM signal is introduced in the following sections.
Phase noise is parasitic on the signal. It can be described as the ratio of the power of an oscillator signal within the 1 Hz bandwidth at an offset frequency f m to the power of the carrier signal and denoted L f m .
A radar signal is a complex signal; however, the properties of its real and imaginary parts are the same. For the convenience of analysis, only the real part of the signal is taken for analysis. The mathematical expression of the real part of the LFM signal is as follows:
s ( t ) = A sin ( 2 π f 0 t + π α t 2 + φ 0 ) ,     0 < t < τ
β is the coefficient of phase modulation, and f m is the coefficient of frequency modulation. If the initial phase of the signal is 0, the LFM signal with phase noise is expressed as follows:
s ( t ) = A sin [ 2 π f 0 t + π α t 2 + β sin ( 2 π f m t ) ] , 0 < t < τ
The following formula can be obtained by the sum formula and Bessel expansion:
S t = A sin 2 π f c t + α π t 2 + n = 1 β 2 A sin 2 π t f c + α t 2 + f m n = 1 β 2 A sin 2 π t f c + α t 2 f m
In practice, the coefficient of frequency modulation f m is a set of frequency offsets, while the coefficient of phase modulation β is a corresponding set of values.

2.4. Knowledge Graph

Google formally put forward the concept of the knowledge graph (KG) in May 2012 [33]. Its original intention was to optimize the results returned by search engines, transform the search based on search keywords into the search object itself, and enhance users’ search quality and experience. The knowledge graph is mainly divided into general and domain knowledge graphs [34]. For the general knowledge graph, four large-scale knowledge bases, including Freebase, Wikidata, DBpedia and YAGO, are at the core [35,36]. They provide essential data support for intelligent searches and personalized recommendations of common sense. The domain knowledge graphs include the Internet Movie Database (IMDB), MusicBrainz, UMLS and GeneOnto [37,38,39,40]. IMDB is a database about movie actors, movies, TV programs, TV stars and film production [37]. MusicBrainz is a music knowledge base that collects all music metadata [38]. The medical field includes knowledge bases such as UMLS and GeneOnto [39,40]. Then, the domain knowledge graphs in medical care, e-commerce, finance, agriculture and other fields have been effective [19,20,21,22,23]. Pham T proposed a graph-based multi-label disease prediction model, which uses the medical knowledge graph to help identify the connection between different diseases [19]. Experiments showed that their method outperformed the state-of-the-art algorithms. L. Feng proposed a domain knowledge graph in the E-commerce field called AliMe KG [20]. L. Feng applied AliMe KG to several online business scenarios, such as shopping guides, question answering over properties and recommendation reason generation, and gained approving results. Knowledge graph research in various fields has promoted the better development of the field.
The knowledge graph is essentially a relational network and a graph-based data structure. Broadly speaking, a knowledge graph describes various entities or concepts and their real-world relationships. It constitutes a vast semantic network graph comprising nodes and edges. Nodes are composed of entities or concepts, while the edges are composed of attributes of entities or relationships among entities. The key to constructing the radar emitter knowledge graph is to model nodes and edges and quantify the attribute values of the edges. The successful application of the KGs motivates us to develop a new framework to organize the recognition information provided by the model.

3. Methods

The current research on intelligent emitter recognition algorithms pays more attention to improving the algorithm performance and the numerical improvement of the recognition rate. The relationship between the data itself and the information implied by the difference in the recognition rate is barely utilized. In addition, for many given recognition tasks, the recognition rate of the algorithm has certain requirements, but it is not the only criterion. Furthermore, it is also required to quickly select and organize the appropriate data to train the recognizer that meets the task index efficiently and quickly. To address the data management problem, the proposed KG-1D-CNN has the following processes, as shown in Figure 2:
  • At first, we construct the knowledge graph of the radar emitter. The knowledge graph is used to provide a qualitative and quantitative representation of the relationship between radar data while in the process of radar emitter identification.
  • Secondly, a precise dataset of specific tasks is compiled. For the specific recognition tasks, we performed data selection and identification difficulty ranking based on the constructed knowledge graph to construct the precise dataset.
  • Thirdly, we constructed a radar emitter identification network based on the knowledge graph. On the basis of the selected training data (precise dataset), the network is adjusted so that it can identify targets from simple to complex based on prior knowledge.

3.1. Construct Radar Emitter Knowledge Graph

Other knowledge graphs aim to describe various entities (nodes) and their relationships (edges) in the real world. However, the radar emitter knowledge graph is actually used to measure the magnitude of difference between different emitter data; that is, to characterize the degree of recognition difficulty among radar emitter individuals. For clarity, some terms need to be explained:
  • Node: In graph structures, a node is a vertex in a graph. The knowledge graph expands on the graph’s basis, and a node is a vertex composed of entities and concepts.
  • Edge: In a graph, an edge is a line between nodes. In the knowledge graph, edges represent the connections between nodes, comprising relationships and attributes.
  • Radar emitter individual: the radar emitter individual is a unique radar with fingerprint characteristics, and all emitters mentioned in this paper refer to the radar emitter.
The reasonable selection and application of radar data depend on the analysis of data relationships. In this paper, the knowledge graph of radar emitters is defined as the recognition relationship between radar data regarding a certain model. The key to constructing the emitter’s knowledge graph is to model the construction of nodes and edges. As shown in Figure 3, the construction of the knowledge graph in this section consists primarily of three steps.
  • Step 1: Node Modeling: this section primarily implements the mapping of radar data to the nodes in the knowledge graph.
  • Step 2: Edge Modeling: the relationship between radar data is materialized as the edges between nodes, and the proposed measure model is used for qualitative and quantitative measurements.
  • Step 3: Radar Emitter Knowledge Graph Construction: by integrating the results of step 1 and step 2, a radar emitter knowledge graph is formed to represent the interaction between radar data during the radar identification process.

3.1.1. Node

Node modeling and edge modeling are the basis for knowledge graph construction. This section uses node modeling to implement the representation of radar emitter data in the knowledge graph. The knowledge graph in this article primarily describes the relationship between radar data. Typically, the dataset originating from the same radar individual can represent the radar individual at the data level. The relationship between the radar individuals and samples fits the connotation of entities and concepts in node definition. Therefore, the radar individual is modeled as a node in the knowledge graph. Specifically, the radar dataset representing the radar individual is used as the filling content of the individual radar node. The specific node construction process is shown in Figure 4.
The preceding diagram demonstrates that the radar data samples are modeled as distinct nodes in the knowledge graph via node construction. The comprehensive algorithm for node construction is shown in Algorithm 1.
Algorithm 1: The Nodes Construction Algorithm
1 : Input :   radar   emitter   datasets :   d a t a s e t s 1 , d a t a s e t s 2 , , d a t a s e t s k . 2 : Output : the   node - set   of   radar   emitter   knowledge   graph :   V 3 :   Construct   the   radar   emitter   nodes   4 : for   i = 1   to   k   do                                                 / /   k : the   number   of   radar   emitter 5 :             V i ( n i r a d a r i , c i d a t a s e t i )                                                       / /   n i : the   name   of   V i ,   c i : the   content   of   V i 6 : end for 7 : return V

3.1.2. Edge

In the section, when using edge models, the relationships between radar data are modeled. Unlike the previous radar emitter identification process that is based on multi-parameter measurements and time-frequency analysis, this paper’s specific radar emitter identification is based on the full-pulse radar data of the intermediate frequency, and it is unnecessary to measure and analyze the attributes of radar data samples. The primary purpose of constructing the radar emitter knowledge graph is to measure the relationship between radar emitter data. Undoubtedly, there is a relationship between radar emitter data. In the recognition network, data interaction influences the training and ultimate recognition results of the recognizer. It is easy to find that some data collaboration can improve recognition performance during actual training, while others can make recognition more difficult. For recognition tasks, different data combinations have different effects on the task results, reflecting the collaborative relationship between data, which provides a feasible idea for measuring the relationship between radar data.
This paper models the relationships between radar data using a description of the relationships between nodes in the signed network [41]. A signed network is a two-dimensional complex network using nodes and edges to express the connection of things. The signed network defines the edges between nodes in two opposite relationships: a positive relationship and a negative relationship. However, the signed network only describes the node relationship qualitatively, and its description accuracy is too low to effectively show the difference in radar data influences on the recognition task. Therefore, based on its concept, the value of the edge is processed continuously. In a given network with N nodes, the definition of edge e i j is as follows:
e i j = ( 0 , + 1 )   if   node   v i   to   v j   is   linked   positively ,   ( 1 ,   0 )   if   node   v i   to   v j   is   linked   negatively ,   0   if   node   v i   and   v j   is   linked   weakly .  
where, e i j is the edge of the node v i pointing to the node v j . It should be noted that e i j is different from e j i .
Data drives the application of intelligent networks in radar emitter identification; therefore, whether the data contribute to completing the identification task is a qualitative criterion for its positive and negative relationships. The interaction of data causes the result of emitter recognition, and the emitter recognition rate is its numerical expression. Thus, a comprehensive analysis of the emitter recognition rate can be used to quantify the interaction between data in this recognition task. The specific measurement algorithm is shown in Algorithm 2.
Algorithm 2: The Edges Quantification Algorithm
1 :   input :   the   radar   emitter   nodes   :   V = { , V i : ( n i r a d a r i , c i d a t a s e t i ) , } N :   the   nuber   of   radar   emitter   nodes 2 :   output : the   edge   set   formed   by   the   nodes   in   V :   E = { , e i j , } 3 : Use   the   emitter   identifier   to   obtain   the   recognition   rate   set   of   { , r a d a r i , }   in   V   is   { , p i , } .                                           //   Prepare   for   the   edge s   quantificaion   4 :   for   i = 1   to   N   do                                         / /   Quantify   the   edge   in   the   graph 5 :         for   j = 1   to   N   do 6 :                     e i j = p j                                         / /   Use   the   recognition   rate   to   quantify   the   edge 7 :                     if   i = j   then 8 :                             e i j = N o n e                                         / /   Correct   the   value   of   edges   pointing   to   itself   9 :                     end   if 10 :         end   for 11 :   end   for 12 : return   E
Through the quantification operations of all edges in the graph, the set of all edge values e = , e i j , is obtained. Since the recognition rate is a value on the continuous interval ( 0 , 1 ) , there is e i j ( 0 , 1 ) . Locating the values 0, −1 and 1, and in particular, 0 in the threshold, is the key objective of edge value characterization in Formula (7). In this paper, the mean, maximum and minimum values of the set are taken to map 0, −1 and 1 in Formula (7), respectively, using the function f · to achieve their mapping. The specific formula is as follows:
min ( e ) , m e a n ( e ) , max ( e ) f ( · ) 1 , 0 , + 1 f ( e ) = e min ( e ) m e a n ( e ) min ( e ) 1 , e < m e a n ( e ) e m e a n ( e ) max ( e ) m e a n ( e ) ,             e m e a n ( e )

3.1.3. Radar Emitter Knowledge Graph

The recognition accuracy of a radar emitter individual is the result of the interaction of all the training data. The certain target individual’s recognition accuracy is the embodiment of the interactions of the other individuals included in the training set, which can be used to describe the other individuals’ influence on the identification of the individual quantitatively. However, in one recognition task, it is difficult to distinguish the influence degree of other individuals on the target individual. Therefore, this paper subdivides the identification tasks in the building process of the radar emitter knowledge graph and measures the different influence values through multiple identification tasks.
In this paper, the measurement of the edge e i j from node v i pointing to node v j is taken as an example. Firstly, the recognition task, including the target node v j , the node v i and other nodes, is selected to train the recognition network, and the recognition rate is obtained. In a recognition task, the recognition rate of v j is the edge sub-value e i j from node v i pointing to node v j under the interference of this third-party node in this recognition task. Notably, (1) the recognition network is used as the measurement component to provide the recognition rate in this process; (2) the node’s number K , including the measured nodes v i and v j , is set to K 3 because at least one third-party node participation is required in one recognition task for measuring the edges. Secondly, all task combinations are to be obtained, including the target nodes and third-party nodes, and the recognition rates of the target nodes under these recognition task conditions are to be counted. Then, we obtain all the edge sub-values e i j from node v i pointing to node v j when various influences are introduced in the radar emitter knowledge graph. Thirdly, all the sub-values e i j are averaged, and the ultimate value of edge e i j is the average value, which balances the effects of all the other nodes. Finally, all edges in the radar emitter knowledge graph traverse the above operations. By integrating these edges, the radar emitter knowledge graph’s relational adjacency matrix of nodes is obtained. The specific Algorithm 3 is as follows.
Algorithm 3: Knowledge Graph of Radar Emitter Structuring Algorithm
1 : input :   the   radar   emitter   nodes :   V = { , V i : ( n i r a d a r i , c i d a t a s e t i ) , } ( included   N   nodes ) ,   the   node s   number   in   once   recognition   task   for   measuring   edges :   K ( K 3 ) 2 : output : the   adjacent   matrix   of   radar   emitter   knowledge   graph :   G ( V , E )   3 : Divide   the   nodes   into   a   group   of   K   nodes ,   and   get   all   possible   combinations   as   M ,   where M t = { , v j , } M .                                                     / /   Prepare   node   grouping   for   measuring   edges   4 : for   M i = { , v j , } in   M   do                                               / /   Get   the   measured   values   of   the   edges   in   all   groups   5 :         Train   the   emitter   identifier with   { , d a t a s e t s j , }   in   M i ,   and   obtain   the   recognition   rate           set   of   { , r a d a r j , }   is   { , p j i , } .                               / /   Prepare   for   the   edge s   quantificaion   in   M i
6 :         for   t   in M i do 7 :                         for   q   in M i do 8 :                                     e q t i = p t i                                       / /   Use   the   recognition   rate   to   quantify   the   edge   in   M i 7 :                                     if   i = j   then 8 :                                               e t t i = N o n e                               / /   Correct   the   value   of   edges   pointing   to   itself   9 :                                     end   if 9 :                         end   for 11 :         end   for 12 : end   for 13 : e = 1 C N 2 K 2 i = 1 , , C N K e i                           / /   Take   the   average   of   all   measured   values   as   the   final   value   14 : e = f ( e )                                               / /   Use   formula ( 8 )   to   map   the   value   of   edges   in   the   graph   to   ( 1 ,   1 ) 15 : G ( V , E ) ,   V = { v 1 , , v N } ,   E = { e 12 , , e ( N 1 ) N }                                                   / /   Integrate   V   and   E   to   get   G 16 : return   G
The above process of building the radar emitter knowledge graph based on radar data can be simply represented in Figure 5.

3.2. Precise Dataset Construction

In the radar information processing system, the specific emitter identification generally trains the recognizer based on the data provided by the front end. The intelligence information on the target of the front-end reconnaissance system is beneficial for radar emitter identification. However, it is usually only sent to the decision-making system to assist in decision-making, while it is not applied to the process of emitter identification. The previous identification process could not extract helpful information and form an effective strategy to improve the identification performance, which resulted in a waste of intelligence information. The actual recognition scene is a complex scene with multiple emitters. Generally, radar emitter recognition usually sends all the training data of the radar emitters without distinction to the intelligent recognition network for recognizer training, which can achieve good results when the data and computing resources are sufficient. However, because the data are not distinguished, the network’s resources are evenly distributed to all types of data. The effective features for identification in the network are screened out little by little through training iteration. Moreover, when many types of data enter the network simultaneously, they often need a deeper network to obtain the required recognition rate. To sum up, the existing problems of the current recognition methods include insufficient use of front-end target information and insufficient consideration of the data differences in recognition network training.
With the above radar emitter knowledge graph, we can obtain the difference values between the data. With the front-end intelligence information and task information, we can obtain the recognition difficulty values between the emitter data. According to the information, the effective part of the knowledge graph is extracted to form a subgraph. Using the subgraph, the data influence relationship between the target node and the task-related nodes can be described.
In the process of learning new knowledge, humans tend to learn key and simple knowledge first, followed by progressively more difficult information until they master the complex new knowledge. In this section, the precise dataset construction method can learn from the human knowledge acquisition process. The specific operation is to arrange all nodes according to the degree of difficulty, distinguishing nodes from target nodes and forming a precise dataset with a difficulty ranking for a specific task. The specific operation process is shown in Figure 6.
Compared to the disorderly placement of data and feeding them together into the network, the precise dataset can express the ease of differentiation between different individuals and target individuals, which provides data preparation for further use of the precise dataset for the simple to complex identification of radar emitters.

3.3. The Proposed Specific Emitter Identification Method

3.3.1. Specific Emitter Identification via 1D-CNN

The convolutional neural network has been widely used because of its excellent feature extraction and noise immunity performance [42,43]; therefore, this paper selects CNN as the identification model. Meanwhile, in order to better retain the subtle features of radar individuals and improve the timeliness of the recognition algorithm, this paper selects the radar emitter recognition algorithm based on the IF data. This paper selects 1D-CNN to classify and identify the IF radar data because the radar IF data is a one-dimensional signal.
Our radar emitter identification model is the 1D-CNN, comprising an input layer, convolutional layer, pooling layer, fully connected layer and classifier. Figure 7 shows the structure of the 1D-CNN constructed in this paper. First, the input layer inputs a one-dimensional radar IF data sequence of size 3000 × 1. Then, three blocks of the “convolutional layer + pooling layer” are built. Since the network’s input data is one-dimensional, we use one-dimensional convolutional kernels with the size of 7 × 1. The pooling layer performs the extraction of the main features, and the maximum pooling is chosen here. In addition, the activation functions after the three pooling layers are chosen as the hyperbolic tangent activation function. Finally, a fully connected layer connects the features obtained from the third pooling layer to obtain a vector of size 1 × 96. Dense is used for dimensionality reduction to obtain a vector of size 1 × 10. The vector is sent to the softmax classifier for its final classification.

3.3.2. Specific Emitter Identification via Knowledge Graph and 1D-CNN

The previously constructed radar emitter knowledge graph has already laid the foundation for solving the proposed problem, which measures the relationship between the radar data in the knowledge graph and provides a necessary reference basis for selecting and using data in this method. The framework diagram of the proposed method is shown in Figure 8.
The method is divided into three main parts: the construction part of the radar emitter knowledge graph, the precise dataset construction part, and the training part of the radar emitter identification network. The first part constructs a radar emitter knowledge graph based on radar data, in the form of which the relationships between radar data are described. The second part is to use the information from the knowledge graph to construct the precise dataset for the specific task. At first, we combine the front-end intelligence information and task information to extract the subgraphs of the radar emitter knowledge graph, which contain the relationships between the target nodes and nodes in the task scene. Then, the nodes are ranked according to the subgraphs to obtain the precise dataset with a recognition difficulty from easy to difficult. The third part is training the recognition network based on the previous research. The network, built on the identification sub-model according to the precise dataset, sifts out the non-target data from easy to difficult. Finally, the data that pass all the sub-models are those predicted to be the target, while vice versa are those predicted to be non-targets. According to the data characteristics and task scene, the final recognition network is built by the sub-models of the same structure. In this paper, the sub-models are chosen as 1D-CNNs because radar emitter identification is performed on the IF data (belonging to one-dimensional data). The specific emitter identification algorithm via KG and 1D-CNN is as follows.
Compared to feeding all the data directly into the network, the proposed method guides the network’s training through a reasonable analysis of the relationships between the radar data. The proposed method uses a precise dataset to hierarchize the recognition difficulty. Recognition sub-models are cascaded to achieve target recognition from easy to difficult, step by step. Each passing sub-model screens out a portion of the non-target data, thus reducing the difficulty of the final task. The task’s difficulty is reduced step by step, and by the last sub-model, the task difficulty has been simplified into layers. The traditional all-in approach needs to continuously fit comprehensive, high-quality features to distinguish all individuals during training. At the same time, in the proposed method, each sub-model tends to learn the significant distinguishing features of the corresponding sub-task. The results of all sub-models are added together to obtain the final recognition results. The task difficulty of the proposed method is the sum of the difficulty of each sub-task. However, the difficulty of the all-into method is geometrically multiplied by the difficulty of all the sub-tasks.

3.4. Computational Complexity Analysis

In this section, the computational complexity of the radar emitter knowledge graph construction algorithm and the KG-1D-CNN algorithm are analyzed. The basic computational composition of both algorithms contains training the 1D-CNN sub-model, and the complexity of the model is mainly described by the model’s parameters and floating-point operations (FLOPs). Since the data size and model structure have been determined, the parameter of a 1D-CNN sub-model is determined to be 5562, and the FLOPs of a 1D-CNN sub-model are also determined to be 3.67 M. Therefore, the complexity of the 1D-CNN sub-model is denoted as O ( B ) , with B being a constant.
The computational complexity of the knowledge graph construction is mainly determined by two parts: the metric part and the edge value computation part. In the first part, the computational complexity is determined by (1) the number of executions of metric operations and (2) the complexity of an operation (that is, the complexity of training a single 1D-CNN sub-model). The knowledge graph contains N nodes, and a single metric requires the K nodes to participate; therefore, the metric experiment is executed by the T = C N K times, and its computational complexity is O ( N K ) ; therefore, the computational complexity of the metric part is O ( B N K ) . The second part is to compute the edge values based on the metric results. For a single edge, the computation is the average of the results of all metric operations associated with it, and its complexity is O ( N 2 ) . There are N 2 edges to be computed in the knowledge graph; thus, the complexity of the edge value computation is O N 2 N 2 O N 3 . In summary, the complexity of the knowledge graph construction is O N K B + N 2 N 2 O N K .
The computational complexity of the KG-1D-CNN algorithm is also determined by two main components. The first source of computation is the precise dataset construction part, which ranks the subgraph of the n radar emitters contained in the task environment, and has a computational complexity of O n 1 2 . The second part is the model training, which comprises n 1 / k 1 1D-CNN sub-models with the same structure as the previous 1D-CNN sub-model; thus, the computational complexity of this part is O B n 1 / k 1 . In conclusion, the computational complexity of the KG-1D-CNN algorithm is O n 1 2 + B n 1 / k 1 . In terms of numbers, a determined CNN model’s computing effort B is significantly more than a given task’s environmental radar number n . Therefore, the complexity of the KG-1D-CNN algorithm depends mainly on the second term.

4. Experiments

In this section, we set five test problems to verify the performance of the proposed method from different aspects, using the 1D-CNN algorithm as the baseline algorithm for comparison. In addition, the proposed method is compared with other radar identification methods at different signal-to-noise ratios (SNR) and the number of samples. All experiments are performed on a computer with an Intel 10900K CPU, 64 GB of RAM and an RTX 3070 GPU. The evaluation metrics of the algorithm mainly comprise precision, recall, the F1-score and accuracy, which are defined as follows.
p r e c i s i o n = T P T P + F P ,   r e c a l l = T P T P + F N ,   a c c u r a c y = T P + T N T P + F P + F N + T N ,   F 1 - s c o r e = 2 × p r e c i s i o n × r e c a l l p r e c i s i o n + r e c a l l
where, T P (True Positive) is the correctly predicted positive; F P (False Negative) is the wrongly predicted positive; T N (True Negative) is the correctly predicted negative; F N (False Positive) is the wrongly predicted negative.

4.1. Experiment Settings

In this part, ten radar individuals are constructed with different types of parameters or individual parameters. The radar-type parameters are mainly carrier frequencies, frequency bandwidths and time widths, while the individual radar parameters are mainly phase noise parameters and envelope parameters. Since we use filters to simulate the envelope shape, the envelope parameters are mainly expressed as filter parameters. The sampling frequency of all signals is 1 GHz. Ten radar emitters contain different values of SNR of 0 dB, 5 dB, 10 dB and 15 dB, respectively. The number of samples per radar emitter individual dataset with each SNR is 200 and 400, separately. The ten emitter-type parameters and individual parameters are shown in Table 1 and Table 2, respectively.
The Figure 9 shows the signal waveforms of 10 radar emitter individuals with the SNR of 10 dB.
We designed five recognition problems with the same radar database and SNR of 10 dB. The database contains ten emitters, each with 200 samples. The task’s target individual and interfering individuals in the task environment can be changed to verify the algorithm performance in various task scenes. The five test recognition problems are as follows (Table 3).
In training the network, we used the cross-entropy loss function and Adam optimizer with a learning rate of 0.001 and a batch size of 64. The model with the highest accuracy on the validation set was saved.

4.2. Construction Experiment of Radar Emitter Knowledge Graph

The experimental scenes of five test problems contain the same radar database; therefore, the same radar emitter knowledge graph is constructed. As described in the construction process in Section 3.1, the measure-kernel is constructed using the 1D-CNN network proposed in Section 3.3.1. The number of nodes for each measurement experiment in the edge measure process is chosen as K = 3 . The adjacency matrix of the final radar emitter knowledge graph, obtained from the measurement experiments, is shown in Table 4.
The nodes and elements in the adjacency matrix A correspond to the nodes and edges in the knowledge graph G , respectively. The correspondence is as follows:
a i j = e i j       a i j A , e i j E , v i , v j V

4.3. Results

The experimental process is divided into the following three main steps.
  • First, as in Section 3.2, we extract the task-related subgraph according to the task scene, and the specific formula for extraction is as follows:
    G s u b ( V s u b , E s u b ) G ( V , E ) v t , v i V s u b v t : target   node ,   v i : node   in   the   scene e t i E s u b
  • Second, the task subgraph is ranked from easy to difficult to construct the corresponding precise dataset for the target.
  • Third, the precise dataset is divided into a training set and a test set. In all the subsequent experiments, the number ratio of the training data to test the data is 8:2, and 1/8 of the training data is used as the validation data. As in Algorithm 4, the training set is fed into the network for training to obtain a well-trained recognition model. Finally, the test set is fed into the recognition model to obtain the recognition accuracy.
    Algorithm 4: Specific Emitter Identification via KG and 1D-CNN Algorithm
    1 : input :   V :   the   dataset   V = v T + { v 1 , v 2 , , v n }   ( including   n + 1   nodes   and   N   data   samples   per   node in   the   task   scene ) ,   v T :   the   target   node ,   { v 1 , v 2 , , v n } :   the   precise   dataset ,   the   node s   number   in   a recognition   identification   sub - model   training :   k ( k 3 ) .   λ :   training   ratio   ( the   percentage   of training   data   to   total   data ) .   λ 1 :   validation   ratio   ( the   percentage   of   validation   data   to   total   data ) . 2 : output :   the   trained   identification   network   3 : Data   partition : V t = { V t r , V t v , V t e }       training   set :   V t r = V ( 1 : λ N ) = v T ( 1 : λ N ( T ) ) + { v 1 ( 1 : λ N ( 1 ) ) , v 2 ( 1 : λ N ( 2 ) ) , , v n ( 1 : λ N ( n ) ) } .       validation   set :   V t v = V ( λ N + 1 : ( λ + λ 1 ) N ) .       test   set :   V t e = V ( ( λ + λ 1 ) N + 1 : N ) . 4 : for   i = 1   to   n / k 1 do                                                                 / /   Train   all   sub - models   with   the   precise   dataset 5 :             Take   the   most   distinguishable   k 1   nodes   in   the   precise   dataset ,   and   combine   them                 with   the   target   node   to   form   the   sub - model   dataset :   s u b _ V t i                 / /   Prepare   datasets   for   the   s u b m o d e l i   training   6 :             Feed   the   sub - model   with   s u b _ V t i                           / /   Train   the   s u b m o d e l ( i )   with   s u b _ V t i 7 :             do :   8 :                         o u t p u t i = s u b m o d e l . m o d e l ( s u b _ V t r i )                         l o s s = c a t e g o r i c a l _ c r o s s e n t r o p y ( o u t p u t i , L t r i )                                                                   / /   L t r i   is   the   label   of   data                         l o s s . b a c k w a r d ( ) 9 :             While   e p o c h < g 10 :             Validate   the   trained   sub - models   with   s u b _ V t v i   and   obtain   a   well   trained   s u b m o d e l ( i ) . 11 :             Remove   the   k - 1   nodes   that   have   been   trained .                               / /   Update   the   precise   dataset   12 : end   for 13 : Connect   all   the   trained   sub - model   to   obtain   the   well   trained   network 1 ^   : The   target   output   channel   of   the   front   sub - model   is   connected   with   the   input   channel   of the   back   sub - model .                                     / /   Connect   all   the   trained   sub - model s   input   and   output 14 :   Test   the   network   with   the   test   set   V t e . 15 : return   network 1 ^

4.3.1. Experiments on Five Test Problems

We performed experiments based on the five test problems in Table 3 to verify the performance of the proposed algorithm in different situations, and we used 1D-CNN without KG (as in Figure 7) as the baseline method for the comparison.
The experiments were first conducted under Problem 1 to verify the recognition performance of our method for a single task target.
The interfering emitter individuals under Problem 1 are Emitter 1, Emitter 4, Emitter 6, Emitter 8 and Emitter 9, so the subgraph of Problem 1 is extracted from Table 4. The values of the subgraph are sorted from easy to difficult. The result is shown in Table 5.
Based on the ranking result of Table 5, the training set was extracted, and the recognition model was trained and tested. The experiments were repeated ten times to exclude the chance factors. The final recognition results are listed in the following table.
From Table 6, it can be seen that the proposed method can achieve good recognition accuracy with an SNR of 10 dB in a single-target recognition task. The process of extracting subgraphs and constructing the precise dataset of a task is simple, yet tedious. A similar description is already provided in the previous experiments; thus, this part will not repeat in the later experiments. Repeated experiments of the proposed and baseline methods were performed under five test problems (10 times per method per test problem). The results are mainly presented in terms of recognition accuracy and time usage, as shown in Figure 10.
The results of the repeated experiments were integrated to obtain the results in Table 7. Comparing the results of Problem 1 and Problem 2, it can be seen that our method achieves good recognition results for different targets. For the same target emitter 7, the recognition results are slightly different between Problem 1 and Problem 4; however, their accuracies both reach more than 97%. For the algorithm time usage, the recognition environment of Problem 4 is more complex than Problem 1; thus, the running time spent under Problem 4 is slightly larger than Problem 1. Problem 3 and Problem 5 are designed to verify the performance of the proposed method under the task with multiple recognition targets. The target recognition problem under multiple targets is solved by decomposing it into multiple single-target recognition problems. The results show that the proposed method is also effective for the multiple-target recognition problem. However, the usage time increases as the number of targets increases, which is because the proposed method is more applicable to situations with task-prior information to determine or reduce the range of targets. In addition, the accuracy of the proposed method is higher than that of the baseline method in all five test problems. This indicates that the proposed method of constructing precise datasets based on the radar emitter knowledge graph does help to improve the recognition rate.
Since test problem 5 is more complex than the other problems, its results are displayed and analyzed separately next. In test problem 5, the target radar emitters are the same as the environment emitters, simulating the task without a priori information. This is the least suitable case for the proposed method because it is more suitable for tasks with a priori information. The specific experimental results for test problem 5 are as follows:
According to Table 8, the recognition results of ten emitter individuals in Problem 5 differ, with the worst result reaching 95.7%. This difference in recognition merely verifies what is stated previously: there is a difference in the difficulty of recognition between individuals. From Table 1 and Table 2, there is a significant difference between Emitter 10 and the other nine, both in the type parameters and individual parameters; thus, it is the easiest to identify and achieve the highest recognition rate. In this experiment, the overall recognition rate is 97.28% for all the target emitters. We took the sum of each emitter’s time usage as the task time usage, which is 197.23 s.

4.3.2. Comparisons with Other Methods

To better demonstrate the effectiveness of our method, this part is compared with some other individual recognition algorithms based on deep learning. The recognition under Problem 5 can be equivalent to the recognition scene of the traditional method, and thus the identification setting of Problem 5 is chosen as the setting of the comparison experiments. The SNR in the scene is changed to observe the change in recognition accuracy with the SNR. The classical RESNET50 is chosen for comparison Algorithm 1. Since this paper recognizes the radar by IF data, which is one-dimensional, the convolution kernel in the network is changed to one dimension, and the network becomes 1D-RESNET50. The algorithms of article [28], article [14] and article [29] are chosen as the comparison Algorithms 2–4. The 1D-CNN mentioned in Section 3.3.1 is chosen for the 5th comparison algorithm. The results of the comparison experiments are as follows:
The recognition accuracy of each method is good when the SNRs are 10 dB and 15 dB. However, with the decrease in SNR, the recognition rates of the five comparison algorithms are significantly reduced. In contrast, the accuracy of the proposed method is slightly reduced with the SNR, and it is still stable above 90%. Although the recognition accuracy of the 1D-CNN algorithm proposed in this paper is slightly lower than that of the comparison algorithms, it takes much less time than all other comparison algorithms. The 1D-CNN makes up for the disadvantage that the proposed algorithm needs more time in the condition to recognize all individuals, so we chose the 1D-CNN as the sub-model of the proposed algorithm. The experiments also show that the proposed method’s recognition accuracy is stable and high under all SNRs but with the most time used to identify all individuals. However, the proposed method is mainly aimed at the situation where prior knowledge can narrow the target. In conjunction with the previous experiments, it is evident that the time usage of the proposed algorithm will be substantially reduced if the target number is decreased.
Table 9 demonstrates that the recognition performance of the comparison algorithms is poor when the SNR is low. Considering that it may be related to the number of samples, we raised the sample number of each individual to 400 under each SNR and conducted the following recognition experiments. The results are as follows:
Table 10 shows the amount of data that increases; the recognition accuracy of each algorithm increases, and so does the recognition time. The overall recognition of each algorithm with a sample number of 400 is consistent with the sample number of 200. The proposed method can stabilize the recognition accuracy at a high level.
Comparing all the experimental results, we can see that the recognition performances of other traditional recognition algorithms decrease significantly with a smaller sample number and low SNR. At the same time, our method can maintain a high recognition accuracy. Our proposed method measures the influence relationship between the radar data in the recognition task via a knowledge graph, extracts the corresponding subgraph of the specific task and analyzes the influence relationship to guide the network from easy to difficult to identify different emitter individuals. The experiments demonstrate that this recognition approach has good recognition performance in various test scenes.

5. Conclusions

In this paper, we propose a radar emitter identification method based on the radar relationship knowledge graph, which has (1) measured the relationship between radar data, (2) improved the identification accuracy by training the network based on the knowledge graph, and (3) ensured the identification accuracy with fewer data samples and a lower SNR. In this paper, a knowledge graph is used to represent the relationship between radar emitters, where 1D-CNN is used as the metric kernel of the relationship between the nodes in the knowledge graph. The knowledge graph is used to rank the recognition difficulty levels on the task dataset, and the ranked data are fed from easy to difficult to train the sub-models, which are used to build the recognition network to realize the recognition task. The experimental results show that this method could improve the recognition rate. Compared with other recognition methods, it also had better robustness to noise and had more stable recognition results with fewer data.
However, there are some limits to our method. First, the construction of the radar relationship knowledge graph is time-consuming. Secondly, this paper mainly verifies the methodology’s feasibility; thus, the number of radar emitters is not large. Thirdly, the proposed method’s time usage without a priori information is not less than the comparison algorithms. For the first limit, the “offline + online” model is currently used to solve it, in which the knowledge graph’s generation is carried out offline in the early stage. For the second problem, we will expand the radar emitter’s number and explore the characteristics of a larger radar relationship knowledge graph in the future. For the third problem, in future work, we will continue to explore a combined method of knowledge graphs and radar emitter identification that relies little on a priori information.

Author Contributions

Conceptualization, Y.C. and P.L.; methodology, Y.C. and G.L.; software, Y.C.; validation, Y.C.; formal analysis, Z.W. and Y.C.; investigation, Y.C., E.Y. and Z.J.; resources, P.L.; data curation, Y.C.; writing—original draft preparation, Y.C.; writing—review and editing, Y.C. and Z.W.; validation, Y.C.; supervision, P.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research is funded by the Fundamental Research Funds for the Central Universities (No. XJSJ23020).

Data Availability Statement

Data sharing is not applicable.

Acknowledgments

The authors would like to show their gratitude to the editors and the reviewers for their insightful comments.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zohuri, B. Electronic countermeasure and electronic counter-countermeasure. In Radar Energy Warfare and the Challenges of Stealth Technology; Springer: Berlin/Heidelberg, Germany, 2020; pp. 111–145. [Google Scholar]
  2. Cao, R.; Cao, J.; Mei, J.-p.; Yin, C.; Huang, X. Radar emitter identification with bispectrum and hierarchical extreme learning machine. Multimed. Tools Appl. 2019, 78, 28953–28970. [Google Scholar] [CrossRef]
  3. Ting, C.; Wei, G.; Bing, S. A new radar emitter recognition method based on pulse sample figure. In Proceedings of the 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Shanghai, China, 26–28 July 2011; pp. 1902–1905. [Google Scholar]
  4. Jin, Q.; Wang, H.; Yang, K. Radar emitter identification based on EPSD-DFN. In Proceedings of the 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China, 12–14 October 2018; pp. 360–363. [Google Scholar]
  5. Matuszewski, J.; Sikorska-Łukasiewicz, K. Neural network application for emitter identification. In Proceedings of the 2017 18th International Radar Symposium (IRS), Prague, Czech Republic, 28–30 June 2017; pp. 1–8. [Google Scholar]
  6. Dash, D.; Valarmathi, J. Radar Emitter Identification in Multistatic Radar System: A Review. In Proceedings of the International Conference on Automation, Signal Processing, Instrumentation and Control, Singapore, 27–28 February 2021; pp. 2655–2664. [Google Scholar]
  7. Kong, M.; Zhang, J.; Liu, W.; Zhang, G. Radar emitter identification based on deep convolutional neural network. In Proceedings of the 2018 International Conference on Control, Automation and Information Sciences (ICCAIS), Hangzhou, China, 24–27 October 2018; pp. 309–314. [Google Scholar]
  8. Wang, J.; Wang, X.; Tian, Y.; Chen, Z.; Chen, Y. A Radar Emitter Recognition Mechanism Based on IFS-Tri-Training Classification Processing. Electronics 2022, 11, 1078. [Google Scholar] [CrossRef]
  9. Shi, Y.; Zhang, W.; Zhu, M.; Wang, L.; Xu, S. Specific Radar Emitter Identification: A Comprehensive Review. J. Electron. Inf. Technol. 2022, 44, 1–14. [Google Scholar]
  10. Zhu, M.; Feng, Z.; Zhou, X. A Novel Data-Driven Specific Emitter Identification Feature Based on Machine Cognition. Electronics 2020, 9, 1308. [Google Scholar] [CrossRef]
  11. Yu, H.-h.; Yan, X.-p.; Liu, S.-k.; Li, P.; Hao, X.-h. Radar emitter multi-label recognition based on residual network. Def. Technol. 2021, 18, 410–417. [Google Scholar]
  12. Yao, Y.; Yu, L.; Chen, Y. Specific emitter identification based on square integral bispectrum features. In Proceedings of the 2020 IEEE 20th International Conference on Communication Technology (ICCT), Nanning, China, 28–31 October 2020; pp. 1311–1314. [Google Scholar]
  13. Pan, Y.; Yang, S.; Peng, H.; Li, T.; Wang, W. Specific emitter identification based on deep residual networks. IEEE Access 2019, 7, 54425–54434. [Google Scholar] [CrossRef]
  14. Xiao, Y.; Wei, X. Specific emitter identification of radar based on one dimensional convolution neural network. J. Phys. Conf. Ser. 2020, 1550, 032114. [Google Scholar] [CrossRef]
  15. Hinton, G.E.; Osindero, S.; Teh, Y.-W. A fast learning algorithm for deep belief nets. Neural Comput. 2006, 18, 1527–1554. [Google Scholar] [CrossRef]
  16. Bengio, Y.; Lamblin, P.; Popovici, D.; Larochelle, H. Greedy layer-wise training of deep networks. In Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 4–7 December 2006; Volume 19. [Google Scholar]
  17. Ranzato, M.A.; Poultney, C.; Chopra, S.; Cun, Y. Efficient learning of sparse representations with an energy-based model. In Advances in Neural Information Processing Systems; MIT Press: Cambridge, MA, USA, 2006; Volume 19. [Google Scholar]
  18. Singhal, Amit.: Introducing the Knowledge Graph: Things, Not Strings. Google Blog 16, May, 2012. Available online: https://blog.google/products/search/introducing-knowledge-graph-things-not (accessed on 31 May 2023).
  19. Pham, T.; Tao, X.; Zhang, J.; Yong, J.; Li, Y.; Xie, H. Graph-based multi-label disease prediction model learning from medical data and domain knowledge. Knowl. Based Syst. 2022, 235, 107662. [Google Scholar] [CrossRef]
  20. Li, F.-L.; Chen, H.; Xu, G.; Qiu, T.; Ji, F.; Zhang, J.; Chen, H. AliMeKG: Domain knowledge graph construction and application in e-commerce. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management, Virtual, 19–23 October 2020; pp. 2581–2588. [Google Scholar]
  21. Cheng, D.; Yang, F.; Wang, X.; Zhang, Y.; Zhang, L. Knowledge graph-based event embedding framework for financial quantitative investments. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual, 25–30 July 2020; pp. 2221–2230. [Google Scholar]
  22. Chen, Y.; Kuang, J.; Cheng, D.; Zheng, J.; Gao, M.; Zhou, A. AgriKG: An agricultural knowledge graph and its applications. In Proceedings of the International Conference on Database Systems for Advanced Applications, Chiang Mai, Thailand, 22–25 April 2019; pp. 533–537. [Google Scholar]
  23. Haussmann, S.; Seneviratne, O.; Chen, Y.; Ne’eman, Y.; Codella, J.; Chen, C.-H.; McGuinness, D.L.; Zaki, M.J. FoodKG: A semantics-driven knowledge graph for food recommendation. In Proceedings of the International Semantic Web Conference, Auckland, New Zealand, 26–30 October 2019; pp. 146–162. [Google Scholar]
  24. Li, L.; Ji, H.-B.; Jiang, L. Quadratic time–frequency analysis and sequential recognition for specific emitter identification. IET Signal Process. 2011, 5, 568–574. [Google Scholar] [CrossRef]
  25. Yang, L.; Zhang, S.; Xiao, B. Radar emitter signal recognition based on time-frequency analysis. In Proceedings of the IET International Radar Conference 2013, Xi’an, China, 14–16 April 2013; pp. 1–4. [Google Scholar]
  26. Xiao, Z.; Yan, Z. Radar Emitter Identification Based on Novel Time-Frequency Spectrum and Convolutional Neural Network. IEEE Commun. Lett. 2021, 25, 2634–2638. [Google Scholar] [CrossRef]
  27. Baldini, G.; Gentile, C. Transient-based internet of things emitter identification using convolutional neural networks and optimized general linear chirplet transform. IEEE Commun. Lett. 2020, 24, 1482–1486. [Google Scholar] [CrossRef]
  28. Man, P.; Ding, C.; Ren, W.; Xu, G. A Specific Emitter Identification Algorithm under Zero Sample Condition Based on Metric Learning. Remote Sens. 2021, 13, 4919. [Google Scholar] [CrossRef]
  29. Merchant, K.; Revay, S.; Stantchev, G.; Nousain, B. Deep Learning for RF Device Fingerprinting in Cognitive Communication Networks. IEEE J. Sel. Top. Signal Process. 2018, 12, 160–167. [Google Scholar] [CrossRef]
  30. Jiang, H.; Guan, W.; Ai, L. Specific radar emitter identification based on a digital channelized receiver. In Proceedings of the 2012 5th International Congress on Image and Signal Processing, Agadir, Morocco, 28–30 June 2012; pp. 1855–1860. [Google Scholar]
  31. Cheng, F.; Ying, N. Visualization and Re-extraction Technology of 2D Radar Envelope Data. Comput. Mod. 2018, 1, 69–73. [Google Scholar] [CrossRef]
  32. Herzel, F.; Ergintav, A.; Sun, Y. Phase noise modeling for integrated PLLs in FMCW radar. IEEE Trans. Circuits Syst. II Express Briefs 2013, 60, 137–141. [Google Scholar] [CrossRef]
  33. Eder, J.S. Knowledge Graph Based Search System. US20120158633A1, 24 February 2012. [Google Scholar]
  34. Chen, Z.; Wang, Y.; Zhao, B.; Cheng, J.; Zhao, X.; Duan, Z. Knowledge graph completion: A review. IEEE Access 2020, 8, 192435–192456. [Google Scholar] [CrossRef]
  35. Chen, X.; Jia, S.; Xiang, Y. A review: Knowledge reasoning over knowledge graph. Expert Syst. Appl. 2020, 141, 112948. [Google Scholar] [CrossRef]
  36. Zheng, D.; Long, Y.; Zhou, Z.; Chen, W.; Li, J.; Tang, Y. Scholar-Course Knowledge Graph Construction Based on Graph Database Storage. In Proceedings of the International Symposium on Emerging Technologies for Education, Zhuhai, China, 11 November 2021; pp. 448–459. [Google Scholar]
  37. Herr, B.W.; Ke, W.; Hardy, E.; Borner, K. Movies and actors: Mapping the internet movie database. In Proceedings of the 2007 11th International Conference Information Visualization (IV’07), Zurich, Switzerland, 4–6 July 2007; pp. 465–469. [Google Scholar]
  38. Stutzbach, A.R. MusicBrainz; JSTOR: Ann Arbor, MI, USA, 2011. [Google Scholar]
  39. Bodenreider, O. The unified medical language system (UMLS): Integrating biomedical terminology. Nucleic Acids Res. 2004, 32, D267–D270. [Google Scholar] [CrossRef] [Green Version]
  40. Khan, S.; Situ, G.; Decker, K.; Schmidt, C.J. GoFigure: Automated Gene Ontology™ annotation. Bioinformatics 2003, 19, 2484–2485. [Google Scholar] [CrossRef] [Green Version]
  41. Tang, J.; Chang, Y.; Aggarwal, C.; Liu, H. A survey of signed network mining in social media. ACM Comput. Surv. (CSUR) 2016, 49, 1–37. [Google Scholar] [CrossRef] [Green Version]
  42. Chen, Y.; Jiang, H.; Li, C.; Jia, X.; Ghamisi, P. Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 2016, 54, 6232–6251. [Google Scholar] [CrossRef] [Green Version]
  43. Wiatowski, T.; Bölcskei, H. A mathematical theory of deep convolutional neural networks for feature extraction. IEEE Trans. Inf. Theory 2017, 64, 1845–1866. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Oscillator characteristic diagram.
Figure 1. Oscillator characteristic diagram.
Remotesensing 15 03289 g001
Figure 2. The flow diagram of the proposed KG-1D-CNN. (different colors represent different nodes, datasets and network layers).
Figure 2. The flow diagram of the proposed KG-1D-CNN. (different colors represent different nodes, datasets and network layers).
Remotesensing 15 03289 g002
Figure 3. The flow diagram of the construction of the radar emitter knowledge graph. (different colors represent different nodes).
Figure 3. The flow diagram of the construction of the radar emitter knowledge graph. (different colors represent different nodes).
Remotesensing 15 03289 g003
Figure 4. The node construction flow diagram of the radar emitter knowledge graph. (different colors represent different samples and nodes).
Figure 4. The node construction flow diagram of the radar emitter knowledge graph. (different colors represent different samples and nodes).
Remotesensing 15 03289 g004
Figure 5. The construction framework diagram of the radar emitter knowledge graph. (different colors represent different samples and nodes).
Figure 5. The construction framework diagram of the radar emitter knowledge graph. (different colors represent different samples and nodes).
Remotesensing 15 03289 g005
Figure 6. The process diagram of forming the precise dataset.
Figure 6. The process diagram of forming the precise dataset.
Remotesensing 15 03289 g006
Figure 7. The 1D-CNN structure diagram.
Figure 7. The 1D-CNN structure diagram.
Remotesensing 15 03289 g007
Figure 8. The framework diagram of the proposed method. (different colors represent different radar emitter data).
Figure 8. The framework diagram of the proposed method. (different colors represent different radar emitter data).
Remotesensing 15 03289 g008
Figure 9. The radar emitter signals of ten radar individuals. (a) Emitter 1; (b) Emitter 2; (c) Emitter 3; (d) Emitter 4; (e) Emitter 5; (f) Emitter 6; (g) Emitter 7; (h) Emitter 8; (i) Emitter 9; (j) Emitter 10.
Figure 9. The radar emitter signals of ten radar individuals. (a) Emitter 1; (b) Emitter 2; (c) Emitter 3; (d) Emitter 4; (e) Emitter 5; (f) Emitter 6; (g) Emitter 7; (h) Emitter 8; (i) Emitter 9; (j) Emitter 10.
Remotesensing 15 03289 g009
Figure 10. Accuracy and time usage of our method and 1D-CNN in test problems 1–5. (a) Accuracy of our method; (b) accuracy of 1D-CNN method; (c) time usage of our method; (d) time usage of 1D-CNN method.
Figure 10. Accuracy and time usage of our method and 1D-CNN in test problems 1–5. (a) Accuracy of our method; (b) accuracy of 1D-CNN method; (c) time usage of our method; (d) time usage of 1D-CNN method.
Remotesensing 15 03289 g010
Table 1. Specific type parameters of 10 radar emitters.
Table 1. Specific type parameters of 10 radar emitters.
Carrier FrequencyFrequency BandwidthTime Width
Emitter 110 GHz30 MHz3 μs
Emitter 210 GHz30 MHz3 μs
Emitter 310 GHz30 MHz3 μs
Emitter 48 GHz20 MHz3 μs
Emitter 58 GHz20 MHz3 μs
Emitter 68 GHz20 MHz3 μs
Emitter 712 GHz40 MHz3 μs
Emitter 812 GHz40 MHz3 μs
Emitter 912 GHz40 MHz3 μs
Emitter 1011 GHz50 MHz3 μs
Table 2. Specific individual parameters of 10 radar emitters.
Table 2. Specific individual parameters of 10 radar emitters.
Phase Noise ParametersFilter Parameters
Frequency OffsetPhase Noise CoefficientSampling FrequencyCutoff Frequency
Emitter 1 [ 1 ,   10 ,   100 ,   2000 ,   10 , 000 ] 1 kHz [ 1 ,   0.1 ,   0.01 ,   0.004 ,   0.0003 ] 20 kHz200 Hz
Emitter 2 [ 1 ,   10 ,   100 ,   1000 ,   10 , 000 ] 1 kHz [ 0.5 ,   0.1 ,   0.03 ,   0.008 ,   0.0004 ]   30 kHz150 Hz
Emitter 3 [ 1 ,   10 ,   100 ,   1000 ,   10 , 000 ] 1 kHz [ 0.1 ,   0.05 ,   0.01 ,   0.007 ,   0.0008 ] 30 kHz200 Hz
Emitter 4 [ 1 ,   10 ,   100 ,   2000 ,   10 , 000 ] 1 kHz [ 1 ,   0.1 ,   0.01 ,   0.004 ,   0.0003 ] 20 kHz200 Hz
Emitter 5 [ 1 ,   10 ,   100 ,   1000 ,   10,000 ] 1 kHz [ 0.5 ,   0.1 ,   0.03 ,   0.008 ,   0.0004 ] 30 kHz150 Hz
Emitter 6 [ 1 ,   10 ,   100 ,   1000 ,   10 , 000 ] 1 kHz [ 0.1 ,   0.05 ,   0.01 ,   0.007 ,   0.0008 ] 30 kHz200 Hz
Emitter 7 [ 1 ,   10 ,   100 ,   2000 ,   10 , 000 ] 1 kHz [ 1 ,   0.1 ,   0.01 ,   0.004 ,   0.0003 ] 20 kHz200 Hz
Emitter 8 [ 1 ,   10 ,   100 ,   1000 ,   10 , 000 ] 1 kHz [ 0.5 ,   0.1 ,   0.03 ,   0.008 ,   0.0004 ] 30 kHz150 Hz
Emitter 9 [ 1 ,   10 ,   100 ,   1000 ,   10 , 000 ] 1 kHz [ 0.1 ,   0.05 ,   0.01 ,   0.007 ,   0.0008 ] 30 kHz200 Hz
Emitter 10 [ 1 ,   10 ,   100 ,   1000 ,   20 , 000 ] 1 kHz [ 1 ,   0.1 ,   0.03 ,   0.007 ,   0.0002 ] 20 kHz100 Hz
Table 3. Details of the five test problems.
Table 3. Details of the five test problems.
Test ProblemTargetEnvironmentFeatures
Problem 1Emitter 7(Emitter 1, Emitter 4, Emitter 6, Emitter 7, Emitter 8, Emitter9)
  • Give one target emitter to test the algorithm’s ability in single-target problems.
Problem 2Emitter 4
  • Change the target emitter to test the algorithm’s ability in different targets.
Problem 3Emitter 4, Emitter 7
  • Give one more target (two targets) to test the algorithm’s ability in multi-target problems.
Problem 4Emitter 7(Emitter 1—Emitter 10)
  • Give more environment emitters (10 emitters total) to test the algorithm’s ability in more complex environments.
Problem 5Emitter 1—Emitter 10
  • No prior information to clarify the target to test the algorithm’s ability to identify all the emitters in the complex environment.
Table 4. The adjacent matrix of radar emitter knowledge graph of the five test problems in Table 3.
Table 4. The adjacent matrix of radar emitter knowledge graph of the five test problems in Table 3.
12345678910
10.40−0.670.900.750.480.710.890.561.00
20.53−0.470.900.770.750.740.770.781.00
3−0.34−0.450.830.530.660.730.830.361.00
40.830.730.660.46−1.000.570.750.591.00
50.750.930.620.48−0.310.610.780.731.00
60.830.840.710.04−0.660.610.840.771.00
70.740.630.670.830.850.750.58−0.751.00
80.730.740.560.710.690.900.68−0.651.00
90.860.930.500.830.760.77−0.89−0.101.00
100.830.480.840.790.730.280.850.830.76
Table 5. The subgraph of Problem 1 and the sorting result of the subgraph.
Table 5. The subgraph of Problem 1 and the sorting result of the subgraph.
The subgraph146789
0.710.570.610.68−0.89
The sorting result186497
0.710.680.610.57−0.89
Table 6. Accuracy and time usage of the proposed method in Problem 1.
Table 6. Accuracy and time usage of the proposed method in Problem 1.
ExperimentPrecisionRecallF1-ScoreAccuracyTime (s)
Non-TargetTargetNon-TargetTargetNon-TargetTarget
Experiment 199.5090.2498.0697.6798.7593.6797.9213.04
Experiment 298.9883.7296.5394.7497.7488.8996.2512.15
Experiment 3100.0090.4898.02100.0099.0095.0098.3313.29
Experiment 498.9883.7296.5394.7497.7488.8996.2512.60
Experiment 599.5186.4997.5896.9798.5491.4397.5011.86
Experiment 6100.0082.2296.06100.0097.9990.2496.6712.12
Experiment 7100.0086.1197.61100.0098.7992.5497.9212.44
Experiment 899.4984.4496.5297.4497.9890.4896.6712.61
Experiment 9100.0081.8296.08100.0098.0090.0096.6712.24
Experiment 10100.0085.7197.62100.0098.8092.3197.9211.72
Average99.6585.5097.0698.1698.3391.3597.2112.41
Table 7. Accuracy and time usage of the proposed method and baseline method in five test problems (mean of 10 repeated experiments).
Table 7. Accuracy and time usage of the proposed method and baseline method in five test problems (mean of 10 repeated experiments).
Test
Problems
1D-CNNKG-1D-CNN
AccuracyTime (s)AccuracyTime (s)
Problem 190.508.98 97.2112.41
Problem 286.508.98 96.5813.52
Problem 388.508.98 96.9025.92
Problem 487.2510.41 97.5819.87
Problem 588.8010.4197.28197.23
Table 8. Accuracy and time usage of the proposed method in Problem 5.
Table 8. Accuracy and time usage of the proposed method in Problem 5.
Target EmitterPrecisionRecallF1-ScoreAccuracyTime (s)
Non-TargetTargetNon-TargetTargetNon-TargetTarget
Emitter 199.83%84.88%97.92%98.50%98.86%90.85%97.98%19.91
Emitter 299.75%78.35%97.02%97.75%98.34%86.92%97.05%19.83
Emitter398.70%77.93%97.21%88.50%97.90%82.69%96.25%19.66
Emitter499.58%86.67%98.33%96.25%98.95%91.17%98.13%19.58
Emitter599.72%82.89%97.70%97.50%98.69%89.47%97.68%19.70
Emitter698.74%75.63%96.47%88.75%97.57%81.05%95.7%19.71
Emitter798.89%86.47%98.42%90.00%98.65%88.08%97.58%19.87
Emitter899.49%74.99%96.39%95.50%97.91%83.89%96.3%19.69
Emitter998.00%80.04%96.90%82.00%97.75%80.90%96.13%19.63
Emitter10100.00%100.00%100.00%100.00%100.00%100.00%100%19.65
Total99.27%82.79%97.64%93.48%98.46%87.50%97.28%197.23
Note: For excluding chance factors of experimental results, each emitter individual identification experiment is performed ten times, and the results in the table are the average of the ten times.
Table 9. Accuracy and time usage of traditional methods and the proposed method in different SNR conditions.
Table 9. Accuracy and time usage of traditional methods and the proposed method in different SNR conditions.
SNR1D-RESNET50CNN-Man [28]CNN-Xiao [14]CNN-Kevin [29]1D-CNNKG-1D-CNN
AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)
0 dB50.20%154.9156.55%15.852.75%28.4053.48%31.6051.00%10.6791.86%200.42
5 dB70.55%154.1774.70%16.0273.5%27.9174.53%31.6271.15%10.2495.33%200.65
10 dB92.70%154.6793.35%16.0493.80%28.2393.58%31.3888.80%10.4197.28%197.23
15 dB97.98%154.4999.95%16.1398.90%29.7799.25%30.2097.75%10.1399.35%205.44
Note 1: All recognition accuracies above are the average results of 10 experiments. Note 2: The knowledge graphs in KG-1D-CNN have been reconstructed because the datasets are different for different SNRs, and the construction process will not be described repeatedly.
Table 10. Accuracy and time usage of traditional methods and the proposed method using 400 samples per emitter.
Table 10. Accuracy and time usage of traditional methods and the proposed method using 400 samples per emitter.
SNR1D-RESNET50CNN-Man [28]CNN-XiaoCNN-Kevin1D-CNNKG-1D-CNN
AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)AccuracyTime (s)
0 dB58.33%294.9064.13%26.1459.00%49.4759.28%56.5156.73%16.6193.30%310.59
5 dB79.00%295.8981.75%26.4079.43%49.4480.84%57.0073.55%16.0695.47%320.85
10 dB95.25%295.9698.55%26.3496.28%49.8496.40%56.2293.48%16.2798.62%314.98
15 dB99.25%296.16100.00%26.0999.94%51.4999.37%57.1899.33%16.7699.70%310.52
Note 1: All recognition accuracies above are the average results of 10 experiments. Note 2: The knowledge graphs in KG-1D-CNN have been reconstructed because of the change in the sample number of the dataset, and the construction process will not be shown here.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, Y.; Li, P.; Yan, E.; Jing, Z.; Liu, G.; Wang, Z. A Knowledge Graph-Driven CNN for Radar Emitter Identification. Remote Sens. 2023, 15, 3289. https://doi.org/10.3390/rs15133289

AMA Style

Chen Y, Li P, Yan E, Jing Z, Liu G, Wang Z. A Knowledge Graph-Driven CNN for Radar Emitter Identification. Remote Sensing. 2023; 15(13):3289. https://doi.org/10.3390/rs15133289

Chicago/Turabian Style

Chen, Yingchao, Peng Li, Erxing Yan, Zehuan Jing, Gaogao Liu, and Zhao Wang. 2023. "A Knowledge Graph-Driven CNN for Radar Emitter Identification" Remote Sensing 15, no. 13: 3289. https://doi.org/10.3390/rs15133289

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop