1. Introduction
Electromagnetic imaging is an advanced technique that entails evenly distributing transmitter and receiver antennas around a scatterer widely employed in biomedical imaging [
1], remote sensing [
2], non-destructive testing [
3], etc. By illuminating an unknown scatterer with electromagnetic waves and capturing the reflected scattered field, valuable information regarding its size, shape, and material composition can be reconstructed. Due to the highly nonlinear nature of inverse scattering problems (ISPs), iterative algorithms with regularization are frequently utilized to address them. Electromagnetic imaging algorithms generally fall into two categories: (1) Approximation methods [
4,
5]: Traditional techniques demonstrate significant inversion capabilities, particularly with small scatterers or low-contrast objects. Accuracy will diminish significantly when the size or contrast becomes larger due to the multiple scattering effect. (2) Iterative methods [
6,
7,
8,
9]: These methods can achieve higher accuracy by minimizing the mismatch error between inversion and measurement results. Considering the inherent ill-posedness of the ISPs, incorporating a regularization term into the cost function is crucial to stabilize the optimization process. However, challenges such as high computational costs and low iterative convergence will hinder instant inversion tasks.
Convolutional neural networks (CNNs) have been widely utilized in image and speech recognition recently, yielding promising results. There are three main categories of learning methods: (1) Direct learning methods [
10,
11,
12,
13,
14,
15,
16]: These methods employ neural networks directly to learn wave equations and solve them. (2) Learning-assisted objective function methods [
17,
18,
19,
20,
21]: Neural networks are used iteratively in the training process for image reconstruction. (3) Physics-assisted learning methods [
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32]: This method applies Maxwell’s equations to pre-calculate certain physical quantities. Neural networks are subsequently employed to compute more precise physical quantities to achieve better reconstruction of objects. In 2020, Shao introduced a two-stage model to solve ISPs. His approach involved developing an autoencoder to convert high-resolution vectors in the first stage, followed by creating a second neural network to correlate microwave signals with the compressed features. The numerical results indicated that the deep learning network developed by Shao could accurately identify objects of similar complexity levels across the entire domain of interest [
14]. In 2021, Zhuo proposed a modified contrast scheme utilizing convolutional neural networks to handle the high nonlinearity present in electromagnetic imaging. The numerical findings suggested that this modified contrast scheme, when combined with convolutional neural networks, could get rid of nonlinearity effectively [
28]. In 2022, Ye combined the visual geometric group and the total variation loss function to reconstruct biaxial objects with a generative adversarial network (GAN). The experimental results show that this method requires a long training time, but it has good image reconstruction capabilities [
29]. In 2023, Xu combined a weighted loss function composed of adversarial loss, mean absolute percentage error (MAPE), and structural similarity (SSIM) into a generative adversarial network with a self-attention mechanism. The numerical results show that the proposed architecture exhibits good generalization ability and stability [
31].
Recently, the convergence of electromagnetic imaging (EMI) technology with the Internet of Things (IoT) has sparked a wave of innovation across multiple sectors. This amalgamation offers unprecedented opportunities for real-time monitoring, predictive maintenance, and enhanced decision-making processes. As the world becomes increasingly interconnected, the integration of EMI with the IoT presents a transformative paradigm that transcends traditional boundaries. Electromagnetic imaging techniques, ranging from magnetic resonance imaging (MRI) to ground-penetrating radar (GPR), have long been instrumental in diverse fields such as healthcare, geophysics, and industrial diagnostics. These methods harness electromagnetic waves to probe, visualize, and analyze the internal structures and properties of materials and environments with remarkable precision. However, the advent of the IoT has infused this realm with a newfound vitality, enabling seamless connectivity, data aggregation, and intelligent decision-making capabilities.
Figure 1 shows the diagram illustrates the schematic of electromagnetic imaging and the IoT.
Our contributions are summarized below:
As far as we know, no two-stage network for reconstructing electromagnetic images of uniaxial objects has been published to date. We are the pioneers who rolled out this idea.
The tensor formed by the TE wave in the cross-section may exhibit greater complexity compared to the TM case.
The dielectric constant components distributed on various lateral directions for uniaxial objects may lead to the greater severity of the nonlinear problem. Consequently, regeneration by scattered fields will be relatively challenging for a TE scenario.
Section 1 analyzes techniques applied in the past to solve ISPs. Our theory and formula are elucidated in
Section 2.
Section 3 introduces the two-step neural network architecture.
Section 4 presents the numerical results.
Section 5 presents the conclusions.
2. Formula
This section presents the direct problem formulation for TM and TE waves via electromagnetic imaging.
Figure 2 shows the dielectric scatterer located in the free space. We configure the transmitter and receiver around the domain of interest area for measurement. The position, shape, and size of the scatterers can be known from the measured scattered field. We define a Cartesian coordinate system to describe the dielectric coefficient distribution of the object by a diagonal matrix as follows:
In the TM case, we assume the incident wave to be
and the scattered field along the z-direction. The material of the scatterer is related to the x- and y-directions, so the irradiation of the TM-polarized waves will produce only TM-scattered waves. We define the incident wave as follows:
where
represents the wave number in free space, and
denotes the angle of incidence.
Figure 2.
Schematic of dielectric scatterer.
Figure 2.
Schematic of dielectric scatterer.
The TM wave contains the z-component scattered field only. Equations (3) and (4) represent the total field
=
and the external scattered field
=
, respectively.
In 2-D free space, the Green’s function is
.
represents the zero-order Hankel function of the second kind.
In the case of TE, the material properties of the scatterer are related to the x- and y-directions. We define the incident wave as:
The total field
and the external scattered field
can be defined as follows:
By first solving the total electric field
E using Equations (3), (7), and (8) with the tensor distribution information, we can subsequently calculate the scattered field
from Equations (4), (9), and (10). Further information on the Green’s functions can be found in [
30].
In the numerical computations for the direct problem, we begin by dividing both the scatterer and the closed surface S into N small segments. This ensures that the dielectric coefficient and electric field remain constant within each segment. Let
,
, and
denote the dielectric coefficients corresponding to the n-th small segment in the x-, y-, and z-directions, respectively. To solve Equations (3)–(10) using the method of moments, we utilized pulse basis functions for expansion and Dirac delta functions for testing. These equations are subsequently transformed into matrix equations.
In the next section, we will utilize the measured scattered fields as input for a two-stage neural network to reconstruct electromagnetic images. The first stage neural network is trained to simulate Maxwell’s equations and swiftly reconstruct the initial image. We employ the second stage neural network to refine and reconstruct accurate electromagnetic images. This approach stands out for its high efficiency and distinction between previous imaging methods.
3. Two-Step Neural Network
Artificial intelligence technology is currently experiencing a boom with widespread applications in self-driving cars. Meanwhile, electromagnetic imaging technology, image processing, and speech recognition are also widely utilized, including CNN, DCNN, and GAN, among others. In this section, we implement a two-stage neural network to reconstruct electromagnetic images. Initially, we utilize the measured scattered field input to train and simulate Maxwell’s equations in the first-stage neural network. This may accelerate the reconstructed acquisition image. Subsequently, we feed the image estimated from the first stage into the neural network for the second stage of training, aiming to reconstruct a more accurate electromagnetic image. In our research, DCNN architecture, renowned for its effectiveness in processing and analyzing visual data, is employed in the first stage. Inspired by the human visual cortex, this architecture consists of convolutional layers interconnected by artificial neurons. Each neuron within a convolutional layer is dedicated to detecting a specific visual feature present in the input data.
Figure 3 illustrates the architecture of the DCNN.
In the second stage, we enhance the reconstructed electromagnetic images by employing a CNN architecture, as illustrated in
Figure 4. The proposed architecture consists of two halves: the left half comprises a sequence of a
convolutional layer, a normalization layer, a linear correction layer, and a
pooling layer. Conversely, the right half involves a
convolutional layer, a normalization layer, a linear correction layer, and a
up-convolutional layer, which are added iteratively. Finally, a
convolutional layer acts as a fully connected layer, and the resulting average is input into the regression layer to compute the error value associated with the dielectric coefficient distribution.
4. Numerical Results
In our investigation, we operate under the assumption that anisotropic objects are situated within free space, surrounded by emitters and receivers distributed uniformly around the scattering object. Both TM and TE waves are emitted in diverse directions to illuminate the anisotropic objects, while we gather scattered field data from these unknown scatterers. Leveraging this received scattered field data, we employ a DCNN to estimate the initial permittivity. Subsequently, this estimate is fed into a CNN to reconstruct a precise electromagnetic image.
In our simulated environment, we partition the edge constant size of the scatterer into , where stands for the relative permittivity of the anisotropic object, and represents the wavelength in free space. We vary the dielectric coefficient of the scatterer from 1 to 2.5, while maintaining the frequency of the incident wave at 3 GHz. We deploy 32 transmitter and receiver antennas evenly. To mimic real-world conditions, we introduce Gaussian noise of 5% and 20% into the simulated environment for analysis. We gauge the dielectric constant distribution using scatter field information through the DCNN in the first stage, i.e., to input the real and imaginary parts, respectively, into the DCNN. In the second stage, we use the preliminary image from the DCNN to reconstruct a more accurate dielectric constant distribution through a convolutional neural network architecture. In the artificial intelligence segment, we allocate 80% of the scattered field for the training set and the rest for the test set. We utilize ADAM uniformly to train the two-step module, setting the training parameters with a learning rate ranging from to , and a maximum epoch of 40. For every optimization epoch, we ensure that the training data are shuffled.
We use the root mean square error and image similarity to verify the results of the numerical simulation as well as conduct comparison and analysis. The equations are as follows:
and are the ground truth and reconstructed relative permittivity profiles, respectively, represents the number of tests conducted, and F denotes the Frobenius norm.
In this context,
and y represent the reconstructed and true relative permittivity profiles, respectively.
denotes the mean of y,
signifies the variance of y, and
represents the covariance of
and y. To prevent division by zero, two small constraints
and
are added, where
and
serve as hyperparameters. Here,
signifies the dynamic pixel range for the image y [
30].
4.1. Relative Permittivity between 1 and 1.5
In this scenario, we establish the permittivity distribution within the range of 1 to 1.5. We analyze 10 scatterers, each characterized by distinct permittivity distributions, and these scatterers have the capability to freely move among 50 different positions within the measurement area. We introduce 20% Gaussian noise into the simulated environment. Following the estimation of dielectric coefficient distributions from scattered field data using a DCNN, we proceed with reconstructing the electromagnetic image using a CNN. The results for TM and TE cases are visualized in
Figure 5 and
Figure 6, respectively.
Figure 5a and
Figure 6a display the ground truth distributions of
and
for the scatterers, while
Figure 5b and
Figure 6b depict the reconstructed images of
and
, respectively.
Table 1 summarizes the reconstruction performance metrics for
and
.
4.2. Relative Permittivity between 1.5 and 2
In this scenario, we establish the permittivity distributions ranging from 1.5 to 2. We examine 10 scatterers with unique permittivity distributions, capable of freely moving across 50 positions within the measurement area. We proceed to estimate the dielectric coefficient distribution via the received scattered field information from the DCNN with 5% Gaussian noise added. This information is then inputted into the CNN for electromagnetic image reconstruction.
Figure 7 and
Figure 8 illustrate the respective TM and TE results.
Figure 7a and
Figure 8a display the ground truth of the
and
scatterers, respectively, while
Figure 7b and
Figure 8b display the image reconstruction of the
and
scatterers, respectively.
Table 2 gives the reconstruction performance of
and
.
4.3. MNIST Dielectric Distribution between 7.5 and 8
Established in 1988 by the National Institute of Standards and Technology, the Modified National Institute of Standards and Technology Database (MNIST) is a sizable collection of handwritten data. Widely exploited in the realms of machine learning and deep learning, the MNIST dataset encompasses 70,000 grayscale images of handwritten numbers ranging from 0 to 9, each image measuring
pixels. In this instance, we chose MNIST and define its dielectric distribution within the range of 7.5 to 8. In our simulation, we randomly select 1000 images to comprise the dataset and augment with 5% Gaussian noise. The DCNN is used prior to estimate the dielectric coefficient distribution from the scattered field information before inputting into a CNN for reconstructing the electromagnetic images.
Figure 9a and
Figure 10a display the ground truth of the
and
scatterers, respectively, while
Figure 9b and
Figure 10b display the image reconstruction of the
and
scatterers, respectively. The reconstruction performance of
and
is listed in
Table 3.
4.4. Experimental Data Verification
We selected the training data to mirror case A and case B above, with the sole distinction being the relative permittivity of (1.3–3.3). Within these training data, 8 transmitter antennas were employed, yielding a total dataset of 15,120 (1890 × 8) scattered fields. We trained the two-step model with noiseless synthetic data and subsequently tested the network, implementing the measured experimental data sourced from the Fresnel Institute [
32]. This dataset was used to validate the proposed two-step neural network for the TM and TE cases. The experimental setup included 8 transmitter antennas and 241 receiver antennas, positioned 1.67 m apart from the source and measurement object. A horn antenna was used to measure the scattered field, resulting in receivers not being evenly distributed around the transmitter. We specifically selected the FoamDielExt dataset for both the TM and TE cases. This dataset comprises large (SAITEC SBF 300) and small (Berlon) cylinders with diameters of 80 mm and 31 mm, respectively, and dielectric coefficients of
and
(ref.
Figure 11). Here, “
” denotes the uncertainty range surrounding the experimental values, and
represents the diameter. In our simulation, the scatterer was placed within a 320 × 320 mm domain. A 3 GHz wave frequency was incidented in both the TM and TE scenarios. The experimental data were normalized using the simulated scattered field received from the opposite side of the incident angle.
The reconstruction outcomes through the experimental data implementing the two-step neural networks for the TM and TE cases are illustrated in
Figure 12.
Table 4 displays the corresponding RMSE and SSIM values of satisfactory levels for 2 cases. Based on these results, we assert that our proposed method has been validated by the experimental data. Additionally, the two-step neural network proves to be more adept at handling highly nonlinear problems in either case.
5. Conclusions
In this paper, we deploy a two-stage neural network architecture to address the ISPs. We unify a DCNN and CNN to reconstruct the uniaxial objects. The findings demonstrate that the proposed two-stage neural network architecture can vividly handle more complex TE scenarios. Moving forward, we aim to further enhance the two-stage neural network architecture and apply it to even more challenging situations such as reconstructing buried objects in half-space. In addition to that, we also consider merging the enhanced two-stage neural network architecture with a Switch Transformer to improve the imaging.
Author Contributions
Conceptualization, W.C.; Data curation, P.-H.C.; Formal analysis, H.-Y.W.; Funding acquisition, W.C.; Investigation, C.-C.C.; Methodology, W.C.; Project administration, C.-C.C.; Resources, W.C.; Software, P.-H.C.; Supervision, E.H.L.; Validation, H.-Y.W.; Visualization, E.H.L.; Writing—original draft, P.-H.C.; Writing—review & editing, C.-C.C. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by Guangxi, Hong Kong, Macao and Taiwan High-level Talents Program: HMTP2023004.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The original contributions presented in the study are available on request from the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Gürbüz, T.U.; Aslanyürek, B.; Yapar, A.; Sahintürk, H.; Akduman, I. A Nonlinear Microwave Breast Cancer Imaging Approach Through Realistic Body–Breast Modeling. IEEE Trans. Antennas Propag. 2014, 62, 2596–2605. [Google Scholar]
- Estatico, C.; Fedeli, A.; Pastorino, M.; Randazzo, A. A Multifrequency Inexact-Newton Method in Lp Banach Spaces for Buried Objects Detection. IEEE Trans. Antennas Propag. 2015, 63, 4198–4204. [Google Scholar] [CrossRef]
- Zhdanov, M.S. Geophysical Inverse Theory and Regularization Problems; Elsevier: Amsterdam, The Netherlands, 2002. [Google Scholar]
- Oliveri, G.; Poli, L.; Rocca, P.; Massa, A. Bayesian Compressive Optical Imaging within the Rytov Approximation. Opt. Lett. 2012, 37, 1760. [Google Scholar] [CrossRef]
- Chen, X. Computational Methods for Electromagnetic Inverse Scattering; Wiley: Hoboken, NJ, USA, 2018. [Google Scholar]
- Hajebi, M.; Tavakoli, A.; Dehmollaian, M.; Dehkhoda, P. An Iterative Modified Diffraction Tomography Method for Reconstruction of a High-Contrast Buried Object. IEEE Trans. Geosci. Remote Sens. 2018, 56, 4138–4148. [Google Scholar] [CrossRef]
- Wei, T.-F.; Wang, X.-H.; Wang, L.; Feng, Z.; Wang, B.-Z. Efficient Born Iterative Method for Inverse Scattering Based on Modified Forward-Solver. IEEE Access 2020, 8, 229101–229107. [Google Scholar] [CrossRef]
- Zhao, P.; Liu, L.; Xu, K.; Ye, X.; Chen, S.; Wang, G.; Chan, C.H. An Improved Subspace-Regularized DBIM-MLGFIM Method for Three-Dimensional Inverse Scattering Problems. IEEE Trans. Antennas Propag. 2021, 69, 2798–2809. [Google Scholar] [CrossRef]
- Rodriguez-Duarte, D.O.; Origlia, C.; Vasquez, J.A.T.; Scapaticci, R.; Crocco, L.; Vipiana, F. Experimental Assessment of Real-Time Brain Stroke Monitoring via a Microwave Imaging Scanner. IEEE Open J. Antennas Propag. 2022, 3, 824–835. [Google Scholar] [CrossRef]
- Caorsi, S.; Gamba, P. Electromagnetic Detection of Dielectric Cylinders by a Neural Network Approach. IEEE Trans. Geosci. Remote Sens. 1999, 37, 820–827. [Google Scholar] [CrossRef]
- Rekanos, I.T. Neural-network-based Inverse-scattering Technique for Online Microwave Medical Imaging. IEEE Trans. Magn. 2002, 38, 1061–1064. [Google Scholar] [CrossRef]
- Yao, H.M.; Sha, W.E.I.; Jiang, L. Two-Step Enhanced Deep Learning Approach for Electromagnetic Inverse Scattering Problems. IEEE Antennas Wirel. Propag. Lett. 2019, 18, 2254–2258. [Google Scholar] [CrossRef]
- Yao, H.M.; Jiang, L.; Sha, W.E.I. Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems. IEEE Antennas Wirel. Propag. Lett. 2020, 19, 1211–1215. [Google Scholar] [CrossRef]
- Shao, W.; Du, Y. Microwave Imaging by Deep Learning Network: Feasibility and Training Method. IEEE Trans. Antennas Propag. 2020, 68, 5626–5635. [Google Scholar] [CrossRef]
- Zhang, H.H.; Yao, H.M.; Jiang, L.; Ng, M. Enhanced Two-Step Deep-Learning Approach for Electromagnetic-Inverse-Scattering Problems: Frequency Extrapolation and Scatterer Reconstruction. IEEE Trans. Antennas Propag. 2023, 71, 1662–1672. [Google Scholar] [CrossRef]
- Wang, Y.; Zhao, Y.; Wu, L.; Yin, X. An Early Fusion Deep Learning Framework for Solving Electromagnetic Inverse Scattering Problems. IEEE Trans. Geosci. Remote Sens. 2023, 61, 2005914. [Google Scholar] [CrossRef]
- Guo, R.; Song, X.; Li, M.; Yang, F.; Xu, S.; Abubakar, A. Supervised Descent Learning Technique for 2-D Microwave Imaging. IEEE Trans. Antennas Propag. 2019, 67, 3550–3554. [Google Scholar] [CrossRef]
- Chen, G.; Shah, P.; Stang, J.; Moghaddam, M. Learning-Assisted Multimodality Dielectric Imaging. IEEE Trans. Antennas Propag. 2019, 68, 2356–2369. [Google Scholar] [CrossRef]
- Sanghvi, Y.; Kalepu, Y.; Khankhoje, U.K. Embedding Deep Learning in Inverse Scattering Problems. IEEE Trans. Comput. Imaging 2020, 6, 46–56. [Google Scholar] [CrossRef]
- Zhou, H.; Ouyang, T.; Li, Y.; Liu, J.; Liu, Q. Linear-Model-Inspired Neural Network for Electromagnetic Inverse Scattering. IEEE Antennas Wirel. Propag. Lett. 2020, 19, 1536–1540. [Google Scholar] [CrossRef]
- Sun, Y.; Xia, Z.; Kamilov, U.S. Efficient and Accurate Inversion of Multiple Scattering with Deep Learning. Opt. Express 2018, 26, 14678–14688. [Google Scholar] [CrossRef]
- Li, L.; Wang, L.G.; Teixeira, F.L.; Liu, C.; Nehorai, A.; Cui, T.J. DeepNIS: Deep Neural Network for Nonlinear Electromagnetic Inverse Scattering. IEEE Trans. Antennas Propag. 2019, 67, 1819–1825. [Google Scholar] [CrossRef]
- Li, L.; Wang, L.G.; Teixeira, F.L. Performance Analysis and Dynamic Evolution of Deep Convolutional Neural Network for Electromagnetic Inverse Scattering. IEEE Antennas Wirel. Propag. Lett. 2019, 18, 2259–2263. [Google Scholar] [CrossRef]
- Wei, Z.; Chen, X. Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems. IEEE Trans. Geosci. Remote Sens. 2019, 57, 1849–1860. [Google Scholar] [CrossRef]
- Wei, Z.; Chen, X. Physics-Inspired Convolutional Neural Network for Solving Full-Wave Inverse Scattering Problems. IEEE Trans. Antennas Propag. 2019, 67, 6138–6148. [Google Scholar] [CrossRef]
- Khoshdel, V.; Ashraf, A.; LoVetri, J. Enhancement of Multimodal Microwave-Ultrasound Breast Imaging Using a Deep-Learning Technique. Sensors 2019, 19, 4050. [Google Scholar] [CrossRef] [PubMed]
- Peng, P.; Jalali, S.; Yuan, X. Solving Inverse Problems via Auto-Encoders. IEEE J. Sel. Areas Inf. Theory 2020, 1, 312–323. [Google Scholar] [CrossRef]
- Zhou, Y.; Zhong, Y.; Wei, Z.; Yin, T.; Chen, X. An Improved Deep Learning Scheme for Solving 2D and 3D Inverse Scattering Problems. IEEE Trans. Antennas Propag. 2021, 69, 2853–2863. [Google Scholar] [CrossRef]
- Ye, X.; Yang, D.; Yuan, X.; Song, R.; Sun, S.; Fang, D. Application of generative adversarial network-based inversion algorithm in imaging two-dimensional lossy biaxial anisotropic scatterer. IEEE Trans. Antennas. Propag. 2022, 70, 8262–8275. [Google Scholar] [CrossRef]
- Chiu, C.C.; Chen, P.H.; Jiang, H. Electromagnetic imaging of Uniaxial Objects by Artificial Intelligence Technology. IEEE Trans. Geosci. Remote Sens. 2022, 60, 2008414. [Google Scholar] [CrossRef]
- Xu, K.; Qian, Z.; Zhong, Y.; Su, J.; Gao, H.; Li, W. Learning-Assisted Inversion for Solving Nonlinear Inverse Scattering Problem. IEEE Trans. Microw. Theory Technol. 2023, 71, 2384–2395. [Google Scholar] [CrossRef]
- Geffrin, J.-M.; Sabouroux, P.; Eyraud, C. Free space experimental scattering database continuation: Experimental set-up and measurement precision. Inverse Probl. 2005, 21, S117. [Google Scholar] [CrossRef]
| Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).