Search Results (39)

In video synthetic aperture radar (Video SAR), target motion causes defocusing, making it impossible to determine the target’s real-time position using reflected echoes. However, the shadows formed by the target occluding ground reflections can accurately characterize the target’s real-time position. To address challenges such as varying shadow scales, low contrast with the moving background, and susceptibility to clutter interference, this paper proposes a shadow detection network called DSENet to enhance the detail and semantic features of shadows. First, to enhance shadow features and reduce sampling loss during backbone network feature extraction, we design a detailed information enhancement (DIE) module to achieve lossless downsampling and effectively preserve the detailed features of the shadowed target. Second, we propose a semantic spatial feature aggregation (SSFA) module to enhance global semantic space feature extraction, improve the contextual feature representation of the target’s shadow region, and provide robust semantic space prior information for the model. Finally, we designed a detailed semantic fusion (DSF) module to improve the neck network’s ability to fuse shadow details and semantic features in video SAR images, further enhancing the model’s localization performance for target shadow features and achieving accurate localization of moving targets in video SAR. Comparative and ablation experiments validate the effectiveness and superiority of the proposed method. Experimental results on the Sandia National Laboratories (SNL) public dataset demonstrate that DSENet is efficient and performs excellently, achieving a P of 92.4% and an F1 score of 83.1%. Full article

Video synthetic aperture radar (ViSAR) provides continuous multiframe images while maintaining high resolution and has become an important tool for complex scene surveillance and moving target tracking. ViSAR imaging is susceptible to interframe drift caused by motion errors, which severely degrades video stability. When registering long time series of real airborne video SAR images, conventional image registration based on Normalized Cross-Correlation (NCC) is affected by several factors, including platform residual motion errors, approximations in the imaging geometry, interpolation resampling, and SAR speckle noise. As a result, noticeable interframe jitter persists in the registered sequence, and the stabilization accuracy is insufficient to meet high-precision image stabilization requirements. To address these issues, this paper proposes an image stabilization method for airborne video SAR based on a joint Singer-random walk model. Firstly, with the first frame selected as the reference, subpixel drift measurements in the azimuth and range directions are extracted from continuous frames via NCC-based registration. Subsequently, the true drift is modeled as a two-dimensional Singer process and the systematic bias as a random walk process, yielding a joint state space model that comprises displacement, velocity, acceleration, and bias components. On this basis, a Kalman filter and a Rauch–Tung–Striebel (RTS) fixed-interval smoother are applied to perform temporal filtering and trajectory smoothing on the drift measurements, thereby producing smooth two-dimensional drift estimates that closely approximate the actual drift trajectory. Finally, the smoothed drift trajectory is used to perform frame-by-frame subpixel drift correction on the original image sequence, achieving high-precision interframe stabilization of the ViSAR imagery. The results of real data processing demonstrate that the proposed method can effectively improve the consistency and scene stability of ViSAR multi-frame imaging. Full article

Accurate large-scale crop mapping is critical for yield prediction, agricultural disaster monitoring, and global food security. Synthetic aperture radar (SAR), with its all-weather imaging capability, plays a vital role in remote sensing based on crop mapping studies. However, although feature-level fusion has been widely explored in remote sensing, existing VV and VH fusion approaches for rice mapping are still predominantly conducted at the data level and fail to adequately integrate their complementary information across the rice growth cycle, so the simplistic fusion methods yield features that are redundant or conflicting at field boundaries and in heterogeneous areas, thereby increasing classification errors. To address these challenges, this study proposes a novel spatiotemporal attention model (SimTA) for feature fusion to improve rice mapping. (1) A VV-VH feature-level fusion scheme is designed, integrated with a Content-Guided Attention (CGA) fusion method which effectively exploits the complementary information of the dual-polarized SAR data for achieving deep spatiotemporal dynamics fusion. (2) A Central Difference Convolution Spatial Extraction Conv (CDCSE Conv) Block is designed, enhancing sensitivity to edge variations in rice fields by combining standard and central difference convolutions. (3) To achieve efficient spatiotemporal feature integration across SAR time series, a Temporal–Spatial Attention (TSA) Block is developed, utilizing large-kernel convolutions for spatial feature extraction and a squeeze-and-excitation mechanism for capturing long-range temporal dependencies of rice time series. Extensive experiments were conducted by comparing SimTA with different models under five fusion schemes. Results demonstrate that feature-level fusion consistently outperforms other schemes, with SimTA achieving the best performance: OA = 91.1%, F1 score = 90.9%, and mIoU = 86.2%. Compared to the baseline Simple Video Prediction (SimVP), SimTA improves F1 score and mIoU by 0.8% and 2.1%, respectively. The CGA enhanced feature-level fusion further boosts SimTA’s performance to OA = 91.5% and F1 = 91.4%. SimTA bridges the gap between existing VV-VH deep fusion schemes and modern spatiotemporal modeling demands, offering a more accurate and generalizable approach for large-scale rice field mapping. Full article

Video synthetic aperture radar (SAR) enables observation of moving targets by leveraging temporal information across successive frames. In particular, dynamic shadows in video SAR image sequences provide critical cues for detecting moving objects whose energy is smeared or Doppler-shifted. To achieve high-resolution imaging at a high frame rate for effective dynamic scene monitoring, video SAR systems typically operate at extremely high frequencies or even in the terahertz band, rather than the microwave band. However, terahertz video SAR suffers from significant signal attenuation due to atmospheric absorption. We present a deep learning framework to achieve high-frame-rate and high-resolution imaging for microwave video SAR systems. In this framework, the problem of microwave video SAR imaging is formulated as an image super-resolution reconstruction task for low-resolution yet high-frame-rate image sequences from microwave video SAR. We develop a simple yet effective image super-resolution reconstruction network that is completely built upon convolutional neural networks. The designed network takes a low-resolution image sequence and the corresponding high-resolution image with blurred shadows as input, and then produces a high-resolution image sequence where shadows are clearly visible. Furthermore, the network is trained in a self-supervised manner and thus does not require high-resolution image sequences with unblurred shadows as ground truth, which is appealing to practical applications. Processing results of real data from two different video SAR systems have shown good performance of the proposed approach with convincing generalization ability. Full article

Terahertz waves are located in the “transition zone” between millimeter waves and infrared light. Terahertz video synthetic aperture radar (THz-ViSAR) utilizes the high operating frequency, strong radar cross-section intensity, and high azimuth repetition frequency of terahertz waves to detect and track ground moving targets. The conventional methods for detecting moving targets do not take into account the imaging characteristics of moving targets in THz-ViSAR. The constant false alarm rate (CFAR) detection method is used together with other methods to detect moving targets, resulting in unsatisfactory detection performance. This article proposes a new detection method for single channel slow-moving targets in THz-ViSAR based on shadows and light spots, which extracts the features of the shadow and spot areas of the moving target, and determines the position and direction of the moving target through the identification of the shadow and spot areas. The progressiveness of this method is verified by simulation and experimental tests. Full article

Shadow detection has become a key technology for ground-based moving target indication in video synthetic aperture radar (SAR). However, single-platform video SAR faces the issue of moving-target shadows being occluded. This paper proposes a new dynamic programming-based spatiotemporal track-before-detect (DP-ST-TBD) algorithm for moving-target shadow indication based on a distributed unmanned aerial vehicle (UAV)-borne video SAR system. First, this approach establishes a spatiotemporal cooperative shadow detection model, which extends the temporal accumulation of traditional DP-TBD to spatiotemporal accumulation by state temporal transition and spatial mapping. Second, an adaptive state transition method is proposed to address the challenge in which the fixed-state transition of traditional DP-TBD struggles with maneuvering target detection. It utilizes target’s Doppler features from heterogeneous-view range-Doppler (RD) spectra to assist in target’s shadow search within the image domain. Finally, a state shrinking–sparseness strategy is used to reduce the computational burden caused by dense states in spatiotemporal search; thus, multi-platform, multi-frame accumulation of moving-target shadows can be realized based on sparse states. The comparative experiments demonstrate that the proposed DP-ST-TBD improves shadow-detection performance through heterogeneous-view measurements while reducing the required number of frames for reliable detection compared to the conventional two-step detection method (single-platform shadow detection followed by multi-platform track fusion). Full article

High frame rate imaging of synthetic aperture radar (SAR), also known as video SAR (ViSAR), has attracted extensive research in recent years. When ViSAR system parameters are fixed, there is a technical trade-off between high frame rates and high resolution. In traditional ViSAR, the frame rate is usually increased by increasing the carrier frequency to increase the azimuth modulation frequency and reducing the synthetic aperture time. This paper attempts to propose a strip non-overlapping mode ViSAR based on Orbital Angular Momentum (OAM) beams, which uses the topological charge of vortex electromagnetic wave (VEW) to improve the azimuth modulation frequency, to improve the frame rate. By introducing the concept of VEW frame splitting, a corresponding time-varying topological charge mode is designed for ViSAR imaging. This design successfully introduces an additional azimuth modulation frequency while maintaining the original imaging resolution, thus significantly improving the frame rate performance of the ViSAR system. However, the Bessel function term in VEW causes amplitude modulation in the echo signal, while the additional frequency modulation causes the traditional matching filter to fail. To address these problems, an improved Range-Doppler algorithm (RDA) is proposed in this paper. By employing the range cell center approximation method, the negative effect of the Bessel function on imaging is reduced effectively. Furthermore, for the introduction of tuning frequency, the azimuth matched filter is specially improved, which effectively prevents the defocusing issues caused by the mismatch of tuning frequency. Finally, the computer simulation results prove that the ViSAR system and imaging algorithm based on VEW can effectively improve the frame rate of ViSAR and maintain the imaging resolution, which provides a research direction for the development of ViSAR technology. Full article

Multimedia Forensics (MMF) investigates techniques to automatically assess the integrity of multimedia content, e.g., images, videos, or audio clips. Data-driven methodologies like Neural Networks (NNs) represent the state of the art in the field. Despite their efficacy, NNs are often considered “black boxes” due to their lack of transparency, which limits their usage in critical applications. In this work, we assess the interpretability properties of Deep High-Frequency Residuals (DHFRs), i.e., noise residuals extracted from images by NNs for forensic purposes, that nowadays represent a powerful tool for image splicing localization. Our research demonstrates that DHFRs not only serve as a visual aid in identifying manipulated regions in the image but also reveal the nature of the editing techniques applied to tamper with the sample under analysis. Through extensive experimentation on spliced amplitude Synthetic Aperture Radar (SAR) images, we establish a correlation between the appearance of the DHFRs in the tampered-with zones and their high-frequency energy content. Our findings suggest that, despite the deep learning nature of DHFRs, they possess significant interpretability properties, encouraging further exploration in other forensic applications. Full article

Video Synthetic Aperture Radar (ViSAR) operates by continuously monitoring regions of interest to produce sequences of SAR imagery. The detection and tracking of ground-moving targets, through the analysis of their radiation properties and temporal variations relative to the background environment, represents a significant area of focus and innovation within the SAR research community. In this study, some key challenges in ViSAR systems are addressed, including the abundance of low-confidence shadow detections, high error rates in multi-target data association, and the frequent fragmentation of tracking trajectories. A multi-target tracking algorithm for ViSAR that utilizes re-identification (ReID) features and a multi-stage data association process is proposed. The algorithm extracts high-dimensional ReID features using the Dense-Net121 network for enhanced shadow detection and calculates a cost matrix by integrating ReID feature cosine similarity with Intersection over Union similarity. A confidence-based multi-stage data association strategy is implemented to minimize missed detections and trajectory fragmentation. Kalman filtering is then employed to update trajectory states based on shadow detection. Both simulation experiments and actual data processing experiments have demonstrated that, in comparison to two traditional video multi-target tracking algorithms, DeepSORT and ByteTrack, the newly proposed algorithm exhibits superior performance in the realm of ViSAR multi-target tracking, yielding the highest MOTA and HOTA scores of 94.85% and 92.88%, respectively, on the simulated spaceborne ViSAR data, and the highest MOTA and HOTA scores of 82.94% and 69.74%, respectively, on airborne field data. Full article

Existing convolution neural network (CNN)-based video synthetic aperture radar (SAR) moving target shadow detectors are difficult to model long-range dependencies, while transformer-based ones often suffer from greater complexity. To handle these issues, this paper proposes MambaShadowDet, a novel lightweight deep learning (DL) detector based on a state space model (SSM), dedicated to high-speed and high-accuracy moving target shadow detection in video SAR images. By introducing SSM with the linear complexity into YOLOv8, MambaShadowDet effectively captures the global feature dependencies while relieving computational load. Specifically, it designs Mamba-Backbone, combining SSM and CNN to effectively extract both global contextual and local spatial information, as well as a slim path aggregation feature pyramid network (Slim-PAFPN) to enhance multi-level feature extraction and further reduce complexity. Abundant experiments on the Sandia National Laboratories (SNL) video SAR data show that MambaShadowDet achieves superior moving target shadow detection performance with a detection accuracy of 80.32% F1 score and an inference speed of 44.44 frames per second (FPS), outperforming existing models in both accuracy and speed. Full article

This paper presents a polar-format algorithm (PFA)-based synthetic-aperture radar (SAR) processor that can be mounted on a small drone to support video SAR (ViSAR) imaging. For drone mounting, it requires miniaturization, low power consumption, and high-speed performance. Therefore, to meet these requirements, the processor design was based on a field-programmable gate array (FPGA), and the implementation results are presented. The proposed PFA-based SAR processor consists of both an interpolation unit and a fast Fourier transform (FFT) unit. The interpolation unit uses linear interpolation for high speed while occupying a small space. In addition, the memory transfer is minimized through optimized operations using SAR system parameters. The FFT unit uses a base-4 systolic array architecture, chosen from among various fast parallel structures, to maximize the processing speed. Each unit is designed as a reusable block (IP core) to support reconfigurability and is interconnected using the advanced extensible interface (AXI) bus. The proposed PFA-based SAR processor was designed using Verilog-HDL and implemented on a Xilinx UltraScale+ MPSoC FPGA platform. It generates an image 2048 × 2048 pixels in size within 0.766 s, which is 44.862 times faster than that achieved by the ARM Cortex-A53 microprocessor. The speed-to-area ratio normalized by the number of resources shows that it achieves a higher speed at lower power consumption than previous studies. Full article

The video synthetic aperture radar (ViSAR) system can utilize high-frame-rate scene motion target shadow information to achieve real-time monitoring of ground mobile targets. Modeling the characteristics of moving target shadows and analyzing shadow detection performance are of great theoretical and practical value for the optimization design and performance evaluation of ViSAR systems. Firstly, based on the formation mechanism and characteristics of video SAR moving target shadows, two types of shadow models based on critical size and shadow clutter ratio models are established. Secondly, for the analysis of moving target shadow detection performance in ViSAR systems, parameters such as the maximum detectable speed of moving targets, the minimum clutter backscatter coefficient, and the number of effective shadow pixels of moving targets are derived. Furthermore, the shadow characteristics of five typical airborne/spaceborne ViSAR systems are analyzed and compared. Finally, a set of simulation experiments on moving target shadow detection for the Hamas rocket launcher validates the correctness and effectiveness of the proposed models and methods. Full article

The unmanned aerial vehicle (UAV)-borne video synthetic aperture radar (SAR) possesses the characteristic of having high-continuous-frame-rate imaging, which is conducive to the real-time monitoring of ground-moving targets. The real-time imaging-processing system for UAV-borne video SAR (ViSAR) requires miniaturization, low power consumption, high frame rate, and high-resolution imaging. In order to achieve high-frame-rate real-time imaging on limited payload-carrying platforms, this study proposes a miniaturization design of a high-integration UAV-borne ViSAR real-time imaging-processing component (MRIPC). The proposed design integrates functions such as broadband signal generation, high-speed real-time sampling, and real-time SAR imaging processing on a single-chip FPGA. The parallel access mechanism using multiple sets of high-speed data buffers increases the data access throughput and solves the problem of data access bandwidth. The range-Doppler (RD) algorithm and map-drift (MD) algorithm are optimized using parallel multiplexing, achieving a balance between computing speed and hardware resources. The test results have verified that our proposed component is effective for the real-time processing of 2048 × 2048 single-precision floating-point data points to realize a 5 Hz imaging frame rate and 0.15 m imaging resolution, satisfying the requirements of real-time ViSAR-imaging processing. Full article

This article presents a high-precision airborne video synthetic aperture radar (SAR) raw echo simulation method aimed at addressing the issue of simulation accuracy in video SAR image generation. The proposed method employs separate techniques for simulating targets and ground clutter, utilizing pre-existing SAR images for clutter simulation and employing the shooting and bouncing rays (SBR) approach to generate target echoes. Additionally, the method accounts for target-generated shadows to enhance the realism of the simulation results. The fast simulation algorithm is implemented using the C++ programming language and the Accelerated Massive Parallelism (AMP) framework, providing a fusion technique for integrating clutter and target simulations. By combining the two types of simulated data to form the final SAR image, the method achieves efficient and accurate simulation technology. Experimental results demonstrate that this method not only improves computational speed but also ensures the accuracy and stability of the simulation outcomes. This research holds significant implications for the development of algorithms pertaining to video SAR target detection and tracking, providing robust support for practical applications. Full article

As a cutting-edge research direction in the field of radar imaging, video SAR has the capability of high-resolution and persistent imaging at any time and under any weather. Video SAR requires high computational efficiency of the imaging algorithm, and PFA has become the preferred imaging algorithm because of its applicability to the spotlight mode and relatively high computational efficiency. However, traditional PFA also has problems, such as low efficiency and limited scene size. To address the above problems, a generalized persistent polar format algorithm, called GPPFA, is proposed for airborne video SAR imaging that is applicable to the persistent imaging requirements of airborne video SAR under multitasking conditions. Firstly, the wavenumber domain resampling characteristics of video SAR PFA are analyzed, and a generalized resampling method is proposed to obtain higher efficiency. Secondly, for the problem of scene size limitation caused by wavefront curvature error, an efficient compensation method applicable to different scene sizes is proposed. GPPFA is capable of video SAR imaging at different wavebands, different slant ranges, and arbitrary scene sizes. Point target and extended target experiments verify the effectiveness and efficiency of the proposed method. Full article