This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Open AccessArticle
MapGen-Diff: An End-to-End Remote Sensing Image to Map Generator via Denoising Diffusion Bridge Model
by
Jilong Tian
Jilong Tian ,
Jiangjiang Wu
Jiangjiang Wu ,
Hao Chen
Hao Chen * and
Mengyu Ma
Mengyu Ma
College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2024, 16(19), 3716; https://doi.org/10.3390/rs16193716 (registering DOI)
Submission received: 10 July 2024
/
Revised: 27 September 2024
/
Accepted: 2 October 2024
/
Published: 6 October 2024
Abstract
Online maps are of great importance in modern life, especially in commuting, traveling and urban planning. The accessibility of remote sensing (RS) images has contributed to the widespread practice of generating online maps based on RS images. The previous works leverage an idea of domain mapping to achieve end-to-end remote sensing image-to-map translation (RSMT). Although existing methods are effective and efficient for online map generation, generated online maps still suffer from ground features distortion and boundary inaccuracy to a certain extent. Recently, the emergence of diffusion models has signaled a significant advance in high-fidelity image synthesis. Based on rigorous mathematical theories, denoising diffusion models can offer controllable generation in sampling process, which are very suitable for end-to-end RSMT. Therefore, we design a novel end-to-end diffusion model to generate online maps directly from remote sensing images, called MapGen-Diff. We leverage a strategy inspired by Brownian motion to make a trade-off between the diversity and the accuracy of generation process. Meanwhile, an image compression module is proposed to map the raw images into the latent space for capturing more perception features. In order to enhance the geometric accuracy of ground features, a consistency regularization is designed, which allows the model to generate maps with clearer boundaries and colorization. Compared to several state-of-the-art methods, the proposed MapGen-Diff achieves outstanding performance, especially a RMSE and SSIM improvement on Los Angeles and Toronto datasets. The visualization results also demonstrate more accurate local details and higher quality.
Share and Cite
MDPI and ACS Style
Tian, J.; Wu, J.; Chen, H.; Ma, M.
MapGen-Diff: An End-to-End Remote Sensing Image to Map Generator via Denoising Diffusion Bridge Model. Remote Sens. 2024, 16, 3716.
https://doi.org/10.3390/rs16193716
AMA Style
Tian J, Wu J, Chen H, Ma M.
MapGen-Diff: An End-to-End Remote Sensing Image to Map Generator via Denoising Diffusion Bridge Model. Remote Sensing. 2024; 16(19):3716.
https://doi.org/10.3390/rs16193716
Chicago/Turabian Style
Tian, Jilong, Jiangjiang Wu, Hao Chen, and Mengyu Ma.
2024. "MapGen-Diff: An End-to-End Remote Sensing Image to Map Generator via Denoising Diffusion Bridge Model" Remote Sensing 16, no. 19: 3716.
https://doi.org/10.3390/rs16193716
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details
here.
Article Metrics
Article metric data becomes available approximately 24 hours after publication online.