arXiv:2507.04678cs.CV2025-07中稿 · CVPR被引 3

用多模态控制生成遥感图像变化,兼顾事件与季节性变迁。

ChangeBridge: Spatiotemporal Image Generation with Multimodal Controls for Remote Sensing

论文配图:ChangeBridge: Spatiotemporal Image Generation with Multimodal Controls for Remote Sensing
图 1 · 摘自论文原文
  • 基于漂移异步扩散桥,从事件前状态出发分步生成
  • 在跨时空对齐上优于当前最佳方法,支持季节与事件双重变化
  • 适合土地规划与变化检测数据生成,代码开源

时空图像生成是一项极具意义的任务,可基于观测生成未来场景。然而,现有变化生成方法仅能处理事件驱动型变化(如新建建筑),无法建模跨时序变化(如季节更替)。本文提出ChangeBridge,一种面向遥感的条件时空图像生成模型。给定事件前图像和多模态事件控制,生成空间与时间一致的事件后场景。核心是漂移异步扩散桥:1)组合桥初始化替代噪声初始化,从事件前状态开始扩散过程;2)异步漂移扩散使用像素级漂移图,为事件与时间演化分配不同漂移强度,实现前后过渡中的差异化生成;3)漂移感知去噪将漂移图嵌入去噪网络,引导漂移感知重建。实验表明,ChangeBridge在跨时空对齐方面优于现有方法。此外,该模型在土地利用规划及一系列变化检测任务的数据生成中展现出巨大潜力。代码已开源于https://github.com/zhenghuizhao/ChangeBridge。

原文摘要 · Abstract (English)

Spatiotemporal image generation is a highly meaningful task, which can generate future scenes conditioned on given observations. However, existing change generation methods can only handle event-driven changes (e.g., new buildings) and fail to model cross-temporal variations (e.g., seasonal shifts). In this work, we propose ChangeBridge, a conditional spatiotemporal image generation model for remote sensing. Given pre-event images and multimodal event controls, ChangeBridge generates post-event scenes that are both spatially and temporally coherent. The core idea is a drift-asynchronous diffusion bridge. Specifically, it consists of three main modules: a) Composed Bridge Initialization, which replaces noise initialization. It starts the diffusion from a composed pre-event state, modeling a diffusion bridge process. b) Asynchronous Drift Diffusion, which uses a pixel-wise drift map, assigning different drift magnitudes to event and temporal evolution. This enables differentiated generation during the pre-to-post transition. c) Drift-Aware Denoising, which embeds the drift map into the denoising network, guiding drift-aware reconstruction. Experiments show that ChangeBridge can generate better cross-spatiotemporal aligned scenarios compared to state-of-the-art methods. Additionally, ChangeBridge shows great potential for land-use planning and as a data generation engine for a series of change detection tasks. Code is available at https://github.com/zhenghuizhao/ChangeBridge

遥感生成时空模型扩散模型多模态控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。