用扩散模型生成中间帧,解决遥感图像长期时序差带来的对齐难题
Morphing Through Time: Diffusion-Based Bridging of Temporal Gaps for Robust Alignment in Change Detection
- 通过扩散模型生成时序中间帧,填补长间隔图像差异
- 在三个数据集上提升配准精度与变化检测性能
- 模块化设计可无缝接入现有检测模型,适合实际遥感应用
遥感变化检测常因双时相图像间存在空间错位而受挑战,尤其在季节或多年跨度的影像之间。尽管现代卷积和基于Transformer的模型在对齐数据上表现良好,但其对精确配准的依赖限制了真实场景下的鲁棒性。现有联合注册-检测框架通常需重新训练,跨域迁移能力差。本文提出一种模块化流程,在不修改现有变化检测网络的前提下,提升空间与时间鲁棒性。该框架结合基于扩散的语义形变、密集配准与残差流精修。扩散模块生成中间形变帧,弥合大尺度外观差距,使RoMa能估计连续帧间的逐步对应关系。合成的光流随后通过轻量级U-Net精修,生成高保真形变场以共配准原始图像对。在LEVIR-CD、WHU-CD和DSIFN-CD上的大量实验表明,该方法在多个骨干网络上均一致提升配准精度与下游变化检测效果,验证了其通用性与有效性。
原文摘要 · Abstract (English)
Remote sensing change detection is often challenged by spatial misalignment between bi-temporal images, especially when acquisitions are separated by long seasonal or multi-year gaps. While modern convolutional and transformer-based models perform well on aligned data, their reliance on precise co-registration limits their robustness in real-world conditions. Existing joint registration-detection frameworks typically require retraining and transfer poorly across domains. We introduce a modular pipeline that improves spatial and temporal robustness without altering existing change detection networks. The framework integrates diffusion-based semantic morphing, dense registration, and residual flow refinement. A diffusion module synthesizes intermediate morphing frames that bridge large appearance gaps, enabling RoMa to estimate stepwise correspondences between consecutive frames. The composed flow is then refined through a lightweight U-Net to produce a high-fidelity warp that co-registers the original image pair. Extensive experiments on LEVIR-CD, WHU-CD, and DSIFN-CD show consistent gains in both registration accuracy and downstream change detection across multiple backbones, demonstrating the generality and effectiveness of the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。