用预训练模型指导遥感变化数据合成,提升多样性与实用性
Real-World Knowledge-Guided Change Data Synthesis for Remote Sensing

- 基于视觉语言模型推理真实场景中的合理变化位置与类别转变
- 合成数据在跨域迁移和数据增强任务中表现优于现有方法
- 可无缝集成到现有流程,适合遥感变化检测研究者使用
变化数据合成为扩展训练数据、提升变化检测模型性能提供了低成本方案。然而,现有方法多依赖手工规则模拟变化,类别转变覆盖有限,且预设转变设计缺乏灵活性。本文提出KnowChange框架,利用预训练视觉-语言模型作为知识源,从变化前场景和目标变化类型中推理出合理的变更位置与类别转移。通过将知识引导的变化模拟与通用合成模型结合,KnowChange在统一框架内实现多样化变化类型的灵活合成。大量实验表明,尽管生成规模紧凑,KnowChange生成的数据在合成到真实迁移及合成数据增强任务中均优于现有合成数据集。进一步分析显示,该知识引导机制可无缝融入现有合成流程,显著提升合成数据的下游应用价值。
原文摘要 · Abstract (English)
Change data synthesis provides a cost-effective solution for expanding training data and improving the performance of change detection models. However, existing synthesis methods typically rely on handcrafted rules to simulate changes, where limited coverage of class transitions restricts the diversity of synthesized data, while predefined transition designs limit their flexibility in accommodating varied change types. In this work, we introduce KnowChange, a knowledge-guided change data synthesis framework that leverages pretrained vision-language models as knowledge sources to reason about plausible change locations and class transitions from pre-change scenes and desired change types. By integrating knowledge-guided change simulation with generalizable synthesis models, KnowChange enables flexible synthesis of diverse change types within a unified framework. Extensive experiments demonstrate that KnowChange-generated data consistently outperforms existing synthetic datasets in both synthetic-to-real transfer and synthetic data augmentation, despite being generated at a compact scale. Further analyses show that the knowledge-guided change simulation can be seamlessly integrated into existing synthesis pipelines and enhance the downstream utility of synthesized data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。