arXiv:2511.20306cs.CV2025-11被引 6

用文本引导的时序过渡特征提升遥感变化检测的语义一致性

TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detection

  • 引入文本引导的跨时相转换生成器,建模双时相间的语义演化
  • 在六大数据集上实现当前最优性能,且推理无额外开销
  • 适合需要高语义一致性的遥感变化检测任务

遥感变化检测(RSCD)旨在识别双时相卫星图像间的地表变化。以往方法仅依赖掩码监督,虽能精确定位空间变化,但对时间语义演化的约束不足,导致预测存在语义不一致问题。为此,本文提出TaCo,一种时空语义一致网络,通过引入时空语义联合约束,丰富现有掩码监督框架。TaCo将变化视为双时相状态间的语义过渡,其中一时刻特征可通过专用过渡特征从另一时刻推导得到。为此,设计了文本引导的过渡生成器,融合文本语义与双时相视觉特征以构建跨时相过渡特征。同时提出包含双时相重建约束和过渡约束的联合约束机制:前者强制重构与原始特征对齐,后者增强变化判别力。该设计在不增加推理计算开销的前提下显著提升性能。在六个公开数据集上的实验表明,无论二分类还是语义变化检测任务,TaCo均持续达到当前最优表现。

原文摘要 · Abstract (English)

Remote sensing change detection (RSCD) aims to identify surface changes across bi-temporal satellite images. Most previous methods rely solely on mask supervision, which effectively guides spatial localization but provides limited constraints on the temporal semantic transitions. Consequently, they often produce spatially coherent predictions while still suffering from unresolved semantic inconsistencies. To address this limitation, we propose TaCo, a spatio-temporal semantic consistent network, which enriches the existing mask-supervised framework with a spatio-temporal semantic joint constraint. TaCo conceptualizes change as a semantic transition between bi-temporal states, in which one temporal feature representation can be derived from the other via dedicated transition features. To realize this, we introduce a Text-guided Transition Generator that integrates textual semantics with bi-temporal visual features to construct the cross-temporal transition features. In addition, we propose a spatio-temporal semantic joint constraint consisting of bi-temporal reconstruct constraints and a transition constraint: the former enforces alignment between reconstructed and original features, while the latter enhances discrimination for changes. This design can yield substantial performance gains without introducing any additional computational overhead during inference. Extensive experiments on six public datasets, spanning both binary and semantic change detection tasks, demonstrate that TaCo consistently achieves SOTA performance.

遥感变化检测时序语义多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。