揭示遥感语义变化检测中跨时相攻击的脆弱性
On the Adversarial Robustness of Remote Sensing Semantic Change Detection

- 分离输入扰动与输出目标,系统分析双时相预测链路脆弱性
- 单时相扰动可导致最终语义变化预测严重错误,而二值变化定位仍稳定
- 适用于遥感图像分析、对抗鲁棒性研究者,尤其关注多时相任务
语义变化检测(SCD)是一项双时相密集预测任务,联合识别变化区域及其变化前后的语义状态。不同于单图像分割或二值变化检测,SCD将两个时相输入与时间戳级语义预测、变化定位及最终语义-变化解码耦合,形成传统鲁棒性评估未涵盖的对抗依赖关系。本文提出面向任务的评估框架,分离输出端攻击目标与输入端时相扰动访问权限,实现对组件脆弱性和跨时相传播的系统分析。在四个数据集和六种代表性模型(基于CNN、Transformer、状态空间)上,评估了组件级与时相级目标、单/双时相扰动、多种攻击方法及跨架构可迁移性。结果表明:即使二值变化定位相对稳定,最终语义变化预测仍可能被严重破坏;一个时相的扰动或攻击目标可传播至另一时相的预测。此类现象在不同架构族中均存在,而直接跨模型迁移攻击远弱于白盒攻击。研究证实,SCD的对抗鲁棒性取决于完整的双时相预测路径,而非单一分支或主干架构。提供了结构化协议用于评估耦合双时相图像分析中的鲁棒性。代码见https://github.com/EricYu97/AdvSCD。
原文摘要 · Abstract (English)
Semantic change detection (SCD) is a bitemporal dense-prediction task that jointly identifies changed regions and their semantic states before and after change. Unlike single-image segmentation or binary change detection, SCD couples two temporal inputs with timestamp-wise semantic prediction, change localization, and final semantic-change decoding, creating adversarial dependencies that are not captured by conventional robustness protocols. We present a task-specific evaluation framework that separates output-side attack objectives from input-side temporal perturbation access, enabling systematic analysis of component vulnerability and cross-temporal propagation. Experiments on four datasets and six representative CNN-, Transformer-, and state-space-based models evaluate component-level and temporal objectives, single- and dual-timestamp perturbations, multiple attack methods, and cross-architecture transferability. The results show that final semantic-change predictions can be severely corrupted even when binary change localization remains comparatively stable, and that perturbations or attack objectives associated with one timestamp can propagate to the prediction of the other. These behaviors occur across different architecture families, while direct cross-model transfer remains considerably weaker than white-box attacks. The study demonstrates that adversarial robustness in SCD depends on the complete bitemporal prediction pathway rather than on an individual branch or backbone family, and provides a structured protocol for evaluating robustness in coupled bitemporal image analysis. Code is available at https://github.com/EricYu97/AdvSCD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。