用递归解码器提升场景变化检测精度,更适配真实机器人应用。
TERDNet: Transformer Encoder-Recurrent Decoder Network for Scene Change Detection

- 基于变压器编码器与递归门控单元解码器,逐轮优化变化区域
- 在四个公开数据集上均超越现有方法,变化掩膜更精确细致
- 支持分割预训练,对视角偏差鲁棒,适合实际机器人系统
本文针对场景变化检测(SCD)问题,即识别同一地点不同时间拍摄的图像间差异。现有模型常忽略多层特征的重要性差异,采用单步解码器限制精细化修复,且缺乏对编码器预训练策略的深入分析。为此提出TERDNet:一种基于变压器的编码器-递归解码器网络。其包含多层级特征提取的编码器、融合相关体积与特征的模块、执行迭代优化的3门控GRU解码器,以及结合卷积与插值的上采样器以恢复细粒度分辨率。在四个公开基准上的实验表明,TERDNet持续优于以往方法,生成更准确、更精细的变化掩膜。消融实验证实了基于分割的预训练价值及融合设计的有效性。此外,在视角错位下的鲁棒性测试表明,该模型具备部署于真实机器人系统的潜力,其可靠感知能力至关重要。代码已开源:https://github.com/AutoCompSysLab/TERDNet。
原文摘要 · Abstract (English)
In this work, we address the challenge of Scene Change Detection (SCD), where the goal is to identify variations between two images of the same location captured at different times. Existing SCD models often overlook the varying importance of features across layers, employ single-step decoders that confine refinement, and provide limited insight into encoder pretraining strategies. We propose TERDNet, a Transformer Encoder-Recurrent Decoder Network designed to overcome these limitations. TERDNet consists of a transformer-based encoder that extracts multi-level representations, a feature fusion module that integrates correlation volumes with these features, a recurrent 3-gate-GRU decoder that performs iterative refinement, and a combined convolution-interpolation upsampler that restores fine-grained resolution. Extensive experiments on four public benchmarks show that TERDNet consistently outperforms prior approaches and produces more accurate and detailed change masks. Ablation studies confirm the benefit of segmentation-based pretraining and the effectiveness of our fusion design. In addition, robustness tests under viewpoint misalignment confirm TERDNet's potential for deployment in real-world robotic systems, where reliable perception is critical. Our code is available at https://github.com/AutoCompSysLab/TERDNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。