零样本检测街景变化,无需训练即可准确识别场景差异。
ZeroSCD: Zero-Shot Street Scene Change Detection

- 利用预训练的定位与语义分割模型特征进行零样本变化检测。
- 在多个基准数据集上超越现有方法,准确率显著提升。
- 适合无标注数据场景下的实时变化感知应用。
场景变化检测是计算机视觉与机器人领域的一项挑战性任务,旨在识别同一场景在不同时间拍摄的两幅图像之间的差异。传统方法依赖于大量标注数据训练模型,成本高昂且耗时。为此,我们提出ZeroSCD——一种零样本场景变化检测框架,无需任何训练即可实现检测。该框架利用现有的位置识别与语义分割模型的特征和输出,通过位置识别模型提取的特征估计图像间对应关系并检测变化,再结合语义分割结果精确划定变化边界。在多个基准数据集上的大量实验表明,ZeroSCD在未曾在这些数据集上训练的情况下,仍优于多种前沿方法,证明了其在不同场景下的有效性与适应性。
原文摘要 · Abstract (English)
Scene Change Detection is a challenging task in computer vision and robotics that aims to identify differences between two images of the same scene captured at different times. Traditional change detection methods rely on training models that take these image pairs as input and estimate the changes, which requires large amounts of annotated data, a costly and time-consuming process. To overcome this, we propose ZeroSCD, a zero-shot scene change detection framework that eliminates the need for training. ZeroSCD leverages pre-existing models for place recognition and semantic segmentation, utilizing their features and outputs to perform change detection. In this framework, features extracted from the place recognition model are used to estimate correspondences and detect changes between the two images. These are then combined with segmentation results from the semantic segmentation model to precisely delineate the boundaries of the detected changes. Extensive experiments on benchmark datasets demonstrate that ZeroSCD outperforms several state-of-the-art methods in change detection accuracy, despite not being trained on any of the benchmark datasets, proving its effectiveness and adaptability across different scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。