提出环境变化检测新任务,解决视角不匹配下的真实场景变化识别问题。
Environmental Change Detection: Toward a Practical Task of Scene Change Detection
- 用多参考图像和语义特征聚合应对视角偏差
- 在三个重建数据集上显著优于现有方法
- 适合自动驾驶、遥感等实际应用
人类不会记忆所有内容,而是通过回顾过往图像来识别场景变化。然而,可用的参考图像通常仅来自相近视角,而非完全相同的视点。尽管存在这一现实限制,传统场景变化检测(SCD)仍基于理想化设定——假设每个查询场景都有对应视角的参考图像。本文将该问题推向实际任务,提出环境变化检测(ECD),核心是避免人为对齐的查询-参考配对,仅依赖环境线索。受真实实践启发,我们构建了一个大规模未标注图像数据库作为线索来源。为此,提出一种新框架,联合理解空间环境并检测变化:由于视角错位和视场覆盖有限,直接在相同空间位置匹配查询与参考可能带来次优解。因此,我们采用多个参考候选,并聚合语义丰富的表征进行变化检测。在三个为ECD重构的标准基准集上评估,本框架显著优于简单组合现有先进方法的表现,且达到接近理想情况(oracle)的性能。代码将在录用后公开。
原文摘要 · Abstract (English)
Humans do not memorize everything. Thus, humans recognize scene changes by exploring the past images. However, available past (i.e., reference) images typically represent nearby viewpoints of the present (i.e., query) scene, rather than the identical view. Despite this practical limitation, conventional Scene Change Detection (SCD) has been formalized under an idealized setting in which reference images with matching viewpoints are available for every query. In this paper, we push this problem toward a practical task and introduce Environmental Change Detection (ECD). A key aspect of ECD is to avoid unrealistically aligned query-reference pairs and rely solely on environmental cues. Inspired by real-world practices, we provide these cues through a large-scale database of uncurated images. To address this new task, we propose a novel framework that jointly understands spatial environments and detects changes. The main idea is that matching at the same spatial locations between a query and a reference may lead to a suboptimal solution due to viewpoint misalignment and limited field-of-view (FOV) coverage. We deal with this limitation by leveraging multiple reference candidates and aggregating semantically rich representations for change detection. We evaluate our framework on three standard benchmark sets reconstructed for ECD, and significantly outperform a naive combination of state-of-the-art methods while achieving comparable performance to the oracle setting. The code will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。