arXiv:2604.11402cs.CV2026-04

提出多模态场景变化检测方法,提升长期视觉定位数据库的更新准确性。

SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Update

  • 融合视觉与语言特征,区分真实变化与视角差异
  • 在8122对图像上实现像素级多类变化标注,性能提升30.1 R@1
  • 适合需要长期稳定定位的机器人系统研发人员

长期自主移动机器人需要随环境变化持续更新的地图。视觉位置识别(VPR)在查询与数据库图像时间跨度增大时性能显著下降,尤其在季节更替期间。场景变化检测(SCD)为数据库维护提供合理机制,但现有方法依赖二元、单模态视觉特征,无法区分结构变化与视角引起的差异,而这一区分对正确更新决策至关重要。我们提出SCD4VPR,一种在统一视觉-语言框架下联合推理“何物改变”并区分真实变化与视角诱导差异的场景变化检测方法。SCD4VPR通过交叉模态注意力融合视觉语言模型生成的语义描述与视觉特征,并利用几何-语义匹配优化预测,生成多类别变化掩码,分别标识物体变化、外观变化和视角诱导变化。我们构建了首个真实街景的SCD基准数据集NYC-CD,包含8122对图像的像素级多类标注。在四个SCD基准上的实验表明,SCD4VPR可一致提升三种不同架构的骨干网络性能。在覆盖夏末至深冬的纽约大学VPR数据集上进行受控的数据库维护实验,结果证实:若不更新数据库,检索性能大幅下降;而采用SCD4VPR指导的更新可恢复大部分性能损失(最大时间间隔下R@1提升30.1),且数据库远比直接追加更紧凑。

原文摘要 · Abstract (English)

Long-term autonomy in mobile robotics requires maps that remain accurate as environments change over time. Visual Place Recognition (VPR), a core localization capability, degrades sharply as the temporal gap between query and database images grows, particularly across seasonal transitions. Scene Change Detection (SCD) offers a principled mechanism for database maintenance, but existing methods rely on binary, uni-modal visual features that cannot distinguish structural changes from viewpoint-induced differences - a distinction essential for correct update decisions. We propose SCD4VPR, a scene change detection that jointly reasons about what has changed and distinguishes genuine change from viewpoint-induced difference in a unified vision-language framework. SCD4VPR fuses VLM-generated semantic descriptions with visual features via cross-modal attention and refines predictions with geometric-semantic matching, producing multi-class change masks that separately identify object changes, appearance changes, and viewpoint-induced changes. We introduce NYC-CD, the first real-world street-view SCD benchmark with pixel-level multi-class annotations across 8,122 image pairs. Experiments across four SCD benchmarks show that SCD4VPR consistently improves three architecturally distinct backbones. In a controlled VPR database maintenance experiment on NYU-VPR spanning summer through late winter, we confirm that retrieval performance deteriorates substantially when the database is left unchanged, and show that SCD4VPR-guided updates recover most of this loss (+30.1 R@1 at the largest time gap) while keeping the database far more compact than naive append.

场景变化检测视觉定位多模态机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。