用时序差异建模提升动态环境下的视觉定位精度
OptiCorNet: Optimizing Sequence-Based Context Correlation for Visual Place Recognition
- 将空间特征与时间差分融合为可端到端训练的模块
- 在多个基准上优于当前最优方法,尤其在季节和视角变化下表现突出
- 适合需要长时定位鲁棒性的自动驾驶与机器人场景
动态和感知混淆环境下,长期定位中的视觉场景识别仍是根本挑战。现有基于深度学习的方法主要关注单帧嵌入,忽略了图像序列中的时间一致性。本文提出OptiCorNet,一种新型序列建模框架,将空间特征提取与时间差分统一为可微、端到端可训练的模块。核心是轻量级一维卷积编码器结合可学习的时间差分算子——可微序列差分(DSD),共同捕捉短时空间上下文与长程时间演变。DSD模块通过固定权重差分核建模序列方向差异,经由基于LSTM的优化与可选残差投影,生成紧凑且具有区分性的描述符,对视角与外观变化具有鲁棒性。为增强类间分离性,引入四元组损失,优化批次内正样本对齐与多负样本发散。不同于以往将时间聚合视为后处理的方法,OptiCorNet直接学习序列级嵌入,实现更有效的端到端场景识别。在多个公开基准上的全面评估表明,该方法在季节和视角变化等挑战条件下均优于当前最优基线。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) in dynamic and perceptually aliased environments remains a fundamental challenge for long-term localization. Existing deep learning-based solutions predominantly focus on single-frame embeddings, neglecting the temporal coherence present in image sequences. This paper presents OptiCorNet, a novel sequence modeling framework that unifies spatial feature extraction and temporal differencing into a differentiable, end-to-end trainable module. Central to our approach is a lightweight 1D convolutional encoder combined with a learnable differential temporal operator, termed Differentiable Sequence Delta (DSD), which jointly captures short-term spatial context and long-range temporal transitions. The DSD module models directional differences across sequences via a fixed-weight differencing kernel, followed by an LSTM-based refinement and optional residual projection, yielding compact, discriminative descriptors robust to viewpoint and appearance shifts. To further enhance inter-class separability, we incorporate a quadruplet loss that optimizes both positive alignment and multi-negative divergence within each batch. Unlike prior VPR methods that treat temporal aggregation as post-processing, OptiCorNet learns sequence-level embeddings directly, enabling more effective end-to-end place recognition. Comprehensive evaluations on multiple public benchmarks demonstrate that our approach outperforms state-of-the-art baselines under challenging seasonal and viewpoint variations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。