REMIND让机器人在复杂室内环境中长期识别物体,靠记忆和空间关系而非定位。
REMIND: RE-Identification with Memory for INDoor Navigation

- 用双内存池和空间共现推理,构建物体外观与位置的长期记忆
- 在自建数据集上达90.35% IDF1,比顶尖基线高近20分
- 无需深度或位姿,适合无人导航、智能仓储等场景
室内移动机器人需在长时间间隔、视角变化大、光照剧烈波动后重新识别曾见过的物体,这仍是难题:多目标跟踪方法适用于视频帧率下的短时关联,人车重识别缺乏持久记忆机制,而最先进视频目标分割依赖反应式干扰物过滤,无法保证全局身份一致性。为此,我们提出REMIND,一种面向单目RGB图像的在线长期多物体重识别追踪器,无需相机位姿或深度信息。受视觉认知研究启发,人类依靠累积外观熟悉度与空间上下文而非显式自定位,REMIND结合冻结的DINOv3特征、双存储池多原型外观记忆、部件与背景级描述符、利用空间共现的邻居上下文推理模块,以及兼顾模糊性的匈牙利匹配策略。在自建的室内数据集上,该方法取得90.35% IDF1,比最先进的视频目标分割基线高出近20个百分点,比强追踪基线高出36以上。在ScanNet++上,在除端到端检测外的所有设置中均达到最高IDF1;即使在端到端检测场景中,尽管基线略胜一筹,但REMIND仍更准确地关联并恢复身份,且可完整运行全部场景,而视频目标分割基线在66.9%的场景中因显存不足崩溃。完整系统、评估框架与数据集已公开。
原文摘要 · Abstract (English)
Mobile robots operating indoors must re-identify previously observed objects after long temporal gaps, significant viewpoint changes, and severe illumination variations. This remains a challenging problem: multi-object tracking methods are optimized for short-term association of pedestrians and vehicles at video rates, person and vehicle re-identification approaches lack persistent memory mechanisms, and state-of-the-art video object segmentation techniques rely on reactive distractor filtering rather than enforcing global identity consistency. To address these limitations, we present REMIND, an online tracker designed for long-term multi-object re-identification of generic indoor objects from monocular RGB imagery, requiring neither camera pose nor depth. Motivated by evidence from visual cognition that humans rely on accumulated appearance familiarity and spatial context rather than explicit self-localization, REMIND combines frozen DINOv3 features with a dual-bank multi-prototype appearance memory, part- and background-level descriptors, a neighbour-context reasoning module exploiting spatial co-occurrence, and joint Hungarian assignment with ambiguity-aware safeguards. On a purpose-built indoor dataset featuring controlled revisits and dense same-class clutter, REMIND reaches 90.35% IDF1, nearly 20 points above a state-of-the-art video object segmentation baseline and more than 36 above a strong tracking-by-detection baseline. On ScanNet++, it attains the highest IDF1 in every setting but one, end-to-end detection over all scenes, where the tracking-by-detection baseline is marginally ahead while REMIND still associates and recovers identities more accurately; it also completes every scene, whereas the video object segmentation baseline exhausts GPU memory on 66.9% under YOLO detections. The complete system, evaluation framework, and dataset are publicly released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。