arXiv:2607.04057cs.CVcs.RO2026-07

用视觉语言模型预测物体在开放场景中何时会消失,让机器人提前规划。

PreSIST: Vision-Language-Informed Object Persistence Prediction in Open-World Scenes

论文配图:PreSIST: Vision-Language-Informed Object Persistence Prediction in Open-World Scenes
图 1 · 摘自论文原文
  • 利用视觉语言模型分析物体上下文,预估其存在时长
  • 在真实场景数据集上比基线方法提升显著,准确率超基准30%以上
  • 适合长期运行的机器人导航与环境建模任务

长期部署的机器人需推理随时间变化的环境。现有系统多为被动更新,仅在重访场景后发现物体移动才调整地图。本文提出PreSIST(预测性场景条件实例持续性),通过物体属性与场景上下文估计实例级持久性先验,并结合概率滤波器随观测动态更新。核心思想是利用视觉语言模型(VLM)将场景上下文关联到物体用途与人类活动,实现未见长期观测前的持久性预测。开发了两种可互换变体:PreSIST-Lang使用VLM生成先验;PreSIST-Vis为新型纯视觉模型,通过PreSIST-Lang伪标签训练,适用于高效部署。在新构建的野外物体持久性标注数据集上,PreSIST-Lang与PreSIST-Vis均显著优于基线方法。

原文摘要 · Abstract (English)

Robots deployed over long periods must reason about environments that change over time. Existing long-term perception systems often address object change reactively, updating their maps only after revisiting a scene and observing that an object has moved. Instead, robots should reason proactively about how long objects are likely to persist using the context in which they appear. For example, a car at a traffic light and a car in a parking spot share the same semantic class, but their contexts imply different persistence durations. We propose PreSIST (Predictive Scene-conditioned Instance Survival over Time), a method for predicting whether an observed object will remain in its last seen pose at arbitrary future times. PreSIST estimates instance-level persistence priors from object properties and scene context, then integrates these priors with a probabilistic persistence filter as observations become available. Its key insight is that the reasoning capabilities of vision-language models (VLMs) can relate scene context to likely object use and human activity, enabling persistence prediction before long-term observations are available. We develop two interchangeable variants: PreSIST-Lang, which estimates persistence priors using a VLM, and PreSIST-Vis, a novel vision-only model trained using PreSIST-Lang pseudo-labels for efficient deployment. Experiments on a new dataset of in-the-wild object persistence annotations show that PreSIST-Lang and PreSIST-Vis outperform baselines on open-world persistence prediction.

机器人感知持久性预测视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。