让机器人预测物体在时间中的位置变化,如杯子的日常移动轨迹。
Predictive Spatio-Temporal Scene Graphs for Semi-Static Scenes

- 用贝叶斯滤波器建模物体状态随时间的变化规律。
- 在仿真和真实场景中,对物体未来状态预测准确率优于基线方法。
- 适合需要长期环境理解的机器人导航任务,如家庭服务机器人。
近年来,我们在构建融合几何与语义的时空表示方面取得了显著进展,但大多数方法缺乏时间推理能力。当机器人反复观察一个结构化变化的环境时,这一能力尤为重要。例如,在家庭环境中,杯子通常每天在橱柜、台面、水槽间循环移动。本文提出一种方法,通过名为Perpetua$^*$的贝叶斯滤波器,结合3D场景图结构PredictiveGraphs,实现对物体时空状态的动态建模。节点代表物体,边为编码空间语义关系的Perpetua$^*$滤波器。我们在仿真和真实世界动态导航任务中验证该方法,真实实验持续三周,环境每两小时发生一次半静态变化。结果表明,该方法在分布外变化条件下仍能有效预测未来环境状态,优于现有基线。
原文摘要 · Abstract (English)
We have seen tremendous recent progress in our ability to build "spatio-semantic" representations that enable robots to perform complex reasoning across geometry and semantics. However, the vast majority of these methods lack any ability to perform reasoning across time. This is a desirable property in situations where a robot repeatedly observes an environment where instances may change in between observations, but in a structured way. Consider as an example a home environment where the location of a mug typically moves from the cupboard to a countertop to the sink and then back to the cupboard on a daily basis. We should be able to learn this cyclic behavior and use it to predict the state of the mug in the future. In this work, we propose a method that is able to perform this type of tempo-spatio-semantic reasoning. Underpinning the method is a filter, Perpetua$^*$, that performs Bayesian reasoning on the states of the environment that are observed over time. This filter is integrated within a 3D scene graph structure that we call PredictiveGraphs, where nodes represent objects and edges function as Perpetua$^*$ filters encoding spatio-semantic relationships. We validate the method in both simulation and real-world dynamic navigation tasks, where our real world experiments consist of an environment that is undergoing semi-static changes at a bi-hourly frequency over a period of three weeks. In both settings, we demonstrate that our method outperforms baselines in predicting future environment states, even in the presence of distributional shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。