arXiv:2602.16911cs.RO2026-02被引 2

从少量示范中构建完整任务图谱,让机器人理解要做什么而非如何做。

SparTa: Sparse Graphical Task Models from a Handful of Demonstrations

  • 用物体关系图建模任务全过程状态演变
  • 支持多示范学习,准确分割任务阶段并估计状态分布
  • 适合需要少样本泛化的真实机器人部署

高效学习长时程操纵任务是机器人示教学习的核心挑战。不同于直接在动作空间学习的方法,本文关注推断机器人在任务中应达成的目标,而非具体操作方式。通过一系列图形化物体关系表示场景状态演化,提出演示分割与池化方法,提取一系列操纵图,并估计任务各阶段的物体状态分布。相比以往仅捕捉部分交互或短时窗口的图模型方法,本方法可覆盖从控制开始到任务结束的完整交互过程。为提升多示范学习的鲁棒性,引入预训练视觉特征进行物体匹配。在大量实验中评估了演示分割准确率及多示范学习对获取最小化任务模型的有效性。最终在仿真与真实机器人上部署模型,证明所得任务表示可在不同环境中可靠执行。

原文摘要 · Abstract (English)

Learning long-horizon manipulation tasks efficiently is a central challenge in robot learning from demonstration. Unlike recent endeavors that focus on directly learning the task in the action domain, we focus on inferring what the robot should achieve in the task, rather than how to do so. To this end, we represent evolving scene states using a series of graphical object relationships. We propose a demonstration segmentation and pooling approach that extracts a series of manipulation graphs and estimates distributions over object states across task phases. In contrast to prior graph-based methods that capture only partial interactions or short temporal windows, our approach captures complete object interactions spanning from the onset of control to the end of the manipulation. To improve robustness when learning from multiple demonstrations, we additionally perform object matching using pre-trained visual features. In extensive experiments, we evaluate our method's demonstration segmentation accuracy and the utility of learning from multiple demonstrations for finding a desired minimal task model. Finally, we deploy the fitted models both in simulation and on a real robot, demonstrating that the resulting task representations support reliable execution across environments.

机器人学习任务建模图神经网络少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。