arXiv:2607.25397cs.RO2026-07

将人类示范分解为可重用技能,实现复杂机械臂操作的高效规划

Decompose and Reorganize: Planning with Primitives and Visuomotor Policies Learned from Demonstrations

论文配图:Decompose and Reorganize: Planning with Primitives and Visuomotor Policies Learned from Demonstrations
图 1 · 摘自论文原文
  • 基于接触关系分解示范,生成可复用的视觉-运动策略
  • 在多种场景下完成多步操作,支持未见过的布局和物理约束
  • 大幅降低数据需求,适合需要长序列操作的机器人任务

实现高精度、长时程的机器人灵巧操作,需兼具高层推理与精细执行能力。传统任务与运动规划(TAMP)擅长符号化推理,但在接触密集操作中易失效;模仿学习(IL)虽在视觉反馈任务中表现良好,却受限于空间泛化能力弱和多阶段操作能力不足。为此,本文提出DR-LfD框架,将视觉-运动策略无缝融入受TAMP控制的决策系统。基于接触关系,该框架将人类示范分解为原子级技能,并以视觉-运动策略或对象为中心的原语形式再现。策略的启动、终止及约束均以TAMP兼容方式建模,支持来自不同来源技能的灵活重组。此方法将学习问题从需指数级演示数据的技能序列转变为仅需少量每类技能的演示,显著降低数据负担。通过真实世界与仿真环境中的多场景基准测试,验证了其在多步骤、未知布局与物理约束下的强大性能。

原文摘要 · Abstract (English)

Successfully automating dexterous, long-horizon robotic manipulation requires frameworks capable of both high-level reasoning and fine-grained execution. Traditional task and motion planning (TAMP), while excellent at symbolic planning, is often brittle in contact-rich operations. Simultaneously, imitation learning (IL), while effective in manipulation tasks with visual feedback, is limited by its low capability in spatial generalization and multi-stage operation. To reconcile their complementary strengths and limitations, we propose DR-LfD (Decomposed and Reorganized Skills Learned from Demonstrations), a framework that seamlessly integrates visuomotor policies into a TAMP-gated decision-making system. Based on contact relationships, DR-LfD decomposes human demonstrations into atomic skills, which are reproduced as visuomotor policies or object-centric primitives. The initiation, termination, and constraints of the visuomotor policies are carefully modeled and implemented in a TAMP-compatible form, enabling reorganization of skills learned from different sources. DR-LfD transforms the learning problem from one requiring exponential demonstration data over possible skill sequences to one whose demonstration burden scales with the number of distinct skill types, with limited data for each skill. Through comprehensive real-world and simulation benchmarking across diverse scenarios, we demonstrate the strong performance of DR-LfD on tasks involving multiple steps, unseen setups, and physical constraints. Project website: https://dr-lfd.github.io/DR-LfD-website.

机器人操作模仿学习任务规划技能分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。