arXiv:2601.01948cs.RO2026-01AAAI被引 4

用基础操作技能指导机器人,让动作更连贯可靠。

Learning Diffusion Policy from Primitive Skills for Robot Manipulation

  • 用视觉语言模型提取指令和视觉信息,生成可解释的技能表示
  • 通过轻量路由网络选择当前状态下的最优基础技能,生成对齐动作
  • 在仿真和真实机器人上均优于现有方法,适合复杂任务分解

扩散策略(DP)在机器人操作中展现出巨大潜力,但现有方法常依赖全局指令生成短期控制信号,易导致动作不一致。我们提出一种技能条件化扩散策略(SDP),将细粒度、短时长的基础操作技能(如‘抬升’‘打开夹爪’)作为学习接口。SDP在多个任务中抽象出8种可复用的原始技能,利用视觉-语言模型从视觉观测和语言指令中提取离散表征,并设计轻量级路由网络为每个状态分配目标技能,进而构建单技能策略以生成与技能对齐的动作。通过将复杂任务分解为一系列基础技能并逐个选择单技能策略,确保跨任务行为的一致性。在两个挑战性仿真基准和真实机器人部署上的大量实验表明,SDP持续优于最先进方法,为基于技能的扩散策略学习提供了新范式。

原文摘要 · Abstract (English)

Diffusion policies (DP) have recently shown great promise for generating actions in robotic manipulation. However, existing approaches often rely on global instructions to produce short-term control signals, which can result in misalignment in action generation. We conjecture that the primitive skills, referred to as fine-grained, short-horizon manipulations, such as ``move up'' and ``open the gripper'', provide a more intuitive and effective interface for robot learning. To bridge this gap, we propose SDP, a skill-conditioned DP that integrates interpretable skill learning with conditional action planning. SDP abstracts eight reusable primitive skills across tasks and employs a vision-language model to extract discrete representations from visual observations and language instructions. Based on them, a lightweight router network is designed to assign a desired primitive skill for each state, which helps construct a single-skill policy to generate skill-aligned actions. By decomposing complex tasks into a sequence of primitive skills and selecting a single-skill policy, SDP ensures skill-consistent behavior across diverse tasks. Extensive experiments on two challenging simulation benchmarks and real-world robot deployments demonstrate that SDP consistently outperforms SOTA methods, providing a new paradigm for skill-based robot learning with diffusion policies.

机器人操作扩散模型技能学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。