将语言指令分解为慢速推理与快速控制,提升机器人任务泛化能力。
Dual-Process Atomic Skill Learning: Decoupling Semantic Reasoning and Real-Time Control

- 分层设计:慢速策略用向量量化生成可解释动作技能,快速策略用扩散模型生成精确动作。
- 在多个仿真环境上超越现有方法,在未见指令下仍能准确执行复杂组合任务。
- 适合研究机器人具身智能、语言驱动控制的学者,尤其关注任务泛化与可解释性的场景。
语言条件模仿学习对机器人理解自然语言指令完成复杂任务至关重要。然而,实现多步组合任务的泛化仍是重大挑战。现有层次化方法因高层技能推理与低层动作生成在联合训练中紧密耦合,常出现训练不稳和代码本坍塌问题。受认知双过程理论启发,我们提出双过程原子技能学习(DASL),一种异步层次化模仿学习框架,将慢速语义推理与快速实时运动控制解耦。DASL包含慢频策略,通过向量量化预测可解释的离散技能;以及高频策略,利用潜在扩散模型与决策变压器生成基于这些潜在技能的精确动作。通过异步协调模块并用扩散结构化潜在空间,该框架有效缓解了联合训练中的技能代码本干扰问题。在多个仿真基准和实验中验证,DASL显著优于当前最优基线,在技能获取与未见指令的组合泛化方面表现优异。
原文摘要 · Abstract (English)
Language-conditioned Imitation Learning (IL) is essential for enabling robots to perform complex tasks following natural language instructions. However, generalizing to multi-step compositional tasks remains a significant challenge. While hierarchical approaches attempt to address this by decomposing tasks into atomic skills, existing methods often suffer from training instability and codebook collapse due to the tight coupling between high-level skill reasoning and low-level action generation in joint training paradigms. Inspired by the Dual-Process Theory of cognition, we propose Dual-Process Atomic Skill Learning (DASL), a novel asynchronous hierarchical imitation learning framework that decouples slow semantic reasoning from fast, real-time motion control. DASL comprises a Slow-Frequency Policy that predicts interpretable, discrete skills via Vector Quantization, and a High-Frequency Policy that leverages a latent diffusion model and a Decision Transformer to generate precise actions conditioned on these latent skills. By asynchronously coordinating these modules and utilizing diffusion to structure the latent space, our framework mitigates the skill codebook interference problem common in joint training paradigms. Evaluations across simulation benchmarks and experiment demonstrate that DASL significantly outperforms state-of-the-art baselines, excelling in skill acquisition and compositional generalization to unseen instructions. GitHub page: https://github.com/Hatakekaka/DASL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。