用专家混合模型提升机器人长任务的抗错能力和可解释性
MoE-DP: An MoE-Enhanced Diffusion Policy for Robust Long-Horizon Robotic Manipulation with Skill Decomposition and Failure Recovery
- 在视觉编码器与扩散模型间加入专家混合层,动态激活不同专家处理任务阶段
- 6个仿真任务中受扰条件下成功率平均提升36%,真实场景也表现更优
- 专家对应具体操作技能,支持不重新训练即可调整任务顺序
扩散策略在机器人视觉运动控制中表现出强大能力,但在长时序多阶段任务中缺乏对子任务失败的恢复能力,且学习到的观测表征难以解释。本文提出混合专家增强的扩散策略(MoE-DP),在视觉编码器与扩散模型之间引入混合专家(MoE)层,将策略知识分解为一组专用专家,动态激活以应对任务不同阶段。大量实验表明,MoE-DP具备强抗干扰能力,在6个长时序仿真任务中,受扰条件下的成功率平均提升36%。该鲁棒性在真实世界中也得到验证。此外,MoE-DP学习到可解释的技能分解结构,不同专家对应语义任务原语(如接近、抓取),可在推理阶段无需重训练即重构子任务顺序。视频与代码见 https://moe-dp-website.github.io/MoE-DP-Website/
原文摘要 · Abstract (English)
Diffusion policies have emerged as a powerful framework for robotic visuomotor control, yet they often lack the robustness to recover from subtask failures in long-horizon, multi-stage tasks and their learned representations of observations are often difficult to interpret. In this work, we propose the Mixture of Experts-Enhanced Diffusion Policy (MoE-DP), where the core idea is to insert a Mixture of Experts (MoE) layer between the visual encoder and the diffusion model. This layer decomposes the policy's knowledge into a set of specialized experts, which are dynamically activated to handle different phases of a task. We demonstrate through extensive experiments that MoE-DP exhibits a strong capability to recover from disturbances, significantly outperforming standard baselines in robustness. On a suite of 6 long-horizon simulation tasks, this leads to a 36% average relative improvement in success rate under disturbed conditions. This enhanced robustness is further validated in the real world, where MoE-DP also shows significant performance gains. We further show that MoE-DP learns an interpretable skill decomposition, where distinct experts correspond to semantic task primitives (e.g., approaching, grasping). This learned structure can be leveraged for inference-time control, allowing for the rearrangement of subtasks without any re-training.Our video and code are available at the https://moe-dp-website.github.io/MoE-DP-Website/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。