用调制注意力提升扩散策略,让机器人操作成功率最高升12%。
MTDP: A Modulated Transformer based Diffusion Policy Model
- 提出调制注意力模块,更好融合引导信息与输入
- 六项任务中成功率最高提升12%,尤其在工具悬挂任务表现突出
- 可适配不同架构,生成速度提升近一倍且性能不降
基于行为克隆的机器人操作研究近年取得显著进展。通过将扩散模型与行为克隆结合,扩散策略被提出,使机器人能快速学习操作任务并获得高成功率。然而,将高容量Transformer与扩散策略结合面临挑战:传统Transformer难以有效整合引导条件,导致操作任务表现不佳。本文研究Transformer关键结构设计,提出调制注意力扩散策略(MTDP)模型。其核心为调制注意力模块,更有效地融合引导条件与主输入,提升生成质量,从而提高机器人任务成功率。在六个实验任务中,MTDP优于现有Transformer模型,尤其在工具悬挂任务中成功率提升12%。为验证调制注意力的通用性,将其应用于UNet架构,构建调制UNet扩散策略(MUDP),在全部六项实验中均优于现有UNet模型。基于去噪扩散概率模型(DDPM)的基础上,进一步探索去噪扩散隐式模型(DDIM),构建MTDP-I与MUDP-I模型,生成速度几乎翻倍,同时保持性能稳定。
原文摘要 · Abstract (English)
Recent research on robot manipulation based on Behavior Cloning (BC) has made significant progress. By combining diffusion models with BC, diffusion policiy has been proposed, enabling robots to quickly learn manipulation tasks with high success rates. However, integrating diffusion policy with high-capacity Transformer presents challenges, traditional Transformer architectures struggle to effectively integrate guiding conditions, resulting in poor performance in manipulation tasks when using Transformer-based models. In this paper, we investigate key architectural designs of Transformers and improve the traditional Transformer architecture by proposing the Modulated Transformer Diffusion Policy (MTDP) model for diffusion policy. The core of this model is the Modulated Attention module we proposed, which more effectively integrates the guiding conditions with the main input, improving the generative model's output quality and, consequently, increasing the robot's task success rate. In six experimental tasks, MTDP outperformed existing Transformer model architectures, particularly in the Toolhang experiment, where the success rate increased by 12\%. To verify the generality of Modulated Attention, we applied it to the UNet architecture to construct Modulated UNet Diffusion Policy model (MUDP), which also achieved higher success rates than existing UNet architectures across all six experiments. The Diffusion Policy uses Denoising Diffusion Probabilistic Models (DDPM) as the diffusion model. Building on this, we also explored Denoising Diffusion Implicit Models (DDIM) as the diffusion model, constructing the MTDP-I and MUDP-I model, which nearly doubled the generation speed while maintaining performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。