只在需要时才引入多样性,让机器人学习更高效
MARS Policy: Multimodality Only When It Matters

- 按需激活随机性,仅在必要阶段生成多模式行为
- 实测成功率提升16.67%,推理延迟降低83.20%
- 适合追求高效与多样平衡的机器人任务
模仿学习已成为解决复杂机器人操作任务的核心方法。其中,多模态能力使机器人能捕捉多种有效行为模式,推动生成式策略成为主流。然而,实现多模态通常依赖随机噪声初始化和迭代去噪,导致训练复杂且推理效率低。并非所有任务阶段都需行为多样性。为此,我们提出模态自适应机器人采样(MARS)策略,仅在真正有益时动态引入随机性,其余阶段采用高效确定性学习。即在恰当时间注入恰当之噪声。通过选择性激活多模态生成,MARS弥合了生成式策略的多模态能力与确定性模型的高效率之间的差距。在8个仿真任务和4个真实任务上的实验表明,MARS兼具强多模态表达力与高效率:真实测试中成功率提升16.67%,推理延迟减少83.20%。反直觉的是,在近确定性任务上,其训练效率也优于确定性策略,因能更有效地建模细微动作差异。
原文摘要 · Abstract (English)
Imitation learning has become a cornerstone for solving complex robotic manipulation tasks. In particular, multimodality, which enables robots to capture diverse yet valid behavioral patterns, has driven the rapid emergence of generative policies as a dominant paradigm in robot learning. However, achieving such multimodality typically relies on stochastic noise initialization and iterative denoising procedures, resulting in substantial training complexity and low inference efficiency. Meanwhile, not all phases of a robotic task inherently require behavioral diversity. Motivated by this insight, we propose the Modality-Adaptive Robot Sampling (MARS) policy, which adaptively invokes tailored stochasticity only when it is truly beneficial, while reverting to an efficient deterministic learning during single-modal phases. In other words, the proper amount of noise is injected only at the proper time. By selectively activating multimodal generation, MARS policy bridges the gap between the multimodal capability of generative policies and the superior training and inference efficiency of deterministic models. Empirical studies across 8 simulated and 4 real-world tasks demonstrate that MARS exhibits robust multimodal expressivity and high efficiency, with a 16.67% success rate improvement and an 83.20% inference latency reduction in real-world tests. Counterintuitively, MARS also outpaces deterministic policies in training efficiency on near-deterministic tasks by more effectively modeling nuanced action diversity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。