通过混合不同动作时长,提升机器人任务的长期规划与精细控制能力。
Mixture of Horizons in Action Chunking
- 将动作分段采用不同时间跨度,由共享模型并行处理
- 在真实场景中实现99%成功率,训练仅需3万次迭代
- 支持动态推理,速度比基线快2.5倍,适合复杂任务
视觉-语言-动作(VLA)模型在机器人操作中表现优异,但其性能对训练时的动作分块长度(即视野长度)敏感。实证研究表明:较长视野具备更强的全局预见性,但损害局部精度;较短视野则增强局部控制,却难以应对长期任务,表明固定单一视野次优。为此,本文提出“视野混合”(MoH)策略:将动作分块拆分为多个不同视野的段落,通过共享动作变换器并行处理,并用轻量线性门控融合输出。该方法有三重优势:1)在同一模型内兼顾长程预见性与短程精确性,显著提升性能与泛化能力;2)可无缝集成至全注意力动作模块,训练与推理开销极低;3)支持动态推理,通过跨视野一致性选择稳定动作,吞吐量达基线2.5倍,同时保持优异性能。在基于流形策略π₀、π₀.₅及单步回归策略π_reg的大量实验中,MoH在仿真与真实任务上均取得一致且显著提升。尤其在混合任务设置下,π₀.₅结合MoH在LIBERO数据集上仅用3万次训练迭代即达到99%平均成功率,刷新当前最优水平。
原文摘要 · Abstract (English)
Vision-language-action (VLA) models have shown remarkable capabilities in robotic manipulation, but their performance is sensitive to the $\textbf{action chunk length}$ used during training, termed $\textbf{horizon}$. Our empirical study reveals an inherent trade-off: longer horizons provide stronger global foresight but degrade fine-grained accuracy, while shorter ones sharpen local control yet struggle on long-term tasks, implying fixed choice of single horizons being suboptimal. To mitigate the trade-off, we propose a $\textbf{mixture of horizons (MoH)}$ strategy. MoH rearranges the action chunk into several segments with different horizons, processes them in parallel with a shared action transformer, and fuses outputs with a light linear gate. It has three appealing benefits. 1) MoH exploits long-term foresight and short-term precision jointly within a single model, improving both performance and generalizability to complex tasks. 2) MoH is plug-and-play for full-attention action modules with minimal training or inference overhead. 3) MoH enables dynamic inference with adaptive horizons, which selects stable actions through cross-horizon consensus, achieving 2.5$\times$ higher throughput than baselines while preserving superior performance. Extensive experiments over flow-based policies $π_0$, $π_{0.5}$, and one-step regression policy $π_{\text{reg}}$ demonstrate that MoH yields consistent and significant gains on both simulations and real-world tasks. Notably, under mixed-task setting, $π_{0.5}$ with MoH reaches a new state-of-the-art with 99$\%$ average success rate on LIBERO after only $30k$ training iterations. Project page: https://timsty1.github.io/moh/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。