用L1损失实现快速视觉-运动学习,兼顾多模态与高效推理。
L1 Sample Flow for Efficient Visuomotor Learning
- 将流匹配重构为样本预测,改用L1回归加速训练与推断。
- 仅需两步积分即可生成精准动作序列,性能接近传统方法。
- 适合追求高效、高鲁棒性的机器人控制任务研究者。
基于去噪的模型(如扩散模型和流匹配)在机器人操作中表现优异,具备强大的分布拟合能力和可扩展性。同时,一些研究发现简单的L1回归目标在特定任务上可达到与去噪方法相当的性能,且收敛更快、推理更高效。本文旨在融合两类方法的优势:保留去噪模型对多模态分布的建模能力,避免模式崩溃,同时实现L1回归的高效性。为此,我们重新设计了原始的v预测流匹配,转化为采用L1训练目标的样本预测形式。实验表明,多模态信息可通过单步常微分方程(ODE)表达。因此,我们提出**L1 Flow**:一种两步采样策略,先通过单次积分生成近似动作序列,再通过单次预测精确重构。该方法大幅保留了流匹配的优点,将神经函数评估次数减少至两次,并缓解了直接样本回归带来的性能下降问题。我们在多种基准上进行评估,涵盖MimicGen中的8个任务、RoboMimic & PushT Bench中的5个任务,以及一个真实场景任务。结果表明,该方法在训练效率、推理速度和整体性能方面均具优势。
原文摘要 · Abstract (English)
Denoising-based models, such as diffusion and flow matching, have been a critical component of robotic manipulation for their strong distribution-fitting and scaling capacity. Concurrently, several works have demonstrated that simple learning objectives, such as L1 regression, can achieve performance comparable to denoising-based methods on certain tasks, while offering faster convergence and inference. In this paper, we focus on how to combine the advantages of these two paradigms: retaining the ability of denoising models to capture multi-modal distributions and avoid mode collapse while achieving the efficiency of the L1 regression objective. To achieve this vision, we reformulate the original v-prediction flow matching and transform it into sample-prediction with the L1 training objective. We empirically show that the multi-modality can be expressed via a single ODE step. Thus, we propose \textbf{L1 Flow}, a two-step sampling schedule that generates a suboptimal action sequence via a single integration step and then reconstructs the precise action sequence through a single prediction. The proposed method largely retains the advantages of flow matching while reducing the iterative neural function evaluations to merely two and mitigating the potential performance degradation associated with direct sample regression. We evaluate our method with varying baselines and benchmarks, including 8 tasks in MimicGen, 5 tasks in RoboMimic \& PushT Bench, and one task in the real-world scenario. The results show the advantages of the proposed method with regard to training efficiency, inference speed, and overall performance. \href{https://song-wx.github.io/l1flow.github.io/}{Project Website.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。