用历史动作信息初始化生成,单步完成机器人动作预测。
Action-to-Action Flow Matching
- 以历史动作序列作为起点生成新动作,替代随机噪声采样。
- 仅需一步推理即可生成高质量动作,速度显著提升。
- 适合实时控制场景,对视觉扰动和未知配置更鲁棒。
基于扩散模型的策略在机器人领域取得显著进展,将动作预测建模为条件去噪过程。然而,传统方法依赖随机高斯噪声采样,通常需多次迭代才能生成清晰动作,导致推理延迟高,成为实时控制的主要瓶颈。本文提出动作到动作流匹配(A2A),挑战无信息噪声采样的必要性,将采样起点由随机噪声改为前序本体感觉动作。与现有方法将本体感觉反馈视为静态条件不同,A2A利用历史本体感觉序列,将其嵌入高维隐空间作为动作生成起始点。该设计跳过昂贵的迭代去噪过程,有效捕捉机器人物理动力学与时间连续性。大量实验表明,A2A具备高训练效率、快速推理速度及更强泛化能力。特别地,A2A可在单次推理中实现高质量动作生成,并对视觉扰动更具鲁棒性,能更好适应未见配置。最后,我们还将A2A扩展至视频生成任务,验证其在时序建模中的广泛适用性。
原文摘要 · Abstract (English)
Diffusion-based policies have recently achieved remarkable success in robotics by formulating action prediction as a conditional denoising process. However, the standard practice of sampling from random Gaussian noise often requires multiple iterative steps to produce clean actions, leading to high inference latency that incurs a major bottleneck for real-time control. In this paper, we challenge the necessity of uninformed noise sampling and propose Action-to-Action flow matching (A2A), a novel policy paradigm that shifts from random sampling to initialization informed by the previous proprioceptive action. Unlike existing methods that treat proprioceptive action feedback as static conditions, A2A leverages historical proprioceptive sequences, embedding them into a high-dimensional latent space as the starting point for action generation. This design bypasses costly iterative denoising while effectively capturing the robot's physical dynamics and temporal continuity. Extensive experiments demonstrate that A2A exhibits high training efficiency, fast inference speed, and improved generalization. Notably, A2A enables high-quality action generation in as few as a single inference step, and exhibits superior robustness to visual perturbations and enhanced generalization to unseen configurations. Lastly, we also extend A2A to video generation, demonstrating its broader versatility in temporal modeling. Project site: https://lorenzo-0-0.github.io/A2A_Flow_Matching.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。