提出频域流匹配方法,让机器人动作连续平滑且适应不同控制频率。
Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation

- 用DCT将离散动作转到频域进行流匹配,再通过余弦基重构连续动作
- 通过约束一阶导数提升动作平滑性,使成功率提高12%-23%,收敛更快
- 无需额外参数,适配现有视觉语言模型和流匹配策略,真实机器人验证有效
流匹配已成为机器人操作的标准范式,因其对复杂多模态动作分布的强大建模能力。然而,现有方法依赖离散动作分块,对异构控制频率的演示数据敏感,易产生时序不一致的动作,影响控制稳定性。本文提出频率感知流匹配(FAFM),输出连续且时序一致的动作。为处理异构频率输入,将离散动作序列通过离散余弦变换(DCT)转入频域,在系数上执行流匹配,并通过余弦基展开重建连续动作。为生成时序一致动作,正则化一阶时间导数,引入类似Sobolev的约束,抑制高频误差并避免突变。FAFM结构简洁,不增加网络参数,适用于独立的流匹配策略及视觉-语言动作模型。在合成玩具基准、障碍物避障、LapGym与LIBERO任务中,显著提升成功率(最高+23%)、多模态表达能力、运动平滑性、收敛速度、对机械偏差及混合频率输入的鲁棒性。真实世界Franka机器人部署验证效果一致。代码已公开。
原文摘要 · Abstract (English)
Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy. However, existing methods rely on discretized action chunks, making them brittle to demonstrations collected at heterogeneous control frequencies and prone to temporally inconsistent actions that degrade control stability. In this paper, we propose Frequency-Aware Flow Matching (FAFM), which outputs continuous, temporally consistent actions. To handle heterogeneous frequency input, we transform discrete action sequences into the frequency domain with the discrete cosine transform (DCT), perform flow matching over the resulting coefficients, and reconstruct continuous actions via cosine basis expansion. To generate temporally consistent actions, we regularize the first-order temporal derivative to promote smooth actions. This corresponds to a Sobolev-type constraint that suppresses high-frequency errors and discourages abrupt action changes. Our FAFM is simple, introduces no additional network parameters and applies to standalone flow-matching policies and vision-language action models. Across synthetic toy benchmark, obstacle avoidance, LapGym, and LIBERO, FAFM improves success rates, multimodal expressivity, motion smoothness, convergence speed, robustness to mechanical bias and mixed-frequency input. These gains are consistent when deployed on a real-world Franka robot. Code available at https://anonymous.4open.science/r/FAFM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。