arXiv:2508.16845cs.CVcs.AI2025-08被引 7

用归一化流替代扩散模型,实现毫秒级动作推理

NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows

  • 用可逆变换的归一化流替代扩散模型做动作解码
  • 在LIBERO上性能持平,推理速度提升数倍
  • 适合需要高频实时控制的应用场景

视觉-语言-动作(VLA)模型通常采用两阶段架构:预训练的视觉-语言模型(VLM)编码视觉观测和任务描述,动作解码器将其映射为连续动作。扩散模型因其能建模复杂的多模态动作分布而被广泛用作动作解码器,但其推理需多次去噪步骤或依赖加速技术,在高频控制需求的现实场景中实用性受限。本文提出NinA(Normalizing Flows in Action),一种快速且表达能力强的VLA动作解码新方案。NinA将扩散模型替换为归一化流(NF),通过可逆变换实现一次采样完成推理,显著降低延迟。我们将NinA集成到FLOWER VLA架构中,并在LIBERO基准上微调。实验表明,在相同训练条件下,NinA性能与基于扩散模型的版本相当,但推理速度大幅提升。结果表明,NinA为高效、高频的VLA控制提供了一条无需牺牲性能的可行路径。

原文摘要 · Abstract (English)

Recent advances in Vision-Language-Action (VLA) models have established a two-component architecture, where a pre-trained Vision-Language Model (VLM) encodes visual observations and task descriptions, and an action decoder maps these representations to continuous actions. Diffusion models have been widely adopted as action decoders due to their ability to model complex, multimodal action distributions. However, they require multiple iterative denoising steps at inference time or downstream techniques to speed up sampling, limiting their practicality in real-world settings where high-frequency control is crucial. In this work, we present NinA (Normalizing Flows in Action), a fast and expressive alternative to diffusion-based decoders for VLAs. NinA replaces the diffusion action decoder with a Normalizing Flow (NF) that enables one-shot sampling through an invertible transformation, significantly reducing inference time. We integrate NinA into the FLOWER VLA architecture and fine-tune on the LIBERO benchmark. Our experiments show that NinA matches the performance of its diffusion-based counterpart under the same training regime, while achieving substantially faster inference. These results suggest that NinA offers a promising path toward efficient, high-frequency VLA control without compromising performance.

VLA归一化流动作解码实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。