arXiv:2603.01766cs.RO2026-03中稿 · ICML被引 2

将动作从离散点转为连续函数,提升机器人控制的平滑性与物理合理性。

Neural Implicit Action Fields: From Discrete Waypoints to Continuous Functions for Vision-Language-Action Models

  • 用视觉语言模型调制可学习运动先验,生成任意时间分辨率的连续动作流。
  • 支持解析微分,显式监督速度并正则化高阶导数,提升动作数学一致性。
  • 在CALVIN和LIBERO上表现优异,实测可实现稳定阻抗控制,适合真实场景部署。

尽管视觉-语言-动作(VLA)模型发展迅速,但当前普遍采用离散方式预测动作片段,这与物理运动的内在连续性不匹配。这种离散化源于固定采样率的机器人数据收集和大语言模型的逐标记预测范式,导致动作绑定于刚性采样频率,无法自然支持解析一致的高阶导数,并引入量化误差,影响精确、柔顺的交互。本文提出神经隐式动作场(NIAF),将动作表示从离散关键点重构为连续动作函数。通过视觉-语言模型作为分层频谱调制器,作用于可学习的运动先验,NIAF合成任意时间分辨率的连续时间动作流。该形式支持解析微分,可显式监督速度并正则化高阶导数信号,以促进数学一致性、物理合理性及控制平滑性。方法在CALVIN和LIBERO多个基线模型上均取得优异表现。真实世界实验进一步验证,NIAF能支持稳定的阻抗控制,实现策略端动作生成与执行端平滑控制之间的无缝衔接。

原文摘要 · Abstract (English)

Despite the rapid progress of vision-language-action (VLA) models, the prevailing practice of predicting action chunks as discrete waypoints remains structurally misaligned with the intrinsic continuity of physical motion. This discretization arises naturally from fixed-rate robot data collection and the token-by-token prediction paradigm of large language models, but ties actions to rigid sampling rates, does not naturally support analytically consistent higher-order derivatives, and introduces quantization artifacts that hinder precise, compliant interaction. We propose Neural Implicit Action Fields (NIAF), which reformulates chunk-level action representation from discrete waypoints to continuous action functions. Using a vision-language model as a hierarchical spectral modulator over a learnable motion prior, NIAF synthesizes continuous-time action manifolds with arbitrary temporal resolution. This formulation enables analytical differentiation, allowing explicit supervision of velocity and regularization of higher-order derivative signals to promote mathematical consistency, physical plausibility, and control smoothness. Our approach achieves strong results on CALVIN and LIBERO across diverse backbones. Real-world experiments further confirm that NIAF supports stable impedance control, bridging policy-side action generation and execution-side smooth control.

动作生成连续控制视觉语言机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。