arXiv:2606.15142cs.CVcs.RO2026-06

用双流频域分治法,让机器人动作生成更真实、更连贯。

MotionVLA: Vision-Language-Action Model for Humanoid Motion

论文配图:MotionVLA: Vision-Language-Action Model for Humanoid Motion
图 1 · 摘自论文原文
  • 分频处理动作:基底姿态与高频物理信号分开编码,避免信息失真。
  • 20亿参数模型在两个数据集上显著提升动作多样性与条件一致性。
  • 适合研究动作生成、具身智能或想改进运动控制的开发者。

从场景图像和文本生成逼真的人形机器人动作,需同时捕捉低频姿态语义与高频物理动态。现有方法多使用单一码本对动作进行量化,导致异质信号混杂于同一量化空间。我们对人形动作数据的频域分析发现:前五项DCT系数包含93%的关节位置能量,但仅占37%的关节速度能量,表明单码本量化会偏向姿态统计,忽视高频速度成分。此外,标准自回归模型难以有效建模动作序列中的高频物理信号。为此,我们提出DSFT双流频域分词器,将动作分为基底流与物理流,分别通过DCT截断与BPE独立压缩。进一步提出基于Qwen3.5的MotionVLA模型,将基底与物理令牌统一排列,其中物理令牌在基底之后预测。在HumanML3D和MBench上的实验表明,尽管仅使用20亿参数轻量级骨干网络,MotionVLA在HumanML3D上将动作多样性差距降低超50%,在MBench上提升动作条件一致性3.8%,验证了频率感知的双流解耦是自回归动作生成的有效范式。

原文摘要 · Abstract (English)

Generating realistic humanoid motion from scene images and text involves both low-frequency pose semantics and high-frequency physical dynamics. However, many existing methods tokenize motion with a single shared codebook, forcing heterogeneous motion signals into the same quantization space. Our frequency-domain analysis of human motion data reveals a clear mismatch between single-codebook quantization and motion statistics: five DCT coefficients capture 93% of joint-position energy but only 37% of joint-velocity energy, which can bias quantization toward pose statistics and under-represent high-frequency velocity components. A second challenge lies in adapting a standard autoregressive model to effectively model high-frequency physical signals in motion sequences. Therefore, we propose DSFT, a dual-stream frequency tokenizer that separates motion into Base and physical streams and compresses them independently with DCT truncation and BPE. Furthermore, we present MotionVLA, a Qwen3.5-based model that arranges Base and physical tokens in a unified sequence, where Phys tokens are predicted after Base tokens. Experiments on HumanML3D and MBench show that, despite using a lightweight 2B backbone, MotionVLA reduces the Diversity gap to real data by over 50% on HumanML3D and improves Motion-Condition Consistency by 3.8% on MBench, supporting frequency-aware dual-stream decoupling as an effective formulation for autoregressive motion generation. Code: https://github.com/AIGeeksGroup/MotionVLA. Website: https://aigeeksgroup.github.io/MotionVLA.

动作生成双流模型频域分析具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。