让机器人动作更稳定:用动态局部坐标系提升视觉语言模型的操控能力
Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models

- 提出运动中心动作帧,通过旋转矩阵动态构建局部坐标系
- 无需额外标注,动作表示更紧凑,主方向减少30%以上
- 适合关注机器人操控鲁棒性与泛化能力的研究者
视觉-语言-动作(VLA)模型虽快速发展,但其动作头仍多采用固定世界坐标系,缺乏灵活性。本文提出轻量级动作头MCF-Proto,引入运动中心动作帧(MCF)和基于原型的动作参数化。每一步,策略预测旋转矩阵 $R_t \in SO(3)$,在变换后的局部坐标系中组合动作原型,并映射回世界坐标系进行端到端训练,仅依赖标准示范数据,无需辅助监督。该设计催生稳定的隐式结构:未使用方向标签时,学习得到的局部坐标轴与末端执行器运动高度对齐;动作表示更紧凑,主要变化由更少主导方向捕捉,且通过共享原型更规律组织。这些结构特性显著提升几何扰动下的鲁棒性。结果表明,为动作头添加轻量级几何与组合结构,可实质性改善VLA策略在机器人操控中的行为组织与泛化能力。代码见补充材料。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have advanced rapidly with stronger backbones, broader pre-training, and larger demonstration datasets, yet their action heads remain largely homogeneous: most directly predict action commands in a fixed world coordinate frame. We propose \textbf{MCF-Proto}, a lightweight action head that equips VLA policies with a Motion-Centric Action Frame (MCF) and a prototype-based action parameterization. At each step, the policy predicts a rotation $R_t \in SO(3)$, composes actions in the transformed local frame from a set of prototypes, and maps them back to the world frame for end-to-end training, using only standard demonstrations without auxiliary supervision. This simple design induces stable emergent structure. Without explicit directional labels, the learned local frames develop a stable geometric structure whose axes are strongly compatible with demonstrated end-effector motion. Meanwhile, actions in the learned representation become substantially more compact, with variation captured by fewer dominant directions and more regularly organized by shared prototypes. These structural properties translate into improved robustness, especially under geometric perturbations. Our results suggest that adding lightweight geometric and compositional structure to the action head can materially improve how VLA policies organize and generalize robotic manipulation behavior. An anonymized code repository is provided in the supplementary material.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。