arXiv:2606.06904cs.ROcs.CV2026-06被引 2

用体素热图预测机器人动作,提升控制精度与数据效率

ActionMap: Robot Policy Learning via Voxel Action Heatmap

论文配图:ActionMap: Robot Policy Learning via Voxel Action Heatmap
图 1 · 摘自论文原文
  • 用体素热图替代传统单点动作预测,显式建模动作空间几何关系
  • 在LIBERO任务上比现有方法平均提升8.2%,低数据下仍表现优异
  • 适合作为通用模块嵌入多种视觉语言模型,推动动作表示研究

视觉-语言-动作(VLA)模型在骨干网络、训练方法和数据规模方面发展迅速,但动作解码器——将骨干网络隐藏状态转化为连续控制信号的部分——变化甚微,多数仍采用单点预测。无论是自回归分桶、L1回归还是流匹配去噪,现有解码器都将动作空间视为无结构的,未利用相邻动作间的几何邻近性。为此,我们提出ActionMap,一种可替换现有VLA中动作解码器的体素热图动作头。对于每个新动作,该头在动作空间上预测一个体素热图,每个体素直接存储对应动作的概率。在LIBERO仿真和真实世界Franka操作任务中,该热图头在相同训练步数下超越两种架构不同的骨干网络(如在LIBERO四套任务平均上,较OpenVLA-OFT的L1回归头提升8.2%),收敛速度相当或更快,且在低数据条件下显著更高效。跨骨干的一致表现表明,动作表示是提升VLA性能的真实杠杆,独立于骨干或训练配方的进一步扩展。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models have advanced rapidly across backbones, training recipes, and data scale, yet the action decoder, which converts the backbone's hidden state into a continuous control signal, has barely changed and remains a single-point predictor across the majority of current VLAs. Whether implemented via autoregressive token bins, L1 regression, or flow-matching denoising, the resulting decoder treats the action space as unstructured, leaving the geometric proximity of neighboring actions unexploited during training. To advance this, we introduce ActionMap, a voxel heatmap action head that drops into an existing VLA in place of its native action decoder. For each new action, the head predicts a voxel heatmap over the action space, where each voxel directly stores the probability of the corresponding action. Across LIBERO simulation and real-world Franka manipulation, our heatmap head surpasses two architecturally distinct backbones at matched training steps (e.g., +8.2% over OpenVLA-OFT's L1 regression head on the LIBERO four-suite average), converges at comparable or faster rates on both backbones, and remains markedly more data-efficient at low training data. The cross-backbone consistency indicates that action representation is a real lever for VLA performance, distinct from further backbone or recipe scaling. Project Page: https://showlab.github.io/ActionMap/.

机器人控制动作预测体素表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。