arXiv:2609.04893cs.RO2026-09

让机器人模型学会推理但不增加运行成本,训练时加个辅助模块,部署时直接删掉。

Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies

论文配图:Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies
图 1 · 摘自论文原文
  • 训练时用小投影头对齐动作与物理推理文本,推理信息融入模型表征
  • 按每个操作阶段分别对齐(密集对齐)比整体对齐成功率更高,迁移能力更强
  • 推理模块可完全移除,部署零开销,适合需要高效推理的机器人应用

视觉-语言-动作(VLA)模型通过模仿学习掌握该采取什么动作,但不理解为何如此。加入因果推理虽能提升操作表现,但现有方法需在推理时生成推理文本或展开预测状态,成本随任务长度累积。本文提出潜语义支架(LSS),在人类示范预训练阶段引入辅助损失,通过一个小投影头将动作标记表示对齐至物理推理理由的文本嵌入。推理模块在推理阶段被移除,不影响原模型性能。核心发现:按每个操作阶段分别对齐(密集对齐)比使用全局任务级嵌入(池化对齐)的表征更具泛化能力。密集对齐在原任务上成功率更高,并在未见任务上表现最优;而池化对齐则过度适应训练任务。表征探测显示,密集对齐使骨干网络每阶段区分度提高约两倍,证实阶段局部对齐是关键机制。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models are trained by imitation and capture what action to take but not why; adding causal reasoning improves manipulation, but current methods pay for it at inference time - generating reasoning tokens or rolling out predicted future states at every step, a cost that compounds over long horizons. We ask whether this benefit can instead be captured during training and discarded before deployment. We introduce Latent Semantic Scaffolding (LSS), an auxiliary loss applied during human-demonstration pretraining that aligns a VLA's action-token representations to text embeddings of physical-reasoning rationales through a small projection head. The head is dropped at inference, leaving the unmodified base policy with zero added cost. Our central finding concerns alignment granularity: aligning each action token to the rationale of its own manipulation phase (Dense LSS) rather than to a single pooled episode-level embedding (Pooled LSS) yields representations that transfer markedly better to held-out tasks. Dense LSS attains both the best in-distribution success and the best transfer to tasks unseen during alignment, whereas pooled alignment over-specializes to the training task. A representational probe shows Dense LSS induces roughly twice the per-phase separability in the backbone, supporting that phase-local alignment is the operative mechanism.

机器人推理零开销

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。