arXiv:2608.07596cs.ROcs.CV2026-08中稿 · ance of the paper

LIRA通过分层路由机制,让视觉语言模型更高效地指导机器人动作决策。

LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decoding

论文配图:LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decoding
图 1 · 摘自论文原文
  • 设计局部跨层信息路由,动态选择不同深度的中间特征用于动作预测。
  • 在LIBERO-Plus上零样本迁移成功率提升18.9个百分点至78.0%。
  • 无需改动主干网络和训练方式,适配性强,适合实际机器人系统部署。

视觉-语言-动作(VLA)模型将预训练视觉语言模型(VLM)的表示转换为机器人动作,但如何将VLM的中间特征有效传递给动作解码器仍缺乏研究。现有方法或仅使用有限层次的特征,或僵化地将解码器每层与VLM某一层对应,限制了跨层次任务证据的整合。本文提出LIRA,一种面向动作条件化的局部跨层信息路由机制,将VLM到动作的条件化建模为深度感知的信息路由。LIRA基于任务令牌特征与从VLM中间状态提取的LIRA查询特征,为每个并行融合模块分配一个以对应VLM层为中心的深度对齐局部窗口。并行融合模块聚合邻近的LIRA查询特征,结合任务令牌特征与本体感觉输入后进行动作预测。该接口不改变骨干架构、动作解码器及监督训练方式。在LIBERO、LIBERO-Plus、CALVIN ABC→D及真实世界操作任务中,相同0.5B参数配置下,LIRA在主指标上优于VLA-Adapter基线。在零样本迁移至LIBERO-Plus时,平均成功率从59.1%提升至78.0%,提升18.9个百分点,表明其在受控分布偏移下具备更强鲁棒性。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models transform representations from pretrained vision-language models (VLMs) into robot actions, yet the interface that routes intermediate VLM features into action decoders remains underexplored. Existing designs either expose only a narrow part of the representation hierarchy or rigidly match each decoder block to one VLM layer, restricting access to complementary task evidence across depths. We introduce LIRA, a local cross-layer action-conditioning mechanism that formulates VLM-to-action conditioning as depth-aware information routing. LIRA operates on task-token features and LIRA Query features derived from intermediate VLM states, then assigns each Parallel Fusion Block a depth-aligned local window centered on its corresponding VLM layer. Parallel Fusion Blocks aggregate neighboring LIRA Query features and integrate them with task-token features and proprioceptive inputs before action prediction. This routing interface leaves the backbone architecture, action decoder, and supervised training recipe unchanged. Across LIBERO, LIBERO-Plus, CALVIN ABC$\rightarrow$D, and real-world manipulation, LIRA improves the principal aggregate metrics over the VLA-Adapter baseline under the same 0.5B-parameter configuration. In zero-shot transfer to LIBERO-Plus, LIRA increases average success from 59.1% to 78.0%, an 18.9-point gain indicating improved robustness under controlled distribution shifts.

视觉语言动作机器人控制特征路由多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。