arXiv:2602.03983cs.ROcs.CV2026-02被引 5

通过分离静态与动态视觉信息,显著提升长时序机器人控制模型的效率与性能。

Efficient Long-Horizon Vision-Language-Action Models via Static-Dynamic Disentanglement

  • 将视觉输入分解为静态与动态特征,仅保留一份静态信息跨帧复用
  • 在真实任务中实现23.3%成功率提升,推理速度加快2.2倍
  • 适合需要长时序理解的机器人控制场景,如记忆依赖任务

视觉-语言-动作(VLA)模型近年来成为通用机器人控制的有力范式。基于视觉-语言模型架构,VLA根据视觉观测和语言指令预测动作,在多种任务上表现出优异的性能与泛化能力。然而,现有VLA面临两大挑战:输入帧上下文窗口有限,以及因二次注意力复杂度和参数量大导致的推理效率低下。为此,我们提出DySta框架,将视觉输入解耦为多层级的静态与动态令牌,实现(1)跨帧仅保留一份静态令牌以大幅缩短上下文长度;(2)通过轻量级重缓存门控机制,仅在必要时更新静态令牌的键值缓存。该设计有效支持多帧融合与高效推理。此外,我们引入一个新基准,更准确评估VLA的多帧融合能力。实验表明,DySta在新基准上多帧融合能力提升24.5%,在真实世界记忆依赖任务中绝对成功率提高23.3%;在仿真基准上推理加速2.0倍(成功率+2.3%),在真实世界通用任务上加速2.2倍(成功率+10.6%)。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for generalist robotic control. Built upon vision-language model (VLM) architectures, VLAs predict actions conditioned on visual observations and language instructions, achieving strong performance and generalization across tasks. However, VLAs face two major challenges: a limited context window for input frames and inefficient inference due to the quadratic attention complexity and large parameter counts. To this end, we propose DySta, a framework that disentangles visual inputs into multi-level static and dynamic tokens, which enables (1) retaining a single copy of static tokens across frames to significantly reduce context length, and (2) reusing the key-value (KV) cache of static tokens through a lightweight recache gate that updates only when necessary. This design enables efficient multi-frame integration and efficient inference. In addition, we introduce a new benchmark that more effectively evaluates the multi-frame integration ability of VLAs. Experiments show that Dysta improves multi-frame integration by 24.5% across metrics on our benchmark and 23.3% in absolute success rate on real-world memory-dependent tasks, while accelerating inference by 2.0x (with +2.3% success rate) on simulation benchmarks and 2.2x (with +10.6% success rate) on real-world general tasks.

机器人控制多模态长序列高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。