arXiv:2608.06434cs.ROcs.LG2026-08

通过环境感知切换,让机器人在快速反应与精准规划间自动平衡。

Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selection

论文配图:Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selection
图 1 · 摘自论文原文
  • 用环境反馈动态选择轻量或重型模型,实现完全解耦的双系统切换。
  • 实测动作频率达93.4赫兹,任务成功率接近大模型基准。
  • 适合需要高实时性与可扩展性的机器人控制场景。

具身智能要求长时推理与实时闭环响应并重。现有视觉-语言-动作(VLA)双系统架构虽兼顾速度与成功率,但快慢模块紧密耦合,需端到端联合训练,限制了模块化、可扩展性及系统灵活切换。本文提出环境感知模型选择(EMS),通过环境感知策略在两个完全解耦的异构系统间动态切换:大型推理系统提供全局一致的轨迹规划以保障任务成功,轻量反应系统实现高频闭环控制。基于强化学习的切换策略依据实时反馈决定调用哪个系统,稀疏使用慢速系统,在利用预训练知识的同时提升运行效率。该设计具备三大优势:(1)全解耦模块化双系统架构,支持即插即用替换;(2)自适应环境感知切换机制;(3)支持高频推理以实现响应式闭环控制。我们在仿真与真实环境广泛评估了EMS。在LIBERO基准上,其成功率接近大规模基线,同时将有效动作频率提升至93.4赫兹。框架在真实双臂操作任务中也展现出强可扩展性,加速任务完成且保持稳健性能。

原文摘要 · Abstract (English)

Embodied intelligence demands both long-horizon reasoning and real-time closed-loop responsiveness. Recent dual-system Vision-Language-Action (VLA) architectures combine fast reactive control with slow deliberative reasoning to balance inference speed and task success rate. However, existing dual-process VLAs tightly couple the fast module to intermediate representations of the slow module, necessitating end-to-end joint training and limiting modularity, extensibility and flexible system switching. In this paper, we propose Environment-aware Model Selection (EMS), an adaptive VLA inference framework that switches between two fully decoupled systems of different scales through environment-aware model selection. The large-scale deliberative system provides globally consistent trajectory planning to ensure task success, while a lightweight reactive system enables high-frequency closed-loop control. A reinforcement-learning-based switching policy dynamically selects which system to invoke based on real-time feedback, enabling sparse use of the slow system and thereby balancing pretrained knowledge utilisation with runtime efficiency. Our design offers three key advantages over prior hierarchical VLA frameworks: (1) a fully decoupled and modular dual-system architecture that supports plug-and-play model replacement; (2) an adaptive, environment-aware switching strategy; (3) high-frequency inference for responsive closed-loop control. We extensively evaluate EMS in both simulation and real-world environments. On the LIBERO benchmark, EMS achieves success rates comparable to the large-scale baseline while increasing the effective action frequency to 93.4 Hz. The framework further demonstrates strong extensibility in real-world dual-arm manipulation tasks, where it accelerates task completion while maintaining robust performance.

机器人控制双系统自适应推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。