arXiv:2606.22794cs.RO2026-06被引 1

UniFS通过分层更新机制提升视觉语言动作模型的效率与精度

UniFS: Unified Fast-to-Slow Hierarchical Architecture for Vision-Language-Action Models

论文配图:UniFS: Unified Fast-to-Slow Hierarchical Architecture for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 将视觉语言模型分层按频率更新,兼顾快速变化与稳定语义
  • 98.3%成功率,推理速度提升2.1倍,延迟降至17.8ms
  • 适合需要高效实时控制的机器人应用场景

主流的快慢双系统视觉语言动作模型为提升效率,将高频动作专家与低频视觉语言模型解耦,但面临根本性频率困境:更新间隔过大导致上下文过时引发语义漂移,间隔过小则削弱计算节省效果。且动作专家仅接收视觉语言模型单一层级固定频率的表示,丢弃了丰富的中间特征,限制信息耦合与操作精度。受人脑多时间尺度神经处理启发,我们提出UniFS统一快慢架构,通过三项设计解决上述问题:首先,将视觉语言模型层按层级分组,逐步降低更新频率,使浅层捕捉快速变化动态,深层保存稳定语义上下文;其次,引入潜在向量反演机制,调整多尺度视觉语言特征与动作专家的交互顺序,使快速变化表示匹配精细动作解码,缓慢变化表示用于粗粒度规划;第三,采用多层次监督策略,在时间尺度上构建从粗到精的学习层次。这些设计实现单一主干内更丰富的跨频率信息传递,同时低频路径额外保留跨步的时间上下文。在LIBERO数据集上的实验表明,UniFS达到98.3%平均成功率(较VLA-Adapter基线提升2.5%),平均推理延迟从36.5毫秒降至17.8毫秒(提速2.1倍)。在Franka机器人平台的真实场景实验进一步验证其实际可用性。代码已开源于https://github.com/linsun449/UniFS。

原文摘要 · Abstract (English)

Mainstream Fast-Slow dual system vision-language-action models decouple a high-frequency action expert from a low-frequency vision-language model for efficiency, yet they face a fundamental frequency dilemma: large update gaps cause semantic drift from stale context, while small gaps erode the intended computational savings. Moreover, because the action expert receives only the VLM's final-layer representation at a single fixed frequency, rich intermediate features are discarded, limiting both information coupling and manipulation precision. Inspired by multi-timescale neural processing in the human brain, we introduce UniFS, a unified fast-to-slow architecture that resolves these challenges through three key designs. First, we stratify the VLM layers into groups with progressively decreasing update frequencies, enabling shallow layers to capture fast-changing dynamics while deeper layers cache stable semantic context. Second, a latent vector inversion mechanism re-routes the interaction order between multi-scale VLM features and the action expert, aligning fast-varying representations with fine-grained action decoding and slow-varying ones with coarse planning. Third, a multi-level supervision strategy enforces a coarse-to-fine learning hierarchy across temporal scales. Together, these designs enable richer cross-frequency information transfer within a single backbone, while the low-frequency pathways additionally preserve temporal context across steps. Experiments on LIBERO show that UniFS achieves state-of-the-art performance (98.3\% average success rate, a 2.5\% gain over VLA-Adapter baseline) while reducing average inference latency from 36.5~ms to 17.8~ms (2.1$\times$ speedup). Real-robot experiments on a Franka platform further validate its practical applicability. Code is opensourced at https://github.com/linsun449/UniFS.

视觉语言动作多模态机器人控制高效架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。