arXiv:2608.04428cs.ARcs.LG2026-08被引 1

通过位级稀疏与推测推理,实现机器人视觉语言动作模型实时推理。

Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

论文配图:Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference
图 1 · 摘自论文原文
  • 利用输入时序相似性,仅计算连续帧间差异,减少冗余运算。
  • 在边缘设备上实现34.2倍速度提升,延迟低于50毫秒。
  • 适合部署于移动机器人等对延迟敏感的嵌入式场景。

视觉-语言-动作(VLA)模型是具身智能的核心组件。基于扩散模型的VLA具备更优的动作质量和泛化能力,但其计算开销大,需以50–200 Hz的高控制频率运行,对边缘设备的延迟和能耗提出严苛要求。本文提出Deltoris,一种算法-硬件协同设计框架,用于高效推理扩散型VLA模型。首先,利用连续输入间的时序相似性,提出时序感知位级稀疏算法,仅计算帧间差异,消除冗余位级操作。为缓解该算法引入的额外片外数据传输,进一步提出推测推理技术,将数据加载开销分摊至多个控制周期。最后,为支持上述技术,设计专用加速器,采用定制化1D systolic位串行处理单元阵列,避免处理单元负载不均。评估显示,Deltoris相比移动端GPU提速34.2倍,优于先前加速器6.1倍,同时保持相近精度。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models have emerged as a key component in embodied AI. Among existing approaches, diffusion-based VLA models achieve superior motion quality and generalization. However, diffusion-based VLA models are compute-intensive and must run at high control frequency, e.g., 50-200 Hz. Thus, it imposes strict latency and energy constraints on edge devices. In this work, we present Deltoris, an algorithm-hardware co-design framework for efficient diffusion-based VLA inference. First, we exploit the temporal similarity of consecutive inputs and propose a \textit{temporal-aware bit-sparsity} algorithm that computes only the differences between consecutive inputs, eliminating redundant bit-level operations. To further address the extra off-chip traffic introduced by our algorithm, we propose a \textit{speculative inference} technique, which amortizes data loading across multiple control steps. Lastly, to support these techniques, we co-design a dedicated accelerator with customized 1D systolic bit-serial PE arrays that eliminate PE workload imbalance. Our evaluation shows that Deltoris achieves up to 34.2$\times$ speedup over mobile GPUs and 6.1$\times$ over prior accelerators, while maintaining comparable accuracy.

具身智能扩散模型边缘计算稀疏推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。