通过跨块缓存加速少步自回归世界模型推理,显著提升自动驾驶仿真效率。
X-Cache: Cross-Chunk Block Caching for Few-Step Autoregressive World Models Inference

- 在连续生成块间缓存残差,而非传统去噪步骤间缓存。
- 实现71%的块跳过率,推理速度提升2.6倍且精度几乎无损。
- 适合需实时交互的自动驾驶仿真系统,无需额外训练。
实时世界模拟正成为大规模自动驾驶评估与在线强化学习的关键基础设施。近期基于自回归视频扩散的世界模型实现了高保真、多摄像头可控生成,但其推理成本仍是交互式部署的瓶颈。现有扩散缓存方法适用于离线多步去噪生成,不适用于此场景:少步蒸馏模型已无步骤间冗余可复用,而序列级并行技术又依赖未来条件,不适用于闭环交互生成。本文提出X-Cache,一种无需训练的加速方法,将缓存维度从去噪步骤转向连续生成块。X-Cache维护跨块持久的每块残差缓存,并基于结构与动作感知的块输入指纹,采用双指标门控机制独立决定每个块是否重用或重新计算。为防止近似误差永久污染自回归键值缓存,X-Cache识别键值更新块(即写入干净键值的前向传播),强制在此类块上完全计算,阻断误差传播。我们在基于多块因果DiT、少步去噪与滚动键值缓存的生产级多摄像头动作条件驱动世界模型X-world上实现了X-Cache。结果表明,该方法在保持最小精度损失的前提下,实现71%的块跳过率和2.6倍的墙钟时间加速。
原文摘要 · Abstract (English)
Real-time world simulation is becoming a key infrastructure for scalable evaluation and online reinforcement learning of autonomous driving systems. Recent driving world models built on autoregressive video diffusion achieve high-fidelity, controllable multi-camera generation, but their inference cost remains a bottleneck for interactive deployment. However, existing diffusion caching methods are designed for offline video generation with multiple denoising steps, and do not transfer to this scenario. Few-step distilled models have no inter-step redundancy left for these methods to reuse, and sequence-level parallelization techniques require future conditioning that closed-loop interactive generation does not provide. We present X-Cache, a training-free acceleration method that caches along a different axis: across consecutive generation chunks rather than across denoising steps. X-Cache maintains per-block residual caches that persist across chunks, and applies a dual-metric gating mechanism over a structure- and action-aware block-input fingerprint to independently decide whether each block should recompute or reuse its cached residual. To prevent approximation errors from permanently contaminating the autoregressive KV cache, X-Cache identifies KV update chunks (the forward passes that write clean keys and values into the persistent cache) and unconditionally forces full computation on these chunks, cutting off error propagation. We implement X-Cache on X-world, a production multi-camera action-conditioned driving world model built on multi-block causal DiT with few-step denoising and rolling KV cache. X-Cache achieves 71% block skip rate with 2.6x wall-clock speedup while maintaining minimum degradation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。