arXiv:2603.06331cs.CV2026-03中稿 · ICML被引 3

通过动态缓存稀疏关键令牌,实现世界模型零成本加速。

WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching

  • 根据物理曲率预测令牌可预测性,区分处理混沌与稳定令牌。
  • 实现3.7倍加速,长序列模拟质量保持98%不变。
  • 适合资源受限场景下的交互式世界模型应用。

基于扩散的世界模型在统一世界模拟中展现强大潜力,但迭代去噪计算成本过高,难以用于交互式场景和长时程推演。尽管特征缓存可在无需训练的情况下加速推理,但针对单模态扩散设计的策略在世界模型上表现不佳,主要受两大挑战制约:多模态耦合与空间变化带来的令牌异质性,以及非均匀时间动态下少数难预测令牌主导误差增长,导致均匀跳过策略或不稳定或过于保守。本文提出专为扩散世界模型设计的缓存框架WorldCache。引入曲率引导的异质令牌预测,利用物理启发的曲率分数估计令牌可预测性,并对具有突变方向的混沌令牌采用赫尔米特引导的阻尼预测器。同时设计混沌优先自适应跳过机制,累积归一化的无量纲漂移信号,仅在瓶颈令牌开始漂移时重新计算。在扩散世界模型上的实验表明,WorldCache可实现高达3.7×的端到端加速,同时保持98%的推演质量,充分证明其在资源受限场景下的巨大优势与实用性。代码已开源:https://github.com/FofGofx/WorldCache。

原文摘要 · Abstract (English)

Diffusion-based world models have shown strong potential for unified world simulation, but the iterative denoising remains too costly for interactive use and long-horizon rollouts. While feature caching can accelerate inference without training, we find that policies designed for single-modal diffusion transfer poorly to world models due to two world-model-specific obstacles: \emph{token heterogeneity} from multi-modal coupling and spatial variation, and \emph{non-uniform temporal dynamics} where a small set of hard tokens drives error growth, making uniform skipping either unstable or overly conservative. We propose \textbf{WorldCache}, a caching framework tailored to diffusion world models. We introduce \textit{Curvature-guided Heterogeneous Token Prediction}, which uses a physics-grounded curvature score to estimate token predictability and applies a Hermite-guided damped predictor for chaotic tokens with abrupt direction changes. We also design \textit{Chaotic-prioritized Adaptive Skipping}, which accumulates a curvature-normalized, dimensionless drift signal and recomputes only when bottleneck tokens begin to drift. Experiments on diffusion world models show that WorldCache delivers up to \textbf{3.7$\times$} end-to-end speedups while maintaining \textbf{98\%} rollout quality, demonstrating the vast advantages and practicality of WorldCache in resource-constrained scenarios. Our code is released in https://github.com/FofGofx/WorldCache.

世界模型加速推理扩散模型缓存机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。