arXiv:2608.13546cs.CV2026-08被引 2

用外部记忆库和线性扩展教师,实现持久交互与长时生成的统一。

Alaya-EVOKE: From Linear-Scaling Supervision to Endless World

论文配图:Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
图 1 · 摘自论文原文
  • 将场景几何存于外置索引记忆库,仅提取视图相关数据,保持上下文不变。
  • 设计线性增长的教师模型,支持长序列监督,解决内容漂移问题。
  • 三步生成学生模型无分类器引导,兼顾响应速度与长期一致性,适合开放世界建模。

交互式世界模型需兼顾持续记忆、快速响应与长时生成,但这些需求相互冲突。在去噪器上下文或键值缓存中保留历史会随会话增长而增加开销,导致会话长度与记忆容量的权衡;而低延迟交互依赖少步生成,其能力受限于教师模型。Alaya-EVOKE(Evoke)通过外部化持久世界状态并重构教师模型以实现长时交互生成,解决了上述问题。场景几何被存储于外置、相机索引的世界状态库中,仅检索视图相关信息,使去噪器上下文规模恒定。教师模型不再作为固定生成器,而是设计为支持长时监督:其稀疏注意力结合分块分组、远距离帧检索及线性注意力全局状态,实现内存与计算量的线性增长,支持长序列监督。该监督揭示了局部仍合理但整体出现漂移的内容偏差,而每块条件控制可实现全程提示变更与事件干预。采用30秒分布匹配目标,在自强迫滚动中训练,将能力迁移至三步学生模型,后者不使用分类器自由引导,提升对长期漂移的鲁棒性同时保持快速响应。凭借有界上下文与循环外部记忆,Evoke 支持无限持续生成;在单张 H200 上,每1.5秒片段生成耗时2.11秒。作为三步世界模型,Evoke 在WBench上达到领先性能,且在VBench-Long和VBench-2.0上保持竞争力。

原文摘要 · Abstract (English)

Interactive world models must support persistent memory, responsive interaction, and long-horizon generation, yet these requirements place conflicting demands on the model. Maintaining history in the denoiser context or key-value cache incurs growing cost, forcing a trade-off between session length and retained memory, while low-latency interaction relies on few-step generation whose capabilities are bounded by its teacher. Alaya-EVOKE (Evoke) addresses both limitations by externalizing persistent world state and redesigning the teacher for long-horizon interactive generation. Scene geometry is maintained in an external, camera-indexed world state bank, from which only view-relevant information is retrieved, keeping the denoiser context bounded as the session grows. Rather than treating the teacher as a fixed generator, we design it for long-horizon supervision: its sparse attention combines chunk-wise grouping, retrieval of selected distant frames, and a linear-attention global state, yielding linear growth in memory and compute while enabling supervision over long horizons. Such supervision exposes content drift that stays locally plausible within short windows, while per-chunk conditioning enables prompt changes and event control throughout the sequence. A 30-second distribution-matching objective, applied under self-forced rollouts, transfers both capabilities to a three-step student that uses no classifier-free guidance, improving resistance to long-term drift while preserving responsive conditioning. With bounded context and recurrent external memory, Evoke supports open-ended, continuously evolving generation; on a single H200 at $384\times 640$, each $1.5\,\mathrm{s}$ chunk is generated in $2.11\,\mathrm{s}$. As a three-step world model, Evoke achieves state-of-the-art performance on WBench while remaining competitive on VBench-Long and VBench-2.0.

世界模型长时生成外部记忆交互建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。