让生成式世界模型支持连续会话,实现状态持久化。
Persistent Computational State: A Session-Centric Runtime for Generative World Models
- 通过保存运行时状态(含随机数种子)实现会话连续性
- 状态恢复耗时仅0.012毫秒,生成步长为1.85秒
- 适合需要连续模拟的生成式世界模型应用
生成式世界模型正被用作模拟器:规划器分叉状态、展开未来路径、回溯并返回先前视角。现有基准表明当前视频世界模型无法满足此需求,并归因于模型本身,建议新架构与训练目标。我们指出该归因不完整,对一类重要模型甚至错误。只需快照运行时已持有的状态——观测值、随机数生成器状态、记忆库或窗口化KV上下文——在真实回溯后恢复,即可在三类模型上字节级精确重现未离开的延续;仅破坏随机数生成器状态会导致损坏。该能力本就存在,却被请求中心的服务模式抛弃,其继承自语言模型服务中‘运行时状态可重计算’的假设,但世界模型状态包含不可重计算的核心部分。我们定义了持久计算状态(PCS),即跨请求必须保留的最小非可重计算状态,证明其可通过测量发现,并构建基于它的会话中心运行时。检查点与恢复成本仅为0.012毫秒,相比1.85秒的生成步骤极低;驻留会话数量达1,024个,受主机而非设备限制;世界模型内存应按相关性而非最近性淘汰,与大语言模型实践相反。
原文摘要 · Abstract (English)
Generative world models are increasingly driven as simulators: a planner forks a state, rolls out futures, backtracks, and returns to a visited viewpoint. Recent benchmarks establish that current video world models fail this usage, and attribute it to the model, prescribing new architectures and training objectives. We show this attribution is incomplete, and for an important class of models simply wrong. Snapshotting the state the runtime already holds -- an observation plus RNG state, a memory bank, or a windowed KV context, by architecture -- and restoring it after a genuine excursion reproduces the never-left continuation byte-identically on all three; corrupting only the RNG degrades it. The capability was never missing: request-centric serving discarded it, inheriting from language-model serving the assumption that runtime state is recomputable -- but world-model state carries a non-recomputable kernel. We define Persistent Computational State (PCS), the minimal non-recomputable state that must survive across requests, show it can be discovered by measurement, and build a session-centric runtime over it. Checkpoint and restore cost 0.012 ms against a 1.85 s generation step; resident sessions become host- rather than device-bounded (measured to 1,024); and world memory must be evicted by relevance to the return, not recency -- the inverse of LLM practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。