arXiv:2607.19191cs.CVcs.AI2026-07被引 6

单块显卡实现实时长序列交互世界模拟,支持角色持久身份与流畅控制。

ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

论文配图:ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU
图 1 · 摘自论文原文
  • 基于多源数据训练可控世界模型,通过反馈驱动自主采集与统一质量评估
  • 在单张RTX 5090上实现720P、16FPS视频流,延迟仅1.2秒,显存峰值约19GiB
  • 适合需要低延迟、高一致性交互的虚拟环境开发与测试场景

我们提出ABot-World-0,一种基于动作条件的视频世界模型,可在单台桌面级GPU上实现实时、长时程闭环交互。模型依托来自AAA游戏、仿真引擎和互联网视频的多源数据,学习可控的世界动态。WorldExplorer通过训练反馈引导代理驱动的数据收集,统一流水线包含14项确定性质量检测、基于视觉语言模型的评估以及动作与文本的同步标注。通过教师强制与常微分方程蒸馏,将双向动作条件教师逐步压缩为因果学生,并引入LongForcing,使学生长序列自推演与扩展视野教师对齐,缓解累积分布偏移与自回归漂移。原始键盘输入提供统一控制接口,用于场景漫游与第三人称角色交互;参考角色记忆则保持第三人称推演中角色身份的一致性。部署方面,我们协同设计了流式推理栈,包含轻量级VAE解码器、高效注意力机制、内存感知调度与低比特DiT推理。在优化的低比特配置下,系统在单张NVIDIA RTX 5090 GPU上实现720P视频流输出最高达16 FPS,动作到首帧延迟1.2秒,峰值显存约19GiB。在WorldRoamBench及扩展交互推演实验中,展现了优秀的可控性与长时程世界演化连贯性。

原文摘要 · Abstract (English)

We present ABot-World-0, an action-conditioned video world model for real-time, long-horizon closed-loop interaction, supported by a multi-source data infrastructure spanning AAA games, simulation engines, and internet videos to learn controllable world dynamics. WorldExplorer performs agent-driven collection guided by training feedback, while a unified pipeline applies 14 deterministic quality checks, VLM-based assessment, and synchronized action and text annotation. We progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduce LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift. Raw keyboard actions provide a unified control interface for scene roaming and third-person character interaction, while reference-character memory provides persistent appearance cues for identity consistency during third-person rollouts. For deployment, we co-design a streaming inference stack with a lightweight VAE decoder, efficient attention, memory-aware scheduling, and low-bit DiT inference. Across optimized low-bit configurations, ABot-World-0 streams 720P video at up to 16 FPS on a single NVIDIA RTX 5090 desktop GPU, with 1.2s action-to-first-frame latency and approximately 19GiB peak VRAM. Experiments on WorldRoamBench and extended interactive rollouts demonstrate competitive controllability and coherent long-horizon world evolution.

世界模型实时交互低延迟推理符号控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。