arXiv:2604.01641cs.CV2026-04中稿 · ECCV

从单图生成可交互的动态4D世界,支持云水烟等环境持续演化。

LivingWorld: Interactive 4D World Generation with Environmental Dynamics

  • 渐进式构建全局一致的运动场,实现场景扩展中的动态连贯性。
  • 单步场景生成仅需9秒,运动对齐与更新3秒,支持实时交互。
  • 适合虚拟现实、游戏开发及影视特效中需要动态环境的场景。

我们提出LivingWorld,一个从单张图像生成带有环境动态的交互式4D世界的框架。尽管近期3D场景生成技术已能大规模创建环境,但多数方法聚焦于静态几何重建,对云、水、烟等场景级动态建模仍缺乏探索。建模此类动态极具挑战,因运动需在场景扩展过程中保持全局连贯性,同时支持低延迟用户反馈。LivingWorld通过渐进式构建全局一致的运动场解决该问题。为保障扩展过程中的全局一致性,引入几何感知对齐模块,消除多视角间的方向与尺度歧义。进一步采用基于哈希的紧凑运动场表示,实现高效查询与动态稳定传播。该表示支持渲染时双向运动传播,无需依赖昂贵视频精炼,即可生成长时序且时间连贯的4D序列。在单张RTX 5090 GPU上,每步场景扩展生成耗时9秒,运动对齐与场更新3秒,实现具备全局一致环境动态的交互式4D世界生成。视频演示见paper.pnu-cvsp.com/LivingWorld。

原文摘要 · Abstract (English)

We introduce LivingWorld, an interactive framework for generating 4D worlds with environmental dynamics from a single image. While recent advances in 3D scene generation enable large-scale environment creation, most approaches focus primarily on reconstructing static geometry, leaving scene-scale environmental dynamics such as clouds, water, or smoke largely unexplored. Modeling such dynamics is challenging because motion must remain coherent across an expanding scene while supporting low-latency user feedback. LivingWorld addresses this challenge by progressively constructing a globally coherent motion field as the scene expands. To maintain global consistency during expansion, we introduce a geometry-aware alignment module that resolves directional and scale ambiguities across views. We further represent motion using a compact hash-based motion field, enabling efficient querying and stable propagation of dynamics throughout the scene. This representation also supports bidirectional motion propagation during rendering, producing long and temporally coherent 4D sequences without relying on expensive video-based refinement. On a single RTX 5090 GPU, generating each new scene expansion step requires 9 seconds, followed by 3 seconds for motion alignment and motion field updates, enabling interactive 4D world generation with globally coherent environmental dynamics. Video demonstrations are available at paper.pnu-cvsp.com/LivingWorld.

4D生成动态环境交互生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。