arXiv:2601.22301cs.CV2026-01被引 3

用粗略3D模拟生成逼真城市人群动态视频,可控且真实。

Coarse-to-Real: Generative Rendering for Populated Dynamic Scenes

  • 用粗略3D数据控制布局和轨迹,神经渲染器生成真实外观与细节。
  • 在无配对数据情况下仍实现真实感,生成视频时序一致。
  • 适合影视动画、游戏开发等需要快速生成高真实感场景的场景。

传统渲染依赖复杂资产、精确材质与光照,需大量算力,但在有密集人群的动态场景中仍难兼顾可扩展性与真实感。本文提出C2R(Coarse-to-Real)生成式渲染框架,从粗略3D模拟生成类真实的城市人群视频。该方法利用粗略3D渲染显式控制场景布局、相机运动与人流动线,同时通过学习的神经渲染器,在文本提示引导下生成真实外观、光照与微观动态。为解决粗略模拟与真实视频间缺乏配对数据的问题,采用两阶段合成-真实域对抗策略:先从大规模真实视频中学习强生成先验,再用少量配对的粗-细粒度合成数据锚定跨域共享的隐式时空特征。系统支持粗到细控制,可泛化至多种CG与游戏输入,仅需极少3D输入即可生成时序一致、可控且逼真的城市场景视频。项目代码与网页将于https://gonzalognogales.github.io/coarse2real/发布。

原文摘要 · Abstract (English)

Traditional rendering pipelines rely on complex assets, accurate materials and lighting, and substantial computational resources to produce realistic imagery, yet they still face challenges in scalability and realism for populated dynamic scenes. We present C2R (Coarse-to-Real), a generative rendering framework that synthesizes real-style urban crowd videos from coarse 3D simulations. Our approach uses coarse 3D renderings to explicitly control scene layout, camera motion, and human trajectories, while a learned neural renderer generates realistic appearance, lighting, and fine-scale dynamics guided by text prompts. To overcome the lack of paired training data between coarse simulations and real videos, we adopt a two-stage synthetic-real domain-hedging strategy that first learns a strong generative prior from large-scale real footage, and then introduces controllability by using a small amount of paired synthetic coarse-to-fine data to anchor shared implicit spatio-temporal features across domains. The resulting system supports coarse-to-fine control, generalizes across diverse CG and game inputs, and produces temporally consistent, controllable, and realistic urban scene videos from minimal 3D input. We will release the model and project webpage at https://gonzalognogales.github.io/coarse2real/.

生成渲染城市模拟可控生成神经渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。