arXiv:2511.18005cs.CV2025-11中稿 · ACM MM 2026, the c…被引 3

用智能代理框架生成高保真城市级3D世界,真实感强且可扩展。

UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale

  • 采用智能体架构动态调用多模态工具,实现自我反思与迭代优化。
  • 在感知质量上胜过现有基线86%以上,形状精度与纹理保真度突出。
  • 适合沉浸式媒体、具身智能等需要真实3D环境的场景应用。

自动化生成高保真、城市规模的3D环境仍面临重大挑战,具有深远的学术与工业意义。现有方法难以兼顾质量、真实感与可扩展性。为此,我们提出UrbanWorld2.0,一种现实对齐的智能多模态合成引擎,可生成细节丰富、城市规模的高保真3D世界。该框架引入智能体设计,利用多样化的多模态基础工具获取真实世界知识,保持稳健的中间表征,并构建复杂3D场景。其动态数据处理、迭代自我反思与精炼机制,以及高级多模态工具调用,有效减少累积误差,提升整体性能。大量定量实验与定性分析验证了UrbanWorld2.0在现实对齐、形状精度、纹理保真度和美学水平上的优越表现,整体感知质量优于现有基线超过86%。该框架兼具3D质量、现实对齐性、可扩展性与与计算机图形管线的无缝兼容性,为沉浸式媒体、具身智能与世界模型等应用提供了有力基础。

原文摘要 · Abstract (English)

The automated generation of high-fidelity, city-scale 3D environments remains a formidable challenge with profound academic and industrial implications. However, existing methods struggle to achieve the necessary quality, fidelity, and scalability. To address this, we propose UrbanWorld2.0, a reality-aligned intelligent multimodal synthesis engine that creates detailed, city-scale 3D worlds of high fidelity. We introduce an agentic framework that leverages diverse multimodal foundation tools to acquire real-world knowledge, maintain robust intermediate representations, and construct complex 3D scenes. This agentic design, featuring dynamic data processing, iterative self-reflection and refinement, and the invocation of advanced multimodal tools, minimizes cumulative errors and enhances overall performance. Extensive quantitative experiments and qualitative analyzes validate the superior performance of UrbanWorld2.0 in real-world alignment, shape precision, texture fidelity, and aesthetics level, achieving a win rate of over 86\% against existing baselines for overall perceptual quality. This combination of 3D quality, reality alignment, scalability, and seamless compatibility with computer graphics pipelines makes UrbanWorld2.0 a promising foundation for applications in immersive media, embodied intelligence, and world models.

3D生成多模态智能体城市建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。