arXiv:2511.18734cs.CVcs.AI2025-11中稿 · CVPR被引 8

用大模型生成可无限扩展的个性化3D城市,支持用户交互式演化。

Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion

  • 分层规划+迭代优化:先设计城市结构,再逐网格生成并改进。
  • 多维评估超越基线:在语义、几何、纹理等维度均优于现有方法。
  • 适合虚拟现实与数字孪生场景,支持用户自定义城市生长逻辑。

真实感3D城市生成在虚拟现实与数字孪生等领域具有重要意义。然而,现有方法多依赖单一扩散模型,难以生成个性化且无边界的城市规模场景。本文提出Yo'City,一个基于现成大模型推理与组合能力的智能体框架,实现用户定制化、无限扩展的3D城市生成。首先采用自上而下的规划策略,构建“城市-区域-网格”分层结构:全局规划器确定整体布局与功能区,局部设计师细化各区域的网格级描述。随后通过“生成-优化-评估”的等距图像合成循环,结合图像到3D的转换完成网格级生成。为模拟城市持续演化,引入用户交互式、关系引导的扩展机制,基于场景图进行距离与语义感知的布局优化,保障空间一致性。我们构建了多样化基准数据集,并设计六项多维评价指标,从语义、几何、纹理和布局角度综合评估。大量实验表明,Yo'City在所有评估维度上均显著优于现有最先进方法。

原文摘要 · Abstract (English)

Realistic 3D city generation is fundamental to a wide range of applications, including virtual reality and digital twins. However, most existing methods rely on training a single diffusion model, which limits their ability to generate personalized and boundless city-scale scenes. In this paper, we present Yo'City, a novel agentic framework that enables user-customized and infinitely expandable 3D city generation by leveraging the reasoning and compositional capabilities of off-the-shelf large models. Specifically, Yo'City first conceptualizes the city through a top-down planning strategy that defines a hierarchical "City-District-Grid" structure. The Global Planner determines the overall layout and potential functional districts, while the Local Designer further refines each district with detailed grid-level descriptions. Subsequently, the grid-level 3D generation is achieved through a "produce-refine-evaluate" isometric image synthesis loop, followed by image-to-3D generation. To simulate continuous city evolution, Yo'City further introduces a user-interactive, relationship-guided expansion mechanism, which performs scene graph-based distance- and semantics-aware layout optimization, ensuring spatially coherent city growth. To comprehensively evaluate our method, we construct a diverse benchmark dataset and design six multi-dimensional metrics that assess generation quality from the perspectives of semantics, geometry, texture, and layout. Extensive experiments demonstrate that Yo'City consistently outperforms existing state-of-the-art methods across all evaluation aspects.

3D生成城市建模大模型应用可扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。