arXiv:2511.11470cs.CV2025-11被引 5

从卫星图生成真实城市3D模型,支持地理对齐与风格控制。

Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery

  • 分建筑实体生成,利用预训练3D模型复用并保持真实空间结构。
  • 在真实城市中实现高地理对齐与区域风格一致性,生成逼真资产。
  • 适合数字孪生、城市仿真等需要真实感和可控性的场景应用。

从卫星图像生成3D城市是构建可扩展数字孪生和真实世界模拟环境的重要任务。现有方法多依赖场景级生成范式,通常需要大规模3D城市资产,且难以实现可控性、地理对齐和真实外观约束。为此,我们提出Sat2RealCity——一种基于物体级3D生成先验的地面化城市生成框架,将城市分解为地理上对齐的建筑实体,从而复用预训练的物体级3D生成模型,同时保留真实空间结构。依托自建的BuildVerse3D数据集,(1) 我们提出基于开放街道地图(OSM)的空间对齐策略,将地理空间约束注入3D生成过程;(2) 设计外观引导的可控生成机制,实现真实建筑外观与区域风格一致;(3) 构建基于多模态大语言模型(MLLM)的语义管道,实现区域外观理解与语义感知的外观合成。大量实验表明,与现有城市生成和3D资产生成方法相比,Sat2RealCity在地理对齐、区域风格一致性和城市资产合理性方面均表现优异。

原文摘要 · Abstract (English)

3D urban generation from satellite imagery is an important task for scalable digital twins and real-world simulation environments. Existing approaches primarily rely on scene-level generation paradigms, which often require large-scale 3D city assets and struggle with controllability, geographic alignment, and realistic appearance grounding in real-world urban environments. To address these limitations, we present Sat2RealCity, a grounded urban generation framework that leverages object-level 3D generative priors for scalable city synthesis from satellite imagery. Our framework decomposes cities into geographically grounded building entities, enabling the reuse of pretrained object-level 3D generative priors while preserving real-world spatial structures. Supported by our constructed BuildVerse3D dataset, (1) we introduce an OpenStreetMap (OSM)-guided spatial grounding strategy to inject geospatial constraints into the 3D generation process; (2) we design an appearance-guided controllable generation mechanism for realistic architectural appearance and regional style consistency; and (3) we construct an MLLM-powered semantic pipeline for regional appearance understanding and semantic-aware appearance synthesis. Extensive experiments demonstrate that Sat2RealCity achieves strong geographic alignment, regional stylistic consistency, and plausible urban asset synthesis compared with existing urban generation and 3D asset generation approaches.

3D生成城市仿真地理对齐可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。