arXiv:2507.04403cs.CV2025-07ICCV被引 20

用一张卫星图生成高细节3D城市,突破传统方法局限

Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion

  • 分阶段扩散模型+稀疏体素网格,逐步重建城市三维结构
  • 在自定义3D城市数据集上实现更优几何与外观保真度
  • 适合数字孪生、游戏场景生成等需要大规模真实感建模的领域

近年来生成模型的发展使得从卫星图像生成3D城市场景成为可能,推动了游戏、数字孪生等应用的进展。然而,现有方法严重依赖神经渲染技术,难以在大尺度上生成精细的3D结构,主要受限于二维观测带来的固有结构模糊性。为此,我们提出Sat2City,一种融合稀疏体素网格表征能力与潜在扩散模型的新框架,专为我们的新型3D城市数据集设计。该方法包含三个关键组件:(1) 分级潜在扩散框架,从卫星图像逐步恢复3D城市结构;(2) 在变分自编码器瓶颈引入重哈希操作,生成多尺度特征网格以稳定外观优化;(3) 反向采样策略,实现隐式监督以促进外观平滑过渡。为克服真实世界城市级3D模型获取困难的问题,我们构建了一个合成的大规模3D城市数据集,配有卫星视角高程图。在该数据集上验证,本框架仅需单张卫星图像即可生成细节丰富的3D结构,相比现有城市生成模型具有更高保真度。

原文摘要 · Abstract (English)

Recent advancements in generative models have enabled 3D urban scene generation from satellite imagery, unlocking promising applications in gaming, digital twins, and beyond. However, most existing methods rely heavily on neural rendering techniques, which hinder their ability to produce detailed 3D structures on a broader scale, largely due to the inherent structural ambiguity derived from relatively limited 2D observations. To address this challenge, we propose Sat2City, a novel framework that synergizes the representational capacity of sparse voxel grids with latent diffusion models, tailored specifically for our novel 3D city dataset. Our approach is enabled by three key components: (1) A cascaded latent diffusion framework that progressively recovers 3D city structures from satellite imagery, (2) a Re-Hash operation at its Variational Autoencoder (VAE) bottleneck to compute multi-scale feature grids for stable appearance optimization and (3) an inverse sampling strategy enabling implicit supervision for smooth appearance transitioning.To overcome the challenge of collecting real-world city-scale 3D models with high-quality geometry and appearance, we introduce a dataset of synthesized large-scale 3D cities paired with satellite-view height maps. Validated on this dataset, our framework generates detailed 3D structures from a single satellite image, achieving superior fidelity compared to existing city generation models.

3D生成扩散模型城市建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。