arXiv:2412.17957cs.CVcs.AI2024-12被引 3

用分层扩散模型生成高精度建筑3D结构,细节精细到9厘米。

ArchComplete: Autoregressive 3D Architectural Design Generation with Hierarchical Diffusion-Based Upsampling

  • 先用自回归Transformer生成粗略形状,再通过分层扩散逐步细化细节。
  • 在64³到512³分辨率间逐级提升,最小体素约9厘米,生成效果达顶尖水平。
  • 适合建筑生成、方案补全与风格演化,兼顾质量与效率。

近期的3D生成模型虽有进展,但在捕捉建筑几何复杂性与高分辨率细节方面仍有不足。为此,我们提出ArchComplete,一种基于体素的两阶段3D生成流程:首先使用向量量化模型结合自回归Transformer生成粗略形状;随后采用分层上采样策略,通过一系列条件扩散模型从随机裁剪的粗到细局部体素块中学习并补充精细结构。核心创新在于(i)学习上下文丰富的局部块嵌入码本,并联合优化2.5D感知损失以保持三个正交平面上的全局空间对应关系;(ii)将上采样重定义为从粗到细局部体素块序列学习的条件扩散过程。在我们构建的包含完整内外部建模的3D房屋数据集上训练,ArchComplete可自回归生成64³分辨率模型,并逐步精细化至512³,体素大小低至约9厘米。该方法支持多种任务,包括基因插值、变体生成、无条件合成、形状与平面图补全及几何细节化,在质量、多样性与计算效率方面均达到当前最优水平。

原文摘要 · Abstract (English)

Recent advances in 3D generative models have shown promising results but often fall short in capturing the complexity of architectural geometries and topologies and fine geometric details at high resolutions. To tackle this, we present ArchComplete, a two-stage voxel-based 3D generative pipeline consisting of a vector-quantised model, whose composition is modelled with an autoregressive transformer for generating coarse shapes, followed by a hierarchical upsampling strategy for further enrichment with fine structures and details. Key to our pipeline is (i) learning a contextually rich codebook of local patch embeddings, optimised alongside a 2.5D perceptual loss that captures global spatial correspondence of projections onto three axis-aligned orthogonal planes, and (ii) redefining upsampling as a set of conditional diffusion models learning from a hierarchy of randomly cropped coarse-to-fine local volumetric patches. Trained on our introduced dataset of 3D house models with fully modelled exterior and interior, ArchComplete autoregressively generates models at the resolution of $64^{3}$ and progressively refines them up to $512^{3}$, with voxel sizes as small as $ \approx 9\text{cm}$. ArchComplete solves a variety of tasks, including genetic interpolation and variation, unconditional synthesis, shape and plan-drawing completion, as well as geometric detailisation, while achieving state-of-the-art performance in quality, diversity, and computational efficiency.

3D生成建筑生成扩散模型细节细化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。