arXiv:2511.01767cs.CVcs.AI2025-11TPAMI被引 12

单图生成高保真3D模型,速度效率与质量兼得

Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image

论文配图:Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image
图 1 · 摘自论文原文
  • 跨域扩散模型生成多视角法向图与颜色图
  • 三分钟内完成从2D到高质量3D网格的重建
  • 适合需要快速生成精细3D模型的研究者

本文提出Wonder3D++,一种高效生成高保真纹理网格的单图3D重建方法。基于分数蒸馏采样(SDS)的方法虽具潜力,但存在每形状优化耗时且几何不一致的问题;而直接通过快速网络推理生成3D信息的方法则常导致质量低、细节不足。为此,我们设计了一种跨域扩散模型,生成多视角法向图与对应颜色图像,并引入多视角跨域注意力机制,实现视图间与模态间的信息交互。最后,采用级联式3D网格提取算法,以粗到精的方式仅用约3分钟生成高质量表面。大量实验表明,该方法在重建质量、泛化能力与效率上均优于现有工作。

原文摘要 · Abstract (English)

In this work, we introduce \textbf{Wonder3D++}, a novel method for efficiently generating high-fidelity textured meshes from single-view images. Recent methods based on Score Distillation Sampling (SDS) have shown the potential to recover 3D geometry from 2D diffusion priors, but they typically suffer from time-consuming per-shape optimization and inconsistent geometry. In contrast, certain works directly produce 3D information via fast network inferences, but their results are often of low quality and lack geometric details. To holistically improve the quality, consistency, and efficiency of single-view reconstruction tasks, we propose a cross-domain diffusion model that generates multi-view normal maps and the corresponding color images. To ensure the consistency of generation, we employ a multi-view cross-domain attention mechanism that facilitates information exchange across views and modalities. Lastly, we introduce a cascaded 3D mesh extraction algorithm that drives high-quality surfaces from the multi-view 2D representations in only about $3$ minute in a coarse-to-fine manner. Our extensive evaluations demonstrate that our method achieves high-quality reconstruction results, robust generalization, and good efficiency compared to prior works. Code available at https://github.com/xxlong0/Wonder3D/tree/Wonder3D_Plus.

3D生成扩散模型单图重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。