arXiv:2604.01479cs.CV2026-04中稿 · SIGGRAPH被引 1

用共享空间融合重建与生成,从稀疏视角造出完整一致的3D模型。

RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space

论文配图:RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space
图 1 · 摘自论文原文
  • 重建与生成模型在统一坐标系中协同工作
  • 在稀疏视图下生成模型保持结构完整且多视角一致
  • 适合需要高质量3D重建的工业与科研场景

稀疏视角3D建模面临重建精度与生成合理性之间的根本矛盾。前向重建虽高效且对齐输入,但缺乏全局先验导致结构不完整;而基于扩散的生成虽细节丰富,却难以保证多视角一致性。本文提出RecGen3D框架,将两种范式整合为协作系统。为克服坐标系、表示方式和训练目标的内在冲突,我们使两个模型对齐于共享的规范空间。采用解耦协同学习,在训练中保持稳定,推理时实现无缝协作:重建模块提供规范几何锚点,扩散生成器通过潜在增强条件来细化并补全几何结构。实验表明,RecGen3D在稀疏观测下生成的3D模型具有更高保真度和鲁棒性,优于现有方法。

原文摘要 · Abstract (English)

Sparse-view 3D modeling represents a fundamental tension between reconstruction fidelity and generative plausibility. While feed-forward reconstruction excels in efficiency and input alignment, it often lacks the global priors needed for structural completeness. Conversely, diffusion-based generation provides rich geometric details but struggles with multi-view consistency. We present RecGen3D, a framework that combines these two paradigms into a cooperative system. To overcome inherent conflicts in coordinate spaces, 3D representations, and training objectives, we align both models within a shared canonical space. We employ decoupled cooperative learning, which maintains stable training while enabling seamless collaboration during inference. Specifically, the reconstruction module is adapted to provide canonical geometric anchors, while the diffusion generator leverages latent-augmented conditioning to refine and complete the geometric structure. Experimental results demonstrate that RecGen3D achieves superior fidelity and robustness, outperforming existing methods in creating complete and consistent 3D models from sparse observations.

3D生成重建融合扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。