arXiv:2504.01512cs.CV2025-04CVPR被引 4

用彩色+法向图融合重建3D高保真物体,解决单图生成模糊问题

High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Model

  • 融合RGB与表面法向图,构建体素-高斯混合表示提升几何一致性
  • 在RealEstate10K等数据集上,重建质量优于现有方法,细节更清晰
  • 适合需要高质量3D重建的科研与工业应用,如虚拟场景建模

近期基于高斯溅射的单视图3D生成方法发展迅速,通过预训练多视角扩散模型生成2D图像来学习3D高斯,展现出单图生成3D物体的潜力。然而,当前方法仍受2D图像几何歧义性与3D高斯结构不足的共同影响,导致3D生成结果失真、模糊。本文提出GS-RGBN——一种新型的RGBN体积高斯重建模型,旨在从单张图像生成高保真3D物体。核心思想是:结构化3D表示可同时缓解上述两类问题。为此,我们设计了一种新的体素-高斯混合表示:3D体素包含显式几何信息,消除2D图像中的几何歧义;同时在学习过程中结构化高斯分布,使优化更易收敛至更好局部最优解。3D体素由一个融合模块获得,该模块对齐来自2D图像估计的RGB特征与表面法向特征。大量实验表明,所提方法在高保真重建结果、鲁棒泛化能力与良好效率方面均优于现有工作。

原文摘要 · Abstract (English)

Recently single-view 3D generation via Gaussian splatting has emerged and developed quickly. They learn 3D Gaussians from 2D RGB images generated from pre-trained multi-view diffusion (MVD) models, and have shown a promising avenue for 3D generation through a single image. Despite the current progress, these methods still suffer from the inconsistency jointly caused by the geometric ambiguity in the 2D images, and the lack of structure of 3D Gaussians, leading to distorted and blurry 3D object generation. In this paper, we propose to fix these issues by GS-RGBN, a new RGBN-volume Gaussian Reconstruction Model designed to generate high-fidelity 3D objects from single-view images. Our key insight is a structured 3D representation can simultaneously mitigate the afore-mentioned two issues. To this end, we propose a novel hybrid Voxel-Gaussian representation, where a 3D voxel representation contains explicit 3D geometric information, eliminating the geometric ambiguity from 2D images. It also structures Gaussians during learning so that the optimization tends to find better local optima. Our 3D voxel representation is obtained by a fusion module that aligns RGB features and surface normal features, both of which can be estimated from 2D images. Extensive experiments demonstrate the superiority of our methods over prior works in terms of high-quality reconstruction results, robust generalization, and good efficiency.

3D生成高斯溅射单图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。