arXiv:2508.05631cs.CV2025-08ICCV被引 10

用文本指导将无颜色点云转为高保真3D高斯图

GAP: Gaussianize Any Point Clouds with Text Guidance

  • 多视角优化+深度感知扩散模型生成一致外观
  • 表面锚定机制确保高斯点贴合物体表面
  • 基于扩散的补全策略修复难观测区域

3D高斯泼溅(3DGS)在快速高质量渲染方面表现出显著优势。由于点云是广泛使用且易于获取的3D表示形式,打通点云与高斯之间的鸿沟变得日益重要。现有研究尝试将彩色点转换为高斯,但直接从无颜色3D点云生成高斯仍是一个未解难题。本文提出GAP,一种新颖方法,通过文本引导将原始点云高斯化为高保真3D高斯。核心思路是设计一个多视角优化框架,利用深度感知图像扩散模型合成不同视角间的一致外观。为保证几何准确性,引入表面锚定机制,有效约束高斯点位于3D形状表面。此外,GAP采用基于扩散的修复策略,专门针对难以观测区域进行补全。我们在不同复杂度的数据上评估了GAP,涵盖合成点云、挑战性真实扫描以及大规模场景。项目主页:https://weiqi-zhang.github.io/GAP。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has demonstrated its advantages in achieving fast and high-quality rendering. As point clouds serve as a widely-used and easily accessible form of 3D representation, bridging the gap between point clouds and Gaussians becomes increasingly important. Recent studies have explored how to convert the colored points into Gaussians, but directly generating Gaussians from colorless 3D point clouds remains an unsolved challenge. In this paper, we propose GAP, a novel approach that gaussianizes raw point clouds into high-fidelity 3D Gaussians with text guidance. Our key idea is to design a multi-view optimization framework that leverages a depth-aware image diffusion model to synthesize consistent appearances across different viewpoints. To ensure geometric accuracy, we introduce a surface-anchoring mechanism that effectively constrains Gaussians to lie on the surfaces of 3D shapes during optimization. Furthermore, GAP incorporates a diffuse-based inpainting strategy that specifically targets at completing hard-to-observe regions. We evaluate GAP on the Point-to-Gaussian generation task across varying complexity levels, from synthetic point clouds to challenging real-world scans, and even large-scale scenes. Project Page: https://weiqi-zhang.github.io/GAP.

3D生成点云扩散模型文本控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。