直接生成高质量3D高斯点云,速度更快且无压缩失真。
PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation

- 在像素空间直接去噪,跳过潜在空间压缩
- 生成效果超越现有方法,单卡A100仅需1秒推理
- 融合法向、深度等多维度监督,提升几何与外观质量
文本或图像驱动的3D内容生成虽取得显著进展,但2D生成器带来的视图不一致性及高质量3D数据稀缺仍是主要瓶颈。现有方法通常将大规模预训练文生图潜空间扩散模型适配为3D高斯点云(3DGS)生成器,但这类方法常依赖复杂的级联训练流程,计算开销大且可扩展性差。更重要的是,生成质量受限于各组件能力与压缩的潜在空间,导致解码伪影和误差累积。为此,我们提出PixGS,一种单阶段直接生成高质量3DGS的流水线,利用近期像素空间扩散技术,在绕过有损潜在压缩的同时,仍能受益于丰富的2D生成先验。通过在每个时间步直接对3D高斯属性进行去噪,本方法实现了精细的外观与几何层级正则化。此外,我们引入涵盖表面法向、深度及高频结构信息的综合监督策略,该策略在以往工作中常被忽略。实验表明,PixGS在保持快速推理速度(单张A100 GPU仅需1秒)的前提下,性能超越当前最先进方法,为多阶段生成流程提供了一种高效可靠的替代方案。
原文摘要 · Abstract (English)
Recent advances in 3D content generation from text or images have achieved impressive results, yet view inconsistency from 2D generators and the scarcity of high-quality 3D data remain significant bottlenecks. Existing solutions typically adapt large-scale pre-trained text-to-image latent diffusion models to generate 3D Gaussian Splats (3DGS). However, these approaches often rely on training complex cascade pipelines that are computationally expensive and scalability-limited. Most critically, the quality of generated 3D assets is inherently constrained by each component capacity and compressed latent space, leading to decoding artifacts and accumulated errors. To address these limitations, we propose PixGS, a single-stage pipeline for direct high-quality 3DGS generation, which leverages recent advances in pixel-space diffusion to bypass lossy latent compression while still benefiting from the vast 2D generative priors. By directly denoising 3D Gaussian attributes at each timestep, our method enables precise, splat-level regularization of both appearance and geometry. Furthermore, we introduce a comprehensive supervision strategy that incorporates surface normals, depth, and high-frequency structural information, which is often overlooked in prior works. Experiments demonstrate that PixGS outperforms current state-of-the-art methods while maintaining a fast inference speed (1s on a single A100 GPU), offering a robust and efficient alternative to multi-stage generation pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。