arXiv:2411.14974cs.CV2024-11CVPR被引 61

用3D光滑凸体替代高斯分布,更精准还原硬边与平面场景。

3D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexes

  • 以3D光滑凸体为新基本单元,替代传统高斯分布。
  • 在多个基准上提升PSNR达0.81,LPIPS降低0.026,且用更少粒子。
  • 适合追求高质量重建与高效渲染的3D视觉研究者。

近期基于辐射场的重建方法,如3D高斯点阵(3DGS),通过高斯基元组合实现了高质量的新视角合成与快速渲染。然而,3D高斯在场景重建中存在若干局限:难以准确捕捉硬边,需大量基元导致内存占用过高;对平坦表面表现不佳,因空间扩散特性易产生不规则离散分布。为解决这些问题,本文提出3D凸点阵(3DCS),采用3D光滑凸体作为基元,从多视角图像建模几何语义明确的辐射场。光滑凸体比高斯更具灵活性,能以更少基元更优地表示含硬边与密集体的3D场景。借助高效的CUDA光栅化器,3DCS在Mip-NeRF360、Tanks and Temples和Deep Blending等基准上显著优于3DGS,PSNR最高提升0.81,LPIPS降低0.026,同时保持高速渲染并减少基元数量。结果表明,3DCS有潜力成为高质量场景重建与新视角合成的新标准。项目主页:convexsplatting.github.io。

原文摘要 · Abstract (English)

Recent advances in radiance field reconstruction, such as 3D Gaussian Splatting (3DGS), have achieved high-quality novel view synthesis and fast rendering by representing scenes with compositions of Gaussian primitives. However, 3D Gaussians present several limitations for scene reconstruction. Accurately capturing hard edges is challenging without significantly increasing the number of Gaussians, creating a large memory footprint. Moreover, they struggle to represent flat surfaces, as they are diffused in space. Without hand-crafted regularizers, they tend to disperse irregularly around the actual surface. To circumvent these issues, we introduce a novel method, named 3D Convex Splatting (3DCS), which leverages 3D smooth convexes as primitives for modeling geometrically-meaningful radiance fields from multi-view images. Smooth convex shapes offer greater flexibility than Gaussians, allowing for a better representation of 3D scenes with hard edges and dense volumes using fewer primitives. Powered by our efficient CUDA-based rasterizer, 3DCS achieves superior performance over 3DGS on benchmarks such as Mip-NeRF360, Tanks and Temples, and Deep Blending. Specifically, our method attains an improvement of up to 0.81 in PSNR and 0.026 in LPIPS compared to 3DGS while maintaining high rendering speeds and reducing the number of required primitives. Our results highlight the potential of 3D Convex Splatting to become the new standard for high-quality scene reconstruction and novel view synthesis. Project page: convexsplatting.github.io.

3D重建辐射场点阵渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。