优化隐式点云渲染,速度提升两倍且显存减少20%。
A Bag of Tricks for Efficient Implicit Neural Point Clouds
- 改进光栅化器与采样策略,加速训练与推理。
- 引入预训练卷积网络填洞,提升重建质量。
- 支持点作为小高斯建模,增强远近视角细节。
隐式神经点云(INPC)是一种结合神经场表达力与点云渲染效率的混合表示,在新视角合成中达到当前最优图像质量。然而,由于渲染时需频繁查询神经网络,其实际应用受限于较慢的渲染速度。本文提出一系列优化,显著提升INPC的训练与推理性能,同时保持视觉保真度。关键改进包括:更高效的光栅化器实现、更优的采样技术,以及用于孔洞填充的卷积神经网络预训练。此外,我们证明在推理阶段将点建模为小高斯分布,可进一步提升外推区域(如近距离视图)的质量。所有优化均设计为可泛化至其他方法,并通过系统实验验证。最终,优化后的INPC管道实现最高25%的训练加速、2倍的渲染提速,以及20%的显存降低,同时带来轻微的图像质量提升。
原文摘要 · Abstract (English)
Implicit Neural Point Cloud (INPC) is a recent hybrid representation that combines the expressiveness of neural fields with the efficiency of point-based rendering, achieving state-of-the-art image quality in novel view synthesis. However, as with other high-quality approaches that query neural networks during rendering, the practical usability of INPC is limited by comparatively slow rendering. In this work, we present a collection of optimizations that significantly improve both the training and inference performance of INPC without sacrificing visual fidelity. The most significant modifications are an improved rasterizer implementation, more effective sampling techniques, and the incorporation of pre-training for the convolutional neural network used for hole-filling. Furthermore, we demonstrate that points can be modeled as small Gaussians during inference to further improve quality in extrapolated, e.g., close-up views of the scene. We design our implementations to be broadly applicable beyond INPC and systematically evaluate each modification in a series of experiments. Our optimized INPC pipeline achieves up to 25% faster training, 2x faster rendering, and 20% reduced VRAM usage paired with slight image quality improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。