通过分块分组减少冗余排序,提升3D高斯溅射渲染速度。
GS-TG: 3D Gaussian Splatting Accelerator with Tile Grouping for Reducing Redundant Sorting while Preserving Rasterization Efficiency
- 将小块分组共享排序操作,降低重复计算
- 保持原有小块精细度,实现1.54倍加速
- 无需重训练,可无缝集成现有优化技术
3D高斯溅射(3D-GS)作为神经辐射场(NeRF)的有力替代方案,在新视角合成中兼具高速与高质量。然而,其仍难以满足实时应用对帧率(FPS)的需求。本文提出GS-TG,一种基于分块分组的加速器,通过减少冗余排序操作并保持光栅化效率来提升3D-GS渲染速度。该方法在排序阶段将小块分组形成大块,共享组内排序结果,显著降低重复计算;在光栅化阶段,为每个高斯分配位掩码,仅对相关小块执行计算,从而在排序阶段模拟大块效果,同时保留小块精度。该方法无损且无需重训练,可无缝融合已有优化技术。实验表明,相比最先进3D-GS加速器,平均提速1.54倍。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3D-GS) has emerged as a promising alternative to neural radiance fields (NeRF) as it offers high speed as well as high image quality in novel view synthesis. Despite these advancements, 3D-GS still struggles to meet the frames per second (FPS) demands of real-time applications. In this paper, we introduce GS-TG, a tile-grouping-based accelerator that enhances 3D-GS rendering speed by reducing redundant sorting operations and preserving rasterization efficiency. GS-TG addresses a critical trade-off issue in 3D-GS rendering: increasing the tile size effectively reduces redundant sorting operations, but it concurrently increases unnecessary rasterization computations. So, during sorting of the proposed approach, GS-TG groups small tiles (for making large tiles) to share sorting operations across tiles within each group, significantly reducing redundant computations. During rasterization, a bitmask assigned to each Gaussian identifies relevant small tiles, to enable efficient sharing of sorting results. Consequently, GS-TG enables sorting to be performed as if a large tile size is used by grouping tiles during the sorting stage, while allowing rasterization to proceed with the original small tiles by using bitmasks in the rasterization stage. GS-TG is a lossless method requiring no retraining or fine-tuning and it can be seamlessly integrated with previous 3D-GS optimization techniques. Experimental results show that GS-TG achieves an average speed-up of 1.54 times over state-of-the-art 3D-GS accelerators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。