arXiv:2503.16681cs.GRcs.AI2025-03被引 10

用现有GPU加速3D高斯泼溅,速度提升23倍

GauRast: Enhancing GPU Triangle Rasterizers to Accelerate 3D Gaussian Splatting

  • 复用GPU光栅化器架构,无需专用硬件
  • 实测速度提升23倍,能耗降24倍,达46帧/秒
  • 仅增加0.2%芯片面积,适合边缘设备部署

3D智能依赖丰富的三维特征,是人工智能的重要前沿,3D渲染是众多下游应用的基础。3D高斯泼溅(3DGS)作为一种新兴的高质量3D渲染方法,计算量巨大,现有配备GPU的边缘设备难以实现实时运行。此前加速方案依赖专用加速器,集成复杂且成本高昂。本文提出一种利用3DGS流程与现代GPU高度优化的常规图形管线相似性的加速策略,不开发专用加速器,而是增强现有GPU光栅化器硬件以高效支持3DGS操作。结果表明,处理速度提升23倍,能耗降低24倍;原版3DGS算法端到端运行时间加快6倍,最新优化版提速4倍,分别达到24帧/秒和46帧/秒。该改进仅带来相对于整个SoC芯片面积0.2%的额外开销,充分证明了该方法在资源受限平台上的实用性和高效性。

原文摘要 · Abstract (English)

3D intelligence leverages rich 3D features and stands as a promising frontier in AI, with 3D rendering fundamental to many downstream applications. 3D Gaussian Splatting (3DGS), an emerging high-quality 3D rendering method, requires significant computation, making real-time execution on existing GPU-equipped edge devices infeasible. Previous efforts to accelerate 3DGS rely on dedicated accelerators that require substantial integration overhead and hardware costs. This work proposes an acceleration strategy that leverages the similarities between the 3DGS pipeline and the highly optimized conventional graphics pipeline in modern GPUs. Instead of developing a dedicated accelerator, we enhance existing GPU rasterizer hardware to efficiently support 3DGS operations. Our results demonstrate a 23$\times$ increase in processing speed and a 24$\times$ reduction in energy consumption, with improvements yielding 6$\times$ faster end-to-end runtime for the original 3DGS algorithm and 4$\times$ for the latest efficiency-improved pipeline, achieving 24 FPS and 46 FPS respectively. These enhancements incur only a minimal area overhead of 0.2\% relative to the entire SoC chip area, underscoring the practicality and efficiency of our approach for enabling 3DGS rendering on resource-constrained platforms.

3D高斯泼溅GPU加速边缘计算渲染优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。