将3D高斯溅射融入硬件渲染管线,提升体积渲染速度。
VR-Pipe: Streamlining Hardware Graphics Pipeline for Volume Rendering
- 复用现有GPU硬件实现早期终止,优化渲染流程
- 通过四边形合并分块融合,减少固定功能单元压力
- 在真实与合成场景中实现最高2.78倍加速
基于机器学习和辐射场的图形渲染因能从新视角生成逼真图像而受到广泛关注。然而,以往工作多基于可编程着色器核心进行软件渲染评估,未充分探索其在固定功能图形单元上的表现。本文研究了将辐射场渲染部署于硬件图形管线的性能影响,采用图形API实现了当前最先进的3D高斯溅射方法,并在现代图形硬件上对合成与真实场景进行了评估。基于分析结果,提出VR-Pipe,通过两项创新无缝集成至图形硬件,以优化体积渲染流水线:首先,重用现代GPU中的专用硬件实现原生早期终止;其次,提出多粒度分块与四边形合并策略,在着色器核心中提前融合片段,减轻固定功能混合单元负担。实验表明,VR-Pipe显著提升渲染性能,相比传统图形管线最高提速2.78倍,且硬件开销极低。
原文摘要 · Abstract (English)
Graphics rendering that builds on machine learning and radiance fields is gaining significant attention due to its outstanding quality and speed in generating photorealistic images from novel viewpoints. However, prior work has primarily focused on evaluating its performance through software-based rendering on programmable shader cores, leaving its performance when exploiting fixed-function graphics units largely unexplored. In this paper, we investigate the performance implications of performing radiance field rendering on the hardware graphics pipeline. In doing so, we implement the state-of-the-art radiance field method, 3D Gaussian splatting, using graphics APIs and evaluate it across synthetic and real-world scenes on today's graphics hardware. Based on our analysis, we present VR-Pipe, which seamlessly integrates two innovations into graphics hardware to streamline the hardware pipeline for volume rendering, such as radiance field methods. First, we introduce native hardware support for early termination by repurposing existing special-purpose hardware in modern GPUs. Second, we propose multi-granular tile binning with quad merging, which opportunistically blends fragments in shader cores before passing them to fixed-function blending units. Our evaluation shows that VR-Pipe greatly improves rendering performance, achieving up to a 2.78x speedup over the conventional graphics pipeline with negligible hardware overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。