用2D表面点与3D高斯结合，实现超快高清辐射场渲染。
When Gaussian Meets Surfel: Ultra-fast High-fidelity Radiance Field Rendering
- 用2D表面点表征粗略几何，3D高斯补充细节。
- 无需排序的两阶段渲染，速度极快且无视图跳跃失真。
- 可扩展至抗锯齿、加速和压缩，适合实时应用。
我们提出高斯增强的表面点（GESs），一种双尺度辐射场表示方法：一组具有视角依赖颜色的2D不透明表面点表示场景的粗略几何与外观，若干围绕表面点的3D高斯补充精细外观细节。渲染分两步进行——首先通过标准图形管线将表面点光栅化生成深度与颜色图，然后在每个像素顺序上独立进行高斯点绘制、深度测试与颜色累加。从多视角图像优化GESs采用精心设计的粗到精过程，真实还原丰富场景外观。整个渲染过程无需排序，不仅实现极快速度，还生成视图一致图像，有效避免视图变化时的跳变伪影。基础的GES表示可轻松扩展为支持抗锯齿（Mip-GES）、提升渲染速度（Speedy-GES）和紧凑存储（Compact-GES），并通过用2D高斯替代3D高斯重建更优几何结构（2D-GES）。实验表明，GESs作为超快高保真辐射场渲染的新范式，显著超越现有技术。
原文摘要 · Abstract (English)
We introduce Gaussian-enhanced Surfels (GESs), a bi-scale representation for radiance field rendering, wherein a set of 2D opaque surfels with view-dependent colors represent the coarse-scale geometry and appearance of scenes, and a few 3D Gaussians surrounding the surfels supplement fine-scale appearance details. The rendering with GESs consists of two passes -- surfels are first rasterized through a standard graphics pipeline to produce depth and color maps, and then Gaussians are splatted with depth testing and color accumulation on each pixel order independently. The optimization of GESs from multi-view images is performed through an elaborate coarse-to-fine procedure, faithfully capturing rich scene appearance. The entirely sorting-free rendering of GESs not only achieves very fast rates, but also produces view-consistent images, successfully avoiding popping artifacts under view changes. The basic GES representation can be easily extended to achieve anti-aliasing in rendering (Mip-GES), boosted rendering speeds (Speedy-GES) and compact storage (Compact-GES), and reconstruct better scene geometries by replacing 3D Gaussians with 2D Gaussians (2D-GES). Experimental results show that GESs advance the state-of-the-arts as a compelling representation for ultra-fast high-fidelity radiance field rendering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。