3DGS$^3$让3D高斯点云实时渲染更清晰更快。
3DGS$^3$: Joint Super Sampling and Frame Interpolation for Real-Time Large-Scale 3DGS Rendering

- 后处理阶段联合超分与帧插值,无需修改原始渲染流程。
- 在1080p下实现90帧/秒,比现有方法快2.3倍且画质更好。
- 适合需要低延迟的VR/AR和大规模场景实时可视化应用。
3D高斯点云(3DGS)虽能实现实时高质量三维渲染,但在处理超密集场景和高分辨率时受限于计算瓶颈,难以应用于对延迟敏感的场景。本文提出3DGS$^3$,一个统一的后处理框架,通过可微分处理低分辨率输出,联合完成超采样与帧插值,实现高分辨率与高帧率同步提升。提出的梯度感知超采样(GASS)模块利用3DGS的连续可微性提取图像梯度,指导基于GRU的精炼网络实现高保真超分辨率。同时,轻量级时序帧插值(LTFI)模块采用紧凑的类U-Net结构,融合连续帧间的时空可微信号,生成时序一致的中间帧。在公开数据集上的实验表明,3DGS$^3$在渲染效率与视觉质量上均优于当前最佳方法,且兼容现有3DGS加速技术。代码将在录用后公开。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) enables high-quality real-time 3D rendering but faces challenges in efficiently scaling to ultra-dense scenes and high-resolution due to computational bottlenecks that limit its use in latency-sensitive applications. Instead of optimizing the splatting pipeline itself, we propose \textbf{3DGS$^3$}, a unified post-rendering framework that jointly performs super sampling and frame interpolation through differentiable processing of low-resolution outputs to achieve both high-resolution and high-frame-rate rendering. Our \textbf{Gradient\- \-Aware Super Sampling (GASS)} module leverages the continuous differentiability of 3DGS to extract image gradients that guide a GRU-based refinement network to enable high-fidelity super sampling. Furthermore, a \textbf{Lightweight Temporal Frame Interpolation (LTFI)} module based on a compact U-Net-like backbone fuses temporal and differentiable spatial cues from consecutive frames to synthesize temporally coherent intermediate frames. Experiments on public datasets demonstrate that 3DGS$^3$ achieves superior rendering efficiency and visual quality when compared with state-of-the-art methods and remains compatible with existing 3DGS acceleration techniques. The code will be publicly released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。