让手机也能实时渲染高质量3D场景,压缩显存占用同时保持画质。
Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting

- 用蒙特卡洛采样聚合高阶光照能量,降低存储开销。
- 压缩后通过属性引导增强低阶光照表示,保留高频细节。
- 多视角动态优化点云密度,避免过拟合和冗余点生成。
近期3D高斯溅射在新视角合成中表现卓越,但高阶球谐函数(SH)带来的高推理与存储开销成为移动端瓶颈。本文提出Flux-GS,一种面向资源受限移动平台的实时高保真渲染方法。首先设计蒙特卡洛镜面能量聚合器,采样三阶辐射残差并将镜面能量压缩至紧凑隐空间,无需昂贵蒸馏或预训练即可保留视觉显著光照特征。为缓解压缩导致的高频信息丢失,引入属性条件化SH增强模块,基于高斯内在属性预测偏移量,提升一阶SH表示精度,且无额外推理成本。此外,针对单视图梯度稠密化易引发过度生成与过拟合的问题,提出多视角α-基稠密化与剪枝策略,利用多视角一致性引导结构优化,精准移除冗余原型。大量实验表明,Flux-GS实现显著参数缩减的同时保持竞争力画质,为移动端实时渲染提供鲁棒可扩展的解决方案。
原文摘要 · Abstract (English)
Recent advances in 3D Gaussian Splatting have demonstrated unprecedented success in novel view synthesis. However, the substantial inference and storage overhead driven by high-order Spherical Harmonics (SH) are primary bottlenecks for mobile platforms. In this paper, we present Flux-GS, a real-time Gaussian Splatting method designed to achieve high-fidelity rendering with significantly reduced overhead for resource-constrained mobile platforms. We first propose a Monte Carlo Specular Energy Aggregator, sampling third-order radiance residuals and aggregating specular energy into a compact latent space. In this way, our method effectively preserves visually salient lighting features in lower-order bands without expensive distillation or pre-training. To mitigate the high-frequency details lost during compression, we introduce an Attribute-Conditioned SH Enhancement module. This module predicts Gaussian-aware offsets based on intrinsic Gaussian attributes, which enhance the first-order SH representation prior to inference, without extra inference costs. Furthermore, the original single-view gradient-based densification is prone to producing excessive Gaussians and overfitting to a certain view. We address these limitations by proposing a Multi-view Alpha-based Densification and Pruning strategy. By leveraging multi-view guidance, we ensure multi-view structure consistency and the precise removal of redundant primitives. Extensive experiments demonstrate that Flux-GS achieves substantial parameter reduction while maintaining competitive visual quality, offering a robust and scalable solution for real-time mobile rendering. Code: \textcolor{magenta}{\href{https://xiaobiaodu.github.io/flux-gs-project/}{https://xiaobiaodu.github.io/flux-gs-project/}}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。