用高斯点云重建暗光场景,实现快速真实视角合成。
LL-Gaussian: Low-Light Scene Reconstruction and Enhancement via Gaussian Splatting for Novel View Synthesis
- 用学习式MVS生成高质量初始点云,解决暗光下初始化不稳定问题。
- 分离光照与反射属性,有效抑制噪声并提升优化稳定性。
- 无需标注数据,适合真实暗光环境下的快速三维重建。
低光场景下的新视角合成(NVS)因输入图像严重噪声、动态范围低且初始化不可靠而面临挑战。现有基于NeRF的方法虽效果良好,但计算成本高,且常依赖原始传感器数据或多曝光序列,实用性受限。3D高斯泼溅(3DGS)可实现实时渲染且视觉质量优秀,但处理低光sRGB图像时仍存在初始化不稳与噪声抑制不足的问题。为此,本文提出LL-Gaussian框架,从低光sRGB图像中实现3D重建与增强,支持伪正常光照的新视角合成。方法包含三项创新:1)端到端的低光高斯初始化模块(LLGIM),利用基于学习的MVS密集先验生成高质量初始点云;2)双分支高斯分解模型,将场景固有属性(反射率与照明)与瞬时干扰分离,实现稳定可解释优化;3)基于物理约束与扩散先验的无监督优化策略,协同引导分解与增强。此外,我们构建了一个极端低光环境下的挑战性数据集,并验证了该方法的有效性。相比最先进NeRF方法,LL-Gaussian推理速度提升最高达2000倍,训练时间缩短至2%,同时保持更优的重建与渲染质量。
原文摘要 · Abstract (English)
Novel view synthesis (NVS) in low-light scenes remains a significant challenge due to degraded inputs characterized by severe noise, low dynamic range (LDR) and unreliable initialization. While recent NeRF-based approaches have shown promising results, most suffer from high computational costs, and some rely on carefully captured or pre-processed data--such as RAW sensor inputs or multi-exposure sequences--which severely limits their practicality. In contrast, 3D Gaussian Splatting (3DGS) enables real-time rendering with competitive visual fidelity; however, existing 3DGS-based methods struggle with low-light sRGB inputs, resulting in unstable Gaussian initialization and ineffective noise suppression. To address these challenges, we propose LL-Gaussian, a novel framework for 3D reconstruction and enhancement from low-light sRGB images, enabling pseudo normal-light novel view synthesis. Our method introduces three key innovations: 1) an end-to-end Low-Light Gaussian Initialization Module (LLGIM) that leverages dense priors from learning-based MVS approach to generate high-quality initial point clouds; 2) a dual-branch Gaussian decomposition model that disentangles intrinsic scene properties (reflectance and illumination) from transient interference, enabling stable and interpretable optimization; 3) an unsupervised optimization strategy guided by both physical constrains and diffusion prior to jointly steer decomposition and enhancement. Additionally, we contribute a challenging dataset collected in extreme low-light environments and demonstrate the effectiveness of LL-Gaussian. Compared to state-of-the-art NeRF-based methods, LL-Gaussian achieves up to 2,000 times faster inference and reduces training time to just 2%, while delivering superior reconstruction and rendering quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。