arXiv:2504.00219cs.CV2025-04CVPR被引 28

无需参考图像,通过物理先验实现光照不变的3D高斯点云新视角合成。

LITA-GS: Illumination-Agnostic Novel View Synthesis via Reference-Free 3D Gaussian Splatting and Physical Priors

  • 利用光照不变物理先验提取鲁棒空间结构。
  • 在低光照场景下生成清晰、无噪的高质量新视角图像。
  • 适合低照度环境下的三维重建与视觉生成任务。

在不良光照条件下直接使用3D高斯点云(3DGS)生成高质量、正常曝光的图像面临挑战:(1)不良光照导致运动恢复结构(SfM)点稀疏,难以捕捉足够场景细节;(2)缺乏真实参考图像时,信息丢失严重、噪声大且色彩失真,制约3DGS效果;(3)现有曝光校正方法与3DGS结合后,因各自独立增强过程导致不同视角间光照不一致。为此,我们提出LITA-GS,一种基于无参考3DGS与物理先验的光照无关新视角合成方法。首先设计光照不变物理先验提取流程;其次基于提取的稳健空间结构先验,构建光照无关结构渲染策略,优化场景结构与物体外观;此外引入渐进式去噪模块,有效缓解光照不变表示中的噪声。采用无监督训练策略,大量实验表明,LITA-GS超越当前主流基于NeRF的方法,在推理速度更快、训练时间更短的前提下仍保持更高性能。代码已开源:https://github.com/LowLevelAI/LITA-GS。

原文摘要 · Abstract (English)

Directly employing 3D Gaussian Splatting (3DGS) on images with adverse illumination conditions exhibits considerable difficulty in achieving high-quality, normally-exposed representations due to: (1) The limited Structure from Motion (SfM) points estimated in adverse illumination scenarios fail to capture sufficient scene details; (2) Without ground-truth references, the intensive information loss, significant noise, and color distortion pose substantial challenges for 3DGS to produce high-quality results; (3) Combining existing exposure correction methods with 3DGS does not achieve satisfactory performance due to their individual enhancement processes, which lead to the illumination inconsistency between enhanced images from different viewpoints. To address these issues, we propose LITA-GS, a novel illumination-agnostic novel view synthesis method via reference-free 3DGS and physical priors. Firstly, we introduce an illumination-invariant physical prior extraction pipeline. Secondly, based on the extracted robust spatial structure prior, we develop the lighting-agnostic structure rendering strategy, which facilitates the optimization of the scene structure and object appearance. Moreover, a progressive denoising module is introduced to effectively mitigate the noise within the light-invariant representation. We adopt the unsupervised strategy for the training of LITA-GS and extensive experiments demonstrate that LITA-GS surpasses the state-of-the-art (SOTA) NeRF-based method while enjoying faster inference speed and costing reduced training time. The code is released at https://github.com/LowLevelAI/LITA-GS.

3D高斯光照不变新视角合成无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。