arXiv:2511.13011cs.CV2025-11被引 1

用热成像指导低光3D重建,让不同视角颜色一致、几何准确。

Beyond Darkness: Thermal-Supervised 3D Gaussian Splatting for Low-Light Novel View Synthesis

  • 融合热成像与Retinex分解,实现光照不变的3D高斯点渲染。
  • 在极端低光下,颜色和几何精度显著优于现有方法。
  • 适合做低光三维重建、多模态视觉任务的研究者参考。

在极低光照条件下,新视角合成(NVS)面临几何失真、色彩不一致和辐射稳定性差的问题。直接将标准3D高斯点渲染(3DGS)应用于欠曝输入会导致各视角独立增强,引发光照不一致与几何畸变。为此,我们提出DTGS框架,通过仿视网膜的光照分解与热成像引导的3DGS,实现光照不变重建。不同于以往将增强作为预处理步骤的做法,DTGS采用循环增强-重建机制,在增强、几何与热监督之间进行联合优化。一个热监督分支通过动态平衡增强、结构与热损失,稳定颜色恢复与几何学习。同时,嵌入3DGS循环中的基于Retinex的分解模块,提供物理可解释的反射率-光照分离,确保跨视角颜色与纹理一致性。为评估该方法,我们构建了RGBT-LOW,一个包含严重光照退化的多视角低光热成像数据集。大量实验表明,DTGS显著优于现有低光增强与3D重建基线,在极端光照条件下实现了更优的辐射一致性、几何保真度与色彩稳定性。

原文摘要 · Abstract (English)

Under extremely low-light conditions, novel view synthesis (NVS) faces severe degradation in terms of geometry, color consistency, and radiometric stability. Standard 3D Gaussian Splatting (3DGS) pipelines fail when applied directly to underexposed inputs, as independent enhancement across views causes illumination inconsistencies and geometric distortion. To address this, we present DTGS, a unified framework that tightly couples Retinex-inspired illumination decomposition with thermal-guided 3D Gaussian Splatting for illumination-invariant reconstruction. Unlike prior approaches that treat enhancement as a pre-processing step, DTGS performs joint optimization across enhancement, geometry, and thermal supervision through a cyclic enhancement-reconstruction mechanism. A thermal supervisory branch stabilizes both color restoration and geometry learning by dynamically balancing enhancement, structural, and thermal losses. Moreover, a Retinex-based decomposition module embedded within the 3DGS loop provides physically interpretable reflectance-illumination separation, ensuring consistent color and texture across viewpoints. To evaluate our method, we construct RGBT-LOW, a new multi-view low-light thermal dataset capturing severe illumination degradation. Extensive experiments show that DTGS significantly outperforms existing low-light enhancement and 3D reconstruction baselines, achieving superior radiometric consistency, geometric fidelity, and color stability under extreme illumination.

3D重建低光增强热成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。