通过光照过渡建模,从低光多视角图像恢复出清晰的正常光照新视角。
Robust Low-light Scene Restoration via Illumination Transition
- 将低光到正常光照的转换建模为三维空间中的光照过渡场。
- 利用光照的低秩特性实现有效去噪,提升图像质量和多视角一致性。
- 适合需要高质量低光图像重建的应用,如自动驾驶与增强现实。
从低光多视角图像合成正常光照的新视角是一项重要但极具挑战的任务,因输入图像存在低可见度和高ISO噪声。现有低光增强方法常因忽视多视角间关联而表现不佳;虽有先进方法引入光照相关组件,但仍存在色彩失真、伪影及去噪效果有限等问题。本文提出鲁棒低光场景恢复框架RoSe,将任务转化为三维空间中的光照过渡估计问题,将其视为特定渲染任务。多视角一致的光照过渡场建立了低光与正常光照间的稳健联系。通过利用光照固有的低秩性质约束过渡表示,无需复杂2D技术或显式噪声建模即可实现更有效的去噪。为实现RoSe,设计了简洁的双分支架构并引入低秩去噪模块。实验表明,RoSe在标准基准上显著优于现有模型,在渲染质量和多视角一致性方面均有提升。代码与数据见https://pegasus2004.github.io/RoSe。
原文摘要 · Abstract (English)
Synthesizing normal-light novel views from low-light multiview images is an important yet challenging task, given the low visibility and high ISO noise present in the input images. Existing low-light enhancement methods often struggle to effectively preprocess such low-light inputs, as they fail to consider correlations among multiple views. Although other state-of-the-art methods have introduced illumination-related components offering alternative solutions to the problem, they often result in drawbacks such as color distortions and artifacts, and they provide limited denoising effectiveness. In this paper, we propose a novel Robust Low-light Scene Restoration framework (RoSe), which enables effective synthesis of novel views in normal lighting conditions from low-light multiview image inputs, by formulating the task as an illuminance transition estimation problem in 3D space, conceptualizing it as a specialized rendering task. This multiview-consistent illuminance transition field establishes a robust connection between low-light and normal-light conditions. By further exploiting the inherent low-rank property of illumination to constrain the transition representation, we achieve more effective denoising without complex 2D techniques or explicit noise modeling. To implement RoSe, we design a concise dual-branch architecture and introduce a low-rank denoising module. Experiments demonstrate that RoSe significantly outperforms state-of-the-art models in both rendering quality and multiview consistency on standard benchmarks. The codes and data are available at https://pegasus2004.github.io/RoSe.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。