解决复杂光照下图像恢复难题,首次构建高分辨率多色光源数据集。
After the Party: Navigating the Mapping From Color to Ambient Lighting
- 基于视网膜模型思想,显式分离颜色与亮度成分以解耦光照与反射
- 在多色非均匀光照下保持色彩一致性,避免纹理泄露和色偏
- 适合图像修复、材质分析等需要精确光照建模的场景
实际场景中的光照极为复杂,包含多种彩色光源、遮挡及不同材质的反射与阴影效应。现有方法常简化为单光源或均匀白光,忽视了真实复杂性。本文提出首个大规模、高分辨率的多色光源图像数据集CL3AN,用于恢复多光源环境下拍摄的图像至环境归一化版本。基准测试发现,主流方法易产生光照不一致、纹理泄露和色彩失真等问题,根源在于难以精准分离光照与反射。为此,我们设计一种新学习框架,借鉴视网膜模型原理,通过显式的色度-亮度成分引导实现解耦。在现有基准和本数据集上的大量实验表明,该方法在非均匀彩色光照和材质反射差异下具有更强鲁棒性,且计算开销可控。相关基准、代码与模型已开源:www.github.com/fvasluianu97/RLN2。
原文摘要 · Abstract (English)
Illumination in practical scenarios is inherently complex, involving colored light sources, occlusions, and diverse material interactions that produce intricate reflectance and shading effects. However, existing methods often oversimplify this challenge by assuming a single light source or uniform, white-balanced lighting, leaving many of these complexities unaddressed. In this paper, we introduce CL3AN, the first large-scale, high-resolution dataset of its kind designed to facilitate the restoration of images captured under multiple Colored Light sources to their Ambient-Normalized counterparts. Through benchmarking, we find that leading approaches often produce artifacts, such as illumination inconsistencies, texture leakage, and color distortion, primarily due to their limited ability to precisely disentangle illumination from reflectance. Motivated by this insight, we achieve such a desired decomposition through a novel learning framework that leverages explicit chromaticity-luminance components guidance, drawing inspiration from the principles of the Retinex model. Extensive evaluations on existing benchmarks and our dataset demonstrate the effectiveness of our approach, showcasing enhanced robustness under non-homogeneous color lighting and material-specific reflectance variations, all while maintaining a highly competitive computational cost. The benchmark, codes, and models are available at www.github.com/fvasluianu97/RLN2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。