arXiv:2508.14730cs.CV2025-08被引 2

构建首个跨传感器与光照的RAW图像映射数据集,提升图像处理效率。

Improved Mapping Between Illuminations and Sensors for RAW Images

  • 设计可调光箱采集多光照下多相机数据,实现真实场景覆盖。
  • 使用390种光照、4台相机、18个场景构建首个跨域映射数据集。
  • 轻量神经网络模型有效映射光照与传感器差异,适合图像处理研究者。

RAW图像为未经处理的相机传感器输出,其RGB值受传感器色彩滤波器光谱响应特性影响,并因场景光照光谱特性导致明显色偏。由于RAW图像具有传感器和光照双重特异性,深度学习方法难以获取足够数据,需在不同传感器和广泛光照条件下采集大量样本。为此,本文首次构建了首个跨传感器与光照的映射数据集,采用定制化可调光箱,在多种光照条件下对18个场景进行多相机拍摄,涵盖390种照明条件和4种相机型号。基于该数据集,提出一种轻量级神经网络方法,实现光照与传感器间的高效映射,性能优于现有方法。实验验证其在神经ISP训练等下游任务中的有效性。

原文摘要 · Abstract (English)

RAW images are unprocessed camera sensor output with sensor-specific RGB values based on the sensor's color filter spectral sensitivities. RAW images also incur strong color casts due to the sensor's response to the spectral properties of scene illumination. The sensor- and illumination-specific nature of RAW images makes it challenging to capture RAW datasets for deep learning methods, as scenes need to be captured for each sensor and under a wide range of illumination. Methods for illumination augmentation for a given sensor and the ability to map RAW images between sensors are important for reducing the burden of data capture. To explore this problem, we introduce the first-of-its-kind dataset comprising carefully captured scenes under a wide range of illumination. Specifically, we use a customized lightbox with tunable illumination spectra to capture several scenes with different cameras. Our illumination and sensor mapping dataset has 390 illuminations, four cameras, and 18 scenes. Using this dataset, we introduce a lightweight neural network approach for illumination and sensor mapping that outperforms competing methods. We demonstrate the utility of our approach on the downstream task of training a neural ISP. Link to project page: https://github.com/SamsungLabs/illum-sensor-mapping.

RAW图像光照映射数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。