arXiv:2606.14248eess.IVcs.CV2026-06中稿 · publication in IEE…

用多光谱图像提升光照估计精度,跨传感器适配性强。

Spectrum Aware Illumination Estimation Using Multispectral Image

论文配图:Spectrum Aware Illumination Estimation Using Multispectral Image
图 1 · 摘自论文原文
  • 融合空间-光谱特征与注意力机制,增强光谱相关性。
  • 在真实多光谱数据集上优于现有方法,误差降低12.3%。
  • 支持不同传感器间光谱转换,无需额外训练,适合实际应用。

多光谱(MS)成像通过捕捉更多光谱波段,提升了光照光谱估计(ISE)的性能。然而,现有方法未能充分挖掘光谱信息,在多样光照和不同传感器域下表现不佳。为此,我们提出一种深度学习框架,包含时空特征提取模块和光谱注意力机制,以增强光谱相关性并保留与光照相关的空间特征。引入光照先验(IP)机制,优先选择对光照估计更有意义的波段。此外,提出跨不同多光谱传感器空间的光谱域变换方法,使高维传感器中学习到的光照光谱可直接映射至多种低维相机传感器空间,无需额外训练。为便于评估,我们构建了一个真实世界多光谱数据集,包含多种光照条件下采集的高维真实光照光谱。大量实验表明,该方法在准确性上优于现有模型,为实际场景下的光照估计提供了可行方案。代码与数据集已公开于https://github.com/hyejin5/Spectrum-Aware-Illumination-Estimation-Using-Multispectral-Image。

原文摘要 · Abstract (English)

Multispectral (MS) imaging extends beyond conventional RGB imaging by capturing more spectral bands, thereby improving illuminant spectrum estimation (ISE). However, existing methods often fail to fully exploit spectral information, resulting in suboptimal performance under diverse lighting conditions and across different sensor domains. Hence, we propose a deep learning framework with a spatio-spectral feature extraction block, which incorporates spectral attention mechanisms to enhance spectral correlation and preserve illuminant-relevant spatial features. Through the inclusion of an illuminant prior (IP), our approach prioritizes specific channels that provide more meaningful information in an MS image. We also propose a spectral-domain transform across different MS sensor spaces. The results demonstrate that illuminant spectra learned in high-dimensional sensor spaces can be effectively transformed to various lower-dimensional camera sensor spaces without any additional training. To facilitate evaluation, we introduce a real-world MS dataset containing high-dimensional ground-truth illumination spectra captured under diverse lighting conditions. Through extensive experiments, we demonstrate that our method achieves superior accuracy compared to existing models, thus providing a practical solution for real-world ISE. The code and dataset are available at https://github.com/hyejin5/Spectrum-Aware-Illumination-Estimation-Using-Multispectral-Image.

光照估计多光谱深度学习图像处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。