arXiv:2502.12418cs.CVcs.AI2025-02

提升深度色彩恒常性模型对亮度变化的鲁棒性,显著降低色温估计误差。

Boosting Illuminant Estimation in Deep Color Constancy through Enhancing Brightness Robustness

  • 引入自适应步长对抗性亮度增强策略,识别高风险亮度变化并生成增强图像。
  • 结合对抗训练与亮度对比损失,使模型在亮度波动下仍保持稳定性能。
  • 无需额外参数和计算开销,可无缝集成到现有深度色彩恒常性模型中。

色彩恒常性旨在估计光源色度以校正偏色图像。近年来,基于深度神经网络的色彩恒常性(DNNCC)模型取得显著进展,但其对深度神经网络固有脆弱性的潜在风险尚未被充分探索。本文首次从鲁棒性角度系统研究了亮度这一关键因素对DNNCC的影响。评估发现,尽管主流模型聚焦于色度估计,却对亮度变化高度敏感,而真实数据集中的广泛亮度差异可能限制其实际表现。基于此,我们提出一种简单有效的亮度鲁棒性增强方法(BRE),核心是自适应步长对抗性亮度增强技术,可识别高风险亮度变化并显式调整生成增强图像。随后,BRE采用亮度鲁棒性感知的优化策略,融合对抗性亮度训练与亮度对比损失,显著提升模型对亮度扰动的鲁棒性。BRE无需超参数,可无缝嵌入现有DNNCC模型,测试阶段无额外开销。在ColorChecker与Cube+两个公开数据集上的实验表明,BRE可一致提升六种主流DNNCC模型的色温估计性能,平均降低5.04%的估计误差,凸显增强亮度鲁棒性的关键作用。

原文摘要 · Abstract (English)

Color constancy estimates illuminant chromaticity to correct color-biased images. Recently, Deep Neural Network-driven Color Constancy (DNNCC) models have made substantial advancements. Nevertheless, the potential risks in DNNCC due to the vulnerability of deep neural networks have not yet been explored. In this paper, we conduct the first investigation into the impact of a key factor in color constancy-brightness-on DNNCC from a robustness perspective. Our evaluation reveals that several mainstream DNNCC models exhibit high sensitivity to brightness despite their focus on chromaticity estimation. This sheds light on a potential limitation of existing DNNCC models: their sensitivity to brightness may hinder performance given the widespread brightness variations in real-world datasets. From the insights of our analysis, we propose a simple yet effective brightness robustness enhancement strategy for DNNCC models, termed BRE. The core of BRE is built upon the adaptive step-size adversarial brightness augmentation technique, which identifies high-risk brightness variation and generates augmented images via explicit brightness adjustment. Subsequently, BRE develops a brightness-robustness-aware model optimization strategy that integrates adversarial brightness training and brightness contrastive loss, significantly bolstering the brightness robustness of DNNCC models. BRE is hyperparameter-free and can be integrated into existing DNNCC models, without incurring additional overhead during the testing phase. Experiments on two public color constancy datasets-ColorChecker and Cube+-demonstrate that the proposed BRE consistently enhances the illuminant estimation performance of existing DNNCC models, reducing the estimation error by an average of 5.04% across six mainstream DNNCC models, underscoring the critical role of enhancing brightness robustness in these models.

色彩恒常性亮度鲁棒性深度学习图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。