arXiv:2509.18390cs.CV2025-09

用预训练白平衡网络提升单图光照估计的色彩准确性。

Improving the color accuracy of lighting estimation models

  • 用预训练白平衡网络预处理输入图像,增强色彩鲁棒性。
  • 该方法无需重训练模型,在多个场景下均优于其他策略。
  • 适合需要高真实感渲染的AR应用开发者参考。

单图高动态范围(HDR)光照估计技术的进步为增强现实(AR)应用带来了新可能。从单张图像预测复杂光照环境,可实现虚拟物体的真实渲染与合成。本文研究此类方法的色彩鲁棒性——一个常被忽视但对视觉真实感至关重要的因素。多数评估将色彩与其他光照属性(如强度、方向)混杂,我们将其作为核心变量单独考察。不引入新的光照估计算法,而是探索简单适配技术能否提升现有模型的色彩准确性。基于一个包含多样光照色彩的新HDR数据集,我们系统评估了几种适配策略。结果表明,使用预训练白平衡网络预处理输入图像能显著提升色彩鲁棒性,且在所有测试场景中均优于其他方法。值得注意的是,该方法无需重训练光照估计模型。我们进一步通过三类近期顶尖的光照估计方法验证了该结论的普适性。

原文摘要 · Abstract (English)

Advances in high dynamic range (HDR) lighting estimation from a single image have opened new possibilities for augmented reality (AR) applications. Predicting complex lighting environments from a single input image allows for the realistic rendering and compositing of virtual objects. In this work, we investigate the color robustness of such methods -- an often overlooked yet critical factor for achieving visual realism. While most evaluations conflate color with other lighting attributes (e.g., intensity, direction), we isolate color as the primary variable of interest. Rather than introducing a new lighting estimation algorithm, we explore whether simple adaptation techniques can enhance the color accuracy of existing models. Using a novel HDR dataset featuring diverse lighting colors, we systematically evaluate several adaptation strategies. Our results show that preprocessing the input image with a pre-trained white balance network improves color robustness, outperforming other strategies across all tested scenarios. Notably, this approach requires no retraining of the lighting estimation model. We further validate the generality of this finding by applying the technique to three state-of-the-art lighting estimation methods from recent literature.

光照估计色彩准确AR白平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。