让手机相机自动匹配统一的色彩风格,跨设备效果一致。
Learning Camera-Agnostic White-Balance Preferences
- 学习中性白平衡后的美学转换映射,实现跨相机一致色彩
- 模型仅500参数,移动端0.024毫秒内完成推理
- 适合多摄像头手机、需要统一色彩风格的场景
现代相机的图像信号处理(ISP)流水线包含多个模块,将原始传感器数据转换为视觉上悦目的显示色彩空间图像。其中自动白平衡(AWB)模块对补偿场景光照至关重要。然而,商用AWB系统常追求美学偏好而非准确的中性色校正。尽管基于学习的方法提升了AWB准确性,但普遍难以在不同相机传感器间泛化——这对拥有多个摄像头的智能手机构成挑战。现有跨相机AWB研究多聚焦于中性白平衡,本文首次提出通过学习一个后光照估计的映射,在相机无关空间中将中性光照校正转换为美学偏好校正。训练完成后,该映射可应用于任意中性AWB模块,实现跨未见相机的一致且具风格化的色彩渲染。所提模型轻量级(约500参数),在典型旗舰移动CPU上仅需0.024毫秒。在包含三款相机共771张手机图像的数据集上评估,性能达当前最优,且与现有跨相机AWB技术完全兼容,计算与内存开销极低。
原文摘要 · Abstract (English)
The image signal processor (ISP) pipeline in modern cameras consists of several modules that transform raw sensor data into visually pleasing images in a display color space. Among these, the auto white balance (AWB) module is essential for compensating for scene illumination. However, commercial AWB systems often strive to compute aesthetic white-balance preferences rather than accurate neutral color correction. While learning-based methods have improved AWB accuracy, they typically struggle to generalize across different camera sensors -- an issue for smartphones with multiple cameras. Recent work has explored cross-camera AWB, but most methods remain focused on achieving neutral white balance. In contrast, this paper is the first to address aesthetic consistency by learning a post-illuminant-estimation mapping that transforms neutral illuminant corrections into aesthetically preferred corrections in a camera-agnostic space. Once trained, our mapping can be applied after any neutral AWB module to enable consistent and stylized color rendering across unseen cameras. Our proposed model is lightweight -- containing only $\sim$500 parameters -- and runs in just 0.024 milliseconds on a typical flagship mobile CPU. Evaluated on a dataset of 771 smartphone images from three different cameras, our method achieves state-of-the-art performance while remaining fully compatible with existing cross-camera AWB techniques, introducing minimal computational and memory overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。