无需人工标注,训练通用图像对比度增强模型
UNICE: Training A Universal Image Contrast Enhancer
- 用HDR图像生成多曝光序列,构建无标注训练数据
- 在4个任务上泛化能力超越现有方法,部分指标超人工标注
- 适合需要跨场景通用增强的图像处理应用
现有图像对比度增强方法通常针对特定任务(如过曝/欠曝校正、低光或逆光增强)设计,模型在不同任务间泛化能力差,甚至在同一任务的不同数据集上表现也不稳定。本文提出是否可学习一个通用模型以应对多种对比度增强任务。研究发现,这些任务的共性在于需调整曝光与对比度,若能获取高动态范围(HDR)输入则可有效解决。为此,作者从公开来源收集46,928张HDR原始图像,通过多曝光融合生成328,496张sRGB图像及对应的伪sRGB真值,构建多曝光序列(MES)。训练首个网络从单张sRGB图像生成MES,再训练第二个网络将生成的MES融合为增强图像。所提方法命名为UNICE(Universal Image Contrast Enhancer),无需昂贵的人工标注。实验表明,该方法在跨任务及同任务内均显著优于现有方法,多项无参考图像质量指标甚至超越人工标注真值。相关数据集、代码与模型已开源。
原文摘要 · Abstract (English)
Existing image contrast enhancement methods are typically designed for specific tasks such as under-/over-exposure correction, low-light and backlit image enhancement, etc. The learned models, however, exhibit poor generalization performance across different tasks, even across different datasets of a specific task. It is important to explore whether we can learn a universal and generalized model for various contrast enhancement tasks. In this work, we observe that the common key factor of these tasks lies in the need of exposure and contrast adjustment, which can be well-addressed if high-dynamic range (HDR) inputs are available. We hence collect 46,928 HDR raw images from public sources, and render 328,496 sRGB images to build multi-exposure sequences (MES) and the corresponding pseudo sRGB ground-truths via multi-exposure fusion. Consequently, we train a network to generate an MES from a single sRGB image, followed by training another network to fuse the generated MES into an enhanced image. Our proposed method, namely UNiversal Image Contrast Enhancer (UNICE), is free of costly human labeling. However, it demonstrates significantly stronger generalization performance than existing image contrast enhancement methods across and within different tasks, even outperforming manually created ground-truths in multiple no-reference image quality metrics. The dataset, code and model are available at https://github.com/BeyondHeaven/UNICE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。