通过人机交互迭代优化,让低光图像增强更符合人眼偏好。
HiLLIE: Human-in-the-Loop Training for Low-Light Image Enhancement
- 引入人类视觉反馈,用少量对比标注引导模型训练
- 仅需少量标注即可显著提升图像质量评估能力
- 适合需要真实视觉效果的低光图像增强应用
低光图像增强(LLIE)中,如何生成符合人眼视觉偏好的高质量亮光图像仍具挑战。本文提出一种人机协同的LLIE训练框架HiLLIE,通过多轮迭代训练,利用人类对增强结果的高效视觉质量标注来改进模型。每轮中,我们使用人类标注的成对排序数据训练一个定制化的图像质量评估(IQA)模型,该模型学习人类视觉偏好,并用于指导增强模型的训练。仅需每轮少量成对排名标注,即可持续提升IQA模型对视觉感知的模拟能力,从而生成更符合人眼审美的增强结果。大量实验表明,该方法在定量和定性指标上均显著提升无监督LLIE模型性能。代码与收集的排序数据集将开源。
原文摘要 · Abstract (English)
Developing effective approaches to generate enhanced results that align well with human visual preferences for high-quality well-lit images remains a challenge in low-light image enhancement (LLIE). In this paper, we propose a human-in-the-loop LLIE training framework that improves the visual quality of unsupervised LLIE model outputs through iterative training stages, named HiLLIE. At each stage, we introduce human guidance into the training process through efficient visual quality annotations of enhanced outputs. Subsequently, we employ a tailored image quality assessment (IQA) model to learn human visual preferences encoded in the acquired labels, which is then utilized to guide the training process of an enhancement model. With only a small amount of pairwise ranking annotations required at each stage, our approach continually improves the IQA model's capability to simulate human visual assessment of enhanced outputs, thus leading to visually appealing LLIE results. Extensive experiments demonstrate that our approach significantly improves unsupervised LLIE model performance in terms of both quantitative and qualitative performance. The code and collected ranking dataset will be available at https://github.com/LabShuHangGU/HiLLIE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。