arXiv:2410.08810cs.CV2024-10被引 3

提出新评估框架LIME-Eval,用无标注检测器提升暗光图像增强评价可靠性。

LIME-Eval: Rethinking Low-light Image Enhancement Evaluation via Object Detection

  • 用预训练检测器+能量策略评估增强图质量,避免重新训练
  • 实验证明现有方法易过拟合,评估结果不可靠
  • 构建首个在线人类偏好平台LIME-Bench,支持主观验证

由于增强任务缺乏成对的真值信息,近期常通过在增强后的暗光图像上训练目标检测器,评估其在语义标注下的准确率来衡量性能。本文首次揭示该方法普遍存在过拟合问题,导致评估可靠性下降。为此,我们提出LIME-Bench——首个在线基准平台,用于收集人类对暗光增强效果的偏好,构建有价值的数据集以验证人眼感知与自动化指标的相关性。在此基础上,我们设计LIME-Eval:一种新型评估框架,采用在标准光照数据集上预训练的检测器(无需暗光图像标注),通过能量机制分析输出置信图的准确性,同时规避重训练偏差和对标注数据的依赖。大量实验验证了LIME-Eval的有效性。相关平台(https://huggingface.co/spaces/lime-j/eval)与代码(https://github.com/lime-j/lime-eval)已公开。

原文摘要 · Abstract (English)

Due to the nature of enhancement--the absence of paired ground-truth information, high-level vision tasks have been recently employed to evaluate the performance of low-light image enhancement. A widely-used manner is to see how accurately an object detector trained on enhanced low-light images by different candidates can perform with respect to annotated semantic labels. In this paper, we first demonstrate that the mentioned approach is generally prone to overfitting, and thus diminishes its measurement reliability. In search of a proper evaluation metric, we propose LIME-Bench, the first online benchmark platform designed to collect human preferences for low-light enhancement, providing a valuable dataset for validating the correlation between human perception and automated evaluation metrics. We then customize LIME-Eval, a novel evaluation framework that utilizes detectors pre-trained on standard-lighting datasets without object annotations, to judge the quality of enhanced images. By adopting an energy-based strategy to assess the accuracy of output confidence maps, our LIME-Eval can simultaneously bypass biases associated with retraining detectors and circumvent the reliance on annotations for dim images. Comprehensive experiments are provided to reveal the effectiveness of our LIME-Eval. Our benchmark platform (https://huggingface.co/spaces/lime-j/eval) and code (https://github.com/lime-j/lime-eval) are available online.

图像增强评估框架目标检测人类偏好

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。