arXiv:2410.09831cs.CVcs.AI2024-10中稿 · the Asian Conferen…被引 30

构建首个街景低光图像增强数据集,推动自动驾驶视觉系统发展

LoLI-Street: Benchmarking Low-Light Image Enhancement and Beyond

  • 提出融合Transformer与扩散模型的TriFuse增强方法
  • 在33,000张街景配对图像上训练,1,000张真实测试图验证效果
  • 适用于自动驾驶、安防等需要高可靠低光成像的场景

低光图像增强(LLIE)对目标检测、跟踪、分割和场景理解等计算机视觉任务至关重要。尽管已有大量研究提升欠曝图像质量,但自动驾驶车辆在真实低光环境下仍面临挑战,亟需更鲁棒的增强方法。现有配对数据集稀缺,尤其缺乏街景数据,制约了实用化进展。当前基于Transformer或扩散模型的方法在真实低光条件下表现不佳,且未在街景数据上训练。为此,我们构建了包含33,000对低光与正常曝光街景图像的LoLI-Street数据集,覆盖19,000个物体类别,含1,000张真实低光测试图像。同时提出基于Transformer与扩散模型的增强模型TriFuse。在该数据集上训练并评估了TriFuse及多项先进方法,结果表明其在跨主流数据集测试中显著提升图像质量和目标检测性能,具备实际应用潜力。代码与数据集已开源。

原文摘要 · Abstract (English)

Low-light image enhancement (LLIE) is essential for numerous computer vision tasks, including object detection, tracking, segmentation, and scene understanding. Despite substantial research on improving low-quality images captured in underexposed conditions, clear vision remains critical for autonomous vehicles, which often struggle with low-light scenarios, signifying the need for continuous research. However, paired datasets for LLIE are scarce, particularly for street scenes, limiting the development of robust LLIE methods. Despite using advanced transformers and/or diffusion-based models, current LLIE methods struggle in real-world low-light conditions and lack training on street-scene datasets, limiting their effectiveness for autonomous vehicles. To bridge these gaps, we introduce a new dataset LoLI-Street (Low-Light Images of Streets) with 33k paired low-light and well-exposed images from street scenes in developed cities, covering 19k object classes for object detection. LoLI-Street dataset also features 1,000 real low-light test images for testing LLIE models under real-life conditions. Furthermore, we propose a transformer and diffusion-based LLIE model named "TriFuse". Leveraging the LoLI-Street dataset, we train and evaluate our TriFuse and SOTA models to benchmark on our dataset. Comparing various models, our dataset's generalization feasibility is evident in testing across different mainstream datasets by significantly enhancing images and object detection for practical applications in autonomous driving and surveillance systems. The complete code and dataset is available on https://github.com/tanvirnwu/TriFuse.

低光增强街景数据集自动驾驶扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。