arXiv:2504.14075cs.CV2025-04CVPR被引 20

用结构先验指导变换器,提升极暗环境图像增强效果

Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design

  • 基于光照不变边缘检测提取结构先验,替代依赖预训练模型的语义引导
  • 在UNet框架中设计多尺度混合模块,融合CNN与结构引导变换器
  • 在NTIRE 2025挑战赛中排名第二,兼顾定量指标与视觉质量

现有低光图像增强(LLIE)方法主要依赖直接的低光到正常光映射,或使用语义特征与光照图引导。然而,LLIE固有的病态性及从严重退化图像中恢复鲁棒语义的困难,限制了其在极端低光环境下的性能。为此,我们提出SG-LLIE,一种基于结构先验的多尺度CNN-Transformer混合框架。不同于使用预训练模型提取语义或光照图,我们采用光照不变边缘检测器提取鲁棒结构先验。在UNet编码器-解码器架构中,每个尺度均设计包含CNN块和结构引导变换器块(SGTB)的混合结构引导特征提取模块(HSGFE)。CNN块擅长多尺度特征提取与融合,而SGTB通过引入结构先验对增强过程进行调制。大量实验表明,该方法在多个LLIE基准上达到领先性能,定量指标与视觉质量均优秀,在NTIRE 2025低光增强挑战赛中位列第二。代码已公开于https://github.com/minyan8/imagine。

原文摘要 · Abstract (English)

Current Low-light Image Enhancement (LLIE) techniques predominantly rely on either direct Low-Light (LL) to Normal-Light (NL) mappings or guidance from semantic features or illumination maps. Nonetheless, the intrinsic ill-posedness of LLIE and the difficulty in retrieving robust semantics from heavily corrupted images hinder their effectiveness in extremely low-light environments. To tackle this challenge, we present SG-LLIE, a new multi-scale CNN-Transformer hybrid framework guided by structure priors. Different from employing pre-trained models for the extraction of semantics or illumination maps, we choose to extract robust structure priors based on illumination-invariant edge detectors. Moreover, we develop a CNN-Transformer Hybrid Structure-Guided Feature Extractor (HSGFE) module at each scale with in the UNet encoder-decoder architecture. Besides the CNN blocks which excels in multi-scale feature extraction and fusion, we introduce a Structure-Guided Transformer Block (SGTB) in each HSGFE that incorporates structural priors to modulate the enhancement process. Extensive experiments show that our method achieves state-of-the-art performance on several LLIE benchmarks in both quantitative metrics and visual quality. Our solution ranks second in the NTIRE 2025 Low-Light Enhancement Challenge. Code is released at https://github.com/minyan8/imagine.

低光增强结构先验Transformer多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。