arXiv:2608.08211eess.IVcs.CV2026-08

用检索增强生成修复低光图像的颜色偏差。

Retrieval-Augmented Generation-Based Color Restoration for Low-Light Image Enhancement

论文配图:Retrieval-Augmented Generation-Based Color Restoration for Low-Light Image Enhancement
图 1 · 摘自论文原文
  • 将颜色恢复独立为后处理模块,通过外部知识库动态检索参考图。
  • 在LOLv1/LOLv2数据集上显著提升颜色指标,跨前段模型通用。
  • 依赖纹理结构相似性而非语义,避免像素级对应要求。

现有低光图像增强(LLIE)方法虽能接近正常光照图像的亮度与结构保真度,但输出仍存在系统性色偏,如偏绿天空、偏黄人脸和暖色调白物。我们归因于端到端训练将亮度、结构与颜色耦合在同一网络中,导致颜色通道监督不足。本文将颜色恢复视为独立子问题,解耦亮度增强,设计基于检索增强生成(RAG)的通用后处理模块。该模块不依赖训练时学习的参数化颜色先验,而是从外部高质量颜色知识库中动态检索参考图像,将其颜色分布注入颜色恢复网络以校正残余偏差。模块包含三部分:(i) 基于VGG19中间特征构建的双索引FAISS检索器,通过全局均值与方差统计捕捉纹理与结构相似性;(ii) GlobalSPHistAdaIN,将参考图像的空间保色直方图压缩为全局颜色向量,并通过自适应实例归一化调制网络特征,消除对像素级对应关系的依赖;(iii) 残差形式,预测对前端输出的颜色校正。在LOLv1、LOLv2-Real与LOLv2-Synthetic上,该模块持续提升颜色相关指标,且在更换前端模型(CPGA-Net++、LLFormer、FLIGHTNet、IAT)后仍有效,验证其跨前端通用性。消融实验表明,基于VGG19的双索引优于基于CLIP的检索,说明颜色恢复更依赖纹理与结构相似性而非高层语义。

原文摘要 · Abstract (English)

Recent low-light image enhancement (LLIE) methods have driven brightness and structural fidelity close to that of normally-exposed images, yet their outputs still exhibit systematic color shifts such as greenish skies, yellowish faces, and warm-tinted white objects. We attribute this to end-to-end LLIE training coupling brightness, structure, and color within a single network, leaving the color channels weakly supervised. We recast color restoration as an independent sub-problem and decouple it from brightness enhancement, realizing it as a general-purpose post-processing module built on retrieval-augmented generation (RAG). Rather than relying solely on parametric color priors learned during training, the module dynamically retrieves a reference image from an external high-quality color knowledge base and injects its color distribution into a color-restoration network to correct residual bias. The design has three components: (i) a dual-index FAISS retriever built on intermediate VGG19 features, capturing textural and structural similarity through global mean and variance statistics; (ii) GlobalSPHistAdaIN, which reduces the reference spatial-preserving color histogram to a global color vector and modulates network features via adaptive instance normalization, removing dependence on pixel-level correspondence; and (iii) a residual formulation that predicts a color correction over the front-end output. Across LOLv1, LOLv2-Real, and LOLv2-Synthetic, the module consistently improves color-specific metrics, and it remains effective when the front end is swapped among CPGA-Net++, LLFormer, FLIGHTNet, and IAT, confirming cross-front-end generality. Ablations show that a VGG19 dual index outperforms CLIP-based retrieval, indicating that color restoration depends on textural and structural similarity rather than high-level semantics.

图像增强颜色恢复检索生成低光图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。