arXiv:2410.12346cs.CVcs.AI2024-10CVPR被引 25

用2步实现顶尖低光增强效果,速度远超传统扩散模型。

Efficient Diffusion as Low Light Enhancer

  • 通过反射率感知轨迹优化,修正扩散过程中的误差。
  • 仅需2步即可达到与多步方法相当的增强效果。
  • 适合追求高效低光图像增强的应用场景。

基于扩散模型的低光图像增强(LLIE)面临迭代采样计算负担重的问题。现有加速方法往往导致性能显著下降,体现出性能与效率的权衡。本文识别出性能下降的两大原因:拟合误差和推理差距。核心思想是:通过线性外推错误的得分函数缓解拟合误差,通过将高斯流转移到反射率感知的残差空间减少推理差距。据此设计了反射率感知轨迹精炼模块(RATR),利用图像的反射率成分对教师轨迹进行精炼。进一步提出面向LLIE的反射率感知扩散与蒸馏轨迹框架(ReDDiT),仅需2步即达到先前冗余步骤方法的性能,8步或4步内实现新的最优结果。在10个基准数据集上的全面实验验证了方法的有效性,持续优于现有SOTA方法。

原文摘要 · Abstract (English)

The computational burden of the iterative sampling process remains a major challenge in diffusion-based Low-Light Image Enhancement (LLIE). Current acceleration methods, whether training-based or training-free, often lead to significant performance degradation, highlighting the trade-off between performance and efficiency. In this paper, we identify two primary factors contributing to performance degradation: fitting errors and the inference gap. Our key insight is that fitting errors can be mitigated by linearly extrapolating the incorrect score functions, while the inference gap can be reduced by shifting the Gaussian flow to a reflectance-aware residual space. Based on the above insights, we design Reflectance-Aware Trajectory Refinement (RATR) module, a simple yet effective module to refine the teacher trajectory using the reflectance component of images. Following this, we introduce \textbf{Re}flectance-aware \textbf{D}iffusion with \textbf{Di}stilled \textbf{T}rajectory (\textbf{ReDDiT}), an efficient and flexible distillation framework tailored for LLIE. Our framework achieves comparable performance to previous diffusion-based methods with redundant steps in just 2 steps while establishing new state-of-the-art (SOTA) results with 8 or 4 steps. Comprehensive experimental evaluations on 10 benchmark datasets validate the effectiveness of our method, consistently outperforming existing SOTA methods.

低光增强扩散模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。