arXiv:2508.00308cs.CV2025-08中稿 · ACM MM 2025被引 6

用傅里叶先验与事件协同提升暗光图像质量

Exploring Fourier Prior and Event Collaboration for Low-Light Image Enhancement

  • 分两阶段处理:先恢复可见性,再精修结构
  • 傅里叶域相位幅度耦合设计,增强低光细节
  • 动态对齐融合事件与图像,适合高动态场景

事件相机凭借高动态范围和低延迟,在暗光图像增强中表现优异。与帧相机不同,它以极高时间分辨率记录亮度变化,捕捉丰富结构信息。现有方法将帧与事件直接输入单一模型,未充分挖掘模态优势,限制性能。为此,通过分析各传感模态作用,将增强流程解耦为两阶段:可见性恢复与结构精修。第一阶段设计基于傅里叶空间幅度-相位耦合的可见性恢复网络;第二阶段提出动态对齐融合策略,缓解因时间分辨率差异导致的空间错位问题,以优化图像结构。此外,采用空频插值生成多样光照、噪声与伪影退化样本,构建对比损失,促使模型学习判别性表征。实验表明,该方法优于当前最优模型。

原文摘要 · Abstract (English)

The event camera, benefiting from its high dynamic range and low latency, provides performance gain for low-light image enhancement. Unlike frame-based cameras, it records intensity changes with extremely high temporal resolution, capturing sufficient structure information. Currently, existing event-based methods feed a frame and events directly into a single model without fully exploiting modality-specific advantages, which limits their performance. Therefore, by analyzing the role of each sensing modality, the enhancement pipeline is decoupled into two stages: visibility restoration and structure refinement. In the first stage, we design a visibility restoration network with amplitude-phase entanglement by rethinking the relationship between amplitude and phase components in Fourier space. In the second stage, a fusion strategy with dynamic alignment is proposed to mitigate the spatial mismatch caused by the temporal resolution discrepancy between two sensing modalities, aiming to refine the structure information of the image enhanced by the visibility restoration network. In addition, we utilize spatial-frequency interpolation to simulate negative samples with diverse illumination, noise and artifact degradations, thereby developing a contrastive loss that encourages the model to learn discriminative representations. Experiments demonstrate that the proposed method outperforms state-of-the-art models.

暗光增强事件相机傅里叶先验多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。