双向引导融合提升暗光图像增强,有效抑制闪烁与结构断裂。
Bidirectional Image-Event Guided Fusion Framework for Low-Light Image Enhancement
- 通过双向注意力机制实现图像与事件数据的互补增强。
- 在RELIE数据集上比当前最优方法提升0.81dB PSNR,边缘恢复更优。
- 构建高质量低光图像-事件数据集,提升真实感与色彩保真度。
极端暗光条件下,帧式相机因动态范围有限导致细节严重丢失。近年研究引入事件相机进行事件引导的暗光图像增强,但现有方法常忽略动态光照变化引发的闪烁伪影和事件稀疏性导致的结构断裂。为此,本文提出BiLIE——一种双向图像-事件引导融合框架,实现双模态间的相互引导与互补增强。首先,设计动态自适应滤波增强(DAFE)模块,对事件表示进行自适应高通滤波,抑制光照变化下的闪烁伪影并保留高频信息。其次,提出双向引导感知融合(BGAF)机制,通过两阶段注意力实现从图像到事件的断点感知恢复、从事件到图像的结构感知增强,建立跨模态一致性,生成清晰、平滑且结构完整的融合表示。此外,针对现有数据集真实值保真度与色彩准确性不足的问题,构建了高质量低光图像-事件数据集RELIE,采用可靠的真实值优化方案。大量实验表明,本方法在RELIE和LIE数据集上均优于现有方法。尤其在RELIE上,相比最先进方法提升0.81dB PSNR,显著改善边缘还原、色彩保真与噪声抑制效果。
原文摘要 · Abstract (English)
Under extreme low-light conditions, frame-based cameras suffer from severe detail loss due to limited dynamic range. Recent studies have introduced event cameras for event-guided low-light image enhancement. However, existing approaches often overlook the flickering artifacts and structural discontinuities caused by dynamic illumination changes and event sparsity. To address these challenges, we propose BiLIE, a Bidirectional image-event guided fusion framework for Low-Light Image Enhancement, which achieves mutual guidance and complementary enhancement between the two modalities. First, to highlight edge details, we develop a Dynamic Adaptive Filtering Enhancement (DAFE) module that performs adaptive high-pass filtering on event representations to suppress flickering artifacts and preserve high-frequency information under varying illumination. Subsequently, we design a Bidirectional Guided Awareness Fusion (BGAF) mechanism, which achieves breakpoint-aware restoration from images to events and structure-aware enhancement from events to images through a two-stage attention mechanism, establishing cross-modal consistency, thereby producing a clear, smooth, and structurally intact fused representation. Moreover, recognizing that existing datasets exhibit insufficient ground-truth fidelity and color accuracy, we construct a high-quality low-light image-event dataset (RELIE) via a reliable ground truth refinement scheme. Extensive experiments demonstrate that our method outperforms existing approaches on both the RELIE and LIE datasets. Notably, on RELIE, BiLIE exceeds the state-of-the-art by 0.81dB in PSNR and shows significant advantages in edge restoration, color fidelity, and noise suppression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。