提升极暗图像细节恢复,保留纹理与边缘,适用于文本和边缘检测等下游任务。
Beyond Illumination: Fine-Grained Detail Preservation in Extreme Dark Image Restoration
- 分两阶段:频域全局光照恢复 + 局部纹理精细优化
- 在多个数据集上显著提升细节恢复能力,保持轻量高效
- 适合需要高精度细节恢复的视觉任务,如工业检测、医学成像
极暗图像中精细细节的恢复因结构信息严重丢失和噪声干扰而困难重重。现有增强方法常无法保留复杂细节与锐利边缘,限制了其在文本检测、边缘识别等下游任务中的应用。为此,我们提出一种高效的双阶段方法,聚焦于暗图细节恢复。第一阶段引入残差傅里叶引导模块(RFGM),在频域中有效恢复全局光照;RFGM通过残差连接捕捉跨阶段与跨通道依赖,为高频处理提供稳健先验,降低不可靠先验导致的误差累积风险。第二阶段采用互补的Mamba模块进行纹理结构精修:(1) 块级Mamba对未下采样的通道拼接块建模,精确刻画像素级相关性,无分辨率损失地增强细粒度细节;(2) 梯度级Mamba专注高梯度区域,缓解状态空间模型的状态衰减问题,优先重建锐利边缘与边界。在多个基准数据集及下游应用上的大量实验表明,该方法显著提升细节恢复性能,同时保持高效性。关键模块轻量化,可无缝集成至现有基于傅里叶的框架,计算开销极低。代码已公开于https://github.com/bywlzts/RFGM。
原文摘要 · Abstract (English)
Recovering fine-grained details in extremely dark images remains challenging due to severe structural information loss and noise corruption. Existing enhancement methods often fail to preserve intricate details and sharp edges, limiting their effectiveness in downstream applications like text and edge detection. To address these deficiencies, we propose an efficient dual-stage approach centered on detail recovery for dark images. In the first stage, we introduce a Residual Fourier-Guided Module (RFGM) that effectively restores global illumination in the frequency domain. RFGM captures inter-stage and inter-channel dependencies through residual connections, providing robust priors for high-fidelity frequency processing while mitigating error accumulation risks from unreliable priors. The second stage employs complementary Mamba modules specifically designed for textural structure refinement: (1) Patch Mamba operates on channel-concatenated non-downsampled patches, meticulously modeling pixel-level correlations to enhance fine-grained details without resolution loss. (2) Grad Mamba explicitly focuses on high-gradient regions, alleviating state decay in state space models and prioritizing reconstruction of sharp edges and boundaries. Extensive experiments on multiple benchmark datasets and downstream applications demonstrate that our method significantly improves detail recovery performance while maintaining efficiency. Crucially, the proposed modules are lightweight and can be seamlessly integrated into existing Fourier-based frameworks with minimal computational overhead. Code is available at https://github.com/bywlzts/RFGM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。