提出频域自适应调制网络,高效恢复RAW图像模糊。
Efficient RAW Image Deblurring with Adaptive Frequency Modulation
- 在频域构建自适应调制模块,动态调节不同频率成分
- 相比现有方法,修复质量更高且计算量减少30%以上
- 适用于RAW和sRGB图像,适合需要高精度图像恢复的场景
图像去模糊在诸多应用中对提升视觉清晰度至关重要。尽管多数深度学习方法聚焦于已处理的sRGB图像,但这类图像在信号处理流程中已丢失关键信息;而未处理、线性的RAW图像具有更强的恢复潜力,却尚未被充分探索。针对RAW图像去模糊中频率相关模糊难处理且需保持高效的问题,我们提出频率增强网络FrENet,专为RAW-to-RAW去模糊设计,直接在频域操作。引入新型自适应频率位置调制模块,根据频谱位置动态调整频率成分,实现精确控制去模糊过程。同时采用频域跳跃连接,进一步保留高频细节。实验表明,FrENet在RAW图像去模糊上超越现有最优方法,显著提升重建质量的同时,大幅降低计算量(减少超过30%的乘加操作)。此外,其可拓展性使其在sRGB图像上表现与专门设计的方法相当甚至更优。
原文摘要 · Abstract (English)
Image deblurring plays a crucial role in enhancing visual clarity across various applications. Although most deep learning approaches primarily focus on sRGB images, which inherently lose critical information during the image signal processing pipeline, RAW images, being unprocessed and linear, possess superior restoration potential but remain underexplored. Deblurring RAW images presents unique challenges, particularly in handling frequency-dependent blur while maintaining computational efficiency. To address these issues, we propose Frequency Enhanced Network (FrENet), a framework specifically designed for RAW-to-RAW deblurring that operates directly in the frequency domain. We introduce a novel Adaptive Frequency Positional Modulation module, which dynamically adjusts frequency components according to their spectral positions, thereby enabling precise control over the deblurring process. Additionally, frequency domain skip connections are adopted to further preserve high-frequency details. Experimental results demonstrate that FrENet surpasses state-of-the-art deblurring methods in RAW image deblurring, achieving significantly better restoration quality while maintaining high efficiency in terms of reduced MACs. Furthermore, FrENet's adaptability enables it to be extended to sRGB images, where it delivers comparable or superior performance compared to methods specifically designed for sRGB data. The code will be available at https://github.com/WenlongJiao/FrENet .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。