提出频域增强网络,提升图像去马赛克中高频纹理还原能力。
Frequency Enhancement for Image Demosaicking
- 分路径频域选择,分别处理细节补充与噪声抑制
- 在多个数据集上超越现有方法,尤其在复杂线条场景表现突出
- 新构建的LineSet37数据集专用于评估高频纹理重建性能
图像去马赛克中恢复高频纹理仍是难题。尽管现有方法引入了精细的空间学习机制,仍存在性能局限。为此,本文提出频率增强方法,基于色彩滤波阵列(CFA)、去马赛克结果与真实图像的频域分析,设计双路径频率增强网络(DFENet),通过傅里叶域频率选择实现分治式图像重建。DFENet包含两个频率选择器,分别沿不同路径处理:一路在空间域进行细节精修以补全缺失信息,另一路在频域利用CFA图像指导抑制不期望的频率成分。采用多层级频率监督与分阶段训练策略进一步提升重建效果。实验表明,该方法在多个数据集上优于当前最优算法,尤其在困难样本上优势显著。此外,为更精准评估高频纹理重建能力,本文构建了新数据集LineSet37,包含37张人工生成的复杂线条图像,易产生颜色莫尔等视觉伪影。在LineSet37上的实验提供了对挑战性场景的针对性评估。代码与数据集已公开于https://github.com/VelvetReverie/DFENet-demosaicking。
原文摘要 · Abstract (English)
Recovering high-frequency textures in image demosaicking remains a challenging issue. While existing methods introduced elaborate spatial learning methods, they still exhibit limited performance. To address this issue, a frequency enhancement approach is proposed. Based on the frequency analysis of color filter array (CFA)/demosaicked/ground truth images, we propose Dual-path Frequency Enhancement Network (DFENet), which reconstructs RGB images in a divide-and-conquer manner through fourier-domain frequency selection. In DFENet, two frequency selectors are employed, each selecting a set of frequency components for processing along separate paths. One path focuses on generating missing information through detail refinement in spatial domain, while the other aims at suppressing undesirable frequencies with the guidance of CFA images in frequency domain. Multi-level frequency supervision with a stagewise training strategy is employed to further improve the reconstruction performance. With these designs, the proposed DFENet outperforms other state-of-the-art algorithms on different datasets and demonstrates significant advantages on hard cases. Moreover, to better assess algorithms' ability to reconstruct high-frequency textures, a new dataset, LineSet37, is contributed, which consists of 37 artificially designed and generated images. These images feature complex line patterns and are prone to severe visual artifacts like color moiré after demosaicking. Experiments on LineSet37 offer a more targeted evaluation of performance on challenging cases. The code and dataset are available at https://github.com/VelvetReverie/DFENet-demosaicking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。