arXiv:2505.19120cs.CV2025-05中稿 · ECCV

用可学习频域分解提升去摩尔纹图像质量

Freqformer: Image-Demoiréing Transformer via Effective Frequency Decomposition

  • 通过可学习频域分解将摩尔纹分为高频纹理与低频色偏
  • 在多个数据集上实现当前最优性能,模型体积小
  • 适合需要高保真去摩尔纹的相机/图像处理场景

图像去摩尔纹因纹理退化与色彩失真交织而极具挑战。现有基于图像直接恢复的方法难以有效解耦这些混杂伪影。虽有频域感知方法前景可观,但其依赖离散变换(如哈尔小波或块状DCT)存在空间不连续、通道冗余问题,且固定逆过程易导致误差累积。本文提出Freqformer,一种专为去摩尔纹设计的Transformer框架,通过有效频率分解将摩尔纹分离为高频局部纹理与低频尺度鲁棒的色彩失真,并由双分支结构与非对称训练策略分别处理。进一步提出可学习的频域融合模块(FCT),自适应组合频段输出,实现一致高保真重建。为高效聚合空间依赖与跨通道互补信息,引入空间感知通道注意力(SA-CA),精准优化摩尔纹敏感区域,计算开销低。在多个去摩尔纹基准测试中,Freqformer以紧凑模型规模达到最先进性能。

原文摘要 · Abstract (English)

Image demoiréing remains a challenging task due to the complex interplay between texture corruption and color distortions caused by moiré patterns. Existing methods, especially those relying on direct image-to-image restoration, often fail to disentangle these intertwined artifacts effectively. While frequency-aware approaches offer a promising direction, their potential is hindered by the discrete transform (e.g., Haar wavelet or block-based DCT), which may suffer from spatial discontinuity, channel redundancy, and further cause error accumulation during their fixed inverse processes. In this paper, we present Freqformer, a Transformer-based framework specifically designed for image demoiréing through targeted frequency separation. Our method performs an effective frequency decomposition that splits moiré patterns into high-frequency spatially-localized textures and low-frequency scale-robust color distortions, which are then handled by a dual-branch architecture and an asymmetric training scheme tailored to their distinct characteristics. We further propose a learnable Frequency Composition Transform (FCT) module to adaptively fuse the frequency-specific outputs, enabling consistent and high-fidelity reconstruction. To better aggregate the spatial dependencies and the inter-channel complementary information, we introduce a Spatial-Aware Channel Attention (SA-CA) module that refines moiré-sensitive regions without incurring high computational cost. Extensive experiments on various demoiréing benchmarks demonstrate that Freqformer achieves state-of-the-art performance with a compact model size. The code will be made publicly available at https://github.com/xyLiu339/Freqformer.

图像修复Transformer频域分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。