提出高效网络MZNet,精准去除各类摩尔纹。
Moiré Zero: An Efficient and High-Performance Neural Architecture for Moiré Removal

- 设计U型结构+三模块,捕捉多尺度、多方向摩尔纹特征
- 在高分辨率数据集上达顶尖性能,计算开销低
- 适合摄影、工业检测等真实场景应用
摩尔纹由精细重复结构与相机传感器采样过程中的频率混叠引起,是消费摄影和工业缺陷检测等实际应用中的重大难题。尽管深度学习发展带来了众多基于卷积神经网络的解决方案,但现有方法仍难以有效消除因摩尔纹尺度、方向和色偏多样而产生的伪影,主要受限于CNN受限的感受野无法捕捉复杂特征。本文提出MZNet,一种U型网络,旨在将图像推向‘摩尔零’状态,通过集成三个专用模块:多尺度双注意力块(MSDAB)用于提取和优化多尺度特征,多形状大卷积核块(MSLKB)用于捕获多样摩尔纹结构,基于特征融合的跳跃连接增强信息流动。三者协同提升局部纹理恢复与大范围伪影抑制能力。在基准数据集上的实验表明,MZNet在高分辨率数据集上达到当前最优性能,并在低分辨率数据集上保持竞争力,同时计算成本低,展现出高效且实用的潜力。
原文摘要 · Abstract (English)
Moiré patterns, caused by frequency aliasing between fine repetitive structures and a camera sensor's sampling process, have been a significant obstacle in various real-world applications, such as consumer photography and industrial defect inspection. With the advancements in deep learning algorithms, numerous studies-predominantly based on convolutional neural networks-have suggested various solutions to address this issue. Despite these efforts, existing approaches still struggle to effectively eliminate artifacts due to the diverse scales, orientations, and color shifts of moiré patterns, primarily because the constrained receptive field of CNN-based architectures limits their ability to capture the complex characteristics of moiré patterns. In this paper, we propose MZNet, a U-shaped network designed to bring images closer to a 'Moire-Zero' state by effectively removing moiré patterns. It integrates three specialized components: Multi-Scale Dual Attention Block (MSDAB) for extracting and refining multi-scale features, Multi-Shape Large Kernel Convolution Block (MSLKB) for capturing diverse moiré structures, and Feature Fusion-Based Skip Connection for enhancing information flow. Together, these components enhance local texture restoration and large-scale artifact suppression. Experiments on benchmark datasets demonstrate that MZNet achieves state-of-the-art performance on high-resolution datasets and delivers competitive results on lower-resolution dataset, while maintaining a low computational cost, suggesting that it is an efficient and practical solution for real-world applications. Project page: https://sngryonglee.github.io/MoireZero
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。