arXiv:2504.12245cs.CVeess.IV2025-04

自监督模型通过掩码重建,精准去除图像摩尔纹。

SIDME: Self-supervised Image Demoiréing via Masked Encoder-Decoder Reconstruction

  • 用掩码编码解码结构,利用采样频率特性重建图像。
  • 在真实数据上优于现有方法,泛化能力强。
  • 专为绿通道高采样率设计,提升训练效率。

摩尔纹由物体光信号与相机采样频率间的混叠引起,常导致图像质量下降。传统去摩尔纹方法通常将图像整体处理,忽略了不同颜色通道的信号特性差异。此外,摩尔纹生成的随机性与多样性给现有方法在真实场景下的鲁棒性带来挑战。为此,本文提出SIDME(基于掩码编码解码重建的自监督图像去摩尔纹)模型,通过结合掩码编码解码架构与自监督学习,有效利用相机采样频率的内在特性进行图像重建。关键创新在于引入随机掩码图像重建器,采用编码解码结构完成重建任务。由于相机采样中绿通道采样频率高于红蓝通道,因此设计了专用自监督损失函数以提升训练效率与效果。为增强模型泛化能力,构建了一种自监督摩尔纹图像生成方法,生成接近真实条件的数据集。大量实验证明,SIDME在处理真实摩尔纹数据时表现优于现有方法,展现出更强的泛化性能与鲁棒性。

原文摘要 · Abstract (English)

Moiré patterns, resulting from aliasing between object light signals and camera sampling frequencies, often degrade image quality during capture. Traditional demoiréing methods have generally treated images as a whole for processing and training, neglecting the unique signal characteristics of different color channels. Moreover, the randomness and variability of moiré pattern generation pose challenges to the robustness of existing methods when applied to real-world data. To address these issues, this paper presents SIDME (Self-supervised Image Demoiréing via Masked Encoder-Decoder Reconstruction), a novel model designed to generate high-quality visual images by effectively processing moiré patterns. SIDME combines a masked encoder-decoder architecture with self-supervised learning, allowing the model to reconstruct images using the inherent properties of camera sampling frequencies. A key innovation is the random masked image reconstructor, which utilizes an encoder-decoder structure to handle the reconstruction task. Furthermore, since the green channel in camera sampling has a higher sampling frequency compared to red and blue channels, a specialized self-supervised loss function is designed to improve the training efficiency and effectiveness. To ensure the generalization ability of the model, a self-supervised moiré image generation method has been developed to produce a dataset that closely mimics real-world conditions. Extensive experiments demonstrate that SIDME outperforms existing methods in processing real moiré pattern data, showing its superior generalization performance and robustness.

去摩尔纹自监督图像修复编码解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。