用生成模型自动生成高质量去摩尔数据,提升复杂摩尔纹去除效果。
Improving Complex Moiré Removal with Generative Supervision

- 通过生成模型合成候选参考图,构建真实场景下的摩尔纹训练对。
- 建立6.8K对训练数据的WildMoiré数据集,含250对真实干净图像测试集。
- 适用于需要高精度去摩尔纹的图像修复、显示成像与视觉质量提升场景。
高质量成对数据对基于学习的去摩尔纹模型训练至关重要。然而,现有数据集难以覆盖真实世界中无控制条件下产生的复杂摩尔纹,这类退化常表现为大尺度、多色摩尔纹。且这些图像(如公共显示屏拍摄的照片)往往缺乏清晰的干净版本。为此,本文提出一种新型数据引擎,通过生成式监督提升复杂摩尔纹去除能力。首先收集含复杂摩尔纹的真实图像并定位屏幕区域;随后部署多个图像条件生成基础模型生成候选参考图;通过局部块级质量控制筛选最优结果,建立可靠监督。基于此方法,构建了包含6.8K对训练样本的WildMoiré数据集,并额外构建约250对带真实干净真值的独立测试集。在ESDNet、SDXL和Qwen-Image-Edit上的实验表明,所提生成监督可持续提升复杂摩尔纹去除性能。
原文摘要 · Abstract (English)
The availability of high-quality paired data is essential for training learning-based image demoiréing models. However, it remains challenging for existing datasets to encompass the complex moiré patterns captured in uncontrolled real-world scenarios. Such degradations typically manifest as large-scale, multicolored moiré patterns. Moreover, these patterns frequently occur in images for which clean counterparts are difficult to obtain, such as photographs acquired from public displays or existing online resources. In this work, we propose a novel data engine designed to improve the removal of complex moiré patterns by generating training supervision. Specifically, we initially collect real-world images containing complex moiré patterns and localize the corresponding screen regions. Multiple image-conditioned generative foundation models are subsequently deployed to produce candidate references. To establish reliable supervision, these candidates are subjected to patch-level quality control to filter and select the optimal results. Based on this systematic paradigm, we construct the WildMoiré dataset, which contains 6.8K moiré-GT training pairs. For evaluation, we additionally build an independent test set comprising $\sim$250 pairs with captured clean ground truth. Extensive experiments on ESDNet, SDXL, and Qwen-Image-Edit demonstrate that the proposed generative supervision consistently improves the performance of complex moiré removal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。