用线性注意力与生成先验,提升图像去摩尔纹效果。
MoiréXNet: Adaptive Multi-Scale Demoiréing with Linear Attention Test-Time Training and Truncated Flow Matching Prior
- 结合线性注意力测试时训练与截断流匹配先验,实现自适应多尺度去摩尔纹。
- 在Real-World Demoiréing数据集上,峰值信噪比提升至32.17dB,细节更清晰。
- 适合需要高保真图像恢复的摄影、影视后期等场景使用。
本文提出一种新型图像与视频去摩尔纹框架,融合最大后验(MAP)估计与深度学习技术。摩尔纹属于非线性退化过程,现有方法或无法完全去除,或导致图像过度平滑,主要受限于模型容量与训练数据稀缺,难以准确重建真实图像分布。虽生成模型在处理线性退化时表现优异,但在摩尔纹等非线性任务中常引入伪影。为此,我们设计了一种混合式MAP框架:第一部分为采用高效线性注意力测试时训练(TTT)模块的监督学习模型,直接学习从RAW到sRGB的非线性映射;第二部分为截断流匹配先验(TFMP),通过与干净图像分布对齐,进一步恢复高频细节并抑制伪影。该框架兼具线性注意力的计算效率与生成模型的精修能力,显著提升重建性能。
原文摘要 · Abstract (English)
This paper introduces a novel framework for image and video demoiréing by integrating Maximum A Posteriori (MAP) estimation with advanced deep learning techniques. Demoiréing addresses inherently nonlinear degradation processes, which pose significant challenges for existing methods. Traditional supervised learning approaches either fail to remove moiré patterns completely or produce overly smooth results. This stems from constrained model capacity and scarce training data, which inadequately represent the clean image distribution and hinder accurate reconstruction of ground-truth images. While generative models excel in image restoration for linear degradations, they struggle with nonlinear cases such as demoiréing and often introduce artifacts. To address these limitations, we propose a hybrid MAP-based framework that integrates two complementary components. The first is a supervised learning model enhanced with efficient linear attention Test-Time Training (TTT) modules, which directly learn nonlinear mappings for RAW-to-sRGB demoiréing. The second is a Truncated Flow Matching Prior (TFMP) that further refines the outputs by aligning them with the clean image distribution, effectively restoring high-frequency details and suppressing artifacts. These two components combine the computational efficiency of linear attention with the refinement abilities of generative models, resulting in improved restoration performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。