arXiv:2504.15756cs.CVeess.IV2025-04被引 3

单阶段去摩尔纹网络,兼顾画质与速度

DSDNet: Raw Domain Demoiréing via Dual Color-Space Synergy

论文配图:DSDNet: Raw Domain Demoiréing via Dual Color-Space Synergy
图 1 · 摘自论文原文
  • 融合原始数据与YCbCr色彩空间,协同去摩尔纹
  • 比顶尖方法快2.4倍,视觉质量更优
  • 适合手机拍屏幕的场景,尤其直播录课

随着移动成像技术发展,用手机拍摄显示屏已成为远程教学和会议录制的常见做法。然而,显示屏幕与相机传感器间的频率混叠会引发摩尔纹,且图像信号处理流程会进一步放大该问题,造成严重视觉失真。现有sRGB域去摩尔纹方法因信息不可逆丢失而受限,近期两阶段原始域方法则存在信息瓶颈和推理效率低的问题。为此,我们提出单阶段原始域去摩尔纹框架DSDNet,通过融合原始数据与YCbCr图像,实现摩尔纹去除同时保持亮度与色彩保真度。具体地,设计了从原始数据到YCbCr的映射流程,并引入具有动态调制的协同注意力模块(SADM),增强原始到sRGB转换中的跨域上下文特征;此外,构建亮度-色度自适应变压器(LCAT),解耦亮度与色度表示以更好指导色彩保真。大量实验表明,DSDNet在视觉质量和定量指标上均优于当前最优方法,且推理速度比第二优方法快2.4倍,凸显其实际优势。在线演示地址:https://xxxxxxxxdsdnet.github.io/DSDNet/

原文摘要 · Abstract (English)

With the rapid advancement of mobile imaging, capturing screens using smartphones has become a prevalent practice in distance learning and conference recording. However, moiré artifacts, caused by frequency aliasing between display screens and camera sensors, are further amplified by the image signal processing pipeline, leading to severe visual degradation. Existing sRGB domain demoiréing methods struggle with irreversible information loss, while recent two-stage raw domain approaches suffer from information bottlenecks and inference inefficiency. To address these limitations, we propose a single-stage raw domain demoiréing framework, Dual-Stream Demoiréing Network (DSDNet), which leverages the synergy of raw and YCbCr images to remove moiré while preserving luminance and color fidelity. Specifically, to guide luminance correction and moiré removal, we design a raw-to-YCbCr mapping pipeline and introduce the Synergic Attention with Dynamic Modulation (SADM) module. This module enriches the raw-to-sRGB conversion with cross-domain contextual features. Furthermore, to better guide color fidelity, we develop a Luminance-Chrominance Adaptive Transformer (LCAT), which decouples luminance and chrominance representations. Extensive experiments demonstrate that DSDNet outperforms state-of-the-art methods in both visual quality and quantitative evaluation and achieves an inference speed $\mathrm{\textbf{2.4x}}$ faster than the second-best method, highlighting its practical advantages. We provide an anonymous online demo at https://xxxxxxxxdsdnet.github.io/DSDNet/.

去摩尔纹图像修复移动端成像多域协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。