arXiv:2507.13663cs.CV2025-07被引 4

用小模型实现高效图像修复,兼顾速度与质量。

Global Modeling Matters: A Fast, Lightweight and Effective Baseline for Efficient Image Restoration

  • 分层设计:金字塔波浪-傅里叶结构分解多尺度频域信息
  • 比现有方法少70%参数,推理快2倍以上,修复效果更优
  • 适合移动端或实时系统部署,尤其对雨天/雾霾/低光图像有效

自然图像常因恶劣天气退化,严重影响下游任务。图像修复成为核心解决方案,近年基于Transformer的方法虽进展显著,但系统复杂度高,难以满足实时部署需求。现有方法多简化自注意力机制,却忽视图像修复的本质特征。本文提出金字塔波浪-傅里叶网络(PW-FNet),通过双层设计:1)块间采用金字塔波浪结构实现多尺度、多频带分解;2)块内以傅里叶变换替代自注意力,显著降低计算量并保留全局建模能力。在去雨、去雨滴、超分辨率、运动模糊去除、去雾、去雪、水下/低光增强等任务上,PW-FNet不仅性能超越现有方法,且参数量减少70%,计算成本与推理时间大幅下降。

原文摘要 · Abstract (English)

Natural image quality is often degraded by adverse weather conditions, significantly impairing the performance of downstream tasks. Image restoration has emerged as a core solution to this challenge and has been widely discussed in the literature. Although recent transformer-based approaches have made remarkable progress in image restoration, their increasing system complexity poses significant challenges for real-time processing, particularly in real-world deployment scenarios. To this end, most existing methods attempt to simplify the self-attention mechanism, such as by channel self-attention or state space model. However, these methods primarily focus on network architecture while neglecting the inherent characteristics of image restoration itself. In this context, we explore a pyramid Wavelet-Fourier iterative pipeline to demonstrate the potential of Wavelet-Fourier processing for image restoration. Inspired by the above findings, we propose a novel and efficient restoration baseline, named Pyramid Wavelet-Fourier Network (PW-FNet). Specifically, PW-FNet features two key design principles: 1) at the inter-block level, integrates a pyramid wavelet-based multi-input multi-output structure to achieve multi-scale and multi-frequency bands decomposition; and 2) at the intra-block level, incorporates Fourier transforms as an efficient alternative to self-attention mechanisms, effectively reducing computational complexity while preserving global modeling capability. Extensive experiments on tasks such as image deraining, raindrop removal, image super-resolution, motion deblurring, image dehazing, image desnowing and underwater/low-light enhancement demonstrate that PW-FNet not only surpasses state-of-the-art methods in restoration quality but also achieves superior efficiency, with significantly reduced parameter size, computational cost and inference time.

图像修复轻量化模型频域处理实时部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。