轻量级框架实现超高清图像修复,性能领先且资源消耗低
UHDRes: Ultra-High-Definition Image Restoration via Dual-Domain Decoupled Spectral Modulation
- 分域解耦谱调制:频域显式增强幅度,空间域隐式恢复相位
- 仅400K参数即达顶尖效果,推理延迟和内存占用显著降低
- 适合需要高效处理超高清图像的实时应用开发者
超高清(UHD)图像常受模糊、雾霾、雨痕或低光等退化影响,因其高分辨率与计算需求,修复难度大。本文提出UHDRes,一种轻量级双域解耦谱调制框架,用于UHD图像修复。该方法在频域显式建模振幅谱,通过轻量级谱域调制增强;在空间域隐式重构相位信息,结合多尺度上下文聚合提取局部与全局特征,并采用解耦方式实现频域调制与空间精修。此外,设计共享门控前馈网络,利用共享参数卷积与自适应门控机制高效促进特征交互。在五个公开的UHD基准数据集上广泛实验表明,UHDRes仅需400K参数即可达到当前最优修复性能,同时大幅降低推理延迟与内存使用。代码与模型已开源于https://github.com/Zhao0100/UHDRes。
原文摘要 · Abstract (English)
Ultra-high-definition (UHD) images often suffer from severe degradations such as blur, haze, rain, or low-light conditions, which pose significant challenges for image restoration due to their high resolution and computational demands. In this paper, we propose UHDRes, a novel lightweight dual-domain decoupled spectral modulation framework for UHD image restoration. It explicitly models the amplitude spectrum via lightweight spectrum-domain modulation, while restoring phase implicitly through spatial-domain refinement. We introduce the spatio-spectral fusion mechanism, which first employs a multi-scale context aggregator to extract local and global spatial features, and then performs spectral modulation in a decoupled manner. It explicitly enhances amplitude features in the frequency domain while implicitly restoring phase information through spatial refinement. Additionally, a shared gated feed-forward network is designed to efficiently promote feature interaction through shared-parameter convolutions and adaptive gating mechanisms. Extensive experimental comparisons on five public UHD benchmarks demonstrate that our UHDRes achieves the state-of-the-art restoration performance with only 400K parameters, while significantly reducing inference latency and memory usage. The codes and models are available at https://github.com/Zhao0100/UHDRes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。