D2Net无需降采样或分块,直接恢复超高清图像。
Dropout the High-rate Downsampling: A Novel Design Paradigm for UHD Image Restoration
- 利用频域特性建模长程依赖,结合多尺度卷积捕捉局部细节。
- 在低光增强、去雾、去模糊任务上均优于现有方法。
- 适合需要高保真图像恢复的移动端应用。
随着高端移动设备普及,超高清(UHD)图像已无处不在。由于像素数量庞大,其修复面临巨大挑战,常导致处理过程内存溢出。现有方法要么对UHD图像进行高率降采样,要么分块处理,但前者造成显著信息丢失,后者引入边界伪影。本文提出新型设计范式D2Net,实现对UHD图像的全分辨率直接推理,无需高率降采样或分块。通过频域特性建立特征长程依赖,设计多尺度卷积组捕获UHD图像中更丰富的局部模式。解码阶段动态融合编码阶段特征,减少无关信息传播。在低光增强、去雾、去模糊三个UHD图像修复任务上的实验表明,D2Net在定量与定性指标上均优于当前最优方法。
原文摘要 · Abstract (English)
With the popularization of high-end mobile devices, Ultra-high-definition (UHD) images have become ubiquitous in our lives. The restoration of UHD images is a highly challenging problem due to the exaggerated pixel count, which often leads to memory overflow during processing. Existing methods either downsample UHD images at a high rate before processing or split them into multiple patches for separate processing. However, high-rate downsampling leads to significant information loss, while patch-based approaches inevitably introduce boundary artifacts. In this paper, we propose a novel design paradigm to solve the UHD image restoration problem, called D2Net. D2Net enables direct full-resolution inference on UHD images without the need for high-rate downsampling or dividing the images into several patches. Specifically, we ingeniously utilize the characteristics of the frequency domain to establish long-range dependencies of features. Taking into account the richer local patterns in UHD images, we also design a multi-scale convolutional group to capture local features. Additionally, during the decoding stage, we dynamically incorporate features from the encoding stage to reduce the flow of irrelevant information. Extensive experiments on three UHD image restoration tasks, including low-light image enhancement, image dehazing, and image deblurring, show that our model achieves better quantitative and qualitative results than state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。