用小波递归重建实现任意比例RAW图像下采样,保持细节清晰。
Learning Arbitrary-Scale RAW Image Downscaling with Wavelet-based Recurrent Reconstruction
- 基于小波变换的递归框架,分步保留高低频信息。
- 在1.3×等非整数比例下优于现有方法,视觉与指标双提升。
- 适合需要高保真图像压缩的摄影、遥感领域应用。
图像下采样对高效存储和传输高分辨率图像至关重要。现有学习方法多聚焦sRGB域下采样,常导致细节模糊和异常伪影。RAW图像包含未经处理的光子信息,更具灵活性,但缺乏专用下采样框架。本文提出一种基于小波的递归重建框架,利用小波变换无损特性,以粗到精方式实现任意比例的RAW图像下采样。设计了低频任意尺度下采样模块(LASDM)和高频预测模块(HFPM),分别保护结构与纹理完整性,并引入能量最大化损失,使高频率能量在高/低分辨率域间对齐。此外,构建了真实非整数下采样数据集Real-NIRD(下采样因子1.3×),并结合公开的整数因子数据集(2×、3×、4×)进行综合评估。大量实验表明,该方法在量化指标与视觉效果上均超越当前最优方法。代码与数据集将开源于https://github.com/RenYangSCU/ASRD。
原文摘要 · Abstract (English)
Image downscaling is critical for efficient storage and transmission of high-resolution (HR) images. Existing learning-based methods focus on performing downscaling within the sRGB domain, which typically suffers from blurred details and unexpected artifacts. RAW images, with their unprocessed photonic information, offer greater flexibility but lack specialized downscaling frameworks. In this paper, we propose a wavelet-based recurrent reconstruction framework that leverages the information lossless attribute of wavelet transformation to fulfill the arbitrary-scale RAW image downscaling in a coarse-to-fine manner, in which the Low-Frequency Arbitrary-Scale Downscaling Module (LASDM) and the High-Frequency Prediction Module (HFPM) are proposed to preserve structural and textural integrity of the reconstructed low-resolution (LR) RAW images, alongside an energy-maximization loss to align high-frequency energy between HR and LR domain. Furthermore, we introduce the Realistic Non-Integer RAW Downscaling (Real-NIRD) dataset, featuring a non-integer downscaling factor of 1.3$\times$, and incorporate it with publicly available datasets with integer factors (2$\times$, 3$\times$, 4$\times$) for comprehensive benchmarking arbitrary-scale image downscaling purposes. Extensive experiments demonstrate that our method outperforms existing state-of-the-art competitors both quantitatively and visually. The code and dataset will be released at https://github.com/RenYangSCU/ASRD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。