arXiv:2503.01565cs.CVeess.IV2025-03CVPR被引 10

用自适应采样和残差学习提升查表式超分辨率效果

AutoLUT: LUT-Based Image Super-Resolution with Automatic Sampling and Adaptive Residual Learning

  • 引入自动采样机制,动态学习像素权重以扩大感受野
  • 在保持存储量相近前提下,平均提升0.20 dB PSNR
  • 适合边缘设备部署,兼顾速度与细节重建能力

近年来,高DPI屏幕的普及推动了对高分辨率图像的需求。然而,边缘设备有限的算力制约了复杂超分辨率神经网络的部署,亟需高效方法。现有工作虽有进展,但未充分挖掘像素级信息,且依赖固定采样模式,影响精度与细节捕捉。为此,我们提出两个即插即用模块:自动采样(AutoSample),通过训练中自学习采样权重,灵活适应像素变化并扩大感受野,无额外推理开销;自适应残差学习(AdaRL),增强层间连接,促进细节信息流动,提升细节重建能力。在MuLUT和SPF-LUT上均取得显著性能提升,且存储量相近。在五个数据集上,MuLUT平均提升约+0.20 dB PSNR;SPF-LUT在存储空间减少50%以上、推理时间减少约2/3的前提下,性能仍可媲美原模型。代码已开源。

原文摘要 · Abstract (English)

In recent years, the increasing popularity of Hi-DPI screens has driven a rising demand for high-resolution images. However, the limited computational power of edge devices poses a challenge in deploying complex super-resolution neural networks, highlighting the need for efficient methods. While prior works have made significant progress, they have not fully exploited pixel-level information. Moreover, their reliance on fixed sampling patterns limits both accuracy and the ability to capture fine details in low-resolution images. To address these challenges, we introduce two plug-and-play modules designed to capture and leverage pixel information effectively in Look-Up Table (LUT) based super-resolution networks. Our method introduces Automatic Sampling (AutoSample), a flexible LUT sampling approach where sampling weights are automatically learned during training to adapt to pixel variations and expand the receptive field without added inference cost. We also incorporate Adaptive Residual Learning (AdaRL) to enhance inter-layer connections, enabling detailed information flow and improving the network's ability to reconstruct fine details. Our method achieves significant performance improvements on both MuLUT and SPF-LUT while maintaining similar storage sizes. Specifically, for MuLUT, we achieve a PSNR improvement of approximately +0.20 dB improvement on average across five datasets. For SPF-LUT, with more than a 50% reduction in storage space and about a 2/3 reduction in inference time, our method still maintains performance comparable to the original. The code is available at https://github.com/SuperKenVery/AutoLUT.

超分辨率查表法边缘计算自适应学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。