用插值混合查表法实现任意尺度图像超分,速度快且效果好。
IM-LUT: Interpolation Mixing Look-Up Tables for Image Super-Resolution
- 通过学习插值函数混合权重,支持任意缩放比例。
- 在多个数据集上兼顾高质量与低延迟,优于现有方法。
- 适合移动端或低算力设备部署,推理高效。
图像超分辨率(SR)是图像处理中的关键任务,旨在提升图像分辨率。近年来,基于查找表(LUT)的方法因其高效性受到关注,但通常仅针对固定缩放因子设计,难以用于任意尺度图像超分辨率(ASISR)。现有ASISR技术多采用隐式神经表示,计算开销大、内存占用高。为此,本文提出插值混合查找表(IM-LUT)框架,通过学习融合多个插值函数以最大化表达能力。具体地,引入IM-Net网络,根据局部图像特征和目标缩放因子预测插值函数的混合权重。为提升效率,将IM-Net转化为IM-LUT,使用查找表替代高开销运算,在保持重建质量的同时实现轻量级、快速的CPU推理。在多个基准数据集上的实验表明,IM-LUT在图像质量与效率之间实现了更优平衡,展现出在资源受限场景下的应用潜力。
原文摘要 · Abstract (English)
Super-resolution (SR) has been a pivotal task in image processing, aimed at enhancing image resolution across various applications. Recently, look-up table (LUT)-based approaches have attracted interest due to their efficiency and performance. However, these methods are typically designed for fixed scale factors, making them unsuitable for arbitrary-scale image SR (ASISR). Existing ASISR techniques often employ implicit neural representations, which come with considerable computational cost and memory demands. To address these limitations, we propose Interpolation Mixing LUT (IM-LUT), a novel framework that operates ASISR by learning to blend multiple interpolation functions to maximize their representational capacity. Specifically, we introduce IM-Net, a network trained to predict mixing weights for interpolation functions based on local image patterns and the target scale factor. To enhance efficiency of interpolation-based methods, IM-Net is transformed into IM-LUT, where LUTs are employed to replace computationally expensive operations, enabling lightweight and fast inference on CPUs while preserving reconstruction quality. Experimental results on several benchmark datasets demonstrate that IM-LUT consistently achieves a superior balance between image quality and efficiency compared to existing methods, highlighting its potential as a promising solution for resource-constrained applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。