arXiv:2412.03748cs.CV2024-12CVPR被引 28

提出分层编码的隐式图像函数,提升连续超分辨率细节表现

HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolution

  • 用分层位置编码增强局部隐式表征,捕捉多尺度细节
  • 在多种主干网络上实现最高0.17dB的PSNR提升
  • 适合追求高精度连续超分的视觉重建研究者

基于隐式神经表示(INRs)的图像超分辨率方法虽能生成任意尺度的高清图像,但现有方法多采用全连接网络参数化,忽略了采样点间的层级结构,限制了表征能力。本文提出一种新的分层编码隐式图像函数(HIIF),引入新型分层位置编码以增强局部隐式表示,从而在多尺度下捕捉更精细的细节。同时,在隐式注意力网络中嵌入多头线性注意力机制,融合非局部信息。实验表明,无论搭配何种主干编码器,HIIF 在连续图像超分辨率任务中均优于当前最优方法,最高可提升0.17dB PSNR。代码将公开于www.github.com。

原文摘要 · Abstract (English)

Recent advances in implicit neural representations (INRs) have shown significant promise in modeling visual signals for various low-vision tasks including image super-resolution (ISR). INR-based ISR methods typically learn continuous representations, providing flexibility for generating high-resolution images at any desired scale from their low-resolution counterparts. However, existing INR-based ISR methods utilize multi-layer perceptrons for parameterization in the network; this does not take account of the hierarchical structure existing in local sampling points and hence constrains the representation capability. In this paper, we propose a new \textbf{H}ierarchical encoding based \textbf{I}mplicit \textbf{I}mage \textbf{F}unction for continuous image super-resolution, \textbf{HIIF}, which leverages a novel hierarchical positional encoding that enhances the local implicit representation, enabling it to capture fine details at multiple scales. Our approach also embeds a multi-head linear attention mechanism within the implicit attention network by taking additional non-local information into account. Our experiments show that, when integrated with different backbone encoders, HIIF outperforms the state-of-the-art continuous image super-resolution methods by up to 0.17dB in PSNR. The source code of HIIF will be made publicly available at \url{www.github.com}.

图像超分隐式表示分层编码注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。