arXiv:2504.10929cs.CV2025-04TPAMI被引 2

用小波分解实现自进化频率表征,提升图像重建精度

Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters

  • 将数据分解为四类频段,分频建模增强表达能力
  • 自动优化参数使图像修复任务性能超越现有方法
  • 适合需要高精度重建的视觉数据恢复场景

隐式神经表示(INR)已成为视觉数据表征的强大范式。然而,传统INR方法在原始空间中混合表示不同频率成分,且需手动设置特征编码参数(如频率参数$ω$或秩$R$)。本文提出基于哈尔小波变换的自进化跨频段INR(CF-INR),将数据解耦为四个频率成分,并在小波空间中使用INR进行建模。该方法可分别表征不同频率成分,从而提高数据表示精度。为进一步精确刻画跨频率成分,提出具有自进化参数的跨频段张量分解框架,通过自进化优化自动更新每个频率成分的秩参数$R$和频率参数$ω$。该机制消除了繁琐的手动调参,为每组数据学习定制化的跨频段特征编码配置。在图像回归、修补、去噪及云层去除等多种视觉数据表征与恢复任务上进行了评估,实验结果表明,CF-INR在各项任务中均优于当前最优方法。

原文摘要 · Abstract (English)

Implicit neural representation (INR) has emerged as a powerful paradigm for visual data representation. However, classical INR methods represent data in the original space mixed with different frequency components, and several feature encoding parameters (e.g., the frequency parameter $ω$ or the rank $R$) need manual configurations. In this work, we propose a self-evolving cross-frequency INR using the Haar wavelet transform (termed CF-INR), which decouples data into four frequency components and employs INRs in the wavelet space. CF-INR allows the characterization of different frequency components separately, thus enabling higher accuracy for data representation. To more precisely characterize cross-frequency components, we propose a cross-frequency tensor decomposition paradigm for CF-INR with self-evolving parameters, which automatically updates the rank parameter $R$ and the frequency parameter $ω$ for each frequency component through self-evolving optimization. This self-evolution paradigm eliminates the laborious manual tuning of these parameters, and learns a customized cross-frequency feature encoding configuration for each dataset. We evaluate CF-INR on a variety of visual data representation and recovery tasks, including image regression, inpainting, denoising, and cloud removal. Extensive experiments demonstrate that CF-INR outperforms state-of-the-art methods in each case.

隐式表示小波变换自进化图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。