提出CHOIR模型,提升多维数据隐式表示的稳定性与物理合理性。
Calibrated Harmonic Overlaid Implicit Neural Representations for Multi-Dimensional Data

- 用协调谐波叠加替代函数复合,提升深层网络优化稳定性。
- 引入感知谱校准,使频谱分布更接近自然图像的幂律特性。
- 适用于多光谱图像、视频等多维数据重建,性能优于现有方法。
隐式神经表示(INR)已成为多维数据(如多光谱图像和视频)的强大先验。然而,多数采用周期性激活函数(如Sine)的INR方法依赖函数复合,随网络深度增加导致优化不稳定,限制了性能。同时,这些方法未能融入合适的物理先验来缓解谱偏置问题。受深层周期网络与广义傅里叶级数共性的启发,我们提出新型校准谐波叠加隐式神经表示(CHOIR)。具体地,采用协调谐波叠加(CHS)替代传统函数复合,确保网络深度扩展时的优化稳定性;进一步引入感知谱校准(PSC),嵌入自然图像普遍存在的幂律谱先验,并将全局固定的谱分布调整为物理合理的对数均匀分布。在多种多维数据恢复任务上的大量实验表明,该方法显著优于当前最优方案。代码已公开于 https://github.com/chorl0229/CHOIR。
原文摘要 · Abstract (English)
Implicit neural representation (INR) has emerged as a powerful prior for multi-dimensional data (e.g., multispectral images and videos). However, most INR methods employing periodic activation functions (e.g., Sine) predominantly rely on function composition. This mechanism introduces optimization instability as network depth increases, thereby limiting their performance. Meanwhile, these methods fail to incorporate proper physical priors to effectively alleviate spectrum bias. To address these issues, inspired by the commonalities between deep periodic networks and generalized Fourier series, we propose a novel Calibrated Harmonic Overlaid Implicit Neural Representation (CHOIR). Specifically, we utilize Coordinated Harmonic Superposition (CHS) to replace the conventional function composition used in most INRs, thereby ensuring optimization stability when scaling network depth. Furthermore, we introduce a Perceptual Spectrum Calibration (PSC) to mitigate spectrum bias. This calibration embeds the ubiquitous power-law spectrum prior of natural images and adjusts the globally fixed spectrum towards a physically plausible log-uniform distribution. Extensive experiments on various multidimensional data recovery problems demonstrate that our method achieves superior performance over state-of-the-art approaches. Code is available at https://github.com/chorl0229/CHOIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。