让神经网络先学细节,再学整体,提升图像隐式表示精度
High-Frequency First: A Two-Stage Approach for Improving Image INR
- 分两阶段训练:先重点学习局部变化大的像素
- 在多种基准上重建质量显著优于传统方法
- 适合需要高保真图像重建的研究者
隐式神经表示(INRs)通过将图像建模为坐标空间的连续函数,成为传统像素格式的有力替代。然而,神经网络存在频谱偏差,倾向于捕捉低频成分而难以保留高频细节(如锐利边缘和精细纹理)。现有方法多通过架构改进或特殊激活函数解决此问题,但互补性训练策略仍被忽视。本文提出一种新思路:直接引导训练过程。设计两阶段训练策略,利用邻域感知软掩码动态提高局部变化剧烈像素的权重,促使模型早期聚焦于细节;随后转入全图训练。实验表明,该方法与现有INR方法具有互补性,在多个数据集上均稳定提升重建质量。通过在图像INR中赋予频率感知的重要性分配,有效缓解了频谱偏差问题。
原文摘要 · Abstract (English)
Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of neural networks, which tend to favor low-frequency components while struggling to capture high-frequency (HF) details such as sharp edges and fine textures. While prior approaches have addressed this limitation through architectural modifications or specialized activation functions, the potential of complementary training strategies remains relatively underexplored. In this work, we propose an orthogonal direction by directly guiding the training process. Specifically, we introduce a two-stage training strategy where a neighbor-aware soft mask adaptively assigns higher weights to pixels with strong local variations, encouraging early focus on fine details. The model then transitions to full-image training. Experimental results show that our approach is complementary to existing INR methods and consistently improves reconstruction quality. By assigning frequency-aware importance to pixels in image INR, our work offers an effective avenue to mitigate the spectral bias problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。