arXiv:2410.05050cs.LGcs.AI2024-10ICLR被引 17

通过频谱对齐加速神经隐式表示学习,无需调参

FreSh: Frequency Shifting for Accelerated Neural Representation Learning

  • 用初始输出频谱匹配目标信号,自动选最优频率嵌入参数
  • 在图像、3D形状等任务上性能接近超参搜索,但计算开销极低
  • 适合追求高效训练的科研与工程人员,尤其擅长隐式表示

隐式神经表示(INRs)近年来受到关注,因其能用多层感知机(MLPs)连续表示图像、视频和3D形状等信号。然而,MLP存在低频偏好,难以准确捕捉高频细节。现有方法通常依赖高频率输入嵌入或特殊激活层来缓解此问题,但这些组件的超参数常为平均表现最佳,对特定信号未必最优,需耗费大量计算进行网格搜索以调优。本文发现,未训练模型初始输出的频率谱与最终性能高度相关。基于此,我们提出频率偏移(FreSh)方法:通过调整嵌入超参数,使模型初始输出频谱与目标信号一致。该简单初始化策略显著提升多种神经表示方法与任务的性能,效果媲美大规模超参搜索,仅需比单次标准训练略多一点计算开销。

原文摘要 · Abstract (English)

Implicit Neural Representations (INRs) have recently gained attention as a powerful approach for continuously representing signals such as images, videos, and 3D shapes using multilayer perceptrons (MLPs). However, MLPs are known to exhibit a low-frequency bias, limiting their ability to capture high-frequency details accurately. This limitation is typically addressed by incorporating high-frequency input embeddings or specialized activation layers. In this work, we demonstrate that these embeddings and activations are often configured with hyperparameters that perform well on average but are suboptimal for specific input signals under consideration, necessitating a costly grid search to identify optimal settings. Our key observation is that the initial frequency spectrum of an untrained model's output correlates strongly with the model's eventual performance on a given target signal. Leveraging this insight, we propose frequency shifting (or FreSh), a method that selects embedding hyperparameters to align the frequency spectrum of the model's initial output with that of the target signal. We show that this simple initialization technique improves performance across various neural representation methods and tasks, achieving results comparable to extensive hyperparameter sweeps but with only marginal computational overhead compared to training a single model with default hyperparameters.

神经隐式表示频率对齐加速训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。