arXiv:2605.08298cs.LGcs.AI2026-05

揭示协同训练INR的可迁移层及编码机制,实现可解释的模型优化。

What Cohort INRs Encode and Where to Freeze Them

论文配图:What Cohort INRs Encode and Where to Freeze Them
图 1 · 摘自论文原文
  • 按权重稳定秩最优深度冻结共享编码器,性能优于标准微调。
  • 发现SIREN与FFMLP学习不同字典:前者局部定位,后者覆盖全图轮廓。
  • 单原子消融实验验证其因果作用,为模型可解释性提供新工具。

重用协同训练INR的早期层作为新信号的初始化已被证明能加速并提升信号拟合效果,但尚不清楚哪些层学习了可迁移表示及其编码内容。本文针对SIREN和傅里叶特征MLP(FFMLP)两种标准主干网络展开研究。首先,通过测试时扫描冻结深度,发现最优冻结位置对应权重稳定秩最高的层,且在此深度冻结的性能在所有实验中均不逊于甚至优于标准微调。其次,识别出可迁移层并不等于理解其编码内容。为此,采用稀疏自编码器(SAEs),首次将INR激活分解为稀疏字典原子。有趣的是,尽管两者在协同拟合质量上相当,但学习到的字典本质不同:协同训练的SIREN原子具有局部性,以平铺方式覆盖坐标平面,每个原子仅在特定区域内激活;而协同训练的FFMLP原子则为图像级跨度,勾勒出记忆信号的轮廓。单原子消融实验证实其因果作用:一个FFMLP原子从4096个中移除,可在图像上导致高达10.6 dB的PSNR下降;而SIREN的消融仅限于该原子触发区域。这些结果首次提供了对协同训练INR中可迁移内容的机制解释,并将其激活转化为可检查的字典原子,为刻画INR所编码信息及设计更具泛化能力的架构开辟路径。

原文摘要 · Abstract (English)

Reusing the early layers of cohort-trained INRs as initialization for new signals has been shown to accelerate and improve signal fitting, yet it remains unclear which layers of the shared encoder learn transferable representations and what those representations encode. We address both questions for two standard backbones, SIREN and Fourier-feature MLPs (FFMLP). First, sweeping the freeze depth across the shared encoder at test time, we find that the optimum coincides with the layer of highest weight stable rank. Moreover, freezing at this depth matches or improves on the standard fine-tuning recipe across all our experiments. Second, identifying which layer transfers does not characterize what that layer encodes. To address this we adopt sparse autoencoders (SAEs), the dominant tool in mechanistic interpretability, and present the first SAE decomposition of INR activations into sparse dictionary atoms. Interestingly, SIREN and FFMLP achieve comparable cohort-fitting quality, but learn qualitatively different dictionaries. Cohort SIREN's atoms are localized, tiling the coordinate plane such that each atom fires in a confined region independent of cohort content. Cohort FFMLP's atoms are image-spanning, tracing the contours of memorized cohort signals. Single-atom ablations confirm causal use of these dictionaries: a single FFMLP atom out of 4096 can drop PSNR by up to 10.6 dB across the image, while SIREN ablations remain confined to where the atom fires. Together, these results give the first mechanistic account of what transfers in cohort-trained INRs and turn their activations into inspectable dictionary atoms. These tools open a path towards characterizing what INRs encode and towards architectures designed for generalization rather than memorization.

INR可解释性迁移学习字典学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。