图像分类的类信号并非自然聚集,而是由读取器主动路由。
Is Class Signal Clustered or Routed in Task-Induced Implicit Neural Representation Weight Spaces?

- 通过元学习构建共享初始化与更新策略,研究任务诱导的隐式神经表征权重空间
- 发现类信号在权重空间中不形成稳定聚类,反而可能干扰分类性能
- 揭示读取器后期交互是类信号可判别的关键,适合对神经网络可解释性感兴趣的读者
隐式神经表征(INRs)将图像编码为神经网络权重,使图像分类转化为权重空间的可判别性问题。一个自然的几何假设是:分类器反馈应使图像特定权重在共享锚点坐标中按类别聚类。我们在基于SIREN的元权重变换器(MWT)框架下检验该假设,发现该预测失败。暴露的权重空间几何结构与监督聚类压力无法可靠追踪训练读取器的准确率;聚类甚至可能使局部邻域更类一致,却导致读取器性能下降。关键在于,类对齐几何由读取器构建而非继承:令牌流诊断显示,类对齐邻域仅在读取器后期交互后才显著预测训练准确率,而非输入坐标中即存在。我们进一步识别出增强权重令牌中的天然SIREN偏置列,作为读取器的低维、样本依赖因果读出路径;定向控制排除了通用标量列和边缘分布伪影。该诊断推动了强化读取器路由、添加显式偏置路径或采用更密集内层拟合的干预措施;在本文使用的车道特定训练范式下,路由导向变体常优于共享锚点基线,但交互非加性。任务诱导的INR权重可分类,并非因其形成原始几何聚类,而是因为其类信号被读取器路由。
原文摘要 · Abstract (English)
Implicit neural representations (INRs) encode images as neural-network weights, making image classification a problem of weight-space classifiability. A natural geometric hypothesis is that classifier feedback should make image-specific weights cluster by class in the shared-anchor coordinate. We test this hypothesis in the SIREN-based Meta Weight Transformer (MWT) regime, where end-to-end training meta-learns a shared initialization and inner-loop update schedule for fitting image-specific SIRENs. We find that this prediction fails. Exposed weight-space geometry and supervised clustering pressure do not reliably track trained-reader accuracy; clustering can even make local neighborhoods more class-consistent while making the trained reader worse. Crucially, the reader constructs rather than inherits class-aligned geometry: token-flow diagnostics show that class-aligned neighborhoods become strongly predictive of trained-reader accuracy only after late reader interactions, not in the input coordinate. We further identify the native SIREN bias column in the augmented weight token as a low-dimensional, sample-dependent causal readout route for the trained reader; targeted controls rule out generic scalar-column and marginal-distribution artifacts. The diagnosis motivates interventions that strengthen reader routing, add an explicit bias route, or use denser inner-loop fitting; under the lane-specific training conventions used here, route-directed variants often outperform the shared-anchor baseline but interact non-additively. Task-induced INR weights are classifiable not because they form raw geometric clusters, but because their class signal is routed through the reader.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。