arXiv:2605.03222cs.LGstat.ML2026-05

提出新方法衡量神经网络对微小刺激的敏感性差异。

Beyond Activation Alignment: The Geometry of Neural Sensitivity

论文配图:Beyond Activation Alignment: The Geometry of Neural Sensitivity
图 1 · 摘自论文原文
  • 基于费雪信息与局部表示几何,构建对微小扰动的判别能力度量
  • 在独立训练的神经网络间成功匹配对应层,揭示鲁棒训练差异
  • 适合研究神经表征对刺激细微变化的响应机制

激活对齐方法如RSA、CCA和CKA被广泛用于比较生物与人工神经表征。尽管这些方法可评估全局任务最优线性读出的一致性,但无法反映系统如何利用局部刺激证据。我们提出一种基于局部可解信息的新框架,关注表征在噪声下对特定刺激坐标子空间内微小扰动的判别能力。该框架基于费雪信息与局部表示几何,用期望投影拉回/费雪度量对每个表征进行总结,生成一组二阶矩型局部判别任务,其对应的算子提供数据集级别的完整预期判别性摘要。通过在对称正定矩阵流形上的对数谱距离,得出谱黎曼对齐得分(S-RAS)及统一乘性证书。实证表明,该框架能恢复独立训练的ANN对应层,支持可迁移的类别条件探测器,揭示标准与鲁棒训练间的可控分离,并在Allen Brain Observatory静态条纹数据集中发现刺激坐标族效应。

原文摘要 · Abstract (English)

Activation-alignment measures such as Representational Similarity Analysis (RSA), Canonical Correlation Analysis (CCA), and Centered Kernel Alignment (CKA) are widely used to compare biological and artificial neural representations. Recent theoretical work interprets many of these methods as assessing agreement between optimal linear readouts over broad families of global tasks. However, agreement at the level of global readouts does not determine how a system uses local stimulus evidence. Specifically, representations may align in activation space yet differ in their sensitivity to small perturbations. To address this challenge, we introduce a complementary framework based on local decodable information, which focuses on a representation's ability, under noise, to discriminate small perturbations within a specified stimulus-coordinate subspace. Building on Fisher information and local representation geometry, we summarize each representation using the expected projected pullback/Fisher metric over that subspace. This formulation induces a second-moment family of local discrimination tasks, for which the resulting operator provides a minimal, complete dataset-level summary of expected discriminability. We compare these regularized signatures using a log-spectral distance on the manifold of symmetric positive definite (SPD) matrices, yielding the Spectral Riemannian Alignment Score (S-RAS) and a uniform multiplicative certificate over the corresponding family of lifted task values. Empirically, this framework enables the recovery of corresponding layers across independently trained artificial neural networks, supports transferable class-conditional probes, reveals controlled dissociations between standard and robust training, and uncovers stimulus-coordinate family effects across mouse visual cortex using the Allen Brain Observatory static gratings dataset.

神经表征敏感性分析费雪信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。