通过调控模型表示几何,实现生物与人工神经网络的双向预测对齐
Bidirectional representational alignment between biological and artificial neural networks
- 引入谱正则化框架,主动调节模型表示的几何结构
- 反向预测性能提升55%,前向性能微降,双向对齐显著改善
- 适合关注神经科学与深度学习交叉研究的研究者
近期研究表明,生物与人工神经网络之间的表征对齐具有不对称性:模型表征能更好预测神经反应,而神经反应对模型表征的预测能力较弱。这一不对称性引发疑问:表征几何是否影响双向对齐?我们假设在训练中引导表征几何可系统性调控双向对齐。为此,我们提出一个融合谱正则化与双向预测分析的计算框架。以自监督对比视觉模型为初始验证,调节学习表征的谱几何显著提升了反向预测性能,同时小幅降低前向预测性能,使双向预测性能相对提升55%。该改进伴随有效维度降低及共享表征子空间重构,在中等谱指数下,前向与反向预测性能趋于对称。结果表明,表征几何可被系统性调控,从而调节生物与人工神经网络间的双向表征对齐。
原文摘要 · Abstract (English)
Recent work has shown that representational alignment between biological and artificial neural networks is asymmetric: model representations predict neural responses much better than neural responses predict model representations. This asymmetry raises the question of whether representational geometry contributes to bidirectional representational alignment. We hypothesized that steering representational geometry during training can systematically influence bidirectional alignment. To test this hypothesis, we developed a computational framework that integrates spectral regularization with bidirectional predictivity analyses. As an initial demonstration, we evaluated our framework using self-supervised contrastive vision models. Steering the spectral geometry of the learned representations substantially increased reverse predictivity with modest reductions in forward predictivity, yielding a 55% relative improvement in bidirectional predictivity. These improvements were accompanied by reduced effective dimensionality and a reorganization of the shared representational subspace, within which forward and reverse predictivity became approximately symmetric at intermediate spectral exponents. Overall, these findings demonstrate that representational geometry can be systematically steered to modulate bidirectional representational alignment between biological and artificial neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。