arXiv:2509.21628cs.CVcs.AI2025-09被引 1

比较并融合多种表征对应度量,更好揭示模型与大脑的相似结构。

Comparing and Integrating Different Notions of Representational Correspondence in Neural Systems

  • 用多种度量方法评估神经系统的表征相似性
  • 几何结构和调谐特性比线性预测更可靠地区分模型类别
  • 融合多度量结果可更清晰揭示视觉通路的层级组织

生物与人工神经系统的内部表征是否等价,是神经科学与机器学习的核心问题。以往研究通常依赖单一表征相似性度量,但不同度量强调表征对应的不同方面。本文通过两个领域验证一系列度量:对人工模型,考察架构或训练方式不同的模型是否被赋予更低相似性;对神经数据,检验不同皮层区域的响应是否分离、同区域响应是否跨被试对齐。在视觉模型和神经记录中,保持表征几何或调谐结构的度量能更可靠地分离结构,优于线性可预测性等灵活映射。为整合互补维度,我们引入用于多组学融合的相似性网络融合(Similarity Network Fusion)方法,将不同度量生成的相似性图谱融合。融合后的相似性显著增强模型家族的区分能力;应用于神经数据时,恢复出更清晰的腹侧视觉通路层级结构,与已知解剖与功能层次更一致。该方法揭示了哪些表征对应维度能恢复有意义结构,并展示了如何整合互补的相似性视角。

原文摘要 · Abstract (English)

The extent to which different biological and artificial neural systems rely on equivalent internal representations to support similar tasks remains a central question in neuroscience and machine learning. Prior work typically compares systems using a single representational similarity metric, even though different metrics emphasize distinct facets of representational correspondence. Here we evaluate a suite of representational similarity measures by asking how well each metric recovers known structure across two domains: for artificial models, whether procedurally dissimilar models (differing in architecture or training paradigm) are assigned lower similarity than procedurally matched models; and for neural data, whether responses from distinct cortical regions are separated while responses from the same region align across subjects. Across both vision models and neural recordings, metrics that preserve representational geometry or tuning structure more reliably separate this structure than more flexible mappings such as linear predictivity. To integrate these complementary facets, we adapt Similarity Network Fusion, originally developed for multi-omics integration, to combine similarity graphs across metrics. The resulting fused similarity yields sharper separation of procedurally defined model families and, when applied to neural data, recovers a clearer hierarchical organization of the ventral visual stream that aligns more closely with established anatomical and functional hierarchies than single metrics. Overall, this approach reveals which dimensions of representational correspondence recover meaningful structure in models and brains, and how complementary notions of similarity can be integrated.

表征相似性神经网络视觉通路多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。