对比8种相似性度量,发现几何结构匹配度高的方法更贴近行为表现。
Evaluating Representational Similarity Measures from the Lens of Functional Correspondence
- 用行为指标评估8种表征相似性度量的匹配程度
- 线性中心核对齐(CKA)和Procrustes距离与行为关联更强
- 适合关注行为一致性的神经科学与AI交叉研究
神经科学与人工智能均面临高维神经数据的解读挑战,表征比较在揭示两类系统间共性与差异中至关重要。尽管表征比较方法众多,但何种度量最合适仍不明确。本文从行为对应角度出发,评估八种常用视觉域表征相似性度量(包括基于对齐、CCA、内积核及最近邻的方法),通过群体统计与全面的行为度量进行分析。结果表明,强调表示整体几何结构的度量如线性中心核对齐(CKA)和Procrustes距离,在区分训练与未训练模型方面表现优异,且与行为指标高度一致;而神经科学中常用的线性可预测性度量则仅表现出中等行为对齐。该研究为选择行为相关性强的度量提供了实证依据。
原文摘要 · Abstract (English)
Neuroscience and artificial intelligence (AI) both face the challenge of interpreting high-dimensional neural data, where the comparative analysis of such data is crucial for revealing shared mechanisms and differences between these complex systems. Despite the widespread use of representational comparisons and the abundance classes of comparison methods, a critical question remains: which metrics are most suitable for these comparisons? While some studies evaluate metrics based on their ability to differentiate models of different origins or constructions (e.g., various architectures), another approach is to assess how well they distinguish models that exhibit distinct behaviors. To investigate this, we examine the degree of alignment between various representational similarity measures and behavioral outcomes, employing group statistics and a comprehensive suite of behavioral metrics for comparison. In our evaluation of eight commonly used representational similarity metrics in the visual domain -- spanning alignment-based, Canonical Correlation Analysis (CCA)-based, inner product kernel-based, and nearest-neighbor methods -- we found that metrics like linear Centered Kernel Alignment (CKA) and Procrustes distance, which emphasize the overall geometric structure or shape of representations, excelled in differentiating trained from untrained models and aligning with behavioral measures, whereas metrics such as linear predictivity, commonly used in neuroscience, demonstrated only moderate alignment with behavior. These insights are crucial for selecting metrics that emphasize behaviorally meaningful comparisons in NeuroAI research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。