用多维度表征相似性整合方法,提升脑区与模型的区分能力。
Integrated representational signatures strengthen specificity in brains and models
- 融合几何、单元调制等多类表征指标,构建综合相似性度量
- 整合后方法在脑区与模型家族间分离效果显著优于单一指标
- 结果与视觉皮层解剖功能层级高度一致,适合神经科学与模型分析
神经科学与机器学习中,不同神经网络(包括生物脑与人工模型)在执行相似任务时是否依赖相同表征结构,是核心问题。以往研究通常仅使用单一表征相似性度量,而每种度量仅反映表征结构的一个方面。本文采用多种互补的表征相似性度量——涵盖几何结构、单元级调制特性、线性可解码性等——评估脑区或模型的可分性。发现保持几何或调制结构的度量(如RSA、Soft Matching)能实现更强的区域区分,而线性预测性等灵活映射则表现出较弱分离。这表明几何与调制信息携带脑区或模型族特异性签名,而线性可解码信息更趋于全局共享。为整合这些互补维度,我们引入原始用于多组学数据融合的相似性网络融合(SNF)框架。该方法显著提升了脑区与模型族级别的分离精度,并生成稳健的复合相似性谱。进一步地,基于SNF生成的相似性得分对皮层区域聚类,揭示出更清晰的层级组织,与已知的视觉皮层解剖与功能层级高度吻合,优于任一单一度量的表现。
原文摘要 · Abstract (English)
The extent to which different neural or artificial neural networks (models) rely on equivalent representations to support similar tasks remains a central question in neuroscience and machine learning. Prior work has typically compared systems using a single representational similarity metric, yet each captures only one facet of representational structure. To address this, we leverage a suite of representational similarity metrics-each capturing a distinct facet of representational correspondence, such as geometry, unit-level tuning, or linear decodability-and assess brain region or model separability using multiple complementary measures. Metrics that preserve geometric or tuning structure (e.g., RSA, Soft Matching) yield stronger region-based discrimination, whereas more flexible mappings such as Linear Predictivity show weaker separation. These findings suggest that geometry and tuning encode brain-region- or model-family-specific signatures, while linearly decodable information tends to be more globally shared across regions or models. To integrate these complementary representational facets, we adapt Similarity Network Fusion (SNF), a framework originally developed for multi-omics data integration. SNF produces substantially sharper regional and model family-level separation than any single metric and yields robust composite similarity profiles. Moreover, clustering cortical regions using SNF-derived similarity scores reveals a clearer hierarchical organization that aligns closely with established anatomical and functional hierarchies of the visual cortex-surpassing the correspondence achieved by individual metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。