arXiv:2506.12117q-bio.NCcs.AI2025-06

发现规模不变性是AI与大脑表征趋同的关键机制。

Scale-Invariance Drives Convergence in AI and Brain Representations

  • 用多尺度分析框架量化表征的维度稳定性与跨尺度结构相似性。
  • 维度更稳定、结构更相似的表征与脑成像数据对齐更好。
  • 大训练数据和多模态训练能增强规模不变性,提升类脑对齐。

尽管架构和预训练策略各异,大型AI模型常收敛到相似的内部表征,且与神经活动对齐。我们提出,自然系统中的基本结构原则——规模不变性,是这一收敛的核心驱动力。本文构建多尺度分析框架,量化AI表征中两个核心的规模不变性特征:维度稳定性与跨尺度结构相似性。进一步探究这些特性是否可预测视觉皮层fMRI响应的对齐表现。结果表明,维度更一致、跨尺度结构更相似的嵌入与fMRI数据对齐更优。此外,发现fMRI数据的流形结构更集中,多数特征在小尺度上消散。具有相似尺度模式的嵌入与fMRI数据对齐更紧密。我们还发现,更大规模的预训练数据集及语言模态的引入,可增强嵌入的规模不变性,进一步提升神经对齐效果。研究揭示,规模不变性是连接人工与生物表征的根本结构性原则,为评估类人AI系统的结构质量提供新框架。

原文摘要 · Abstract (English)

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance, a fundamental structural principle in natural systems, is a key driver of this convergence. In this work, we propose a multi-scale analytical framework to quantify two core aspects of scale-invariance in AI representations: dimensional stability and structural similarity across scales. We further investigate whether these properties can predict alignment performance with functional Magnetic Resonance Imaging (fMRI) responses in the visual cortex. Our analysis reveals that embeddings with more consistent dimension and higher structural similarity across scales align better with fMRI data. Furthermore, we find that the manifold structure of fMRI data is more concentrated, with most features dissipating at smaller scales. Embeddings with similar scale patterns align more closely with fMRI data. We also show that larger pretraining datasets and the inclusion of language modalities enhance the scale-invariance properties of embeddings, further improving neural alignment. Our findings indicate that scale-invariance is a fundamental structural principle that bridges artificial and biological representations, providing a new framework for evaluating the structural quality of human-like AI systems.

表征学习类脑智能规模不变性神经对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。