用自蒸馏学习脑动态的语义令牌,提升低信噪比数据下的表示稳定性。
Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Model
- 通过语义分块与自蒸馏,将噪声区域信号整合为功能网络令牌
- 线性探测即达强性能,且未标注数据越多泛化能力越强
- 适合脑科学、医学影像分析人员,尤其关注小样本建模
功能磁共振成像(fMRI)时间序列的基座模型发展有望预测疾病与认知表型。然而,现有模型多在小脑区上采用掩码重建目标训练,仅捕捉低层信息,导致表示对噪声和时间波动敏感,需大量微调才能用于下游任务。本文提出Brain-Semantoks,一种专为学习脑动态抽象表示设计的自监督框架。其核心创新包括:1)语义分词器,将嘈杂的区域信号聚合为代表功能网络的稳健令牌;2)自蒸馏目标,通过新颖的训练课程增强时序表示的稳定性。实验表明,该框架能从低信噪比时间序列中可靠学习有意义特征,并在多种下游任务中仅用线性探测即取得优异表现。全面的扩展分析显示,更多未标注数据可稳定提升分布外性能,无需领域适应。
原文摘要 · Abstract (English)
The development of foundation models for functional magnetic resonance imaging (fMRI) time series holds significant promise for predicting phenotypes related to disease and cognition. Current models, however, are often trained using a mask-and-reconstruct objective on small brain regions. This focus on low-level information leads to representations that are sensitive to noise and temporal fluctuations, necessitating extensive fine-tuning for downstream tasks. We introduce Brain-Semantoks, a self-supervised framework designed specifically to learn abstract representations of brain dynamics. Its architecture is built on two core innovations: a semantic tokenizer that aggregates noisy regional signals into robust tokens representing functional networks, and a self-distillation objective that enforces representational stability across time. We show that this objective is stabilized through a novel training curriculum, ensuring the model robustly learns meaningful features from low signal-to-noise time series. We demonstrate that learned representations enable strong performance on a variety of downstream tasks even when only using a linear probe. Furthermore, we provide comprehensive scaling analyses indicating more unlabeled data reliably results in out-of-distribution performance gains without domain adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。