首个直接从全脑纤维束集学习通用表示的模型,可跨数据集泛化。
Tractogram foundation model

- 用局部编码器与排列等变编码器联合建模全脑纤维束几何上下文
- 在多个数据集上冻结表示仍能准确分割纤维束并预测年龄性别
- 适合神经影像学、脑连接组分析及跨模态迁移研究者使用
弥散磁共振成像(dMRI)纤维束追踪是唯一非侵入性绘制活体人脑白质通路的方法。它将每个大脑表示为一个大型无序三维纤维束集合,包含局部纤维几何与全脑解剖结构信息。这一结构使纤维束成为表征学习的理想但极具挑战的目标。现有方法将纤维束分类与个体层面预测视为独立问题:纤维束分类器关注几何模式,而个体预测常依赖手工特征。因此,当前方法无法学习连接纤维解剖与跨被试变异的可复用表示。本文提出 TractFM,一种直接从全脑纤维束集学习可复用表示的纤维束基础模型。TractFM 结合局部纤维束编码器与排列等变纤维束编码器,使单次前向传播即可联合上下文化同一受试者的全部纤维束。在密集解剖纤维束分割任务上预训练(即为单个纤维束分配解剖标签),生成两种互补表示:用于纤维束分割的上下文化纤维束嵌入,以及用于下游个体表型预测的紧凑个体级描述符。在三种纤维束追踪算法和五个 dMRI 数据集上,TractFM 均实现了对纤维束层级与个体层级任务的迁移。其冻结表示在独立数据集上实现高精度纤维束分割,并准确预测年龄与性别。结果表明,一次学习的全脑几何上下文可跨纤维束处理流程、数据集与预测任务泛化。
原文摘要 · Abstract (English)
Diffusion MRI (dMRI) tractography is the only noninvasive approach for mapping white-matter pathways in the living human brain. It represents each brain as a tractogram: a large, unordered set of three-dimensional streamlines that includes information about both local streamline geometry and whole-brain anatomical organization. This structure makes tractograms a natural but challenging target for representation learning. Existing methods treat streamline classification and subject-level prediction as separate problems: streamline classifiers focus on geometric patterns, whereas subject-level prediction often depends on hand-crafted features. As a result, current methods do not learn reusable representations that connect streamline anatomy with whole-brain inter-subject variation. Here we introduce TractFM, a tractogram foundation model that learns reusable representations directly from whole-brain streamline sets. TractFM combines a local streamline encoder with a permutation-equivariant tractogram encoder, allowing all streamlines from a subject to be contextualized jointly in a single forward pass. Pretraining on dense anatomical tract parcellation, i.e., assigning anatomical labels to individual streamlines, yields two complementary representations: contextualized streamline-level embeddings for tract parcellation and compact subject-level descriptors for downstream prediction of subject phenotypes. Across three tractography algorithms and five dMRI datasets, TractFM transfers to both streamline-level and subject-level tasks. Its frozen representations achieve accurate tract parcellation and predict age and sex across independent datasets. These results show that whole-brain geometric context, learned once, can generalize across tractography pipelines, datasets, and prediction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。