arXiv:2512.21881cs.CVq-bio.NC2025-12被引 9

SLIM-Brain用高效算法实现脑影像的高精度分析,大幅降低数据和训练成本。

SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysis

  • 分两阶段设计:先筛选重要时间窗口,再只处理关键区域,减少计算量。
  • 仅需4000次预训练、30%显存,性能超越现有方法,多任务表现最优。
  • 适合资源有限但需高精度脑影像分析的研究者,尤其适用于大规模研究。

基础模型正成为功能磁共振成像(fMRI)分析的强大范式,但现有方法面临数据与训练效率双重瓶颈。基于图谱的方法将体素信号聚合为固定感兴趣区,虽降低维度却丢失空间细节,且需超大样本训练;而无图谱方法虽保留体素级信息,但内存与算力消耗巨大,难以进行大规模预训练。本文提出SLIM-Brain(Sample-efficient, Low-memory fMRI Foundation Model for Human Brain),一种新型无图谱基础模型,同时提升数据与训练效率。其采用两阶段自适应设计:(i) 轻量级时序提取器捕捉全序列全局上下文,并按显著性排序数据窗口;(ii) 4D分层编码器(Hiera-JEPA)仅对前-k个精选窗口学习细粒度体素表示,同时丢弃约70%被掩码的补丁。在七个公开基准上的大量实验表明,SLIM-Brain在多种任务上达到新最优性能,预训练仅需4000次会话,显存约为传统体素级方法的30%。

原文摘要 · Abstract (English)

Foundation models are emerging as a powerful paradigm for fMRI analysis, but current approaches face a dual bottleneck of data- and training-efficiency. Atlas-based methods aggregate voxel signals into fixed regions of interest, reducing data dimensionality but discarding fine-grained spatial details, and requiring extremely large cohorts to train effectively as general-purpose foundation models. Atlas-free methods, on the other hand, operate directly on voxel-level information - preserving spatial fidelity but are prohibitively memory- and compute-intensive, making large-scale pre-training infeasible. We introduce SLIM-Brain (Sample-efficient, Low-memory fMRI Foundation Model for Human Brain), a new atlas-free foundation model that simultaneously improves both data- and training-efficiency. SLIM-Brain adopts a two-stage adaptive design: (i) a lightweight temporal extractor captures global context across full sequences and ranks data windows by saliency, and (ii) a 4D hierarchical encoder (Hiera-JEPA) learns fine-grained voxel-level representations only from the top-$k$ selected windows, while deleting about 70% masked patches. Extensive experiments across seven public benchmarks show that SLIM-Brain establishes new state-of-the-art performance on diverse tasks, while requiring only 4 thousand pre-training sessions and approximately 30% of GPU memory comparing to traditional voxel-level methods.

fMRI基础模型高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。