提出D-RoPE让Transformer更好理解扩散MRI的定向特性,提升脑部微结构分析性能。
Diffusion MRI Transformer with a Diffusion Space Rotary Positional Embedding (D-RoPE)
- 设计旋转位置编码捕捉扩散信号的方向与空间关系
- 预训练后在认知障碍分类上准确率提升6%,预测相关性提高0.05
- 兼容不同扫描参数,适合多中心临床数据迁移使用
扩散磁共振成像(dMRI)在研究脑部微结构变化中至关重要,广泛应用于临床。然而,从dMRI学习通用表征进展有限,主要因现有深度学习方法难以捕捉扩散信号的独特属性。脑dMRI通常包含多个体积,其衰减特性依赖于扩散敏感梯度的方向和强度。因此,需联合建模空间、扩散加权及方向依赖性。此外,不同采集协议(如不同方向数)也限制了传统模型。为此,我们引入一种扩散空间旋转位置编码(D-RoPE),嵌入dMRI Transformer中,以同时捕获空间结构与方向特征,实现跨多种采集设置和任意扩散方向的鲁棒、可迁移表征。经自监督掩码自动编码预训练后,在多个下游任务中表现优于或媲美若干基线模型(甚至超过全量训练基线);微弱认知障碍分类准确率提升6%,认知评分预测相关系数增加0.05。代码已公开:github.com/gustavochau/D-RoPE。
原文摘要 · Abstract (English)
Diffusion Magnetic Resonance Imaging (dMRI) plays a critical role in studying microstructural changes in the brain. It is, therefore, widely used in clinical practice; yet progress in learning general-purpose representations from dMRI has been limited. A key challenge is that existing deep learning approaches are not well-suited to capture the unique properties of diffusion signals. Brain dMRI is normally composed of several brain volumes, each with different attenuation characteristics dependent on the direction and strength of the diffusion-sensitized gradients. Thus, there is a need to jointly model spatial, diffusion-weighting, and directional dependencies in dMRI. Furthermore, varying acquisition protocols (e.g., differing numbers of directions) further limit traditional models. To address these gaps, we introduce a diffusion space rotatory positional embedding (D-RoPE) plugged into our dMRI transformer to capture both the spatial structure and directional characteristics of diffusion data, enabling robust and transferable representations across diverse acquisition settings and an arbitrary number of diffusion directions. After self-supervised masked autoencoding pretraining, tests on several downstream tasks show that the learned representations and the pretrained model can provide competitive or superior performance compared to several baselines in these downstream tasks (even compared to a fully trained baseline); the finetuned features from our pretrained encoder resulted in a 6% higher accuracy in classifying mild cognitive impairment and a 0.05 increase in the correlation coefficient when predicting cognitive scores. Code is available at: github.com/gustavochau/D-RoPE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。