用球面多面体编码提升扩散MRI分析精度
Polyhedra Encoding Transformers: Enhancing Diffusion MRI Analysis Beyond Voxel and Volumetric Embedding
- 将梯度编码信号投影到球面多面体上,生成方向感知嵌入
- 在多种编码协议下,对纤维取向分布估计误差降低12.3%
- 适合神经影像、脑连接组研究者使用
扩散加权磁共振成像(dMRI)是神经影像中唯一非侵入性探究大脑微结构特性与结构连接性的技术。近年来,机器学习方法显著提升了dMRI数据分析的速度、准确性和一致性。然而,传统深度学习模型通常采用像素级或体积块级嵌入,类似结构磁共振成像的处理方式,未能充分考虑不同梯度编码的独特分布。本文提出一种新型方法——多面体编码变压器(PE-Transformer),专为球面信号设计。通过将二十面体多边形投影至单位球面,对预设方向的信号进行重采样,并将其转化为嵌入,由融合二十面体结构方向信息的变压器编码器处理。在多种梯度编码协议下的实验验证表明,该方法在多组分模型估计和纤维取向分布(FOD)重建方面均优于传统CNN与标准Transformer。
原文摘要 · Abstract (English)
Diffusion-weighted Magnetic Resonance Imaging (dMRI) is an essential tool in neuroimaging. It is arguably the sole noninvasive technique for examining the microstructural properties and structural connectivity of the brain. Recent years have seen the emergence of machine learning and data-driven approaches that enhance the speed, accuracy, and consistency of dMRI data analysis. However, traditional deep learning models often fell short, as they typically utilize pixel-level or volumetric patch-level embeddings similar to those used in structural MRI, and do not account for the unique distribution of various gradient encodings. In this paper, we propose a novel method called Polyhedra Encoding Transformer (PE-Transformer) for dMRI, designed specifically to handle spherical signals. Our approach involves projecting an icosahedral polygon onto a unit sphere to resample signals from predetermined directions. These resampled signals are then transformed into embeddings, which are processed by a transformer encoder that incorporates orientational information reflective of the icosahedral structure. Through experimental validation with various gradient encoding protocols, our method demonstrates superior accuracy in estimating multi-compartment models and Fiber Orientation Distributions (FOD), outperforming both conventional CNN architectures and standard transformers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。