arXiv:2504.18400eess.IVcs.AI2025-04中稿 · Human Brain Mappin…被引 2

用深度学习快速准确预测脑白质形态,支持大规模数据分析。

A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography

  • 融合点云与表格数据的多模态模型,提升预测效率。
  • 在两大数据集上均达最优,平均皮尔逊相关系数最高。
  • 适合神经影像学、脑发育及疾病研究者使用。

形状测量已成为白质纤维束成像的有力描述符,可提供解剖变异性和认知/临床表型关联的补充信息。然而,传统方法依赖体素表示,计算成本高,难以处理大规模数据。本文提出Tract2Shape,一种新型多模态深度学习框架,利用几何(点云)和标量(表格)特征预测十种白质纤维束形状测量值。为提高效率,采用主成分分析(PCA)降低维度,仅预测五个主要形状成分。模型在独立采集的HCP-YA和PPMI两个数据集上训练与评估。在HCP-YA数据集上,相比现有最先进模型,Tract2Shape在全部十项形状测量中表现更优,平均皮尔逊相关系数(Pearson's r)最高,归一化均方误差(nMSE)最低。消融实验证明,多模态输入与PCA均带来性能提升。在未见的PPMI数据集上,仍保持高皮尔逊相关系数与低nMSE,表明其出色的跨数据集泛化能力。Tract2Shape实现了从纤维束数据中快速、准确、可泛化的白质形状测量预测,支持跨数据集的大规模分析,为未来大规模白质形状研究奠定基础。

原文摘要 · Abstract (English)

Shape measures have emerged as promising descriptors of white matter tractography, offering complementary insights into anatomical variability and associations with cognitive and clinical phenotypes. However, conventional methods for computing shape measures are computationally expensive and time-consuming for large-scale datasets due to reliance on voxel-based representations. We propose Tract2Shape, a novel multimodal deep learning framework that leverages geometric (point cloud) and scalar (tabular) features to predict ten white matter tractography shape measures. To enhance model efficiency, we utilize a dimensionality reduction algorithm for the model to predict five primary shape components. The model is trained and evaluated on two independently acquired datasets, the HCP-YA dataset, and the PPMI dataset. We evaluate the performance of Tract2Shape by training and testing it on the HCP-YA dataset and comparing the results with state-of-the-art models. To further assess its robustness and generalization ability, we also test Tract2Shape on the unseen PPMI dataset. Tract2Shape outperforms SOTA deep learning models across all ten shape measures, achieving the highest average Pearson's r and the lowest nMSE on the HCP-YA dataset. The ablation study shows that both multimodal input and PCA contribute to performance gains. On the unseen testing PPMI dataset, Tract2Shape maintains a high Pearson's r and low nMSE, demonstrating strong generalizability in cross-dataset evaluation. Tract2Shape enables fast, accurate, and generalizable prediction of white matter shape measures from tractography data, supporting scalable analysis across datasets. This framework lays a promising foundation for future large-scale white matter shape analysis.

白质形态深度学习脑网络影像分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。