任意模态输入的颅神经纤维束分割模型,提升临床适用性
An Arbitrary-Modal Fusion Network for Volumetric Cranial Nerves Tract Segmentation
- 以T1w图像为主导,动态融合其他模态信息,支持任意组合输入
- 在HCP和临床多壳扩散MRI数据集上均达领先性能
- 适合设备不全或数据缺失场景下的颅神经研究与诊疗
颅神经纤维束分割为个体神经形态与走行分析提供了重要量化工具。现有多模态分割网络如CNTSeg结合结构磁共振(MRI)与扩散MRI,表现良好。然而,由于设备限制、隐私保护及工作条件,临床实践中获取完整多模态数据往往耗时甚至不可行。本文提出新型任意模态融合网络CNTSeg-v2,通过一个模型处理不同模态组合。以易获取且贡献最大的T1加权(T1w)图像为主模态,指导其他辅助模态的信息选择。模型引入任意模态协作模块(ACM),在T1w监督下有效提取其他模态特征;同时构建深度距离引导的多阶段(DDM)解码器,利用符号距离图修正细小误差与断裂,提升分割精度。在人类连接组计划(HCP)与临床多壳扩散MRI(MDM)数据集上的实验表明,CNTSeg-v2显著优于所有对比方法,达到当前最优水平。
原文摘要 · Abstract (English)
The segmentation of cranial nerves (CNs) tract provides a valuable quantitative tool for the analysis of the morphology and trajectory of individual CNs. Multimodal CNs tract segmentation networks, e.g., CNTSeg, which combine structural Magnetic Resonance Imaging (MRI) and diffusion MRI, have achieved promising segmentation performance. However, it is laborious or even infeasible to collect complete multimodal data in clinical practice due to limitations in equipment, user privacy, and working conditions. In this work, we propose a novel arbitrary-modal fusion network for volumetric CNs tract segmentation, called CNTSeg-v2, which trains one model to handle different combinations of available modalities. Instead of directly combining all the modalities, we select T1-weighted (T1w) images as the primary modality due to its simplicity in data acquisition and contribution most to the results, which supervises the information selection of other auxiliary modalities. Our model encompasses an Arbitrary-Modal Collaboration Module (ACM) designed to effectively extract informative features from other auxiliary modalities, guided by the supervision of T1w images. Meanwhile, we construct a Deep Distance-guided Multi-stage (DDM) decoder to correct small errors and discontinuities through signed distance maps to improve segmentation accuracy. We evaluate our CNTSeg-v2 on the Human Connectome Project (HCP) dataset and the clinical Multi-shell Diffusion MRI (MDM) dataset. Extensive experimental results show that our CNTSeg-v2 achieves state-of-the-art segmentation performance, outperforming all competing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。