用半监督方法融合多模态MRI数据,精准勾画视觉通路。
Cross-Sequence Semi-Supervised Learning for Multi-Parametric MRI-Based Visual Pathway Delineation
- 设计关联约束特征分解,捕捉不同MRI序列的独特信息
- 通过一致性增强未标注数据,提升小样本下的分割效果
- 适合医学图像分割、少样本学习研究者参考
准确勾画视觉通路(VP)对理解人类视觉系统及诊断相关疾病至关重要。多参数磁共振成像(multi-parametric MRI)被视为有效识别VP的重要手段。然而,现有方法难以建模不同MRI序列间的复杂跨序列关系,且严重依赖大量标注数据,获取成本高。本文提出一种新型半监督多参数特征分解框架用于VP分割:首先设计相关性约束特征分解(CFD),通过提取各序列特异性特征并缓解多参数信息融合难度;其次引入基于一致性的样本增强(CSE)模块,从无标签数据中生成并强化有意义的边缘信息。在两个公开数据集和一个自建多壳扩散MRI(MDM)数据集上验证,实验结果表明,该方法在分割性能上优于七种先进方法。
原文摘要 · Abstract (English)
Accurately delineating the visual pathway (VP) is crucial for understanding the human visual system and diagnosing related disorders. Exploring multi-parametric MR imaging data has been identified as an important way to delineate VP. However, due to the complex cross-sequence relationships, existing methods cannot effectively model the complementary information from different MRI sequences. In addition, these existing methods heavily rely on large training data with labels, which is labor-intensive and time-consuming to obtain. In this work, we propose a novel semi-supervised multi-parametric feature decomposition framework for VP delineation. Specifically, a correlation-constrained feature decomposition (CFD) is designed to handle the complex cross-sequence relationships by capturing the unique characteristics of each MRI sequence and easing the multi-parametric information fusion process. Furthermore, a consistency-based sample enhancement (CSE) module is developed to address the limited labeled data issue, by generating and promoting meaningful edge information from unlabeled data. We validate our framework using two public datasets, and one in-house Multi-Shell Diffusion MRI (MDM) dataset. Experimental results demonstrate the superiority of our approach in terms of delineation performance when compared to seven state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。