用生成模型补全缺损影像,提升多中心胶质瘤诊断准确率
GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences

- 通过交叉注意力与动态门控生成缺失影像特征
- 训练数据量扩大97%,在跨中心场景下表现更优
- 适合处理多中心医疗影像数据不完整问题
当前胶质瘤诊断结合分子特征与病理学指导临床决策,但不同中心的影像协议差异导致影像序列不完整,使现有方法不得不丢弃大量临床数据,限制其应用。为此,我们提出GMENet——一种针对不完整影像序列的多中心胶质瘤诊断生成混合专家网络。首先设计基于交叉注意力的门控生成模块,利用可用序列通过交叉注意力与动态门控机制合成缺失序列特征,并引入循环一致性损失保持语义完整性;其次提出动态加权专家融合模块,在原始与合成双序列特征上进行混合专家交互与置信度感知融合,实现多任务预测。我们在四个内部数据集和两个公开数据库共1,241名患者的多中心队列上评估,结果表明GMENet将可使用训练数据扩展97%(相对于仅使用完整序列的数据),且持续优于在完整数据上训练的最先进方法,在跨中心分布偏移下展现出更强鲁棒性。
原文摘要 · Abstract (English)
Contemporary glioma diagnosis integrates molecular features with histopathology to guide clinical decision-making. However, in clinical settings, divergent imaging protocols result in incomplete MRI sequences, leading to two primary challenges: forcing existing frameworks to discard a large portion of clinical data during training and consequently limiting their clinical applicability. To address these limitations, we propose GMENet, a Generative Mixture of Experts Network for multi-center glioma diagnosis with incomplete imaging sequences. Firstly, we design a Cross-attention-based Gated Generation Module that synthesizes missing sequence features from available sequences via cross-attention and dynamic gating mechanisms, incorporating a cycle-consistency loss to preserve semantic integrity. Secondly, we introduce a Dynamically Weighted Experts Fusion Module that performs mixture-of-experts interaction and confidence-aware fusion over original and synthesized dual-sequence features for multi-task prediction. We evaluate GMENet on a multi-center cohort of 1,241 subjects from four in-house datasets and two public repositories. Experiments show that GMENet expands clinically usable training data by 97\%, relative to complete-sequence-only data. Furthermore, it consistently outperforms state-of-the-art methods trained on complete data, demonstrating improved robustness under cross-center distribution shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。