arXiv:2509.16436cs.CV2025-09

针对缺失影像模态问题,提出自适应补偿的肝脏纤维化分期模型。

Improved mmFormer for Liver Fibrosis Staging via Missing-Modality Compensation

  • 设计动态补全模块,通过可学习参数合成缺失模态特征。
  • 在真实世界数据上实现66.67%肝硬化检测准确率,74.17%显著纤维化检测准确率。
  • 适用于多模态影像不全的临床场景,尤其适合医疗设备差异大时使用。

真实临床中,因设备差异或患者配合问题,磁共振成像(MRI)常出现模态缺失,严重影响模型性能。为此,我们基于mmFormer架构提出一种新型多模态分类模型,引入自适应模块以处理任意缺失组合。该模型保留mmFormer的模态特定编码器与模态相关编码器,提取跨可用模态的一致病灶特征。同时,集成缺失模态补偿模块,利用零填充、模态可用性掩码及可学习统计参数的Delta函数,动态生成代理特征以恢复缺失信息。为提升预测性能,采用交叉验证集成策略:在不同数据折上训练多个模型,并在推理阶段应用软投票。方法在CARE 2025挑战赛的肝纤维化分期(LiFS)任务测试集上评估,基于非增强动态MRI扫描(含T1WI、T2WI、DWI)。在同分布厂商数据上,肝硬化检测准确率达66.67%,曲线下面积(AUC)为71.73%;显著纤维化检测准确率为74.17%,AUC为68.48%。

原文摘要 · Abstract (English)

In real-world clinical settings, magnetic resonance imaging (MRI) frequently suffers from missing modalities due to equipment variability or patient cooperation issues, which can significantly affect model performance. To address this issue, we propose a multimodal MRI classification model based on the mmFormer architecture with an adaptive module for handling arbitrary combinations of missing modalities. Specifically, this model retains the hybrid modality-specific encoders and the modality-correlated encoder from mmFormer to extract consistent lesion features across available modalities. In addition, we integrate a missing-modality compensation module which leverages zero-padding, modality availability masks, and a Delta Function with learnable statistical parameters to dynamically synthesize proxy features for recovering missing information. To further improve prediction performance, we adopt a cross-validation ensemble strategy by training multiple models on different folds and applying soft voting during inference. This method is evaluated on the test set of Comprehensive Analysis & Computing of REal-world medical images (CARE) 2025 challenge, targeting the Liver Fibrosis Staging (LiFS) task based on non-contrast dynamic MRI scans including T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), and diffusion-weighted imaging (DWI). For Cirrhosis Detection and Substantial Fibrosis Detection on in-distribution vendors, our model obtains accuracies of 66.67%, and 74.17%, and corresponding area under the curve (AUC) scores of 71.73% and 68.48%, respectively.

肝脏纤维化多模态缺失模态医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。