arXiv:2509.11406cs.CV2025-09中稿 · MICCAI2025 ML-CDS …

动态生成模型应对医学影像缺模数据,提升诊断准确率。

No Modality Left Behind: Dynamic Model Generation for Incomplete Medical Data

  • 用超网络根据可用模态动态生成分类模型参数
  • 在25%完整度数据上准确率比现有方法高8%
  • 适合处理真实临床中不完整的多模态医疗数据

真实临床环境中,多模态医学影像深度学习常面临部分数据缺失问题。传统方法或丢弃缺失样本、或依赖插补、或沿用通道丢弃策略,限制了模型鲁棒性与泛化能力。为此,我们提出基于超网络的方法,根据可用模态动态生成任务特异性分类模型。不同于训练固定模型,超网络学习预测适配当前模态组合的模型参数,实现对所有样本的训练与推理,无论数据是否完整。我们在人工构造的不完整数据集上,对比了三种方法:仅在完整数据上训练的模型、先进的通道丢弃方法、以及基于插补的方法。结果表明,本方法在25%完整度(75%训练数据缺失模态)下,准确率绝对提升最高达8%,展现出更强适应性。该方法使单一模型可泛化于所有模态配置,为真实世界多模态医疗数据分析提供高效解决方案。

原文摘要 · Abstract (English)

In real world clinical environments, training and applying deep learning models on multi-modal medical imaging data often struggles with partially incomplete data. Standard approaches either discard missing samples, require imputation or repurpose dropout learning schemes, limiting robustness and generalizability. To address this, we propose a hypernetwork-based method that dynamically generates task-specific classification models conditioned on the set of available modalities. Instead of training a fixed model, a hypernetwork learns to predict the parameters of a task model adapted to available modalities, enabling training and inference on all samples, regardless of completeness. We compare this approach with (1) models trained only on complete data, (2) state of the art channel dropout methods, and (3) an imputation-based method, using artificially incomplete datasets to systematically analyze robustness to missing modalities. Results demonstrate superior adaptability of our method, outperforming state of the art approaches with an absolute increase in accuracy of up to 8% when trained on a dataset with 25% completeness (75% of training data with missing modalities). By enabling a single model to generalize across all modality configurations, our approach provides an efficient solution for real-world multi-modal medical data analysis.

多模态缺模数据超网络医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。