arXiv:2502.12180eess.IVcs.AI2025-02被引 6

解决脑影像多模态联邦学习中数据缺失问题,提升跨机构协作精度。

ClusMFL: A Cluster-Enhanced Framework for Modality-Incomplete Multimodal Federated Learning in Brain Imaging Analysis

  • 通过聚类构建模态特征中心,实现跨机构特征对齐与缺失模态补全。
  • 在ADNI数据集上,面对不同缺失程度仍保持领先性能,准确率显著提升。
  • 适合医疗数据隐私严格、模态不全的跨机构脑影像研究团队使用。

多模态联邦学习(MFL)在医疗领域具有重要价值,尤其在脑影像分析中需跨机构协作训练模型。然而,实际中常出现机构级或实例级模态缺失(如部分医院无PET或CT数据),现有方法通常假设模态完整或简化处理此问题。本文提出ClusMFL框架,模拟更真实的缺失场景,利用FINCH算法为每类模态-标签组合构建特征聚类中心,捕捉细粒度数据分布。这些中心用于同模态内特征对齐(监督对比学习),并作为缺失模态的代理,促进跨模态知识迁移。此外,引入模态感知聚合策略,在严重模态缺失下进一步提升性能。在包含结构化MRI和PET扫描的ADNI数据集上的实验表明,ClusMFL在多种缺失比例下均达到最优表现,为跨机构脑影像分析提供可扩展解决方案。

原文摘要 · Abstract (English)

Multimodal Federated Learning (MFL) has emerged as a promising approach for collaboratively training multimodal models across distributed clients, particularly in healthcare domains. In the context of brain imaging analysis, modality incompleteness presents a significant challenge, where some institutions may lack specific imaging modalities (e.g., PET, MRI, or CT) due to privacy concerns, device limitations, or data availability issues. While existing work typically assumes modality completeness or oversimplifies missing-modality scenarios, we simulate a more realistic setting by considering both client-level and instance-level modality incompleteness in this study. Building on this realistic simulation, we propose ClusMFL, a novel MFL framework that leverages feature clustering for cross-institutional brain imaging analysis under modality incompleteness. Specifically, ClusMFL utilizes the FINCH algorithm to construct a pool of cluster centers for the feature embeddings of each modality-label pair, effectively capturing fine-grained data distributions. These cluster centers are then used for feature alignment within each modality through supervised contrastive learning, while also acting as proxies for missing modalities, allowing cross-modal knowledge transfer. Furthermore, ClusMFL employs a modality-aware aggregation strategy, further enhancing the model's performance in scenarios with severe modality incompleteness. We evaluate the proposed framework on the ADNI dataset, utilizing structural MRI and PET scans. Extensive experimental results demonstrate that ClusMFL achieves state-of-the-art performance compared to various baseline methods across varying levels of modality incompleteness, providing a scalable solution for cross-institutional brain imaging analysis.

联邦学习脑影像多模态数据缺失

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。