用图神经网络统一不同医疗影像模型,提升跨域泛化能力。
GNN-based Unified Deep Learning
- 将各类模型编码为图结构,在共享图空间中联合优化
- 在分布差异大的数据上测试,性能优于传统独立训练
- 适合多医院异构数据协同建模,尤其医疗影像场景
深度学习模型在医学影像中常因分布偏移而失去泛化能力,如成像技术、采集协议、患者群体和设备差异导致的数据分裂。实际中,各医院需针对本地数据训练不同架构的模型(如用于表格或网格数据的MLP/CNN,用于脑连接组等不规则数据的GNN)。如何在异构模型间实现协同训练并增强泛化性仍是个难题。本文提出统一学习范式,将各模型编码为图表示,通过图神经网络(uGNN)在共享图空间中引导优化。通过解耦个体模型参数并由统一GNN控制,实现跨不同架构(MLP/CNN/GNN)与分布的知识迁移与参数共享,显著提升泛化能力。在MorphoMNIST及两个MedMNIST基准(PneumoniaMNIST、BreastMNIST)上的实验表明,当模型在特定分布上训练、在混合分布上测试时,统一学习表现更优,对大分布偏移具有强鲁棒性。代码与基准:https://github.com/basiralab/uGNN
原文摘要 · Abstract (English)
Deep learning models often struggle to maintain generalizability in medical imaging, particularly under domain-fracture scenarios where distribution shifts arise from varying imaging techniques, acquisition protocols, patient populations, demographics, and equipment. In practice, each hospital may need to train distinct models - differing in learning task, width, and depth - to match local data. For example, one hospital may use Euclidean architectures such as MLPs and CNNs for tabular or grid-like image data, while another may require non-Euclidean architectures such as graph neural networks (GNNs) for irregular data like brain connectomes. How to train such heterogeneous models coherently across datasets, while enhancing each model's generalizability, remains an open problem. We propose unified learning, a new paradigm that encodes each model into a graph representation, enabling unification in a shared graph learning space. A GNN then guides optimization of these unified models. By decoupling parameters of individual models and controlling them through a unified GNN (uGNN), our method supports parameter sharing and knowledge transfer across varying architectures (MLPs, CNNs, GNNs) and distributions, improving generalizability. Evaluations on MorphoMNIST and two MedMNIST benchmarks - PneumoniaMNIST and BreastMNIST - show that unified learning boosts performance when models are trained on unique distributions and tested on mixed ones, demonstrating strong robustness to unseen data with large distribution shifts. Code and benchmarks: https://github.com/basiralab/uGNN
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。