提出新框架,让医疗影像多标签分类在异构数据下更高效、抗遗忘。
VGS-ATD: Robust Distributed Learning for Multi-Label Medical Image Classification Under Heterogeneous and Imbalanced Conditions
- 设计分布式学习框架,仅交换权重,保护隐私并适应异构数据。
- 在30个数据集上达92.7%准确率,比中心化高近8个百分点。
- 扩容后仅损失1%性能,适合持续学习的临床智能系统使用。
近年来,深度学习在医学影像任务中表现优异。然而,传统集中式学习存在严重隐私风险,因所有数据需汇聚至单一服务器。为缓解此问题,去中心化方法如联邦学习和蜂群学习应运而生,可在本地节点训练模型并仅共享权重。但此类方法在异构、不平衡数据下表现不佳,且因频繁通信与权重聚合导致效率低下。更重要的是,临床环境动态复杂,亟需可扩展、持续学习的AI系统。然而,集中式与去中心化模型在系统扩展时易发生灾难性遗忘,常需重新训练整个模型。为此,我们提出VGS-ATD分布式学习框架。在覆盖30个数据集、80个独立标签的分布式实验中,VGS-ATD总体准确率达92.7%,优于集中学习(84.9%)和蜂群学习(72.99%),而联邦学习因计算资源要求过高无法运行。此外,其扩展后现有节点准确率仅下降1%,远优于集中学习的20%下降,体现对灾难性遗忘的强鲁棒性。同时,计算成本较集中式与蜂群学习降低最高达50%,证实其高效性与可扩展性。
原文摘要 · Abstract (English)
In recent years, advanced deep learning architectures have shown strong performance in medical imaging tasks. However, the traditional centralized learning paradigm poses serious privacy risks as all data is collected and trained on a single server. To mitigate this challenge, decentralized approaches such as federated learning and swarm learning have emerged, allowing model training on local nodes while sharing only model weights. While these methods enhance privacy, they struggle with heterogeneous and imbalanced data and suffer from inefficiencies due to frequent communication and the aggregation of weights. More critically, the dynamic and complex nature of clinical environments demands scalable AI systems capable of continuously learning from diverse modalities and multilabels. Yet, both centralized and decentralized models are prone to catastrophic forgetting during system expansion, often requiring full model retraining to incorporate new data. To address these limitations, we propose VGS-ATD, a novel distributed learning framework. To validate VGS-ATD, we evaluate it in experiments spanning 30 datasets and 80 independent labels across distributed nodes, VGS-ATD achieved an overall accuracy of 92.7%, outperforming centralized learning (84.9%) and swarm learning (72.99%), while federated learning failed under these conditions due to high requirements on computational resources. VGS-ATD also demonstrated strong scalability, with only a 1% drop in accuracy on existing nodes after expansion, compared to a 20% drop in centralized learning, highlighting its resilience to catastrophic forgetting. Additionally, it reduced computational costs by up to 50% relative to both centralized and swarm learning, confirming its superior efficiency and scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。