arXiv:2602.01633cs.CV2026-02中稿 · Knowledge-Based Sy…被引 1

针对医疗影像分类中的数据异构与类别不平衡,提出自适应聚焦损失联邦学习框架。

Federated Vision Transformer with Adaptive Focal Loss for Medical Image Classification

  • 引入动态聚焦损失,按客户端数据分布自适应调整少数类权重。
  • 在三个公开数据集上准确率提升0.98%至41.69%,优于多种主流模型。
  • 适合医疗领域联邦学习场景,尤其适用于数据分布不均的多中心研究。

尽管视觉变换器(ViT)等深度学习模型取得了显著进展,但通常需要大规模数据集。受数据隐私法规限制,原始医疗影像数据难以获取。联邦学习(FL)通过不交换数据即可实现全局模型聚合,解决了这一问题。然而,本地客户端的数据异构性与类别不平衡会影响模型泛化能力。本文提出一种融合动态自适应聚焦损失(DAFL)和客户端感知聚合策略的联邦学习框架。设计动态类别不平衡系数,根据各客户端样本分布与类别分布自动调节,确保少数类获得足够关注,避免稀疏数据被忽略。为应对客户端异构性,采用基于数据规模与特征的加权聚合策略,更好捕捉客户端间差异。在ISIC、Ocular Disease、RSNA-ICH三个公开数据集上的分类结果表明,该框架在多数情况下优于DenseNet121、ResNet50、ViT-S/16、ViT-L/32、FedCLIP、Swin Transformer、CoAtNet、MixNet,准确率提升0.98%至41.69%。对不平衡的ISIC数据集进行消融实验,验证了所提损失函数与聚合策略相比传统方法的有效性。代码已开源:https://github.com/AIPMLab/ViT-FLDAF。

原文摘要 · Abstract (English)

While deep learning models like Vision Transformer (ViT) have achieved significant advances, they typically require large datasets. With data privacy regulations, access to many original datasets is restricted, especially medical images. Federated learning (FL) addresses this challenge by enabling global model aggregation without data exchange. However, the heterogeneity of the data and the class imbalance that exist in local clients pose challenges for the generalization of the model. This study proposes a FL framework leveraging a dynamic adaptive focal loss (DAFL) and a client-aware aggregation strategy for local training. Specifically, we design a dynamic class imbalance coefficient that adjusts based on each client's sample distribution and class data distribution, ensuring minority classes receive sufficient attention and preventing sparse data from being ignored. To address client heterogeneity, a weighted aggregation strategy is adopted, which adapts to data size and characteristics to better capture inter-client variations. The classification results on three public datasets (ISIC, Ocular Disease and RSNA-ICH) show that the proposed framework outperforms DenseNet121, ResNet50, ViT-S/16, ViT-L/32, FedCLIP, Swin Transformer, CoAtNet, and MixNet in most cases, with accuracy improvements ranging from 0.98\% to 41.69\%. Ablation studies on the imbalanced ISIC dataset validate the effectiveness of the proposed loss function and aggregation strategy compared to traditional loss functions and other FL approaches. The codes can be found at: https://github.com/AIPMLab/ViT-FLDAF.

联邦学习视觉变换器医疗影像类别不平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。