arXiv:2609.05223cs.LG2026-09

解决医疗联邦学习中数据不均衡导致模型偏倚的问题

FedDRAW: Federated Dual Reputation Annealing Weighting for Heterogeneous Multi-Institutional Chest Radiograph Classification

论文配图:FedDRAW: Federated Dual Reputation Annealing Weighting for Heterogeneous Multi-Institutional Chest Radiograph Classification
图 1 · 摘自论文原文
  • 用双权重机制融合数据量与参数相似度,动态调整各机构贡献
  • 在两个胸部X光数据集上,性能超越7种基线方法,平均排名最高
  • 适合多机构协作的医疗诊断模型训练,尤其适用于数据差异大的场景

人工智能在医学诊断中前景广阔,但需大量无偏数据,而医疗数据分散于各医院,无法集中以保护隐私。联邦学习(FL)使各医院在本地训练共享模型,数据保留在本地。训练通过通信轮次进行,各机构本地训练后将模型返回服务器,由加权平均合并。聚合权重决定各机构知识对全局模型的影响。联邦平均(FedAvg)按本地样本数量分配权重,导致小而高质量机构长期影响有限,大机构可能主导模型即使其数据信息量低。本文提出联邦双重声誉退火加权(FedDRAW),一种服务器端聚合方法,结合数据量先验与客户端与全局参数间的余弦相似度,并采用两套耦合退火调度。内层调度将客户端声誉从数据量先验逐步转向相似度;外层延迟退火调度控制softmax逆温度,在早期和中期保持权重选择性,收敛时趋于均匀。我们在两个胸部X光数据集(CheXpert 和 ChestMNIST)的12种模拟客户端划分场景下,对八种方法(包括七种联邦基线)进行了评估,所有实验采用相同本地训练设置。结果表明,FedDRAW在AUC和敏感性与特异性几何均值(GM)两项指标上均取得最高平均排名,经弗里德曼检验与奈门尼后验分析确认,各方法间差异具有统计显著性。同时调度两种信号而非仅依赖样本数固定权重,可实现更少偏倚的诊断模型。

原文摘要 · Abstract (English)

Artificial intelligence models are promising for medical diagnosis, but they require large numbers of unbiased data, which in medicine are distributed across hospitals and cannot be centralized to protect patient privacy. Federated Learning (FL) addresses this, since hospitals train one shared diagnostic model while patient data remain local. Training proceeds in communication rounds, in which each hospital trains the shared model locally and returns it to the server for merging by weighted average. This aggregation weight determines whose institutional knowledge shapes the result. Federated averaging (FedAvg) sets it in proportion to local sample count, so a small but informative hospital is permanently assigned a small influence, andl argest clients could dominate the global model even when they are less informative. We propose Federated Dual Reputation Annealing Weighting (FedDRAW), a server-side aggregation method that combines a data-size prior with the cosine similarity between client and global parameters under two coupled annealing schedules. An inner schedule shifts client reputation from the size prior towards similarity. An outer, deferred annealing schedule on the softmax inverse temperature keeps the weighting selective in the early and middle rounds and relaxes it to uniformity at convergence. We evaluate FedDRAW on 12 simulated client-partition scenarios of two chest radiograph datasets (CheXpert and ChestMNIST), against seven federated baselines under identical local training settings. FedDRAW achieved the highest average rank among all eight methods under both AUC and the geometric mean (GM) of sensitivity and specificity, which a Friedman test with Nemenyi post-hoc analysis confirmed to be a statistically significant difference between the methods. Scheduling two signals, rather than fixing the weights by sample count alone, could enable less biased diagnostic models.

联邦学习医疗AI模型聚合数据异构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。