通过多阶段状态匹配提升医疗影像联邦学习的公平性
Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching
- 用多个收敛状态替代单一指标,更全面评估模型训练过程
- 在RSNA ICH和ISIC 2019上实现优于现有方法的测试公平性
- 适合关注医疗数据异质性下模型公平性的研究者
尽管联邦学习在医疗应用中潜力巨大,但机构间影像质量不一致——尤其是少数客户端提供低质量数据——导致联邦模型偏向常见高质量图像,引发显著公平性问题。现有公平联邦学习方法通过对齐单个0阶或1阶收敛状态(如训练损失或锐度)取得一定效果,但我们认为这种单一指标无法充分捕捉收敛特性,难以有效指导公平学习。为此,本文提出一个通用框架,通过在不同搜索距离下计算锐度或扰动损失来评估多个收敛状态,并在客户端间促进这些状态的公平性。所提方法FedISM+中,搜索距离随时间逐步演进,聚焦不同状态,并在本地训练与全局聚合中引入两个组件,确保各状态跨客户端公平。该过程渐进地使所有状态收敛趋于均衡,从而提升测试阶段的公平性。在著名的RSNA ICH和ISIC 2019数据集上的实证评估表明,FedISM+显著优于现有先进方法。代码已开源。
原文摘要 · Abstract (English)
Despite the potential of federated learning in medical applications, inconsistent imaging quality across institutions-stemming from lower-quality data from a minority of clients-biases federated models toward more common high-quality images. This raises significant fairness concerns. Existing fair federated learning methods have demonstrated some effectiveness in solving this problem by aligning a single 0th- or 1st-order state of convergence (e.g., training loss or sharpness). However, we argue in this work that fairness based on such a single state is still not an adequate surrogate for fairness during testing, as these single metrics fail to fully capture the convergence characteristics, making them suboptimal for guiding fair learning. To address this limitation, we develop a generalized framework. Specifically, we propose assessing convergence using multiple states, defined as sharpness or perturbed loss computed at varying search distances. Building on this comprehensive assessment, we propose promoting fairness for these states across clients to achieve our ultimate fairness objective. This is accomplished through the proposed method, FedISM+. In FedISM+, the search distance evolves over time, progressively focusing on different states. We then incorporate two components in local training and global aggregation to ensure cross-client fairness for each state. This gradually makes convergence equitable for all states, thereby improving fairness during testing. Our empirical evaluations, performed on the well-known RSNA ICH and ISIC 2019 datasets, demonstrate the superiority of FedISM+ over existing state-of-the-art methods for fair federated learning. The code is available at https://github.com/wnn2000/FFL4MIA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。