arXiv:2607.04085cs.LGcs.AI2026-07

解决联邦学习中客户端内外异质性难题,提升路由与预测精度。

FedSPM: Routing-Enabled Federated Learning under Dual Heterogeneity via Semiparametric Mixture

论文配图:FedSPM: Routing-Enabled Federated Learning under Dual Heterogeneity via Semiparametric Mixture
图 1 · 摘自论文原文
  • 用半参数混合模型建模每个客户端的潜在子群体,实现灵活表示。
  • 在真实医疗数据上,路由准确率和分类性能均显著优于基线方法。
  • 适合医疗等存在复杂数据异质性的联邦学习场景使用。

路由预测联邦学习将客户端间异质性视为系统智能资源:推理时,服务器将外部请求路由至最匹配的客户端进行预测。现有方法通常假设客户端内部数据同质,忽视了局部数据中潜在的子群体差异。例如,同一医院的相同诊断患者可能表现出形态学不同的疾病亚型。客户端间与内部异质性共存(称为双重异质性)会损害路由与预测效果。为此,我们提出 FedSPM,一种支持路由的半参数混合框架,用客户端特有的潜在组件表示每个客户端。每个组件结合分类预测分布与用于路由的特征分布。为灵活建模特征分布并有效跨客户端共享信息,FedSPM 以经验似然估计的公共非参数测度为基准,建模密度比。我们开发了一种联邦期望最大化算法,优化可处理的代理目标,并证明当代理误差受控时,精确轮廓目标收敛速率达到标准的 $/mathcal{O}(1/ ext{sqrt}{T})$。在可控基准和真实世界医疗数据上的实验表明,双重异质性下路由与预测性能均有持续提升。代码见 https://github.com/zijianwang0510/FedSPM。

原文摘要 · Abstract (English)

Routing-prediction federated learning has emerged as a new paradigm that reframes inter-client heterogeneity as a resource for system-level intelligence: at inference time, the server routes each external query to the best-matched client for prediction. Existing approaches, however, typically treat each client as internally homogeneous, overlooking latent subpopulations within local data. For example, patients with the same diagnosis at one hospital may exhibit morphologically distinct disease subtypes. The coexistence of inter-client and intra-client heterogeneity, which we call dual heterogeneity, can impair both routing and prediction. To address this challenge, we propose FedSPM, a routing-enabled semiparametric mixture framework that represents each client using client-specific latent components. Each component combines a predictive distribution for classification with a feature distribution for routing. To flexibly model feature distributions while effectively sharing information across clients, FedSPM models their density ratios relative to a common nonparametric measure estimated via empirical likelihood. We develop a federated expectation-maximization algorithm that optimizes a tractable surrogate and prove convergence of the exact profiled objective at the standard $\mathcal{O}(1/\sqrt{T})$ rate when the surrogate errors are properly controlled. Experiments on controlled benchmarks and real-world medical data demonstrate consistent improvements in routing and prediction under dual heterogeneity. Code is available at https://github.com/zijianwang0510/FedSPM.

联邦学习异质性路由医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。