arXiv:2608.18634cs.LG2026-08

低预算下联邦主动学习中,同质数据更需协调查询以避免重复。

Coordination on a Budget: Federated Active Learning with Few Labels

论文配图:Coordination on a Budget: Federated Active Learning with Few Labels
图 1 · 摘自论文原文
  • 用联邦表示学习将客户端数据映射到共享嵌入空间
  • 在低预算下性能超越现有方法,即使后者预算更高
  • 适合隐私敏感场景下的高效标注,尤其数据同质时

联邦主动学习(FAL)应对数据隐私与标签稀缺的双重挑战,但在缺乏全局数据视图的情况下,协同查询选择更为困难。本文研究低预算场景下的跨服务器联邦主动学习,发现:在低预算下,同质(IID)数据需要更强的协调以避免重复查询,而异质数据天然促进多样性;这一趋势在高预算时反转。因此,在低预算下,同质数据反而更难进行有效的查询选择。基于此,我们提出新框架,利用联邦表示学习将客户端数据对齐至共享嵌入空间,使服务器可基于可选混淆的嵌入实现全局协调的主动选择,同时保持标注本地化。尽管运行在更具挑战性的低预算场景,其性能仍优于现有方法,即便后者拥有更大标注预算,证明了在隐私约束下集中式协调的价值。

原文摘要 · Abstract (English)

Federated Active Learning (FAL) addresses the dual challenges of data privacy and label scarcity, where the absence of a global data view introduces additional hurdles for coordinated query selection. We study cross-silo FAL in the low-budget regime, where annotation decisions are most critical. We characterize, both theoretically and empirically, a heterogeneity reversal: in low-budget settings, homogeneous (IID) data requires stronger coordination to avoid redundant queries, whereas heterogeneous data naturally promotes diversity; this trend reverses at higher budgets. Thus, in contrast to the standard federated learning (FL) narrative where heterogeneity is a primary challenge, we show that IID settings are more challenging for query selection in FAL. Motivated by these findings, we propose a new FAL framework that utilizes federated representation learning to align client data in a shared embedding space. This enables the server to perform globally coordinated active selection over optionally obfuscated client embeddings, while annotation remains local to each client. Although our framework operates in the more challenging low-budget regime, it achieves performance that surpasses existing FAL methods even when they are given substantially larger annotation budgets, demonstrating the value of centralized coordination under privacy constraints.

联邦学习主动学习低预算数据异质性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。