让异构智能体在不牺牲个性化的前提下高效协作学习。
Personalized Collaborative Learning with Affinity-Based Variance Reduction
- 基于亲和性设计偏差与重要性校正机制,自适应融合协作与个性化。
- 样本复杂度降低至独立学习的1/max{n⁻¹, δ}倍,实现动态加速。
- 无需预先知晓异构程度,适合多样智能体协同场景。
多智能体学习面临根本矛盾:如何在保持个体差异性的同时实现分布式协作。当目标是完全个性化且需适应未知异构水平时,该矛盾尤为突出——希望在智能体相似时获得协作加速,而在差异大时不致性能下降。为此,本文提出个性化协同学习(PCL)框架,使异构智能体能无缝自适应地协同学习个性化解。通过精心设计的偏差修正与重要性修正机制,所提方法AffPCL可稳健处理环境与目标异构性。理论证明,AffPCL将样本复杂度相比独立学习降低了max{n⁻¹, δ}倍,其中n为智能体数量,δ∈[0,1]衡量其异构程度。该亲和性加速机制自动介于同质情形下联邦学习的线性加速与独立学习基线之间,无需系统先验知识。进一步分析揭示,即使与极度不同的智能体协作,单个智能体仍可能获得线性加速,为高异构性下的个性化与协作提供了新洞见。
原文摘要 · Abstract (English)
Multi-agent learning faces a fundamental tension: leveraging distributed collaboration without sacrificing the personalization needed for diverse agents. This tension intensifies when aiming for full personalization while adapting to unknown heterogeneity levels -- gaining collaborative speedup when agents are similar, without performance degradation when they are different. Embracing the challenge, we propose personalized collaborative learning (PCL), a novel framework for heterogeneous agents to collaboratively learn personalized solutions with seamless adaptivity. Through carefully designed bias correction and importance correction mechanisms, our method AffPCL robustly handles both environment and objective heterogeneity. We prove that AffPCL reduces sample complexity over independent learning by a factor of $\max\{n^{-1}, δ\}$, where $n$ is the number of agents and $δ\in[0,1]$ measures their heterogeneity. This affinity-based acceleration automatically interpolates between the linear speedup of federated learning in homogeneous settings and the baseline of independent learning, without requiring prior knowledge of the system. Our analysis further reveals that an agent may obtain linear speedup even by collaborating with arbitrarily dissimilar agents, unveiling new insights into personalization and collaboration in the high heterogeneity regime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。