arXiv:2608.26989cs.LGcs.SY2026-08

在未知任务关系下,通过学习任务图实现去中心化多任务协同优化。

Decentralized Multitask Learning over Learned Task Graphs

  • 先从噪声数据中估计任务图拉普拉斯矩阵,再用其指导协作学习。
  • 学习到的任务图使性能显著优于非协作学习,接近已知图基准。
  • 适用于分布式场景中任务关系未知的多任务学习问题。

本文研究网络环境下任务关系未知时的去中心化多任务学习。现有图正则化框架通常假设已知结构,但实际场景需从分布式数据中直接学习任务依赖关系。我们提出一种两阶段去中心化策略:首先从带有噪声的非协作随机梯度迭代中估计广义图拉普拉斯矩阵;随后利用学习到的图实现协作式多任务扩散学习。该框架基于高斯马尔可夫随机场先验,导出图拉普拉斯的去中心化最大似然估计器。分析量化了拉普拉斯估计误差及其对多任务扩散递推稳态性能的影响,并引入拓扑敏感性指数以捕捉网络异质性效应。仿真结果验证了理论结论,表明由学习到的任务图所驱动的协作显著提升性能,且当估计步长足够小时,可逼近已知图基准。

原文摘要 · Abstract (English)

This paper investigates decentralized multitask learning over networks when the underlying task relationships are unknown. While existing graph-regularized multitask frameworks typically assume a known structure, practical settings often require learning inter-task dependencies directly from distributed data. We propose a decentralized two-phase strategy that first estimates a generalized graph Laplacian from noisy non-cooperative stochastic gradient iterates, and subsequently exploits the learned graph to enable cooperative multitask diffusion learning. This framework is motivated by a Gaussian Markov random field prior, which gives rise to a decentralized maximum likelihood estimator for the graph Laplacian. The analysis quantifies the Laplacian estimation error and its propagation to the steady-state performance of the multitask diffusion recursion, and introduces a topology sensitivity index to capture the effect of network heterogeneity. Simulation results corroborate the theoretical findings and demonstrate that cooperation enabled by the learned task graph significantly improves performance over non-cooperative learning, while approaching the true-graph baseline when the estimation stepsize is sufficiently small.

多任务学习去中心化图学习分布式优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。