arXiv:2412.01993cs.LGmath.OC2024-12被引 8

解决分布式贝叶斯学习中的偏差问题,提升采样精度。

Generalized EXTRA stochastic gradient Langevin dynamics

  • 基于EXTRA思想设计无偏分布式采样算法。
  • 全批量下消除网络引起的采样偏差,小批量下性能更优。
  • 适合数据分散、隐私敏感的协同学习场景。

Langevin算法是贝叶斯学习中常用的马尔可夫链蒙特卡洛方法,尤其适用于从参数模型的后验分布中采样。其随机版本如随机梯度Langevin动力学(SGLD)可通过随机抽取的小批量数据实现大规模数据的迭代学习,具备良好可扩展性。然而,当数据分布在受通信和隐私约束的网络中时,标准SGLD无法适用。为此,我们采用分布式SGLD(DE-SGLD)算法,使网络中的多个代理在不共享个体数据的情况下协作完成贝叶斯学习。但现有DE-SGLD算法在每个代理处引入偏差,且该偏差在使用全批量时仍存在,源于网络结构影响。受EXTRA及其推广算法启发,我们提出广义EXTRA随机梯度Langevin动力学,可在全批量设置下完全消除此偏差。此外,我们在小批量设置下证明了该算法的性能界显著优于文献中已有DE-SGLD方法。数值实验也验证了所提方法的高效性。

原文摘要 · Abstract (English)

Langevin algorithms are popular Markov Chain Monte Carlo methods for Bayesian learning, particularly when the aim is to sample from the posterior distribution of a parametric model, given the input data and the prior distribution over the model parameters. Their stochastic versions such as stochastic gradient Langevin dynamics (SGLD) allow iterative learning based on randomly sampled mini-batches of large datasets and are scalable to large datasets. However, when data is decentralized across a network of agents subject to communication and privacy constraints, standard SGLD algorithms cannot be applied. Instead, we employ decentralized SGLD (DE-SGLD) algorithms, where Bayesian learning is performed collaboratively by a network of agents without sharing individual data. Nonetheless, existing DE-SGLD algorithms induce a bias at every agent that can negatively impact performance; this bias persists even when using full batches and is attributable to network effects. Motivated by the EXTRA algorithm and its generalizations for decentralized optimization, we propose the generalized EXTRA stochastic gradient Langevin dynamics, which eliminates this bias in the full-batch setting. Moreover, we show that, in the mini-batch setting, our algorithm provides performance bounds that significantly improve upon those of standard DE-SGLD algorithms in the literature. Our numerical results also demonstrate the efficiency of the proposed approach.

贝叶斯学习分布式优化采样算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。