提出降低非可逆随机梯度采样方差的新方法,提升采样效率。
Variance Reduction for Stochastic Gradient Generalized Non-reversible Langevin Monte Carlo Algorithms

- 通过构造反称扰动,有效抑制小步长下的估计波动
- 理论证明方差随步长平方倒数增长时满足中心极限定理
- 适用于贝叶斯线性/逻辑回归,实测显示误差更低
研究广义非可逆朗之万动力学的随机梯度欧拉-马鲁雅米估计器的首阶波动。在适配小步长中心极限定理的结构假设下,结合无偏随机梯度预言机,证明在步长趋于零时,对逆平方步长量级的时域内取平均满足中心极限定理。极限方差由全梯度扩散过程的泊松方程刻画,并以算子形式重写,关联连续时间渐近方差。在标准算子理论假设下,推导出使反称扰动严格减小首阶波动常数的充分条件。同时识别出可直接适用主定理的有界光滑预测可观测变量。作为独立高斯计算,给出二次哈密顿量与线性可观测量的闭式公式。框架涵盖非可逆朗之万动力学及扩展状态例证,包括无海森矩阵高分辨率动力学、正定类梯度调整欠阻尼朗之万动力学等支持随机梯度的情形。基于合成数据的贝叶斯线性回归和真实数据的贝叶斯逻辑回归数值实验验证了预测的高斯波动,并表明非可逆方案始终优于其可逆基线,均方根误差(RMSE)更低。
原文摘要 · Abstract (English)
We study the leading-order fluctuation of stochastic gradient Euler-Maruyama estimators for generalized non-reversible Langevin dynamics. Under structural assumptions tailored to the small-stepsize central limit theorem and under an unbiased stochastic gradient oracle, we prove that the empirical average over a horizon of order the inverse squared stepsize satisfies a central limit theorem in the vanishing-stepsize regime. The limiting variance is characterized through the Poisson equation of the limiting full-gradient diffusion. We then rewrite this constant in an operator form that links it to the continuous-time asymptotic variance and, under standard operator-theoretic assumptions, derive a sufficient condition under which an anti-symmetric perturbation strictly reduces the leading-order fluctuation constant relative to the reversible baseline. We also identify bounded smooth predictive observables that re directly covered by the main theorem. As a separate Gaussian calculation beyond the bounded-test-function regime, we obtain closed-form formulas for quadratic Hamiltonians and linear observables. The framework covers non-reversible Langevin dynamics and augmented-state examples including Hessian-free high-resolution dynamics and a positive-definite subclass of gradient-adjusted underdamped Langevin dynamics that allow stochastic gradients. Numerical experiments on basic examples and Bayesian linear regression using synthetic data, and Bayesian logistic regression using real data support the predicted Gaussian fluctuations and show that the non-reversible schemes consistently reduce the root mean squared error (RMSE) relative to their reversible baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。