arXiv:2607.07538cs.LGmath.AP2026-07

研究训练中避开危险区域的概率,揭示了轨迹瞬态风险与几何形状的关系。

Avoiding unsafe sets when training with Langevin Dynamics

  • 用局部松弛率约束轨迹穿过危险区的概率,突破全局谱间隙限制。
  • 在低噪声下,平衡态时危险区概率随维度指数衰减,但路径上可能瞬时暴涨。
  • 适用于高维强凸优化中安全性分析,尤其关注初始阶段的失控风险。

使用噪声梯度下降训练模型可理想化为过阻尼Langevin动力学。一个自然的安全问题是:轨迹位于指定故障区域 $\mathcal{A}_H$ 的概率 $ν_t(\mathcal{A}_H) = \mathbb{P}(Q_t \in \mathcal{A}_H)$ 是否可控?本文研究了 $d$ 维空间中光滑强凸损失函数下的该问题,其中 $\mathcal{A}_H$ 与最小值点间存在能量间隙。训练结束时,平衡质量 $π(\mathcal{A}_H)$ 随维度 $d$ 指数级减小,且在小噪声下具有能量屏障速率。沿轨迹,得到一个无形状依赖的界 $ν_t(\mathcal{A}_H) \le π(\mathcal{A}_H)(1 + \sqrt{χ_0^2/π(\mathcal{A}_H)}\,e^{-mt})$,表明概率在约 $d$ 量级的烧入期后收敛至(两倍)静态值,仅依赖全局谱间隙 $m$。通过奥尔恩斯坦-乌伦贝克例子验证:即使平衡质量极小,角向壳层仍可瞬时膨胀至指数级。为消除此现象,引入基于区域中心指示函数谱测度的局部松弛率,而非狄利克雷型瑞利商。对于几何隔离区域,该速率超越全局速率,缩短烧入时间,并以最大值原理保证轨迹概率对所有时间均匀有界。

原文摘要 · Abstract (English)

Training a model with noisy gradient descent can be idealized as overdamped Langevin dynamics, and a natural safety question is to bound the probability $ν_t(\mathcal{A}_H) = \mathbb{P}(Q_t \in \mathcal{A}_H)$ that the trajectory lies in a designated failure region $\mathcal{A}_H$. We study this for a smooth, strongly convex loss in $d$ dimensions, with $\mathcal{A}_H$ separated from the minimizer by an energy gap. At the end of training, the equilibrium mass $π(\mathcal{A}_H)$ is exponentially small in $d$, with a complementary energy-barrier rate when the noise is small. Along the trajectory, a shape-free bound $ν_t(\mathcal{A}_H) \le π(\mathcal{A}_H)(1 + \sqrt{χ_0^2/π(\mathcal{A}_H)}\,e^{-mt})$ shows the in-set probability relaxes to (twice) the static value after a burn-in of order $d$, using only the global spectral gap $m$. A worked Ornstein-Uhlenbeck example shows this burn-in is necessary: an angular slice of the equilibrium shell can transiently swell by a factor exponential in $d$, though its equilibrium mass is tiny. To rule this out we introduce a local relaxation rate, defined through the spectral measure of the region's centered indicator rather than a Dirichlet-form Rayleigh quotient. For geometrically isolated regions this rate exceeds the global one, shrinking the burn-in, and with a maximum-principle ceiling it caps the trajectory probability uniformly in time. Strong convexity sets how fast training relaxes, but the shape of the unsafe set decides whether the trajectory bulges through it on the way to equilibrium.

Langevin安全分析强凸优化概率边界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。