用自避行走加速马尔可夫链积分估计,误差随样本量更快速下降。
True Self-Avoiding Walk for Accelerating Markov-Chain Monte Carlo Integration
- 基于经验过度使用惩罚的自避行走机制,提升采样效率。
- 积分估计误差达到 $O(rac{ ootrom{log t}{}}{t})$,优于传统方法的 $t^{-1/2}$。
- 适合需要高精度积分估计的场景,如统计推断与复杂分布采样。
本文研究真自避行走(TSAW)作为改进马尔可夫链蒙特卡罗(MCMC)积分估计的机制。考虑在有限状态空间上、具有平稳分布 $π$ 且不可约的马尔可夫核 $P$ 所对应的自适应采样动态,其中转移概率根据经验过度使用情况进行惩罚。主要结果表明,基于TSAW的行走过程,其状态占用次数 $L_t(i)$ 与转移次数 $N_t(i,j)$ 满足:对任意状态 $i$ 及满足 $P_{ij}>0$ 的边 $(i,j)$,有 $L_t(i)-tπ_i = O( ootrom{log t}{})$ 且 $N_t(i,j)-tπ_iP_{ij} = O( ootrom{log t}{})$,几乎必然成立。因此,对任意有界函数 $f:V\to\mathbb R$,积分估计误差为 $\left|\frac1t\sum_{s=0}^{t-1} f(X_s)-\sum_{i\in V}π_i f(i)\right| = O\left(\frac{\sqrt{\log t}}{t}\right)$,几乎必然成立。该结果表明,相较于标准随机游走方法中 $t^{-1/2}$ 的误差尺度,TSAW 估计器实现了更优的 $O(\sqrt{\log t}/t)$ 误差依赖关系,显著提升了样本量 $t$ 的利用效率。
原文摘要 · Abstract (English)
We study true self-avoiding walk (TSAW) as a mechanism for improving empirical integral estimation via Markov chain Monte Carlo (MCMC). We consider finite-state adaptive sampling dynamics associated with an irreducible Markov kernel $P$ on a finite set, with stationary distribution $π$, in which the transition probabilities are penalized according to empirical overuse. Our main result is that the empirical occupation counts $L_t(i)$ and transition counts $N_t(i,j)$ of the resulting TSAW-based walk satisfy \[ L_t(i)-tπ_i = O(\sqrt{\log t}) \quad\text{and}\quad N_t(i,j)-tπ_iP_{ij}=O(\sqrt{\log t}) \qquad\text{almost surely} \] for every state $i$ and every edge $(i,j)$ with $P_{ij}>0$. Consequently, for every bounded function $f:V\to\mathbb R$, the error of our integral estimator converges as \[ \left|\frac1t\sum_{s=0}^{t-1} f(X_s)-\sum_{i\in V}π_i f(i)\right| = O\left(\frac{\sqrt{\log t}}{t}\right) \qquad\text{almost surely}. \] These results show that, in contrast with the usual $t^{-1/2}$ error scaling for empirical averages under standard random-walk-based methods, TSAW-based estimator yields empirical integral errors of order $O(\sqrt{\log t}/t)$ almost surely, thereby achieving a substantially sharper dependence on the sample size $t$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。