将未知参数的分布更新算法与统计估计结合,实现计算与统计的统一渐近分析。
Computational and Statistical Asymptotic Analysis of the JKO Scheme for Iterative Algorithms to update distributions
- 引入统计估计改进原迭代算法,适应参数未知场景。
- 理论证明样本量与迭代次数无限时的极限动态行为。
- 适用于需要联合优化与推断的机器学习任务。
Jordan、Kinderlehrer 与 Otto 提出的 JKO 方案是一种用于计算分布的迭代算法框架,可视为 Wasserstein 梯度流,在强化学习等机器学习领域有广泛应用。本文将该方案扩展至参数未知的情形,发展了相应的统计估计方法,并将估计值融入算法中。为分析所提出的统计 JKO 方案,我们基于随机偏微分方程建立了渐近理论,描述其在样本量和迭代次数趋于无穷时的极限动态行为。本研究提供了一个统一框架,同时分析算法迭代增加时的计算动态与大样本下分布结果的统计性质。通过数值模拟验证了方法在有限样本下的表现,并支持了渐近理论的有效性。
原文摘要 · Abstract (English)
The seminal paper of Jordan, Kinderlehrer, and Otto introduced what is now widely known as the JKO scheme, an iterative algorithmic framework for computing distributions. This scheme can be interpreted as a Wasserstein gradient flow and has been successfully applied in machine learning contexts, such as deriving policy solutions in reinforcement learning. In this paper, we extend the JKO scheme to accommodate models with unknown parameters. Specifically, we develop statistical methods to estimate these parameters and adapt the JKO scheme to incorporate the estimated values. To analyze the adopted statistical JKO scheme, we establish an asymptotic theory via stochastic partial differential equations that describes its limiting dynamic behavior. Our framework allows both the sample size used in parameter estimation and the number of algorithmic iterations to go to infinity. This study offers a unified framework for joint computational and statistical asymptotic analysis of the statistical JKO scheme. On the computational side, we examine the scheme's dynamic behavior as the number of iterations increases, while on the statistical side, we investigate the large-sample behavior of the resulting distributions computed through the scheme. We conduct numerical simulations to evaluate the finite-sample performance of the proposed methods and validate the developed asymptotic theory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。