提出在线估计新框架,精准追踪动态最优解并实现压缩计算。
Higher-Order Equilibrium Tracking for EM-Compressible Online Estimation

- 将在线估计重构为追踪移动经验平衡点,分离滞后误差与批量最优。
- 首阶方案仅用 d×d 压缩统计量,有限样本风险可精确控制。
- 适用于需高效更新的高维潜变量模型,如高斯协方差估计。
我们通过将潜变量模型中的在线估计问题重新构想为追踪移动的经验平衡点,来研究该问题。标准在线EM与随机逼近分析主要关注向总体参数的收敛性,通常无法在有限时域内分离出经验批最优与在线跟踪误差。我们的框架将在线估计分解为当前运行统计量下的冻结批最优与捕捉算法滞后于该动态目标的跟踪延迟。我们证明了批到在线的转移定理:若 \lVert e_T \rVert_{L^{2}} = o(T^{-1/2}),则在线估计器继承批处理中心极限定理和精确的一阶风险常数。关键观察是,经验最优在由运行统计量索引的光滑平衡流形上演化。采用 m 阶平衡喷射预测器结合 ν 阶冻结校正器,可获得局部跟踪率 O(T^{-ν(m+1)})。我们形式化了 EM 可压缩性与 EM-jet^R-可压缩性,作为使平衡响应与牛顿校正器可从保留的流式统计量中评估的结构条件。该理论在潜在线性高斯协方差估计中得到实例化,其中一阶方案在压缩的 d×d 统计量上运行,具有显式的有限样本风险包络与认证重启规则。
原文摘要 · Abstract (English)
We study online estimation in latent-variable models by recasting the problem as tracking a moving empirical equilibrium. Standard online EM and stochastic approximation analyses primarily study convergence toward the population parameter and typically do not isolate the empirical batch optimum from the online tracking error at finite horizon. Our framework decomposes the online estimate into the frozen batch equilibrium at the current running statistic and a tracking lag that captures the algorithm's delay behind this moving target. We prove a batch-to-online transfer theorem: provided $\lVert e_T \rVert_{L^{2}} = o(T^{-1/2})$, the online estimator inherits the batch central limit theorem and the sharp first-order risk constant. Our key observation is that the empirical optimum evolves on a smooth equilibrium manifold indexed by the running statistic. An $m$-th order equilibrium-jet predictor combined with an order-$ν$ frozen corrector yields localized tracking rates $O(T^{-ν(m+1)})$. We formalize EM-compressibility and EM-jet$^R$-compressibility as the structural conditions that make the equilibrium response and the Newton corrector evaluable from a retained streaming statistic. The theory is instantiated in latent linear Gaussian covariance estimation, where the first-order scheme operates on a compressed $d \times d$ statistic with explicit finite-sample risk envelopes and a certified restart rule.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。