提出新方法估算非独立序列中各频率元素的稳态概率
Estimating stationary mass, frequency by frequency
- 结合经验估计与WingIt修正法,线性时间实现
- 在总变差距离下证明一致性,适配混合过程
- 适合处理依赖数据的概率估计问题
假设从有限但可能较大的状态空间上的指数α-混合随机过程中观察到长度为n的轨迹。研究如何估计该过程的平稳分布对观测序列中特定出现频率元素所分配的概率质量。在总变差距离下估计该概率向量,证明其关于n的普适一致性,并恢复了独立同分布序列的已知结果。所提方法——可在线性时间内实现——巧妙结合了插值(经验)估计器与近期提出的针对马尔可夫序列改进的WingIt估计器。为控制估计误差,我们建立了WingIt和插值估计器在指数α-混合过程下的新性能界。重要的是,在非独立同分布设置下,广泛使用的泊松化方法不再适用,因此我们发展了互补工具,包括混合序列自然自标准化统计量的集中不等式,这些工具可能对相关问题的估计器设计与分析具有独立价值。模拟研究验证了理论结果。
原文摘要 · Abstract (English)
Suppose we observe a trajectory of length $n$ from an exponentially $α$-mixing stochastic process over a finite but potentially large state space. We consider the problem of estimating the probability mass placed by the stationary distribution of any such process on elements that occur with a certain frequency in the observed sequence. We estimate this vector of probabilities in total variation distance, showing universal consistency in $n$ and recovering known results for i.i.d. sequences as special cases. Our proposed methodology -- implementable in linear time -- carefully combines the plug-in (or empirical) estimator with a recently-proposed modification of the Good--Turing estimator called WingIt, which was originally developed for Markovian sequences. En route to controlling the error of our estimator, we develop new performance bounds on WingIt and the plug-in estimator for exponentially $α$-mixing stochastic processes. Importantly, the extensively used method of Poissonization can no longer be applied in our non i.i.d. setting, and so we develop complementary tools -- including concentration inequalities for a natural self-normalized statistic of mixing sequences -- that may prove independently useful in the design and analysis of estimators for related problems. Simulation studies corroborate our theoretical findings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。