在无法归一化分布时,实现渐近最优的异常检测
Asymptotically Optimal Change Detection for Unnormalized Pre- and Post-Change Distributions
- 用热力学积分估计前后分布的归一化常数比值
- 提出LPA-CUSUM算法,实现无偏统计量与渐近最优性能
- 适用于物理系统中能量模型难归一化的场景
本文研究在仅能获取未归一化前后变化分布的情况下进行变化检测的问题。这类情况常见于铁磁学、晶体学、磁流体动力学和热力学等物理领域,其中能量模型难以归一化。现有方法基于累积和(CUSUM)统计量,虽具最优性能但需准确估计归一化常数。我们首先提出一种直观近似方法,但发现其会产生偏差并导致性能下降。为此,提出基于热力学积分(TI)的对数分割近似累积和(LPA-CUSUM)算法,可无偏估计对数归一化常数及CUSUM统计量,实现渐近最优检测性能。进一步推导出热力学积分所需样本量与期望检测延迟之间的关系,为参数选择提供指导。数值实验验证了该方法的有效性。
原文摘要 · Abstract (English)
This paper addresses the problem of detecting changes when only unnormalized pre- and post-change distributions are accessible. This situation happens in many scenarios in physics such as in ferromagnetism, crystallography, magneto-hydrodynamics, and thermodynamics, where the energy models are difficult to normalize. Our approach is based on the estimation of the Cumulative Sum (CUSUM) statistics, which is known to produce optimal performance. We first present an intuitively appealing approximation method. Unfortunately, this produces a biased estimator of the CUSUM statistics and may cause performance degradation. We then propose the Log-Partition Approximation Cumulative Sum (LPA-CUSUM) algorithm based on thermodynamic integration (TI) in order to estimate the log-ratio of normalizing constants of pre- and post-change distributions. It is proved that this approach gives an unbiased estimate of the log-partition function and the CUSUM statistics, and leads to an asymptotically optimal performance. Moreover, we derive a relationship between the required sample size for thermodynamic integration and the desired detection delay performance, offering guidelines for practical parameter selection. Numerical studies are provided demonstrating the efficacy of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。