用勒让德多项式设计在线检测分布变化的高效方法。
Betting on Moments: Legendre Jumper Martingales for Online Exchangeability Testing
- 基于移位勒让德多项式构建赌局函数,捕捉高阶统计变化。
- 可快速检测方差、偏度等非均值变化,比传统方法更敏感。
- 新模型实现常数时间复杂度,适合实时监控场景。
统计与机器学习中的核心假设是“未来如过去”,即数据分布具有可交换性——联合分布不随顺序改变。实际中,分布随时间漂移常导致该假设失效。及时发现这种偏离对防止性能下降和触发模型重训练至关重要。现有方法如符合性检验鞅(conformal test martingales)能以无分布假设方式控制误报率,通过下注违背一致性的符合性p值来实现。尽管已有插件型和混合型策略,但高效基线如Simple Jumper仅能检测均值变化。本文提出一类基于移位勒让德多项式的符合性检验鞅,扩展Simple Jumper至高阶矩。简单勒让德跳跃者将线性投注函数替换为任意阶多项式,可快速检测方差、偏度等变化。乘积勒让德跳跃者融合多阶多项式,但面临指数级状态空间增长(称作‘跳跃税’)。为此,我们提出变分勒让德跳跃者,采用均场近似将每步复杂度降至常数,几乎无损检测能力,提供一种表达性强、可扩展的实时分布漂移监测框架。
原文摘要 · Abstract (English)
A fundamental assumption in statistics and machine learning is that ``the future looks like the past,'' formalized as exchangeability: the joint data distribution is order-invariant. In practice, this assumption is often violated due to distribution shifts over time. Early detection of exchangeability violations is crucial to prevent performance degradation and enable timely interventions like model retraining. Conformal test martingales offer a flexible, distribution-free framework for sequential exchangeability testing with guaranteed false-alarm rate control by betting against the uniformity of conformal p-values. While alternatives such as plug-in martingales and mixture-based strategies exist, computationally efficient baselines like the Simple Jumper are limited to detecting mean location shifts. We propose a family of conformal test martingales based on shifted Legendre polynomials that extend the Simple Jumper to higher-order moments. The Simple Legendre Jumper replaces linear betting functions with polynomials of arbitrary degree, enabling rapid detection of variance, skewness, and other higher-order deviations. The Product Legendre Jumper combines multiple polynomial degrees into a single betting function but suffers from exponential state-space growth, termed the jumping tax. To resolve this, we introduce the Variational Legendre Jumper, which employs a mean-field approximation to reduce complexity to constant time per step with minimal power loss, providing an expressive, scalable framework for real-time distribution shift monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。