arXiv:2505.04608cs.LGcs.AI2025-05ICML被引 13

提出自适应监控方法,实时检测模型部署中的数据分布异常

WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingales

  • 用加权共形鞅框架实现在线监测任意数据分布变化
  • 能快速识别有害漂移并区分概念漂移与极端输入漂移
  • 适合高风险场景的持续可靠性监控,支持故障诊断

在高风险场景中负责任地部署人工智能/机器学习系统,不仅需要证明系统可靠性,还需持续的上线后监控以及时发现并应对不安全行为。非参数序贯检验方法(尤其是共形测试鞅和任意时间有效推断)为此提供了有前景的工具。然而,现有方法受限于假设类别的范围或“警报条件”(如检测违反交换性或独立同分布假设的数据漂移),无法在线适应漂移,也无法诊断退化原因。本文通过提出共形测试鞅的加权推广(WCTMs),为任意意外变化点的在线监控奠定了理论基础,同时控制误报率。针对实际应用,我们设计了具体算法,可在线适应轻微协变量漂移(边际输入分布变化),快速检测有害漂移,并将其诊断为概念漂移(条件标签分布变化)或难以适应的极端(超出支持域)协变量漂移。在真实世界数据集上,性能优于当前最优基线。

原文摘要 · Abstract (English)

Responsibly deploying artificial intelligence (AI) / machine learning (ML) systems in high-stakes settings arguably requires not only proof of system reliability, but also continual, post-deployment monitoring to quickly detect and address any unsafe behavior. Methods for nonparametric sequential testing -- especially conformal test martingales (CTMs) and anytime-valid inference -- offer promising tools for this monitoring task. However, existing approaches are restricted to monitoring limited hypothesis classes or ``alarm criteria'' (e.g., detecting data shifts that violate certain exchangeability or IID assumptions), do not allow for online adaptation in response to shifts, and/or cannot diagnose the cause of degradation or alarm. In this paper, we address these limitations by proposing a weighted generalization of conformal test martingales (WCTMs), which lay a theoretical foundation for online monitoring for any unexpected changepoints in the data distribution while controlling false-alarms. For practical applications, we propose specific WCTM algorithms that adapt online to mild covariate shifts (in the marginal input distribution), quickly detect harmful shifts, and diagnose those harmful shifts as concept shifts (in the conditional label distribution) or extreme (out-of-support) covariate shifts that cannot be easily adapted to. On real-world datasets, we demonstrate improved performance relative to state-of-the-art baselines.

AI监控分布漂移共形推理在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。