arXiv:2506.08734stat.MLcs.LG2025-06被引 1

无需标签即可高效检测模型漂移,提升实时系统可靠性。

Flexible and Efficient Drift Detection without Labels

  • 基于统计过程控制,在无标签环境下检测概念漂移。
  • 计算受限下,检测功效优于已有方法。
  • 适用于标签延迟场景,适合生产系统监控。

机器学习模型被广泛用于各个领域的自动化决策,保障其性能对服务质量至关重要。及时检测概念漂移尤为关键。现有研究多依赖有标签的监督场景,即预测后能立即获取真实标签。但在大规模数据流中,真实标签常延迟到达,此时在控制误报率的前提下持续监控模型性能极具挑战。本文提出一种无需标签的灵活高效概念漂移检测算法,利用经典统计过程控制实现精准漂移识别。实验表明,在计算资源受限条件下,本方法具有更优的统计检出力。此外,我们引入一种新的半监督漂移检测框架,用于建模已有漂移检测结果下的无标签漂移识别问题,并证明该算法可有效融入此框架。数值模拟验证了其良好表现。

原文摘要 · Abstract (English)

Machine learning models are being increasingly used to automate decisions in almost every domain, and ensuring the performance of these models is crucial for ensuring high quality machine learning enabled services. Ensuring concept drift is detected early is thus of the highest importance. A lot of research on concept drift has focused on the supervised case that assumes the true labels of supervised tasks are available immediately after making predictions. Controlling for false positives while monitoring the performance of predictive models used to make inference from extremely large datasets periodically, where the true labels are not instantly available, becomes extremely challenging. We propose a flexible and efficient concept drift detection algorithm that uses classical statistical process control in a label-less setting to accurately detect concept drifts. We show empirically that under computational constraints, our approach has better statistical power than previous known methods. Furthermore, we introduce a new semi-supervised drift detection framework to model the scenario of detecting drift (without labels) given prior detections, and show how our drift detection algorithm can be incorporated effectively into this framework. We demonstrate promising performance via numerical simulations.

概念漂移无监督学习在线监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。