arXiv:2511.09953cs.LG2025-11中稿 · AAAI被引 3

动态调整检测阈值,让模型更准地发现数据漂移。

Autonomous Concept Drift Threshold Determination

  • 用分段最优阈值组合构造动态策略,理论上优于固定阈值。
  • 在多种真实和合成数据上,显著降低漏检率和误报率。
  • 适合对漂移敏感的长期运行机器学习系统使用。

现有漂移检测方法专注于设计敏感的检验统计量,将检测阈值视为固定超参数,统一应用于所有数据集和时间点。然而,从机器学习角度,保持模型性能才是关键目标,我们观察到模型性能对阈值极为敏感。这一现象启发我们探究动态阈值是否可被严格证明更优。本文证明:随时间自适应的阈值策略,能超越任何单一固定阈值。核心思想是,通过组合各数据段最优阈值构成的动态策略,必然优于适用于所有段落的单一阈值。基于该理论,我们提出动态阈值确定算法,为现有漂移检测框架引入新的比较阶段,以指导阈值调整。在涵盖图像与表格数据的广泛合成及真实数据集上进行的大量实验表明,该方法显著提升了先进漂移检测器的性能。

原文摘要 · Abstract (English)

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and over time. However, maintaining model performance is the key objective from the perspective of machine learning, and we observe that model performance is highly sensitive to this threshold. This observation inspires us to investigate whether a dynamic threshold could be provably better. In this paper, we prove that a threshold that adapts over time can outperform any single fixed threshold. The main idea of the proof is that a dynamic strategy, constructed by combining the best threshold from each individual data segment, is guaranteed to outperform any single threshold that apply to all segments. Based on the theorem, we propose a Dynamic Threshold Determination algorithm. It enhances existing drift detection frameworks with a novel comparison phase to inform how the threshold should be adjusted. Extensive experiments on a wide range of synthetic and real-world datasets, including both image and tabular data, validate that our approach substantially enhances the performance of state-of-the-art drift detectors.

概念漂移动态阈值在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。