arXiv:2508.00042cs.NIcs.LG2025-08

无需标签即可检测无线场景中模型性能退化,保障AI长期可靠。

Label-Free Concept Drift Assessment for Reliable AI in Emerging Wireless Applications

  • 利用无标签数据结合表征学习与统计检验,计算模型可靠性评分。
  • 在定位与链路异常检测任务中F1最高达0.94,比传统方法提升0.24。
  • 适合标签稀缺的实时无线系统,助力MLOps实现精准重训练决策。

部署于非平稳环境中的机器学习模型会悄然退化,因输入分布漂移导致准确率下降却无错误信号或标签揭示问题。维持可靠AI需一种概念漂移检测器作为外部观察者,仅用无标签运行数据监控已部署模型,使MLOps在必要时触发重训练与重新部署。本文提出两种漂移检测器:信心过滤伪标签迁移(CFPT)与TabAutoDrift,融合表征学习与统计检验,计算预期效用分数以判断是否需重训练,无需部署后真实标签。在两个标签稀缺的新兴无线应用领域——室外指纹定位与链路异常检测中评估,其表现优于经典检测器ADWIN、DDM与CUSUM。在指纹定位场景中F1得分介于0.88至0.94,在链路异常检测中为0.80至1.00,最高比最强经典方法高出0.24。作为可靠性决策,该精度表明所提检测器更可信地触发重训练。

原文摘要 · Abstract (English)

Machine learning models deployed in non-stationary environments degrade silently, since as the input distribution drifts their accuracy decays without an error signal and without labels to reveal it. Sustaining reliable AI therefore requires a concept-drift detector that acts as an external observer of the deployed model, monitoring it using unlabeled operational data alone, so that an MLOps actuator triggers retraining and redeployment only when it is warranted. This paper contributes two concept drift detectors, namely Confidence-Filtered Pseudo-Label Transfer (CFPT) and TabAutoDrift, which combine representation learning with statistical testing to compute an expected utility score that signals whether a deployed model should be retrained, without requiring ground-truth labels after deployment. The detectors are evaluated on two emerging, label-scarce wireless application domains in which post deployment ground truth is effectively unavailable, namely outdoor fingerprinting-based localization and link-anomaly detection. They outperform the classical detectors ADWIN, DDM, and CUSUM, attaining a drift-detection F1-score between 0.88 and 0.94 in the fingerprinting use case and between 0.80 and 1.00 in the link-anomaly use case, up to 0.24 higher than the strongest classical detector. Interpreted as reliability decisions, this precision indicates that the proposed detectors signal retraining more dependably.

概念漂移无线系统无标签检测MLOps

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。