用可解释AI检测数据概念漂移,提升模型监控精度
From XAI to MLOps: Explainable Concept Drift Detection with Profile Drift Detection
- 基于部分依赖图构建新漂移检测指标,捕捉关系变化
- 在真实与合成数据上表现优于现有方法,灵敏度与稳定性兼备
- 适合需要实时监测的MLOps场景,透明可解释
预测模型常因数据分布演变而性能下降,这种现象称为数据漂移。其中,概念漂移(即解释变量与响应变量间关系发生变化)尤其难以检测和应对。传统方法依赖准确率或边缘变量分布等指标,可能忽略细微但关键的概念性变化。本文提出一种新方法——轮廓漂移检测(Profile Drift Detection, PDD),通过可解释AI工具部分依赖轮廓(Partial Dependence Profiles, PDPs)实现概念漂移的检测及其成因分析。PDD利用新设计的漂移度量量化PDP变化,在保持计算高效的同时对数据流中的偏移敏感。该方法契合MLOps实践,支持动态环境下的持续监控与自适应重训练。在合成与真实数据集上的实验表明,PDD在维持高预测性能的同时,有效平衡了漂移信号的灵敏度与稳定性,适用于实时应用。论文还讨论了该方法的优势、局限及未来扩展方向。
原文摘要 · Abstract (English)
Predictive models often degrade in performance due to evolving data distributions, a phenomenon known as data drift. Among its forms, concept drift, where the relationship between explanatory variables and the response variable changes, is particularly challenging to detect and adapt to. Traditional drift detection methods often rely on metrics such as accuracy or marginal variable distributions, which may fail to capture subtle but important conceptual changes. This paper proposes a novel method, Profile Drift Detection (PDD), which enables both the detection of concept drift and an enhanced understanding of its underlying causes by leveraging an explainable AI tool: Partial Dependence Profiles (PDPs). PDD quantifies changes in PDPs through new drift metrics that are sensitive to shifts in the data stream while remaining computationally efficient. This approach is aligned with MLOps practices, emphasizing continuous model monitoring and adaptive retraining in dynamic environments. Experiments on synthetic and real-world datasets demonstrate that PDD outperforms existing methods by maintaining high predictive performance while effectively balancing sensitivity and stability in drift signals. The results highlight its suitability for real-time applications, and the paper concludes by discussing the method's advantages, limitations, and potential extensions to broader use cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。