无需调参的在线分类模型,自动应对数据分布变化
OLC-WA: Drift Aware Tuning-Free Online Classification with Weighted Average
- 用加权平均融合新数据与基模型,动态适应流式数据
- 在漂移环境下比主流方法准确率高10%-25%
- 适合实时系统中无监督调整的场景
真实世界数据常呈现随时间演化的分布特性,即概念漂移。忽略此现象会显著降低模型预测精度。此外,传统在线模型中的超参数通常固定不变,无法随数据分布变化而动态调整。本文提出一种自适应、免调参的在线分类模型OLC-WA,通过指数加权移动平均融合新数据与基模型,并集成自动优化机制,可动态检测概念漂移、量化其强度并相应调整模型。在多个基准数据集上的实验表明,OLC-WA在静态环境中性能接近批量模型,误差仅1%-3%;在漂移条件下,优于领先在线方法10%-25%,有效适应动态数据流。
原文摘要 · Abstract (English)
Real-world data sets often exhibit temporal dynamics characterized by evolving data distributions. Disregarding this phenomenon, commonly referred to as concept drift, can significantly diminish a model's predictive accuracy. Furthermore, the presence of hyperparameters in online models exacerbates this issue. These parameters are typically fixed and cannot be dynamically adjusted by the user in response to the evolving data distribution. This paper introduces Online Classification with Weighted Average (OLC-WA), an adaptive, hyperparameter-free online classification model equipped with an automated optimization mechanism. OLC-WA operates by blending incoming data streams with an existing base model. This blending is facilitated by an exponentially weighted moving average. Furthermore, an integrated optimization mechanism dynamically detects concept drift, quantifies its magnitude, and adjusts the model based on the observed data stream characteristics. This approach empowers the model to effectively adapt to evolving data distributions within streaming environments. Rigorous empirical evaluation across diverse benchmark datasets shows that OLC-WA achieves performance comparable to batch models in stationary environments, maintaining accuracy within 1-3%, and surpasses leading online baselines by 10-25% under drift, demonstrating its effectiveness in adapting to dynamic data streams.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。