arXiv:2507.18464stat.MLcs.LG2025-07中稿 · KDD被引 4

DriftMoE通过专家协同训练应对数据流概念漂移,高效适应变化。

DriftMoE: A Mixture of Experts Approach to Handle Concept Drifts

  • 构建在线专家混合架构,路由器与增量决策树专家联合训练。
  • 在九个基准上表现优于现有方法,多类与单类两种配置均有效。
  • 适合需要实时自适应的流式学习场景,如金融、工业监控。

面对存在概念漂移的非平稳数据流,模型需具备实时自适应能力且资源高效。现有自适应集成方法常依赖粗粒度调整或简单投票机制,难以充分挖掘专业性知识。本文提出 DriftMoE,一种在线混合专家(MoE)架构,通过新颖的协同训练框架解决上述问题。DriftMoE 包含一个紧凑的神经路由器,与一组增量式霍夫丁树专家共同训练。其核心创新在于共生学习循环:路由器选择最适专家进行预测,相关专家基于真实标签增量更新,路由器则利用多热正确性掩码强化所有准确专家的参数。该反馈机制为路由器提供清晰训练信号,加速专家专业化。我们在涵盖突发、渐进及真实漂移的九个先进数据流学习基准上评估了 DriftMoE 的性能,测试两种配置:一种专家针对不同数据状态专精(多类变体),另一种聚焦单类任务专精(任务型变体)。结果表明,DriftMoE 在性能上达到当前最优流学习自适应集成方法水平,提供了一种原理清晰且高效的漂移适应方案。全部代码、数据管道与可复现脚本已开源至 GitHub:https://github.com/miguel-ceadar/drift-moe。

原文摘要 · Abstract (English)

Learning from non-stationary data streams subject to concept drift requires models that can adapt on-the-fly while remaining resource-efficient. Existing adaptive ensemble methods often rely on coarse-grained adaptation mechanisms or simple voting schemes that fail to optimally leverage specialized knowledge. This paper introduces DriftMoE, an online Mixture-of-Experts (MoE) architecture that addresses these limitations through a novel co-training framework. DriftMoE features a compact neural router that is co-trained alongside a pool of incremental Hoeffding tree experts. The key innovation lies in a symbiotic learning loop that enables expert specialization: the router selects the most suitable expert for prediction, the relevant experts update incrementally with the true label, and the router refines its parameters using a multi-hot correctness mask that reinforces every accurate expert. This feedback loop provides the router with a clear training signal while accelerating expert specialization. We evaluate DriftMoE's performance across nine state-of-the-art data stream learning benchmarks spanning abrupt, gradual, and real-world drifts testing two distinct configurations: one where experts specialize on data regimes (multi-class variant), and another where they focus on single-class specialization (task-based variant). Our results demonstrate that DriftMoE achieves competitive results with state-of-the-art stream learning adaptive ensembles, offering a principled and efficient approach to concept drift adaptation. All code, data pipelines, and reproducibility scripts are available in our public GitHub repository: https://github.com/miguel-ceadar/drift-moe.

概念漂移专家混合在线学习增量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。