arXiv:2506.05736cs.LGcs.AI2025-06被引 10

解决数据流中概念漂移下的持续学习难题,实现标签与分布的协同演化适应。

Generalized Incremental Learning under Concept Drift across Evolving Data Streams

  • 无需训练的原型校准机制,动态融合新类原型与基础表示。
  • 提出RSGS算法,结合尖锐度感知优化与置信度过滤,提升鲁棒性。
  • 适用于开放世界数据流场景,适合长期在线学习系统设计者。

真实世界的数据流具有固有的非平稳性,表现为概念漂移,给自适应学习系统带来重大挑战。现有方法仅处理孤立的分布偏移,忽略了在有限监督和持续不确定性下标签空间与分布的协同演化。为此,我们形式化了概念漂移下的广义增量学习(GILCD),刻画开放环境流式场景中分布与标签空间的联合演化,并提出新型框架校准无源适应(CSFA)。CSFA首先引入无需训练的原型校准机制,动态融合新兴原型与基础表示,实现无优化开销的新类识别。其次,设计新型无源适应算法——可靠代理间隙尖锐度感知(RSGS)最小化,集成尖锐度感知扰动损失优化与代理间隙最小化,结合熵基不确定性过滤,剔除不可靠样本。该机制确保分布对齐稳健性,缓解不确定性导致的泛化退化。因此,CSFA建立了统一框架,稳定适应开放世界流式场景中的语义与分布演化。大量实验验证其性能优于当前最优方法。

原文摘要 · Abstract (English)

Real-world data streams exhibit inherent non-stationarity characterized by concept drift, posing significant challenges for adaptive learning systems. While existing methods address isolated distribution shifts, they overlook the critical co-evolution of label spaces and distributions under limited supervision and persistent uncertainty. To address this, we formalize Generalized Incremental Learning under Concept Drift (GILCD), characterizing the joint evolution of distributions and label spaces in open-environment streaming contexts, and propose a novel framework called Calibrated Source-Free Adaptation (CSFA). First, CSFA introduces a training-free prototype calibration mechanism that dynamically fuses emerging prototypes with base representations, enabling stable new-class identification without optimization overhead. Second, we design a novel source-free adaptation algorithm, i.e., Reliable Surrogate Gap Sharpness-aware (RSGS) minimization. It integrates sharpness-aware perturbation loss optimization with surrogate gap minimization, while employing entropy-based uncertainty filtering to discard unreliable samples. This mechanism ensures robust distribution alignment and mitigates generalization degradation caused by uncertainties. Thus, CSFA establishes a unified framework for stable adaptation to evolving semantics and distributions in open-world streaming scenarios. Extensive experiments validate the superior performance and effectiveness of CSFA compared to SOTA approaches.

持续学习概念漂移数据流无源适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。