用大模型自动监测数据流变化,让持续学习更智能。
LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models

- 用大模型冻结表征空间做零样本漂移检测
- 发现变化后由多模态模型分析原因并适配策略
- 提升现有持续学习方法在复杂流上的表现
在线无任务持续学习(TFCL)要求智能体在严格单遍扫描条件下,从无限且非平稳的数据流中持续积累知识,且无任务标识。现有方法依赖参数高效提示调优或由训练动态驱动的结构扩展,但对分布漂移的结构性根源缺乏认知,机械采用固定策略应对不同流变。为此,我们提出LargeMonitor框架,利用大预训练模型自主协调无任务持续适应。其核心是解耦的检测模块,利用大视觉模型(LVMs)冻结的稳定表征空间实现无训练干扰的零样本漂移检测;当确认漂移时,由大多模态模型(LMMs)驱动的上下文感知诊断模块可解析流变的语义成因(如新类别出现或环境域偏移)。该双阶段能力使持续学习器能动态部署适配且针对漂移类型的优化策略。在多个TFCL设置与基准上实验证明,LargeMonitor能精准、鲁棒地检测与诊断复杂数据流,并持续提升现有在线TFCL算法性能。
原文摘要 · Abstract (English)
Online task-free continual learning (TFCL) requires intelligent agents to sequentially accumulate knowledge from an unbounded, non-stationary data stream under strict single-pass constraints and without any explicit task identifiers. Existing online TFCL paradigms primarily rely on parameter-efficient prompt tuning or dynamic structure expansion driven by training-coupled optimization dynamics, such as empirical loss fluctuations or evolving latent distances. As a result, these training-coupled solvers remain agnostic to the structural origins of distribution drift, mechanically enforcing a fixed strategy across fundamentally distinct streaming variations. To address this gap, we propose LargeMonitor, a framework that leverages large pretrained foundation models to autonomously orchestrate task-free continuous adaptation. Specifically, LargeMonitor introduces a decoupled detection module utilizing the frozen, stable representation space of large vision models (LVMs) to achieve robust, zero-shot drift detection without training-dependent interference or brittle threshold tuning. Upon a confirmed drift, the framework activates a context-aware diagnostic module driven by large multimodal models (LMMs) to interpret the precise semantic etiologies of the stream variation (e.g., novel class emergence vs. environmental domain shift). This dual-stage capability empowers the continuous learner to dynamically deploy adaptive and shift-specific optimization strategies. Extensive experiments across multiple TFCL settings and benchmarks demonstrate that LargeMonitor achieves precise, robust detection and diagnosis of complex data streams while consistently improving the performance of existing online TFCL algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。