arXiv:2512.11668cs.LG2025-12AAAI被引 5

用大模型动态总结数据流,兼顾记忆与适应性,解决持续学习难题。

Bridging Streaming Continual Learning via In-Context Large Tabular Models

  • 用大模型实时压缩数据流为紧凑摘要,实现高效存储。
  • 通过分布匹配与压缩,平衡新旧知识的保留与更新。
  • 适合需要长期适应变化数据的工业场景应用。

在流式场景中,模型需持续学习以适应概念漂移,同时不遗忘已有知识。现有持续学习(CL)关注长期记忆与灾难性遗忘缓解,但常忽略实时约束;流式学习(SL)强调对高频数据流的快速高效适应,却通常忽视遗忘问题。近期尝试融合两者,但缺乏明确算法衔接。本文认为,大上下文表格模型(LTMs)可自然连接流式持续学习(SCL)。我们主张将无界数据流实时压缩为固定大小的紧凑摘要,供LTMs使用。这既满足了传统SL对大规模流压缩的需求,又符合CL中经验回放的理想。我们指出,SL与CL社区均隐含分治策略,以应对可塑性(适应当前分布)与稳定性(保留历史知识)之间的张力,并施加最小复杂度约束,促使多样性(避免冗余存储)与检索(必要时重新优先处理旧信息)。基于此视角,我们提出以LTMs为核心的SCL框架,围绕两个核心数据选择原则:(1) 分布匹配,平衡可塑性与稳定性;(2) 分布压缩,通过多样性与检索机制控制内存规模。

原文摘要 · Abstract (English)

In streaming scenarios, models must learn continuously, adapting to concept drifts without erasing previously acquired knowledge. However, existing research communities address these challenges in isolation. Continual Learning (CL) focuses on long-term retention and mitigating catastrophic forgetting, often without strict real-time constraints. Stream Learning (SL) emphasizes rapid, efficient adaptation to high-frequency data streams, but typically neglects forgetting. Recent efforts have tried to combine these paradigms, yet no clear algorithmic overlap exists. We argue that large in-context tabular models (LTMs) provide a natural bridge for Streaming Continual Learning (SCL). In our view, unbounded streams should be summarized on-the-fly into compact sketches that can be consumed by LTMs. This recovers the classical SL motivation of compressing massive streams with fixed-size guarantees, while simultaneously aligning with the experience-replay desiderata of CL. To clarify this bridge, we show how the SL and CL communities implicitly adopt a divide-to-conquer strategy to manage the tension between plasticity (performing well on the current distribution) and stability (retaining past knowledge), while also imposing a minimal complexity constraint that motivates diversification (avoiding redundancy in what is stored) and retrieval (re-prioritizing past information when needed). Within this perspective, we propose structuring SCL with LTMs around two core principles of data selection for in-context learning: (1) distribution matching, which balances plasticity and stability, and (2) distribution compression, which controls memory size through diversification and retrieval mechanisms.

持续学习数据流大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。