不重训模型,靠系统调度让AI持续适应新任务。
Continual Learning, Not Training: Online Adaptation For Agents
- 用教师-学生双架构+记忆库,推理时动态调整策略
- 零参数更新下达成54.1%成功率,成本降86%
- 适合需要实时自适应的部署型AI系统
传统持续学习依赖梯度重训,不适用于需实时适应的部署智能体。我们提出ATLAS系统,采用教师-学生双架构,分离推理与执行,并引入持久化学习记忆,存储经验提炼的指导信息。该信息驱动编排层,在推理时动态调整监督强度或初始计划选择,实现无梯度持续学习。核心是将适应从参数更新转向系统级调度,目标为自适应效率:在最小计算开销下最大化任务成功率。在微软的ExCyTIn-Bench基准上,以GPT-5-mini为学生模型,取得54.1%成功率,优于更大规模的GPT-5(High)13%,同时降低86%成本。跨事件验证显示泛化能力:冻结的第5次事件提示使准确率从28%提升至41%,且输出由冗长探索转为结构化推理。结果证明无梯度持续学习可支撑可部署、自适应的AI系统,并提供可用于训练显式世界模型的因果标注轨迹。
原文摘要 · Abstract (English)
Continual Learning (CL) methods have traditionally focused on mitigating catastrophic forgetting through gradient-based retraining, an approach ill-suited for deployed agents that must adapt in real time. We introduce our Adaptive Teaching and Learning System (ATLAS), a dual-agent architecture that decouples reasoning (Teacher) from execution (Student) and incorporates a persistent learning memory that stores distilled guidance from experience. This informs the orchestration layer, enabling the system to dynamically adjust its operational strategies, such as supervision level or initial plan selection, at inference time. In doing so, ATLAS achieves gradient-free continual learning, shifting the locus of adaptation from model parameters to system-level orchestration. We formulate this as a system-centric paradigm for continual learning, where the objective is adaptive efficiency: maximizing task success while minimizing computational cost through inference-time orchestration rather than parameter updates. Evaluated on Microsoft's ExCyTIn-Bench, an open-source benchmark simulating complex cyberthreat investigation, ATLAS achieves 54.1% success with GPT-5-mini as its Student, outperforming the larger GPT-5 (High) by 13% while reducing cost by 86%. Cross-incident validation demonstrates generalization: frozen pamphlets from Incident #5 improve accuracy from 28% to 41% with zero retraining, while shifting output composition from verbose exploration to structured reasoning. Together, these findings establish gradient-free continual learning as a viable path toward adaptive, deployable AI systems and provide causally annotated traces valuable for training explicit world models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。