arXiv:2508.15805cs.CLcs.AI2025-08被引 6

让大模型自动学新知识,回答过时问题准确率从15%升至90%。

ALAS: Autonomous Learning Agent for Self-Updating Language Models

  • 自动生成学习计划,从网络抓取新数据并转为问答训练集。
  • 在新版本Python、安全漏洞等动态领域中,问答准确率达90%。
  • 模块化设计,无需人工干预,适合长期持续学习场景。

大语言模型常因知识截止而无法回答新兴信息。本文提出ALAS(自主学习代理系统),一个模块化流程,可极少人工干预地持续更新模型知识。ALAS自动为特定领域生成学习课程,从网络检索最新信息(附引用),将其提炼为问答训练数据,并通过监督微调(SFT)和直接偏好优化(DPO)更新模型。系统迭代评估性能并调整课程,实现长期持续学习。实验表明,该系统在快速变化领域(如新版Python、最新安全漏洞CVE、学术趋势)中显著提升模型在知识截止后的问题回答准确率(平均从15%提升至90%),且无需人工数据标注。系统强调模块化与可复现性:规划、检索、提炼、记忆、微调各环节均可替换,基于标准API构建。对比基线(如检索增强生成与微调)显示,ALAS以极低工程成本实现90%准确率。最后讨论了成本与数据源质量依赖等局限,展望大模型自主终身学习的未来方向。

原文摘要 · Abstract (English)

Large language models (LLMs) often have a fixed knowledge cutoff, limiting their accuracy on emerging information. We present ALAS (Autonomous Learning Agent System), a modular pipeline that continuously updates an LLM's knowledge with minimal human intervention. ALAS autonomously generates a learning curriculum for a target domain, retrieves up-to-date information from the web (with citations), distills this into question-answer training data, and fine-tunes the model through supervised fine-tuning (SFT) and direct preference optimization (DPO). It iteratively evaluates performance and revises the curriculum, enabling long-term continual learning. We demonstrate ALAS's ability to self-improve a model on rapidly evolving domains (e.g., new Python releases, latest security CVEs, academic trends), significantly boosting post-cutoff question answering accuracy (from 15% to 90% on average) without manual dataset curation. The system emphasizes modularity and reproducibility: each component (planning, retrieval, distillation, memory, fine-tuning) is interchangeable and built on standard APIs. We discuss comparative baselines (e.g., retrieval-augmented generation vs. fine-tuning) and show that ALAS achieves 90% accuracy on knowledge-updated queries with minimal engineering overhead. Finally, we outline limitations (cost, dependency on source quality) and future directions for autonomous lifelong learning in LLMs.

大模型持续学习自动更新知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。