arXiv:2608.27147cs.AI2026-08

用持续学习让普通机构也能训练前沿AI模型,降低门槛。

Thomson: Continual Learning of Frontier Models for SovereignAI

论文配图:Thomson: Continual Learning of Frontier Models for SovereignAI
图 1 · 摘自论文原文
  • 基于开源模型持续学习,仅做少量关键参数调整
  • 在多任务、安全、多语言等能力上表现媲美顶尖模型
  • 适合预算有限的组织自主构建AI系统

前沿模型的开发常被视为少数资金雄厚机构的专属领域,造成开发者与用户之间的信息、经济与权力失衡。尽管公众已呼吁推动主权AI(即组织独立构建、部署和治理AI的能力),但缺乏具体实施路径。本文提出,通过在现有开放权重模型上进行持续学习,各类机构均可实现前沿性能。相比小规模微调、提示工程或冻结模型工具增强等局限方法,本方法利用现代中后训练架构,在每阶段兼顾可塑性与稳定性,仅需极少量高影响力参数干预。实验表明,其性能提升相当于多次模型迭代,且所需算力与人力成本远低于普遍预期,使模型、工具基础设施、价值观与数据隐私等主权AI核心部分对更多主体可行。我们以Thomson为例,该通用前沿模型聚焦高风险专业任务训练。评估显示其在智能体任务、安全、法律、税务及多语言能力,以及大规模深度研究方面表现优异,呈现出独特的π型能力提升模式:广泛能力显著增强,且几乎完全消除窄域适配中的遗忘问题。

原文摘要 · Abstract (English)

The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetry between developers and the diverse user base of modern AI. Recent public discourse acknowledges this concern, calling for SovereignAI (an organisation's capability to independently build, deploy and govern AI use), but offers little concrete advice on how this can be achieved in the short term under a diversity of funding settings. We argue that frontier performance is achievable by a wide range of institutions through Continual Learning on readily available open-weight models. Unlike limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation of a frozen model, our approach exploits a modern mid- & post-training stack while introducing safeguards that preserve both plasticity and stability at each stage, making the minimal number of high-impact interventions on the parameters. This yields gains comparable to those typically seen across multiple successive model generations, at compute and personnel budgets substantially lower than commonly thought, making ownership of large parts of the SovereignAI stack (model, tool infrastructure, values & data privacy) viable for far more actors. We demonstrate this with Thomson, a general-purpose frontier model trained with an enhanced focus on high-stakes professional work. Thomson performs competitively with recent frontier models across agentic tasks, safety, legal, tax & multilingualism, and large-scale Deep Research. Evaluations show a distinctive $π$-shaped pattern: distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost completely eliminating the forgetting problem common to narrow domain adaptation.

持续学习主权AI前沿模型开源模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。