让大模型权重公开的同时,用密钥控制敏感能力,防止滥用。
Toward Open Weight Models Without Risks: Separating Public and Private Capabilities in LLMs

- 同一组权重支持多级能力,密钥切换不同功能配置。
- 密钥版可学新语言、跟指令、记私有知识,公开版无此能力。
- 抗模型提取和密钥泄露,适合需开放权重又控风险的场景。
开放权重的大语言模型虽促进科学进步与广泛部署,却难以管控敏感能力。现有方法或在发布前压制危险能力(易被绕过),或通过闭源服务用特殊变体、监控与权限控制(与开放权重矛盾)。本文提出分层语言模型(TLM),单一权重集支持多级能力。默认公开配置如普通LLM;一个小型秘密密钥对少量参数进行置换,生成新计算图以激活额外能力。我们设计训练流程:从头联合预训练双配置,再用正则化微调密钥配置,保持公开模型行为不变。预训练了180M和650M参数的TLM,实证表明密钥配置可掌握新语言、具备指令遵循能力并记忆私有事实,而公开配置无此特性。该方法可自然扩展至多层级。因授权基于权重结构而非输入,抵抗微调提取与部分密钥泄露。总体而言,TLM迈向开放权重与选择性能力控制的统一。
原文摘要 · Abstract (English)
Open-weight Large Language Models (LLMs) enable scientific progress and broad deployment. However, they make it difficult to control access to sensitive capabilities. Current practice either suppresses dangerous capabilities before release or mediates access through closed services that use specialized model variants, input/output monitors, and API permissions. The former is susceptible to jailbreaks while sacrificing capability for all users to mitigate the risks posed by a few, and the latter is fundamentally incompatible with open-weight release. In this paper, we propose Tiered Language Models (TLMs), where a single set of released weights supports multiple capability levels. In its default public configuration, a TLM behaves as a conventional LLM. A compact secret key specifies a permutation over a small parameter subset, inducing an alternative computation graph over the same weights that exposes additional capabilities. We develop a training protocol that jointly pretrains both configurations from scratch, then fine-tunes the keyed configuration on private data with regularization to preserve the public model's behavior. We pretrain 180M- and 650M-parameter TLMs and demonstrate that the keyed configuration can acquire a new language, gain instruction-following ability, and memorize private factual knowledge, whereas the public configuration exhibits none of these capabilities. Moreover, we show that our approach extends naturally to multiple hierarchical tiers. Because authorization operates on the model's weight structure rather than in the input space, the mechanism resists fine-tuning-based extraction and partial key compromise. In general, TLMs take a step toward reconciling open-weight release with selective capability control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。