通过模块化预训练实现可控能力隔离,支持按需启用或禁用AI功能。
Modular Pretraining Enables Access Control

- 引入梯度路由模块,在预训练中选择性更新特定模块以实现功能专化。
- 实验表明能有效关闭目标能力且抵抗微调恢复,大模型下性能差距更小。
- 训练成本与功能数量无关,5种功能配置下比数据过滤节省5倍资源。
AI开发者面临双重用途困境:一项能力可能用于治病,也可能被滥用于伪造信息。解决之道在于访问控制,仅对有正当需求的可信部署开放双用途能力。理想方案是为不同用户部署具备不同能力的独立模型,但训练和部署多模型成本过高。为此,本文提出梯度路由辅助模块(GRAM),在神经网络中添加可选模块,并通过选择性更新诱导功能专化。推理时移除某模块即可消除其对应能力,近似于在过滤数据上训练的模型。我们在合成故事及涵盖病毒学、网络安全、核物理和专业代码的真实双用途数据集上评估了GRAM。结果表明,GRAM能有效关闭目标能力并保留其余性能,且在微调下更难恢复。更重要的是,基于Chinchilla最优缩放分析,从50M到5B参数规模,移除能力的性能差距随规模扩大而增加,但保留能力的差距始终较小,且GRAM表现接近数据过滤。GRAM训练成本不随支持功能数增长,在5种功能设置下相较数据过滤降低5倍开销。
原文摘要 · Abstract (English)
AI developers face a dual-use dilemma. An AI capability that helps one user cure a disease can help another synthesize one. This dilemma could be resolved with access control, limiting dual-use AI capabilities to trusted deployments with a legitimate need. A gold standard for access control would be to serve separate models with different capabilities to different users. However, training and deploying multiple models is prohibitively expensive. To address this challenge, we propose gradient-routed auxiliary modules (GRAM), a pre-training method that adds modules to a neural network and selectively updates them to induce specialization. Ablating a module at inference time removes its capability from the network, approximating a model trained on filtered data. We evaluate GRAM on synthetic stories and realistic dual-use data spanning virology, cybersecurity, nuclear physics, and specialized code. These experiments show that GRAM disables targeted capabilities while preserving the rest, and resists their recovery under finetuning better than post-hoc unlearning. Most importantly, a Chinchilla-optimal scaling analysis from 50M to 5B parameters shows that the gap between data-filtered and full-data models widens with scale on removed capabilities but stays small on retained ones, and that GRAM closely tracks data filtering. GRAM's training cost is independent of the number of supported capability profiles, yielding a 5x reduction over data filtering in our 5-profile setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。