构建细菌生物威胁评估框架,量化大模型潜在生物安全风险。
Biothreat Benchmark Generation Framework for Evaluating Frontier AI Models I: The Task-Query Architecture
- 设计分层任务-查询架构,覆盖不同能力水平的威胁行为
- 聚焦细菌类生物威胁,涵盖技术与操作双重风险因素
- 为开发者和政策制定者提供可复用的风险评估工具
模型开发者与政策制定者亟需量化并缓解前沿人工智能模型(尤其是大语言模型)在生物恐怖主义或获取生物武器方面的风险。本文介绍新型生物威胁基准生成(BBG)框架的第一部分,该框架旨在帮助评估者可靠衡量现有及未来模型的生物安全风险提升程度与普遍危害潜力。不同于以往基准,该框架充分考虑了威胁中的关键要素:不同能力水平的行动者,以及除纯技术外的操作性风险因素。作为试点,当前仅针对细菌类生物威胁进行构建。框架基于生物威胁类别、要素与任务的层级结构,形成与任务对齐的查询体系,本文提出该架构,命名为「细菌生物威胁模式」。后续论文将描述如何将查询转化为模型提示,并实现基准评估。整体而言,该框架通过多层级聚合结构,全面捕捉生物对手的技术与操作需求,覆盖广泛的能力谱系,为大模型引发的细菌生物风险评估提供稳健、可复用的解决方案。
原文摘要 · Abstract (English)
Both model developers and policymakers seek to quantify and mitigate the risk of rapidly-evolving frontier artificial intelligence (AI) models, especially large language models (LLMs), to facilitate bioterrorism or access to biological weapons. An important element of such efforts is the development of model benchmarks that can assess the biosecurity risk posed by a particular model. This paper describes the first component of a novel Biothreat Benchmark Generation (BBG) Framework. The BBG approach is designed to help model developers and evaluators reliably measure and assess the biosecurity risk uplift and general harm potential of existing and future AI models, while accounting for key aspects of the threat itself that are often overlooked in other benchmarking efforts, including different actor capability levels, and operational (in addition to purely technical) risk factors. As a pilot, the BBG is first being developed to address bacterial biological threats only. The BBG is built upon a hierarchical structure of biothreat categories, elements and tasks, which then serves as the basis for the development of task-aligned queries. This paper outlines the development of this biothreat task-query architecture, which we have named the Bacterial Biothreat Schema, while future papers will describe follow-on efforts to turn queries into model prompts, as well as how the resulting benchmarks can be implemented for model evaluation. Overall, the BBG Framework, including the Bacterial Biothreat Schema, seeks to offer a robust, re-usable structure for evaluating bacterial biological risks arising from LLMs across multiple levels of aggregation, which captures the full scope of technical and operational requirements for biological adversaries, and which accounts for a wide spectrum of biological adversary capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。