arXiv:2503.16861cs.AI2025-03被引 14

为通用AI系统建立安全漏洞报告与协作机制,提升系统安全性。

In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AI

  • 提出标准化漏洞报告模板和研究人员行为规范
  • 建议厂商推行广范围漏洞披露计划并提供法律保护
  • 推动跨机构漏洞信息协调基础设施建设

通用人工智能(GPAI)系统的广泛应用带来了显著新风险,但其漏洞评估与报告的基础设施、实践和规范仍严重滞后于软件安全领域。基于软件安全、机器学习、法律、社会科学与政策专家的合作,我们识别出GPAI系统漏洞评估与报告中的关键缺口。为此提出三项干预措施:第一,制定标准化的AI漏洞报告格式与研究人员行为准则,以简化漏洞提交、复现与分类流程;第二,鼓励系统提供商采用覆盖广泛的漏洞披露计划,借鉴漏洞赏金模式,并提供法律豁免保护研究者;第三,推动构建跨多方利益相关者的漏洞报告分发协调基础设施。这些措施日益紧迫,因越狱攻击等漏洞在不同厂商的GPAI系统间普遍存在。通过增强AI生态中的漏洞报告与协作能力,可显著提升GPAI系统的安全性、安全性和问责性。

原文摘要 · Abstract (English)

The widespread deployment of general-purpose AI (GPAI) systems introduces significant new risks. Yet the infrastructure, practices, and norms for reporting flaws in GPAI systems remain seriously underdeveloped, lagging far behind more established fields like software security. Based on a collaboration between experts from the fields of software security, machine learning, law, social science, and policy, we identify key gaps in the evaluation and reporting of flaws in GPAI systems. We call for three interventions to advance system safety. First, we propose using standardized AI flaw reports and rules of engagement for researchers in order to ease the process of submitting, reproducing, and triaging flaws in GPAI systems. Second, we propose GPAI system providers adopt broadly-scoped flaw disclosure programs, borrowing from bug bounties, with legal safe harbors to protect researchers. Third, we advocate for the development of improved infrastructure to coordinate distribution of flaw reports across the many stakeholders who may be impacted. These interventions are increasingly urgent, as evidenced by the prevalence of jailbreaks and other flaws that can transfer across different providers' GPAI systems. By promoting robust reporting and coordination in the AI ecosystem, these proposals could significantly improve the safety, security, and accountability of GPAI systems.

AI安全漏洞披露协同机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。