发现法律漏洞可被AI利用，引发社会系统性风险
Legal Zero-Days: A Novel Risk Vector for Advanced AI Systems
- 提出'法律零日漏洞'概念，指未被发现的法律缺陷
- 用澳洲双重国籍危机案例证明其可能引发大规模治理混乱
- 设计法律谜题测试AI发现漏洞能力，预警未来风险
我们提出'法律零日漏洞'这一新型风险维度，指法律框架中尚未暴露但可被利用、导致即时重大社会动荡的漏洞，无需诉讼即可生效。构建风险评估模型，验证其可能绕过安全机制或阻碍政府对AI事件的响应。以2017年澳大利亚双重国籍危机为例，说明看似微小的法律疏漏可能引发大规模治理瘫痪。开发'法律谜题'作为评估工具，用于测试AI系统发现此类漏洞的能力。研究显示当前AI尚无法稳定发现有影响力的法律零日漏洞，但未来系统可能具备该能力，既带来风险也提供提升法律韧性的机会。本工作推动对前沿AI系统潜在未知风险的识别与缓解。
原文摘要 · Abstract (English)
We introduce the concept of "Legal Zero-Days" as a novel risk vector for advanced AI systems. Legal Zero-Days are previously undiscovered vulnerabilities in legal frameworks that, when exploited, can cause immediate and significant societal disruption without requiring litigation or other processes before impact. We present a risk model for identifying and evaluating these vulnerabilities, demonstrating their potential to bypass safeguards or impede government responses to AI incidents. Using the 2017 Australian dual citizenship crisis as a case study, we illustrate how seemingly minor legal oversights can lead to large-scale governance disruption. We develop a methodology for creating "legal puzzles" as evaluation instruments for assessing AI systems' capabilities to discover such vulnerabilities. Our findings suggest that while current AI models may not reliably find impactful Legal Zero-Days, future systems may develop this capability, presenting both risks and opportunities for improving legal robustness. This work contributes to the broader effort to identify and mitigate previously unrecognized risks from frontier AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。