提出新型安全架构,让AI代理思考与执行分离,防住98.9%攻击
Parallax: Why AI Agents That Think Must Never Act
- 将思考与执行模块物理隔离,杜绝推理系统直接操作
- 在9个攻击类别中,280次测试阻断98.9%攻击且无误报
- 适合开发高风险自主系统的人工智能工程师
自主AI代理正快速从实验工具转向企业核心基础设施,预计到2026年底80%的企业应用将集成AI协作者。随着代理获得读取文件、运行命令、发起网络请求、修改数据库等真实世界操作能力,一个根本性安全漏洞浮现。当前主流安全方案依赖提示层防护——即自然语言指令,但其抽象层级与威胁一致,架构上不足够。本文提出Parallax范式,基于四大原则:认知-执行分离(结构性阻止推理系统执行动作)、对抗验证与渐进确定性(在推理与执行间插入独立多层验证器)、信息流控制(在工作流中传播数据敏感度标签以识别上下文相关威胁)、可逆执行(捕获破坏前状态,验证失败时可回滚)。我们发布OpenParallax开源实现(Go语言),并采用假设妥协评估法,绕过推理系统测试架构边界下的安全性。在280个对抗测试用例、九类攻击中,默认配置下阻断98.9%攻击且零误报,最高安全配置下100%阻断。当推理系统被攻破时,提示级防护完全失效,而Parallax的架构边界依然有效。
原文摘要 · Abstract (English)
Autonomous AI agents are rapidly transitioning from experimental tools to operational infrastructure, with projections that 80% of enterprise applications will embed AI copilots by the end of 2026. As agents gain the ability to execute real-world actions (reading files, running commands, making network requests, modifying databases), a fundamental security gap has emerged. The dominant approach to agent safety relies on prompt-level guardrails: natural language instructions that operate at the same abstraction level as the threats they attempt to mitigate. This paper argues that prompt-based safety is architecturally insufficient for agents with execution capability and introduces Parallax, a paradigm for safe autonomous AI execution grounded in four principles: Cognitive-Executive Separation, which structurally prevents the reasoning system from executing actions; Adversarial Validation with Graduated Determinism, which interposes an independent, multi-tiered validator between reasoning and execution; Information Flow Control, which propagates data sensitivity labels through agent workflows to detect context-dependent threats; and Reversible Execution, which captures pre-destructive state to enable rollback when validation fails. We present OpenParallax, an open-source reference implementation in Go, and evaluate it using Assume-Compromise Evaluation, a methodology that bypasses the reasoning system entirely to test the architectural boundary under full agent compromise. Across 280 adversarial test cases in nine attack categories, Parallax blocks 98.9% of attacks with zero false positives under its default configuration, and 100% of attacks under its maximum-security configuration. When the reasoning system is compromised, prompt-level guardrails provide zero protection because they exist only within the compromised system; Parallax's architectural boundary holds regardless.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。