arXiv:2603.17419cs.CRcs.AI2026-03被引 3

为医疗AI代理构建零信任安全架构,防范敏感信息泄露与越权操作。

Caging the Agents: A Zero Trust Security Architecture for Autonomous AI in Healthcare

  • 基于六域威胁模型,分层防护代理的权限与通信
  • 90天部署中发现4个高危漏洞并自动修复
  • 适合医疗AI系统开发者与安全团队参考

由大语言模型驱动的自主AI代理在生产环境中具备执行命令、访问文件系统、查询数据库及多方通信的能力。近期红队测试表明,这些代理在真实场景中存在严重漏洞:擅自响应非所有者指令、泄露敏感信息、身份伪造、不安全行为跨代理传播,以及通过外部资源间接注入恶意提示。在处理受保护健康信息的医疗环境中,每项漏洞均可能构成HIPAA违规。本文提出一套已部署于某医疗科技公司九个自主代理的安全架构。构建了涵盖凭证暴露、执行滥用、网络外泄、提示完整性失效、数据库风险及集群配置漂移的六域威胁模型。实施四层纵深防御:(1)基于gVisor的Kubernetes内核级工作负载隔离;(2)凭据代理侧车,阻止代理容器直接访问原始密钥;(3)网络外泄策略,限制每个代理仅可连接白名单目的地;(4)带有结构化元数据封装和不可信内容标记的提示完整性框架。90天部署结果显示:由自动化安全审计代理发现并修复4个高危问题,经过三轮虚拟机镜像迭代实现集群渐进式加固,防御覆盖了近期文献中的全部11种攻击模式。所有配置、审计工具及提示完整性框架均已开源。

原文摘要 · Abstract (English)

Autonomous AI agents powered by large language models are being deployed in production with capabilities including shell execution, file system access, database queries, and multi-party communication. Recent red teaming research demonstrates that these agents exhibit critical vulnerabilities in realistic settings: unauthorized compliance with non-owner instructions, sensitive information disclosure, identity spoofing, cross-agent propagation of unsafe practices, and indirect prompt injection through external resources [7]. In healthcare environments processing Protected Health Information, every such vulnerability becomes a potential HIPAA violation. This paper presents a security architecture deployed for nine autonomous AI agents in production at a healthcare technology company. We develop a six-domain threat model for agentic AI in healthcare covering credential exposure, execution capability abuse, network egress exfiltration, prompt integrity failures, database access risks, and fleet configuration drift. We implement four-layer defense in depth: (1) kernel level workload isolation using gVisor on Kubernetes, (2) credential proxy sidecars preventing agent containers from accessing raw secrets, (3) network egress policies restricting each agent to allowlisted destinations, and (4) a prompt integrity framework with structured metadata envelopes and untrusted content labeling. We report results from 90 days of deployment including four HIGH severity findings discovered and remediated by an automated security audit agent, progressive fleet hardening across three VM image generations, and defense coverage mapped to all eleven attack patterns from recent literature. All configurations, audit tooling, and the prompt integrity framework are released as open source.

AI安全医疗AI零信任大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。