自动检测AI代理隐私政策违规,实时守护用户数据安全
AudAgent: Automated Auditing of Privacy Policy Compliance in AI Agents
- 用多大模型投票解析政策,生成可验证的隐私规则
- 实时识别敏感数据并比对行为是否合规,发现违规立即告警
- 适合关注隐私安全的研究者与开发者使用
AI代理能自主执行任务,常在未获用户明确同意的情况下收集或泄露用户本地敏感数据,引发严重隐私问题。尽管其隐私政策描述了预期的数据处理方式,但实际运行行为与政策是否一致仍缺乏透明度和问责机制。为此,我们提出AudAgent,一种可实时持续监控AI代理数据行为、保障其遵守声明隐私政策的工具。AudAgent包含四个组件:(i) 政策形式化:通过新颖的跨大模型投票机制,高置信度地将隐私政策解析为形式化模型;(ii) 运行时标注:基于轻量级Presidio分析器,根据上下文与形式化政策模型检测敏感数据并标注数据操作;(iii) 合规审计:利用本体图与自动机检查,将政策模型与运行时标注关联,实现即时合规验证;(iv) 用户界面:独立于基础设施的可视化系统,实时展示代理执行轨迹及检测到的隐私违规,提供直观透明的问责机制。我们在主流框架构建的AI代理上评估了AudAgent,证明其在发现并可视化隐私政策违规方面的有效性。通过AudAgent,我们进一步发现许多隐私政策对如社会安全号码(SSNs)等高度敏感数据缺乏明确保护措施,其滥用违反法律要求;且包括Claude、Gemini和DeepSeek驱动的多个代理,在第三方工具中仍不拒绝处理此类数据。AudAgent可主动阻断对这些数据的操作,超越原代理的隐私策略与行为。
原文摘要 · Abstract (English)
AI agents can autonomously perform tasks and, often without explicit user consent, collect or disclose users' sensitive local data, which raises serious privacy concerns. Although AI agents' privacy policies describe their intended data practices, there remains limited transparency and accountability about whether runtime behavior matches those policies. To bridge this gap, we present AudAgent, a tool that continuously monitors AI agents' data practices in real time and guards compliance with their stated privacy policies. AudAgent comprises four components for automated privacy auditing of AI agents. (i) Policy formalization: a novel cross-LLM voting mechanism that ensures high-confidence parsing of privacy policies into formal models. (ii) Runtime annotation: a lightweight Presidio-based analyzer that detects sensitive data and annotates data practices based on the AI agent's context and the formalized privacy policy model. (iii) Compliance auditing: ontology graphs and automata-based checking that link the privacy policy model with runtime annotations, enabling on-the-fly compliance verification. (iv) User interface: an infrastructure-independent implementation that visualizes the real-time execution trace of AI agents alongside detected privacy violations, providing user-friendly transparency and accountability. We evaluate AudAgent on AI agents built with mainstream frameworks, demonstrating its effectiveness in detecting and visualizing privacy policy violations. Using AudAgent, we further find that many privacy policies lack explicit safeguards for highly sensitive data such as SSNs, whose misuse violates legal requirements, and that many agents, including those powered by Claude, Gemini, and DeepSeek,do not refuse to process such data via third-party tools. AudAgent proactively blocks operations on such data, overriding the agents' original privacy policies and behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。