arXiv:2605.30727cs.CL2026-05

研究智能体查询可能泄露私有信息,提出新框架有效降低风险。

MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents

论文配图:MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents
图 1 · 摘自论文原文
  • 构建1001个跨文档研究任务,模拟私有信息通过查询泄露
  • 多模型在三类隐私层面均存在泄露,最大达34.0%
  • 新框架结合任务奖励与隐私分类器,显著提升安全性和准确率

深度研究智能体常结合本地私有文档与外部工具(如网络检索),带来隐私风险:其外部查询可能泄露本地上下文中的敏感信息。这一风险因‘拼图效应’而加剧——单个查询看似无害,但聚合后却可能暴露关键信息。我们提出MosaicLeaks,一个包含1001个多跳研究任务的基准,将企业私有文档与公开网络语料链式关联,迫使智能体生成依赖本地信息的外部查询。我们以一个仅观察外部查询的对抗性大模型评估泄漏程度,尝试推断智能体的研究意图、特定私有问题的答案以及关于企业文档的可验证陈述。结果发现,不同模型家族和规模在三个层次上均频繁泄露;零样本隐私提示可减轻但无法消除泄漏;仅优化任务表现的强化学习反而加剧泄漏。为此,我们提出隐私感知深度研究(PA-DR)框架,结合任务成功的情境奖励与学习到的隐私分类器,实现对每条查询及整体拼图级别的细粒度信用分配。使用PA-DR训练Qwen3-4B-Instruct,准确率从48.7%提升至58.7%,答案泄露率从34.0%降至9.9%。

原文摘要 · Abstract (English)

Deep research agents increasingly combine private local documents with external tools like web retrieval, creating a privacy risk: an agent's external queries may leak sensitive information from its local context. This risk is amplified by the mosaic effect, where individual queries may appear harmless but become revealing in aggregate. We introduce MosaicLeaks, a benchmark of 1,001 multi-hop deep research tasks that chain private enterprise documents and a public web corpus, forcing agents to make external queries that depend on local information. We evaluate leakage with an adversary LLM that observes only the agent's external queries and attempts to infer private information at three levels: the agent's research intent, answers to specific private questions and verifiable claims about the enterprise documents. We find that models across families and sizes frequently leak at all three levels, that zero-shot privacy prompting reduces but does not eliminate leakage and that reinforcement learning for task performance alone worsens leakage. To address this, we propose Privacy-Aware Deep Research (PA-DR), an RL framework that combines situational rewards for task success with a learned privacy classifier to provide dense credit assignment over both per-query and mosaic-level leakage. Training Qwen3-4B-Instruct with PA-DR improves accuracy from 48.7% to 58.7% and reduces answer and full-information leakage from 34.0% to 9.9%.

隐私安全智能体泄漏检测强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。