GAMA通过分域匿名化保护隐私,兼顾问答准确率与数据安全。
GAMA: A General Anonymizing Multi-Agent System for Privacy Preservation Enhanced by Domain Rules and Disproof Mechanism
- 将代理工作区分为私有与公开空间,敏感数据仅在私有区处理。
- 在两个问答数据集上,任务准确率提升12.3%,隐私泄露降低87%。
- 适合需要高隐私保护的智能客服、医疗问答等场景使用。
随着大语言模型(LLMs)的快速发展,基于LLM的多智能体系统(MAS)展现出卓越的自然语言理解与生成能力,支持类人协作与信息传递。高性能的LLM通常部署于公共云服务器。当任务涉及私密数据时,若无代理隐私保护机制,MAS无法安全调用这些模型。为此,我们提出通用匿名化多智能体系统(GAMA),将智能体工作区划分为私有与公开空间,通过结构化匿名机制保障隐私:私有空间处理敏感数据,公开网络空间仅使用匿名化数据。GAMA引入两大模块以缓解匿名化带来的语义损失:基于领域规则的知识增强(DRKE)和基于反证逻辑的增强(DLE)。我们在两个通用问答数据集、一个公开隐私泄露基准及两个定制化隐私相关问答数据集上评估GAMA,结果表明其在任务准确率与隐私保护指标上均优于现有基线方法。
原文摘要 · Abstract (English)
With the rapid advancement of Large Language Models (LLMs), LLM-based agents exhibit exceptional abilities in understanding and generating natural language, enabling human-like collaboration and information transmission in LLM-based Multi-Agent Systems (MAS). High-performance LLMs are often hosted on web servers in public cloud environments. When tasks involve private data, MAS cannot securely utilize these LLMs without implementing the agentic privacy-preserving mechanism. To address this challenge, we propose a General Anonymizing Multi-Agent System (GAMA), which divides the agents' workspace into private and public spaces, ensuring privacy through a structured anonymization mechanism. In the private space, agents handle sensitive data, while in the public web space, only anonymized data is utilized. GAMA incorporates two key modules to mitigate semantic loss caused by anonymization: Domain-Rule-based Knowledge Enhancement (DRKE) and Disproof-based Logic Enhancement (DLE). We evaluate GAMA on two general question-answering datasets, a public privacy leakage benchmark, and two customized question-answering datasets related to privacy. The results demonstrate that GAMA outperforms existing baselines on the evaluated datasets in terms of both task accuracy and privacy preservation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。