测试大模型识别人文风格的能力,揭示匿名文本的隐私漏洞
AIDBench: A benchmark for evaluating the authorship identification capability of large language models
- 构建多源文本作者识别基准AIDBench,涵盖邮件、博客等五类数据
- 大模型识别准确率远超随机水平,一对一与一对多任务均表现优异
- 提出RAG增强方法,突破上下文长度限制,适配长文本分析场景
随着大语言模型(LLMs)快速进步并融入日常生活,其带来的隐私风险日益受到关注。本文聚焦于一个具体风险:LLMs可能帮助识别匿名文本的作者,从而威胁真实系统中匿名性,如匿名同行评审。为此,我们提出了AIDBench,一个包含邮件、博客、评论、文章和科研论文等多个作者识别数据集的基准。该基准采用两种评估方式:一对一作者识别(判断两篇文本是否出自同一作者)和一对多作者识别(给定查询文本及候选列表,识别最可能同源的文本)。我们还引入基于检索增强生成(RAG)的方法,提升大模型在输入长度超出上下文窗口时的作者识别能力,建立新的评估基线。实验表明,大模型在作者识别上的正确率显著高于随机水平,揭示了这些强大模型带来的新隐私风险。代码与数据将在论文接收后公开。
原文摘要 · Abstract (English)
As large language models (LLMs) rapidly advance and integrate into daily life, the privacy risks they pose are attracting increasing attention. We focus on a specific privacy risk where LLMs may help identify the authorship of anonymous texts, which challenges the effectiveness of anonymity in real-world systems such as anonymous peer review systems. To investigate these risks, we present AIDBench, a new benchmark that incorporates several author identification datasets, including emails, blogs, reviews, articles, and research papers. AIDBench utilizes two evaluation methods: one-to-one authorship identification, which determines whether two texts are from the same author; and one-to-many authorship identification, which, given a query text and a list of candidate texts, identifies the candidate most likely written by the same author as the query text. We also introduce a Retrieval-Augmented Generation (RAG)-based method to enhance the large-scale authorship identification capabilities of LLMs, particularly when input lengths exceed the models' context windows, thereby establishing a new baseline for authorship identification using LLMs. Our experiments with AIDBench demonstrate that LLMs can correctly guess authorship at rates well above random chance, revealing new privacy risks posed by these powerful models. The source code and data will be made publicly available after acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。