arXiv:2510.20721cs.CLcs.AI2025-10ACL被引 2

用户对隐私敏感回复的评价与代理模型差异大,提示评估需更贴近真实体验。

User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios

  • 通过94名用户测试90个隐私场景,对比真实用户与代理模型判断
  • 用户间评价一致性低,而代理模型内部一致但与用户评价相关性差
  • 揭示代理评估无法反映用户对隐私与帮助性的综合感知,需用户中心设计

大型语言模型(LLMs)在撰写邮件、会议摘要及健康问答等任务中广泛应用,用户可能需共享私密信息(如联系方式、病历)。为评估模型识别并脱敏此类信息的能力,已有研究引入真实场景基准(如PrivacyLens),发现模型在复杂场景中仍会泄露隐私。然而,这些评估依赖代理LLM判断响应的帮助性与隐私保护质量,而非直接测量用户感知。本研究开展用户研究(n=94),基于90个PrivacyLens场景,发现用户对相同模型响应的评价一致性较低;相反,五种代理LLM虽具高内部一致性,但各自与用户评价的相关性均较低。结果表明,代理模型无法准确反映用户在隐私敏感场景中对效用与隐私的多元感知。本文呼吁开展更多以用户为中心的研究,以衡量模型在保障隐私的同时提供有效帮助的能力,并提升模型与用户对感知隐私与效用的一致性。

原文摘要 · Abstract (English)

Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. In these settings, users may need to share private information (e.g., contact details, health records). To evaluate LLMs' ability to identify and redact such information, prior work introduced real-life, scenario-based benchmarks (e.g., ConfAIde, PrivacyLens) and found that LLMs can leak private information in complex scenarios. However, these evaluations relied on proxy LLMs to judge the helpfulness and privacy-preservation quality of LLM responses, rather than directly measuring users' perceptions. To understand how users perceive the helpfulness and privacy-preservation quality of LLM responses to privacy-sensitive scenarios, we conducted a user study ($n=94$) using 90 PrivacyLens scenarios. We found that users had low agreement with each other when evaluating identical LLM responses. In contrast, five proxy LLMs reached high agreement, yet each proxy LLM had low correlation with users' evaluations. These results indicate that proxy LLMs cannot accurately estimate users' wide range of perceptions of utility and privacy in privacy-sensitive scenarios. We discuss the need for more user-centered studies to measure LLMs' ability to help users while preserving privacy, and for improving alignment between LLMs and users in estimating perceived privacy and utility.

隐私保护用户评估大模型测评

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。