arXiv:2412.15047cs.HCcs.AI2024-12中稿 · publication at CSC…被引 13

用AI帮助网友识别发帖隐私风险,让工具更懂人的实际处境。

Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI

  • 用NLP模型分析用户发帖内容,识别潜在隐私泄露点。
  • 21名用户测试显示,模型能帮人发现未察觉的风险并促进反思。
  • 关键在结合发帖语境与用户真实威胁认知,提供可理解的解释。

在匿名论坛如Reddit上,用户容易看到自我表露的益处(如向陌生人倾诉家庭矛盾),但隐私风险却较抽象(如伴侣能否认出这是自己)。已有研究开发了自然语言处理(NLP)工具来识别文本中的高风险披露,但均未经过目标用户的实际评估。缺乏这种评估,工具可能陷入“社会-技术鸿沟”:用户需要辅助决策的工具,而非简单禁止披露的说教式干预。为此,我们对21位Reddit用户进行了研究,让他们使用当前最先进的披露检测模型分析自己撰写的两篇帖子,并通过提问了解模型是否带来帮助、存在哪些不足以及如何改进。尽管模型仍有缺陷,用户仍普遍积极反馈,认为其能帮助发现疏漏、揭示未知风险、激发自我反思。但研究也表明,真正有用的隐私支持AI必须考虑发布情境、披露规范和用户的实际威胁模型,并提供能帮助理解风险背景的解释。

原文摘要 · Abstract (English)

In pseudonymous online fora like Reddit, the benefits of self-disclosure are often apparent to users (e.g., I can vent about my in-laws to understanding strangers), but the privacy risks are more abstract (e.g., will my partner be able to tell that this is me?). Prior work has sought to develop natural language processing (NLP) tools that help users identify potentially risky self-disclosures in their text, but none have been designed for or evaluated with the users they hope to protect. Absent this assessment, these tools will be limited by the social-technical gap: users need assistive tools that help them make informed decisions, not paternalistic tools that tell them to avoid self-disclosure altogether. To bridge this gap, we conducted a study with N = 21 Reddit users; we had them use a state-of-the-art NLP disclosure detection model on two of their authored posts and asked them questions to understand if and how the model helped, where it fell short, and how it could be improved to help them make more informed decisions. Despite its imperfections, users responded positively to the model and highlighted its use as a tool that can help them catch mistakes, inform them of risks they were unaware of, and encourage self-reflection. However, our work also shows how, to be useful and usable, AI for supporting privacy decision-making must account for posting context, disclosure norms, and users' lived threat models, and provide explanations that help contextualize detected risks.

隐私保护AI辅助用户研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。