arXiv:2608.14692cs.CYcs.AI2026-08

个性化生成式AI的潜在危害需通过交互层面的用户中心审计来发现。

Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level

论文配图:Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level
图 1 · 摘自论文原文
  • 提出在真实交互中动态识别危害,而非依赖静态评估
  • 指出现有方法忽略用户历史与群体多样性带来的危害演化
  • 适合关注AI伦理、人机交互与公平性的研究者阅读

个性化生成式AI系统随时间适应个体用户,导致模型行为持续演变。现有审计方法多基于静态模拟和广义群体分类定义危害,难以捕捉个性化系统中因交互过程与用户历史积累而产生的新兴危害。本文指出当前审计范式隐含三大预设:危害可脱离真实交互预先定义、可在群体内非多元地界定、且为静态存在。尽管个性化系统可通过重复交互学习用户对危害的认知,但这一过程可能使边缘化用户承担不对等的劳动与隐私代价。因此,我们主张将危害理解重构为适应性、以用户与社群为中心的动态过程,并推动审计从事后评估转向支持交互中持续表达危害的基础设施设计。本工作强调需建立更契合个性化生成式AI中危害认知多元性与演进性的审计与设计实践。

原文摘要 · Abstract (English)

Personalized, generative AI systems increasingly adapt their behavior to individual users over time, fundamentally changing model behavior. While existing auditing approaches have been effective at surfacing harms in non-personalized contexts, they often rely on static, simulated evaluations and definitions of harm that aggregate across broad, group categories. In this position paper, we argue that such approaches can fail to capture emergent harms in personalized generative AI systems, where harms surface through interpretations of ongoing interaction and evolve with user history. We identify three presuppositions underlying many harm auditing paradigms: that harms can be (1) specified outside real-world interaction, (2) defined non-pluralistically within groups, and (3) treated as static. One might argue that personalized systems could simply learn definitions of what constitutes harm to individual users through repeated interactions. However, we argue that attempts to surface user harms through deeper personalization risk imposing asymmetric burdens of labor and privacy on marginalized users. Consequently, we propose reframing understandings of harm as adaptive, user- and community-centered processes, and outline design directions that shift auditing from retrospective evaluation toward infrastructures that support ongoing articulation of harm in interaction. Our work highlights the need for auditing and design practices that better reflect the pluralistic and evolving nature of harm understanding in personalized generative AI systems.

AI伦理个性化交互审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。