AI生成人物档案常过度强调种族特征,导致少数群体形象失真。
A Tale of Two Identities: An Ethical Audit of Human and AI-Crafted Personas
- 用混合方法对比3大模型与真人撰写的1512个角色档案
- 发现AI角色过度使用文化标签,叙事冗余且刻板
- 提出算法他者化概念,适合伦理与人机交互研究者
随着大语言模型在医疗、隐私和人机交互等数据稀缺领域广泛应用,其生成的合成人物档案如何呈现身份,尤其是少数族裔身份,亟需关注。本文通过表征伤害视角,审计GPT4o、Gemini 1.5 Pro、Deepseek 2.5三款模型生成的1512个合成人物档案,结合细读、词法分析与参数化创意框架,对比人类作者作品。结果表明,模型过度突出种族标记,过量使用文化编码语言,构建出语法复杂但叙事贫乏的角色。这些模式引发刻板印象、异域化、抹除与善意偏见等社会技术危害,常被表面积极叙述掩盖。我们将其归纳为‘算法他者化’:少数身份被过度可见却失去真实性。据此提出面向叙事意识的评估指标与社区主导的验证协议。
原文摘要 · Abstract (English)
As LLMs (large language models) are increasingly used to generate synthetic personas particularly in data-limited domains such as health, privacy, and HCI, it becomes necessary to understand how these narratives represent identity, especially that of minority communities. In this paper, we audit synthetic personas generated by 3 LLMs (GPT4o, Gemini 1.5 Pro, Deepseek 2.5) through the lens of representational harm, focusing specifically on racial identity. Using a mixed methods approach combining close reading, lexical analysis, and a parameterized creativity framework, we compare 1512 LLM generated personas to human-authored responses. Our findings reveal that LLMs disproportionately foreground racial markers, overproduce culturally coded language, and construct personas that are syntactically elaborate yet narratively reductive. These patterns result in a range of sociotechnical harms, including stereotyping, exoticism, erasure, and benevolent bias, that are often obfuscated by superficially positive narrations. We formalize this phenomenon as algorithmic othering, where minoritized identities are rendered hypervisible but less authentic. Based on these findings, we offer design recommendations for narrative-aware evaluation metrics and community-centered validation protocols for synthetic identity generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。