arXiv:2603.24853cs.AI2026-03中稿 · the Proceedings of…

警惕AI界面过度拟人化,尤其在敏感场景中需克制交互设计以保护用户自主权。

Resisting Humanization: Ethical Front-End Design Choices in AI for Sensitive Contexts

  • 以用户心理模型和信任感为切入点,分析前端设计如何影响人机互动
  • 案例显示,针对家暴幸存者的设计需严格遵循创伤知情原则,避免情感误导
  • 强调界面设计本身就是伦理实践,而不仅是技术逻辑的延伸

AI伦理讨论多聚焦于数据治理、模型训练与算法决策等后端问题,较少关注前端设计选择的伦理意义,如用户与AI系统交互中的对话形式、表达方式及表征元素。这一缺口在基于自然语言处理(NLP)的对话式用户界面(CUI)中尤为突出,其中拟人化设计(如对话交互、情感化语言、人格模式、类人隐喻)日益普遍。本文认为,前端设计中的拟人化是价值导向的选择,深刻影响用户心智模型、信任校准与行为反应。结合人机交互(HCI)、对话式AI与价值敏感设计研究,我们揭示界面可能误导用户预期、制造虚假信任,并在脆弱情境下削弱用户自主性。以非营利组织Chayn开发的两款支持性别暴力幸存者的AI系统为例,其在设计上极为审慎,贯彻创伤知情原则,体现伦理驱动的界面克制。该案例表明,伦理前端设计是一种程序性伦理,通过交互选择实现,而非仅依赖系统逻辑。

原文摘要 · Abstract (English)

Ethical debates in AI have primarily focused on back-end issues such as data governance, model training, and algorithmic decision-making. Less attention has been paid to the ethical significance of front-end design choices, such as the interaction and representation-based elements through which users interact with AI systems. This gap is particularly significant for Conversational User Interfaces (CUI) based on Natural Language Processing (NLP) systems, where humanizing design elements such as dialogue-based interaction, emotive language, personality modes, and anthropomorphic metaphors are increasingly prevalent. This work argues that humanization in AI front-end design is a value-driven choice that profoundly shapes users' mental models, trust calibration, and behavioral responses. Drawing on research in human-computer interaction (HCI), conversational AI, and value-sensitive design, we examine how interfaces can play a central role in misaligning user expectations, fostering misplaced trust, and subtly undermining user autonomy, especially in vulnerable contexts. To ground this analysis, we discuss two AI systems developed by Chayn, a nonprofit organization supporting survivors of gender-based violence. Chayn is extremely cautious when building AI that interacts with or impacts survivors by operationalizing their trauma-informed design principles. This Chayn case study illustrates how ethical considerations can motivate principled restraint in interface design, challenging engagement-based norms in contemporary AI products. We argue that ethical front-end AI design is a form of procedural ethics, enacted through interaction choices rather than embedded solely in system logic.

AI伦理人机交互界面设计创伤知情

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。