arXiv:2502.12102cs.AIcs.ET2025-02被引 23

为AI拟人角色设计合适的人机关系规范,避免不当依赖与伦理风险。

Relational Norms for Human-AI Cooperation

  • 基于人类关系规范(如师徒、雇佣)构建AI角色行为准则。
  • 指出AI无意识、不疲劳特性影响其履行情感与责任功能的能力。
  • 适合关注AI伦理、人机交互设计及政策制定的研究者与从业者。

AI代理和聊天机器人正被设计成承担类似人类社会角色的功能,如助手、心理健康提供者、导师或伴侣。这些角色背后存在特定的社会关系规范,如等级、关怀、交易或亲密关系,它们定义了互动中的合理行为边界。例如,职场中上级可下达指令而下属不可反向指挥,体现了层级与交易期待。然而,由于AI缺乏意识且不会疲劳,其在履行这些角色功能时面临根本性限制。本研究由哲学家、心理学家、关系科学家、伦理学家、法律专家及AI研究人员共同完成,强调需审慎评估并构建适用于人机关系的规范体系。尽管AI能提供持续可用性与一致性优势,但可能引发不健康的依赖或对人际关系的错误预期,进而影响真实人际互动。因此,理解并有意识地塑造合适的“人机关系规范”,是确保人机协作符合伦理、值得信赖并促进人类福祉的关键。

原文摘要 · Abstract (English)

How we should design and interact with social artificial intelligence depends on the socio-relational role the AI is meant to emulate or occupy. In human society, relationships such as teacher-student, parent-child, neighbors, siblings, or employer-employee are governed by specific norms that prescribe or proscribe cooperative functions including hierarchy, care, transaction, and mating. These norms shape our judgments of what is appropriate for each partner. For example, workplace norms may allow a boss to give orders to an employee, but not vice versa, reflecting hierarchical and transactional expectations. As AI agents and chatbots powered by large language models are increasingly designed to serve roles analogous to human positions - such as assistant, mental health provider, tutor, or romantic partner - it is imperative to examine whether and how human relational norms should extend to human-AI interactions. Our analysis explores how differences between AI systems and humans, such as the absence of conscious experience and immunity to fatigue, may affect an AI's capacity to fulfill relationship-specific functions and adhere to corresponding norms. This analysis, which is a collaborative effort by philosophers, psychologists, relationship scientists, ethicists, legal experts, and AI researchers, carries important implications for AI systems design, user behavior, and regulation. While we accept that AI systems can offer significant benefits such as increased availability and consistency in certain socio-relational roles, they also risk fostering unhealthy dependencies or unrealistic expectations that could spill over into human-human relationships. We propose that understanding and thoughtfully shaping (or implementing) suitable human-AI relational norms will be crucial for ensuring that human-AI interactions are ethical, trustworthy, and favorable to human well-being.

人机关系伦理规范AI设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。