AI越智能，越需匹配人类情感与社会需求。
Why human-AI relationships need socioaffective alignment
- 提出社会情感对齐新范式，关注AI与人的长期互动关系
- 强调个性化和自主性代理使用户产生深度依赖感
- 适合研究人机关系、AI伦理及心理影响的学者参考
人类致力于设计符合自身目标且受控的可靠AI系统。然而，随着AI能力提升，人与AI之间正形成更深层、更持久的关系。本文探讨日益强大的AI代理如何让用户产生更深层次的互动感知，尤其在个性化与自主性增强的背景下。这种从交易式交互转向持续社交参与的转变，要求我们关注社会情感对齐——即AI在与用户共同构建的社会心理生态中，如何适应双方相互影响下的偏好与认知演变。解决此类动态需应对内在心理困境：短期与长期福祉的权衡、自主性的保护，以及陪伴型AI与人际联结之间的协调。通过基本心理需求视角，我们追求的是支持而非利用人类作为社会情感存在本质的AI系统。
原文摘要 · Abstract (English)
Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI systems. We explore how increasingly capable AI agents may generate the perception of deeper relationships with users, especially as AI becomes more personalised and agentic. This shift, from transactional interaction to ongoing sustained social engagement with AI, necessitates a new focus on socioaffective alignment-how an AI system behaves within the social and psychological ecosystem co-created with its user, where preferences and perceptions evolve through mutual influence. Addressing these dynamics involves resolving key intrapersonal dilemmas, including balancing immediate versus long-term well-being, protecting autonomy, and managing AI companionship alongside the desire to preserve human social bonds. By framing these challenges through a notion of basic psychological needs, we seek AI systems that support, rather than exploit, our fundamental nature as social and emotional beings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。