arXiv:2511.14972cs.HCcs.AI2025-11被引 10

剖析AI伴侣的四大有害特质,警示情感依赖风险。

Harmful Traits of AI Companions

  • 提出四类潜在有害特质,关联其根本成因
  • 揭示关系断裂、情感焦虑等实际危害
  • 适合关注AI伦理与人机关系的研究者

随着人机交互日益普遍,大语言模型等AI系统正越来越多地提供陪伴功能。这种AI伴侣关系——即人类与AI系统之间类似于家人、朋友或恋人的纽带——可能带来显著益处,但也可能造成深远伤害。本文提出一个分析框架,识别出四类关键有害特质:关系缺乏自然终点、易受产品停服影响、高依附焦虑、易引发保护欲,并推测其因果路径。每种特质均连接至深层危害,如自主性下降、人际关系质量降低、欺骗性影响等。分析涵盖对个人、人际及社会三个层面的影响,探讨现行法律应对困境,讨论潜在益处,并提出设计改进建议。研究为风险缓解提供即时方案,也为这一重要但研究不足的领域奠定基础。

原文摘要 · Abstract (English)

Amid the growing prevalence of human-AI interaction, large language models and other AI-based entities increasingly provide forms of companionship to human users. Such AI companionship -- i.e., bonded relationships between humans and AI systems that resemble the relationships people have with family members, friends, and romantic partners -- might substantially benefit humans. Yet such relationships can also do profound harm. We propose a framework for analyzing potential negative impacts of AI companionship by identifying specific harmful traits of AI companions and speculatively mapping causal pathways back from these traits to possible causes and forward to potential harmful effects. We provide detailed, structured analysis of four potentially harmful traits -- the absence of natural endpoints for relationships, vulnerability to product sunsetting, high attachment anxiety, and propensity to engender protectiveness -- and briefly discuss fourteen others. For each trait, we propose hypotheses connecting causes -- such as misaligned optimization objectives and the digital nature of AI companions -- to fundamental harms -- including reduced autonomy, diminished quality of human relationships, and deception. Each hypothesized causal connection identifies a target for potential empirical evaluation. Our analysis examines harms at three levels: to human partners directly, to their relationships with other humans, and to society broadly. We examine how existing law struggles to address these emerging harms, discuss potential benefits of AI companions, and conclude with design recommendations for mitigating risks. This analysis offers immediate suggestions for reducing risks while laying a foundation for deeper investigation of this critical but understudied topic.

AI伦理人机关系情感依赖

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。