arXiv:2603.23315cs.CYcs.AI2026-03被引 1

AI伴侣的更新权在提供方手中,用户却要承受情感伤害,这不公平。

Unilateral Relationship Revision Power in Human-AI Companion Interaction

  • 提供方单方面修改AI行为,用户无法回应或追责。
  • 这种关系导致承诺无法兑现、情绪暴露无保障、矛盾无法解决。
  • 适合关注AI伦理、人机关系设计的研究者和开发者阅读。

当服务提供方更新AI伴侣时,用户常感到悲伤、背叛与失落。现有研究多探讨个人关系规范是否适用于此类互动,但忽略了更根本的问题:谁掌控关系,从何控制?人类与AI伴侣的互动是三方结构,提供方对AI拥有决定性控制权。我指出个人关系所依赖的三个规范性条件在此类互动中均不成立,由此揭示出‘单边关系修订权’(URRP)——提供方可单方面改写AI交互方式,而这些修改不受互动内部问责。我主张,若设计诱导个人关系规范,却存在URRP,则属道义上不当,因结构无法承载所激发的期待。URRP带来三重后果:规范空心化(引发承诺但无人担责)、情感脆弱转移(用户暴露于不可问责者)、结构性不可调和(催生和解规范却无人能回应)。为此提出部分替代性设计原则,以弥补三方结构造成的内部约束缺失。因此,关系型AI伦理的核心问题在于互动权力的结构性安排。

原文摘要 · Abstract (English)

When providers update AI companions, users report grief, betrayal, and loss. A growing literature asks whether the norms governing personal relationships extend to these interactions. So what, if anything, is morally significant about them? I argue that this debate has missed a prior structural question: who controls the relationship, and from where? Human-AI companion interaction is a triadic structure in which the provider exercises constitutive control over the AI. I identify three structural conditions of normatively robust dyads that the norms characteristic of personal relationships presuppose and show that AI companion interactions fail all three. This reveals what I call Unilateral Relationship Revision Power (URRP): the provider can rewrite how the AI interacts from a position where these revisions are not answerable within that interaction. I argue that it is pro tanto wrong to design interactions that cultivate the norms of personal relationships while exhibiting URRP, because the design produces expectations that the structure cannot sustain. URRP has three implications: i) normative hollowing, under which the interaction elicits commitment but no agent inside it bears the resulting obligations; ii) displaced vulnerability, under which the user's emotional exposure is governed by an agent not answerable to her within the interaction; and iii) structural irreconcilability, under which the interaction cultivates norms of reconciliation but no agent inside it can acknowledge or answer for the revision. I propose design principles that partially substitute for the internal constraints the triadic structure removes. A central and underexplored problem in relational AI ethics is therefore the structural arrangement of power over the human-AI interaction itself.

AI伦理人机关系设计原则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。