设计智能体时应匹配其能力与道德地位引发恰当情绪反应
The Emotional Alignment Design Policy
- 依据情感对齐原则，系统应引发与其能力及道德地位相称的情绪
- 避免过度或不足情绪反应，防止错误类型情绪诱导
- 适用于伦理设计、人机交互领域研究者
根据我们称之为情感对齐设计政策的原则，人造实体应被设计为引发用户对其能力与道德地位（或缺乏）适当的情感反应。该原则可能以两种方式被违反：一是设计出引发情感反应强于或弱于其能力与道德地位应有水平的系统（过度或不足）；二是引发错误类型的情感反应（目标偏差）。尽管看似合理，实际实施面临多重挑战：如何在尊重用户自主性的同时促进适当反应？如何处理专家与公众在事实与价值上的分歧与不确定性？若情感对齐要求创造或毁灭具有道德地位的实体，应如何应对？设计应在多大程度上符合而非改变用户的既有假设与态度？
原文摘要 · Abstract (English)
According to what we call the Emotional Alignment Design Policy, artificial entities should be designed to elicit emotional reactions from users that appropriately reflect the entities' capacities and moral status, or lack thereof. This principle can be violated in two ways: by designing an artificial system that elicits stronger or weaker emotional reactions than its capacities and moral status warrant (overshooting or undershooting), or by designing a system that elicits the wrong type of emotional reaction (hitting the wrong target). Although presumably attractive, practical implementation faces several challenges including: How can we respect user autonomy while promoting appropriate responses? How should we navigate expert and public disagreement and uncertainty about facts and values? What if emotional alignment seems to require creating or destroying entities with moral status? To what extent should designs conform to versus attempt to alter user assumptions and attitudes?
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。