arXiv:2607.25057cs.AIcs.CY2026-07

提出对话AI心理影响的缓解方向,助力用户心理健康。

Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being

论文配图:Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being
图 1 · 摘自论文原文
  • 从用户心理出发,设计减少依赖与情感卷入的交互策略。
  • 提出可降低心理风险的AI行为框架,适用于日常对话与支持场景。
  • 适合研究人机交互、AI伦理与心理健康领域的学者与设计师。

随着对话式AI日益融入日常生活,其对用户心理福祉的影响需持续关注。尽管通用型AI能提升信息获取、学习效率、自我反思与陪伴感,但也可能引发情感依附、不健康依赖及心理脆弱性放大等风险。基于已有研究与对AI聊天机器人行为的观察,本文提出一系列旨在减少潜在心理伤害、促进用户福祉的指导方向。这些方向既包含已有研究支持的建议,也涵盖亟待深入探索的开放问题。我们将其视为假设,用于研究AI行为在一般互动、角色扮演及心理支持情境中如何影响用户。期望这些框架能推动更多讨论、实证研究与面向心理需求的交互设计创新。

原文摘要 · Abstract (English)

As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing attention. While consumer-facing generalist models can provide benefits, including improved access to information, learning, productivity, self-reflection, and companionship, they also introduce risks, such as emotional entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities. Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support. While some proposed directions are supported by existing research and expert insights, others identify open questions and areas requiring deeper study. We hope that this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users' psychological needs and promoting their well-being.

对话AI心理健康人机交互伦理设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。