构建真实社交支持数据集,提升AI助人回应的实效性
RedditESS: A Mental Health Social Support Interaction Dataset -- Understanding Effective Social Support to Refine AI-Driven Support Tools
- 基于社交科学理论构建标注体系,识别有效支持行为
- 通过用户反馈验证,发现有效支持包含信息引导与共情并重
- 适合想改进AI心理助手响应质量的研究者使用
有效的心理健康支持对缓解心理困扰至关重要。尽管基于大语言模型(LLM)的助手在心理干预中展现出潜力,但现有研究多将“有效”支持定义为共情认可,忽略了信息指导、群体认同和具体应对策略等关键维度。为弥补这一局限,我们提出RedditESS——一个源自Reddit的真实社交支持互动数据集,包含原始发帖及后续支持性评论与发帖人反馈。基于社会科学研究理论,我们设计集成标注机制,对支持性评论是否有效进行标注,并通过定性评估确保标注可靠性。此外,我们展示该数据集在引导LLM生成更情境化、真正有帮助的支持性回应中的实际应用价值。本研究拓展了对有效支持的理解,为先进AI驱动的心理健康干预提供了新路径。
原文摘要 · Abstract (English)
Effective mental health support is crucial for alleviating psychological distress. While large language model (LLM)-based assistants have shown promise in mental health interventions, existing research often defines "effective" support primarily in terms of empathetic acknowledgments, overlooking other essential dimensions such as informational guidance, community validation, and tangible coping strategies. To address this limitation and better understand what constitutes effective support, we introduce RedditESS, a novel real-world dataset derived from Reddit posts, including supportive comments and original posters' follow-up responses. Grounded in established social science theories, we develop an ensemble labeling mechanism to annotate supportive comments as effective or not and perform qualitative assessments to ensure the reliability of the annotations. Additionally, we demonstrate the practical utility of RedditESS by using it to guide LLM alignment toward generating more context-sensitive and genuinely helpful supportive responses. By broadening the understanding of effective support, our study paves the way for advanced AI-driven mental health interventions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。