大模型在高压力对话中过度乐观,反而让支持失效。
Incongruent Positivity: When Miscalibrated Positivity Undermines Online Supportive Conversations
- 区分轻重情绪场景,分析支持性回复的适配性差异
- 大模型在严重情绪场景中更易出现轻视、过度乐观等不当回应
- 提出弱监督分类器,可有效识别不同情境下的不恰当积极表达
在情感支持对话中,本意良好的积极回应可能因不当表达而显得敷衍、轻视或过于理想化。本文研究了这种‘不一致的积极’现象,涵盖人类与大语言模型生成的回应。通过收集Reddit上真实用户-助手对话,并基于相同语境生成大模型回应,将对话按情绪强度分为两类:轻度(如关系矛盾、一般建议)与重度(如悲伤、焦虑)。分析发现,大模型在高情绪强度场景中更倾向于使用轻视性、最小化语气的不切实际积极回应。为深入探究其成因,我们对大模型在强弱情绪反应数据集上进行微调,并构建了一个弱监督多标签分类器集成(DeBERTa与MentalBERT),在两类情绪关切中均提升了对不一致积极类型的检测能力。研究提示应超越简单生成通用积极回应,转而关注情感一致性支持策略,以平衡积极情绪与情绪共情,为构建具备情境感知与可信度的在线支持系统提供方向。
原文摘要 · Abstract (English)
In emotionally supportive conversations, well-intended positivity can sometimes misfire, leading to responses that feel dismissive, minimizing, or unrealistically optimistic. We examine this phenomenon of incongruent positivity as miscalibrated expressions of positive support in both human and LLM generated responses. To this end, we collected real user-assistant dialogues from Reddit across a range of emotional intensities and generated additional responses using large language models for the same context. We categorize these conversations by intensity into two levels: Mild, which covers relationship tension and general advice, and Severe, which covers grief and anxiety conversations. This level of categorization enables a comparative analysis of how supportive responses vary across lower and higher stakes contexts. Our analysis reveals that LLMs are more prone to unrealistic positivity through dismissive and minimizing tone, particularly in high-stakes contexts. To further study the underlying dimensions of this phenomenon, we finetune LLMs on datasets with strong and weak emotional reactions. Moreover, we developed a weakly supervised multilabel classifier ensemble (DeBERTa and MentalBERT) that shows improved detection of incongruent positivity types across two sorts of concerns (Mild and Severe). Our findings shed light on the need to move beyond merely generating generic positive responses and instead study the congruent support measures to balance positive affect with emotional acknowledgment. This approach offers insights into aligning large language models with affective expectations in the online supportive dialogue, paving the way toward context-aware and trust preserving online conversation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。