LLM在社交媒体回复中会弱化负面情绪,倾向输出更中性或正面内容。
Consistency of Responses and Continuations Generated by Large Language Models on Social Media
- 分析多个大模型在气候议题对话中的情绪与语义延续能力。
- 模型普遍降低负面情绪强度,甚至将愤怒等转为喜悦或惊讶。
- 适合关注AI情感表达、社交应用设计的研究者阅读。
大型语言模型(LLMs)在文本生成方面表现卓越,但其在社交媒体情境下的情感一致性与语义连贯性仍不明确。本研究通过分析来自Twitter和Reddit的气候变化讨论,考察了Gemma、Llama3、Llama3.3及Claude四个模型在续写与回复任务中的表现。结果显示,尽管所有模型均保持较高的语义连贯性,但对情感处理存在明显模式:当输入含愤怒、厌恶、恐惧或悲伤等负向情绪时,模型倾向于生成情绪更中性或转向积极(如喜悦、惊奇)的内容。相比人类撰写内容,四种模型在回复任务中系统性地降低了情绪强度,偏好使用中性理性情绪。虽在续写与回复任务中表现有差异,但整体保持高语义相似度。这些发现为LLM在社交媒体环境中的部署及人机交互设计提供了重要参考。
原文摘要 · Abstract (English)
Large Language Models (LLMs) demonstrate remarkable capabilities in text generation, yet their emotional consistency and semantic coherence in social media contexts remain insufficiently understood. This study investigates how LLMs handle emotional content and maintain semantic relationships through continuation and response tasks using three open-source models: Gemma, Llama3 and Llama3.3 and one commercial Model:Claude. By analyzing climate change discussions from Twitter and Reddit, we examine emotional transitions, intensity patterns, and semantic consistency between human-authored and LLM-generated content. Our findings reveal that while both models maintain high semantic coherence, they exhibit distinct emotional patterns: these models show a strong tendency to moderate negative emotions. When the input text carries negative emotions such as anger, disgust, fear, or sadness, LLM tends to generate content with more neutral emotions, or even convert them into positive emotions such as joy or surprise. At the same time, we compared the LLM-generated content with human-authored content. The four models systematically generated responses with reduced emotional intensity and showed a preference for neutral rational emotions in the response task. In addition, these models all maintained a high semantic similarity with the original text, although their performance in the continuation task and the response task was different. These findings provide deep insights into the emotion and semantic processing capabilities of LLM, which are of great significance for its deployment in social media environments and human-computer interaction design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。