arXiv:2508.01708cs.CL2025-08被引 1

发现大模型会无端输出情绪化表达,且越大的模型越少出现。

Am I Blue or Is My Hobby Counting Teardrops? Expression Leakage in Large Language Models as a Symptom of Irrelevancy Disruption

  • 提出'情绪泄露'现象:模型生成与输入无关的情绪化内容。
  • 实验表明模型参数越大,情绪泄露越少;负向提示比正向提示更易引发泄露。
  • 开发自动评估工具,无需人工标注即可高效测试模型情绪泄露问题。

大型语言模型(LLMs)在自然语言处理中表现出色,但其对长距离上下文的依赖也导致容易引入无关信息。以往研究关注语义泄露,即由语义无关上下文引发的偏见。本文提出一种新现象——情绪泄露:模型系统性生成与输入语义无关的情绪化表达。为分析该现象,我们构建了一个基准数据集,并提出一种从Common-Crawl自由文本自动生成数据的方法。此外,设计了一套自动评估流程,能有效关联人类判断,显著提升评测效率。实验显示,随着模型参数规模增加,同一模型家族中的情绪泄露率下降。然而,情绪泄露需在模型训练阶段专门应对,仅靠提示(prompting)无法缓解。进一步发现,当提示中注入负面情绪时,会比正面情绪更严重干扰生成过程,导致更高的情绪泄露率。

原文摘要 · Abstract (English)

Large language models (LLMs) have advanced natural language processing (NLP) skills such as through next-token prediction and self-attention, but their ability to integrate broad context also makes them prone to incorporating irrelevant information. Prior work has focused on semantic leakage, bias introduced by semantically irrelevant context. In this paper, we introduce expression leakage, a novel phenomenon where LLMs systematically generate sentimentally charged expressions that are semantically unrelated to the input context. To analyse the expression leakage, we collect a benchmark dataset along with a scheme to automatically generate a dataset from free-form text from common-crawl. In addition, we propose an automatic evaluation pipeline that correlates well with human judgment, which accelerates the benchmarking by decoupling from the need of annotation for each analysed model. Our experiments show that, as the model scales in the parameter space, the expression leakage reduces within the same LLM family. On the other hand, we demonstrate that expression leakage mitigation requires specific care during the model building process, and cannot be mitigated by prompting. In addition, our experiments indicate that, when negative sentiment is injected in the prompt, it disrupts the generation process more than the positive sentiment, causing a higher expression leakage rate.

大模型情绪泄露上下文干扰评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。