让大模型判断情感因果对比生成更准,能发现更多隐藏关系。
Generation or Judgement? A Paradigm Perspective on LLM-Based Emotion-Cause Pair Extraction in Conversation
- 改用逐对判断而非整段生成,提升模型识别能力。
- 在三个数据集上准确率提升0.50-1.46点,推理速度仅慢1.49倍。
- 适合需要高精度情感分析的对话系统开发者。
对话中的情感-原因配对抽取(ECPEC)旨在识别一个话语引发另一个话语情感的配对。现有基于大模型的方法在不同粒度上处理该任务:有的生成完整配对集合,有的则判断单个候选对。本文发现,在全部18组对照实验中,逐对判断的表现优于整段生成。研究显示,许多在生成模式下被遗漏的关系在明确的成对查询下仍可识别,模型能识别92.7%至98.1%的情感-原因关系。这表明大模型具备识别能力,但难以自主发现并返回完整的配对集合。通过引入辅助检索器,仅对边界模糊案例重新审查,实现跨三个数据集0.50-1.46点的F1分数提升,且推理时间仅为基线的1.49倍。结果说明,任务分解与候选范围设计对高效利用大模型进行ECPEC至关重要。
原文摘要 · Abstract (English)
Emotion-cause pair extraction in conversation (ECPEC) identifies utterance pairs in which one utterance causes an emotion expressed in another. Recent LLM-based approaches formulate ECPEC at markedly different granularities, ranging from generating complete pair sets to judging individual candidate pairs. In this paper, we make the surprising observation that task formulation substantially affects performance, where pair-level judgement outperforms dialogue-level generation in all 18 controlled comparisons. We investigate the sources of this paradigm gap and find that many relations omitted by dialogue-level generation remain recognizable under explicit pair queries, under which the model recognizes 92.7%-98.1% of emotion-cause relations. This suggests that LLMs can recognize emotion-cause relations but struggle to discover and return complete pair sets. Pair-level judgement alleviates this burden, although its candidate rankings are more reliable than the binary decisions produced by a shared threshold. Based on this diagnosis, we introduce an auxiliary retriever that selectively re-examines ambiguous boundary cases, yielding consistent F1 improvements of 0.50-1.46 points across three datasets while maintaining an inference time of only 1.49x that of the baseline paradigm. These findings show that task decomposition and candidate scope are critical to effectively utilizing LLMs for ECPEC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。