用提示+检索+课程学习,让大模型更懂对话中的隐性情绪。
Do LLMs Feel? Teaching Emotion Recognition with Prompts, Retrieval, and Curriculum Learning
- 设计情绪敏感提示模板,融合显性和隐性情感线索。
- 在IEMOCAP和MELD上达到新SOTA,准确率显著提升。
- 适合想提升对话情绪理解能力的研究者和开发者。
对话中的情绪识别(ERC)是理解人类情感、实现自然人机交互的关键任务。尽管大语言模型(LLMs)在该领域展现出巨大潜力,但其捕捉显性与隐性情绪内在关联的能力仍有限。本文提出一种新型ERC训练框架PRC-Emo,融合提示工程、示范检索与课程学习,旨在探索LLMs在对话情境中感知情绪的可行性。具体而言,基于显性和隐性情感线索设计情绪敏感提示模板,以更好引导模型理解说话者心理状态;构建首个专用示范检索库,包含多个主流数据集的训练样本,以及由大模型生成并人工验证的高质量对话样例;同时,在LoRA微调中引入课程学习策略,通过同说话人与不同说话人间的情感偏移加权,为对话样本分配难度,并按由易到难顺序组织训练。在IEMOCAP和MELD两个基准数据集上的实验结果表明,该方法取得新的最先进性能,验证了其在提升基于大模型的情绪理解能力方面的有效性与泛化性。
原文摘要 · Abstract (English)
Emotion Recognition in Conversation (ERC) is a crucial task for understanding human emotions and enabling natural human-computer interaction. Although Large Language Models (LLMs) have recently shown great potential in this field, their ability to capture the intrinsic connections between explicit and implicit emotions remains limited. We propose a novel ERC training framework, PRC-Emo, which integrates Prompt engineering, demonstration Retrieval, and Curriculum learning, with the goal of exploring whether LLMs can effectively perceive emotions in conversational contexts. Specifically, we design emotion-sensitive prompt templates based on both explicit and implicit emotional cues to better guide the model in understanding the speaker's psychological states. We construct the first dedicated demonstration retrieval repository for ERC, which includes training samples from widely used datasets, as well as high-quality dialogue examples generated by LLMs and manually verified. Moreover, we introduce a curriculum learning strategy into the LoRA fine-tuning process, incorporating weighted emotional shifts between same-speaker and different-speaker utterances to assign difficulty levels to dialogue samples, which are then organized in an easy-to-hard training sequence. Experimental results on two benchmark datasets -- IEMOCAP and MELD -- show that our method achieves new state-of-the-art (SOTA) performance, demonstrating the effectiveness and generalizability of our approach in improving LLM-based emotional understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。