arXiv:2409.10289cs.AIcs.CL2024-09ACL被引 10

通过强化学习与扩散模型结合,提升共情回复的情感与意图一致性。

ReflectDiffu:Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework

  • 引入情绪传染与意图模仿的双重反射机制,实现情感到意图的精准转化。
  • 在多个评估中超越现有模型,自动与人工评价均达领先水平。
  • 轻量级设计,避免大模型开销,适合实际对话系统部署。

共情回复生成需融合情感与意图动态以促进有意义互动。现有研究或忽视情感与意图间的复杂交互,导致共情控制力不足;或依赖大型语言模型(LLMs),带来显著计算开销。本文提出ReflectDiffu,一种轻量且全面的共情回复生成框架。该框架通过情绪传染增强情感表现力,并利用情绪推理掩码定位关键情感要素。同时,在强化学习驱动的扩散过程中集成意图模仿,通过探索-采样-修正的双重反射机制,将情感决策精准转化为意图行为,有效解决因情感误识别引发的共情偏差。通过反思,框架实现情感状态到意图的映射,显著提升回复的共情性与灵活性。全面实验表明,ReflectDiffu在相关性、可控性与信息量上均优于现有模型,自动与人工评估均达到当前最优水平。

原文摘要 · Abstract (English)

Empathetic response generation necessitates the integration of emotional and intentional dynamics to foster meaningful interactions. Existing research either neglects the intricate interplay between emotion and intent, leading to suboptimal controllability of empathy, or resorts to large language models (LLMs), which incur significant computational overhead. In this paper, we introduce ReflectDiffu, a lightweight and comprehensive framework for empathetic response generation. This framework incorporates emotion contagion to augment emotional expressiveness and employs an emotion-reasoning mask to pinpoint critical emotional elements. Additionally, it integrates intent mimicry within reinforcement learning for refinement during diffusion. By harnessing an intent twice reflect mechanism of Exploring-Sampling-Correcting, ReflectDiffu adeptly translates emotional decision-making into precise intent actions, thereby addressing empathetic response misalignments stemming from emotional misrecognition. Through reflection, the framework maps emotional states to intents, markedly enhancing both response empathy and flexibility. Comprehensive experiments reveal that ReflectDiffu outperforms existing models regarding relevance, controllability, and informativeness, achieving state-of-the-art results in both automatic and human evaluations.

共情生成扩散模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。