arXiv:2410.20174cs.CLcs.AI2024-10被引 6

用堆叠传播框架,在少量数据下实现更一致的个性化对话生成。

A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation

  • 堆叠编码器与双解码器,让模型同时生成回复并理解角色一致性。
  • 在低资源条件下,回复质量和角色一致性均优于现有方法。
  • 适合数据稀缺场景下的个性化对话系统开发。

随着开放域对话系统兴起,个性化对话生成任务受到广泛关注。该任务通常被建模为条件生成问题,旨在根据对话上下文和特定约束(如人物设定)生成自然且有意义的回复,保持角色一致性对建立用户信任至关重要。尽管已有显著进展,传统基于角色的对话模型通常依赖大量包含丰富角色信息的对话数据进行训练,而这类数据获取成本高昂,导致规模受限。本文提出一种新方法,将一致性理解视为生成过程的正则化,通过堆叠传播框架学习生成与理解一体化的流水线。具体地,框架包含一个Transformer编码器和两个Transformer解码器:第一个解码器负责回复生成,第二个作为正则化器,联合建模回复生成与一致性理解。该框架能利用堆叠结构从极少量个性化对话数据中学习,同时保持竞争力。在不同低资源设置下,主观与客观评估均表明,该框架在回复质量与角色一致性上超越强基线模型,显著克服了传统模型对密集角色数据的高度依赖。

原文摘要 · Abstract (English)

With the resurgent interest in building open-domain dialogue systems, the dialogue generation task has attracted increasing attention over the past few years. This task is usually formulated as a conditional generation problem, which aims to generate a natural and meaningful response given dialogue contexts and specific constraints, such as persona. And maintaining a consistent persona is essential for the dialogue systems to gain trust from the users. Although tremendous advancements have been brought, traditional persona-based dialogue models are typically trained by leveraging a large number of persona-dense dialogue examples. Yet, such persona-dense training data are expensive to obtain, leading to a limited scale. This work presents a novel approach to learning from limited training examples by regarding consistency understanding as a regularization of response generation. To this end, we propose a novel stack-propagation framework for learning a generation and understanding pipeline.Specifically, the framework stacks a Transformer encoder and two Transformer decoders, where the first decoder models response generation and the second serves as a regularizer and jointly models response generation and consistency understanding. The proposed framework can benefit from the stacked encoder and decoders to learn from much smaller personalized dialogue data while maintaining competitive performance. Under different low-resource settings, subjective and objective evaluations prove that the stack-propagation framework outperforms strong baselines in response quality and persona consistency and largely overcomes the shortcomings of traditional models that rely heavily on the persona-dense dialogue data.

对话生成低资源个性化堆叠框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。