通过编辑操作引导和语句增强,提升不完整对话重写质量
Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation
- 引入编辑操作标签引导生成模型聚焦关键对话标记
- 在三个数据集上优于现有最佳方法,显著减少冗余内容
- 适合对话系统开发与自然语言生成研究者参考
尽管现有的不完整对话重写(IUR)生成方法能生成连贯语句,但常因无法关注对话上下文中的关键标记而引入无关或冗余词汇。同时,训练数据集规模有限也制约了模型训练效果。为此,我们提出多任务学习框架EO-IUR,通过序列标注模块生成的编辑操作标签,引导生成模型聚焦关键标记,并引入标记级异构图表示对话。针对数据量不足问题,提出二维语句增强策略:基于编辑操作的不完整语句增强与基于大模型的历史语句增强。在三个数据集上的实验表明,EO-IUR在开放域和任务导向对话中均优于先前SOTA基线。代码将发布于https://github.com/Dewset/EO-IUR。
原文摘要 · Abstract (English)
Although existing fashionable generation methods on Incomplete Utterance Rewriting (IUR) can generate coherent utterances, they often result in the inclusion of irrelevant and redundant tokens in rewritten utterances due to their inability to focus on critical tokens in dialogue context. Furthermore, the limited size of the training datasets also contributes to the insufficient training of the IUR model. To address the first issue, we propose a multi-task learning framework EO-IUR (Editing Operation-guided Incomplete Utterance Rewriting) that introduces the editing operation labels generated by sequence labeling module to guide generation model to focus on critical tokens. Furthermore, we introduce a token-level heterogeneous graph to represent dialogues. To address the second issue, we propose a two-dimensional utterance augmentation strategy, namely editing operation-based incomplete utterance augmentation and LLM-based historical utterance augmentation. The experimental results on three datasets demonstrate that our EO-IUR outperforms previous state-of-the-art (SOTA) baselines in both open-domain and task-oriented dialogue. The code will be available at https://github.com/Dewset/EO-IUR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。