用对话任务信息提升对话摘要的忠实度
Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks
- 引入任务相关语义信息增强摘要准确性
- 在法语客服对话上提升摘要一致性
- 适合关注对话理解与评估的研究者
对话摘要旨在为多说话人对话生成简洁连贯的摘要。尽管语言模型进展显著,但准确且忠实的对话摘要仍具挑战,因需理解说话人互动并捕捉相关信息。当前抽象式模型常产生不一致的摘要。本文提出利用面向任务的人机对话系统中的语音理解(SLU)语义信息,提升任务导向型人-人对话摘要的语义忠实度。研究提出三项贡献:一、探索任务信息对摘要过程的增强作用;二、提出基于任务语义的新评估标准;三、发布经过标准化标注的数据集新版本,支持任务导向对话摘要研究。实验基于法语客服电话对话数据集 DECODA,结果表明,融合任务信息的模型可提升摘要准确性,即使在不同词错误率下亦然。
原文摘要 · Abstract (English)
Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully remains challenging due to the need to understand speaker interactions and capture relevant information. Indeed, abstractive models used for dialog summarization may generate summaries that contain inconsistencies. We suggest using the semantic information proposed for performing Spoken Language Understanding (SLU) in human-machine dialogue systems for goal-oriented human-human dialogues to obtain a more semantically faithful summary regarding the task. This study introduces three key contributions: First, we propose an exploration of how incorporating task-related information can enhance the summarization process, leading to more semantically accurate summaries. Then, we introduce a new evaluation criterion based on task semantics. Finally, we propose a new dataset version with increased annotated data standardized for research on task-oriented dialogue summarization. The study evaluates these methods using the DECODA corpus, a collection of French spoken dialogues from a call center. Results show that integrating models with task-related information improves summary accuracy, even with varying word error rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。