提出可检测对话中相关上下文与知识的响应选择模型,提升开放域对话准确率。
Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems
- 用最近对话作查询,分词级与句级筛选相关上下文与知识
- 在两个基准数据集上优于现有方法,显著提升匹配精度
- 适合需要精准知识检索的开放域对话系统开发者
开放域知识增强型对话近年受到广泛关注。现有基于检索的对话系统多采用神经网络构建匹配模型,将全部上下文与知识内容用于候选回复匹配。但实际中不同部分对识别正确回复的重要性差异显著,话题转移导致大量无关信息干扰匹配过程,影响性能。为此,我们提出多轮响应选择模型RSM-DCK,首先以近期对话为查询,在词级与句级语义层面预筛选出相关的上下文与知识片段;随后候选回复分别与筛选后的上下文和知识交互;最终融合上下文与回复表示,进一步后选更可信的知识片段用于匹配。在两个基准数据集上的实验表明,该模型性能优于现有方法,能有效识别相关上下文与知识。
原文摘要 · Abstract (English)
Recently, knowledge-grounded conversations in the open domain gain great attention from researchers. Existing works on retrieval-based dialogue systems have paid tremendous efforts to utilize neural networks to build a matching model, where all of the context and knowledge contents are used to match the response candidate with various representation methods. Actually, different parts of the context and knowledge are differentially important for recognizing the proper response candidate, as many utterances are useless due to the topic shift. Those excessive useless information in the context and knowledge can influence the matching process and leads to inferior performance. To address this problem, we propose a multi-turn \textbf{R}esponse \textbf{S}election \textbf{M}odel that can \textbf{D}etect the relevant parts of the \textbf{C}ontext and \textbf{K}nowledge collection (\textbf{RSM-DCK}). Our model first uses the recent context as a query to pre-select relevant parts of the context and knowledge collection at the word-level and utterance-level semantics. Further, the response candidate interacts with the selected context and knowledge collection respectively. In the end, The fused representation of the context and response candidate is utilized to post-select the relevant parts of the knowledge collection more confidently for matching. We test our proposed model on two benchmark datasets. Evaluation results indicate that our model achieves better performance than the existing methods, and can effectively detect the relevant context and knowledge for response selection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。