针对不同对话任务,对比重写与融合策略的优劣。
Exploring Rewriting Approaches for Different Conversational Tasks
- 区分重写与融合两种对话重写方法
- 问答任务用重写,数据可视化用融合更优
- 长对话场景下融合策略持续领先
对话助手常需基于历史交互重写用户问题以提升回答准确性。本文系统比较了两种方法——重写与融合——在两类生成任务中的表现:文本到文本生成和多模态生成(输入文本生成可视化或数据表)。结果表明,具体方法效果高度依赖任务类型。对于对话问答系统,重写策略表现最佳;而对于基于对话生成图表与表格的数据分析助手,融合策略更优。研究还针对短对话与长对话场景使用两个数据集验证,发现融合策略在长对话中始终更优,而重写策略在纯文本问答中更具优势。
原文摘要 · Abstract (English)
Conversational assistants often require a question rewriting algorithm that leverages a subset of past interactions to provide a more meaningful (accurate) answer to the user's question or request. However, the exact rewriting approach may often depend on the use case and application-specific tasks supported by the conversational assistant, among other constraints. In this paper, we systematically investigate two different approaches, denoted as rewriting and fusion, on two fundamentally different generation tasks, including a text-to-text generation task and a multimodal generative task that takes as input text and generates a visualization or data table that answers the user's question. Our results indicate that the specific rewriting or fusion approach highly depends on the underlying use case and generative task. In particular, we find that for a conversational question-answering assistant, the query rewriting approach performs best, whereas for a data analysis assistant that generates visualizations and data tables based on the user's conversation with the assistant, the fusion approach works best. Notably, we explore two datasets for the data analysis assistant use case, for short and long conversations, and we find that query fusion always performs better, whereas for the conversational text-based question-answering, the query rewrite approach performs best.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。