用提示词引导大模型少样本重写对话查询,效果超越传统方法。
Contextualizing Search Queries In-Context Learning for Conversational Rewriting with LLMs
- 设计提示词模板,让大模型在无微调下生成上下文无关的查询。
- 在TREC和Taskmaster-1上,成功率与MRR均显著优于基线模型。
- 适合低资源场景,减少对标注数据和复杂训练的依赖。
对话查询重写对有效对话式搜索至关重要,但传统监督方法需大量标注数据,而低资源环境下数据稀缺。本文提出提示引导的上下文学习方法,利用大语言模型的上下文学习能力实现少样本对话查询重写。通过精心设计的提示,包含任务描述、输入输出格式及少量示例,引导预训练模型生成不依赖上下文的查询,无需显式微调。在TREC和Taskmaster-1基准数据集上的实验表明,该方法在BLEU、ROUGE-L、成功率和MRR等指标上显著优于强基线,包括监督模型和对比共训练方法。消融实验证实了上下文示例的重要性,人工评估也验证了生成结果在流畅性、相关性和上下文利用方面的优越性。结果表明,提示引导的上下文学习为低资源对话查询重写提供了一种高效且有效的范式,降低了对大规模标注数据和复杂训练过程的依赖。
原文摘要 · Abstract (English)
Conversational query rewriting is crucial for effective conversational search, yet traditional supervised methods require substantial labeled data, which is scarce in low-resource settings. This paper introduces Prompt-Guided In-Context Learning, a novel approach that leverages the in-context learning capabilities of Large Language Models (LLMs) for few-shot conversational query rewriting. Our method employs carefully designed prompts, incorporating task descriptions, input/output format specifications, and a small set of illustrative examples, to guide pre-trained LLMs to generate context-independent queries without explicit fine-tuning. Extensive experiments on benchmark datasets, TREC and Taskmaster-1, demonstrate that our approach significantly outperforms strong baselines, including supervised models and contrastive co-training methods, across various evaluation metrics such as BLEU, ROUGE-L, Success Rate, and MRR. Ablation studies confirm the importance of in-context examples, and human evaluations further validate the superior fluency, relevance, and context utilization of our generated rewrites. The results highlight the potential of prompt-guided in-context learning as an efficient and effective paradigm for low-resource conversational query rewriting, reducing the reliance on extensive labeled data and complex training procedures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。