用ColBERT提升关键词搜索效果,解决传统模型不擅长的问题。
Beyond Questions: Leveraging ColBERT for Keyphrase Search
- 用大模型将问题转换为关键词,构建新训练数据
- 新模型在关键词搜索上显著优于现有方法
- 仅训练查询编码器即可大幅降低训练成本
尽管问答式查询日益流行,但关键词搜索仍是网络搜索的核心,尤其在学术和专业领域中,专家常以关键词表达信息需求。然而,当前密集检索模型多基于问答数据训练,对关键词查询表现不佳。本文提出利用ColBERT架构改进关键词搜索的文档排序效果。由于缺乏大规模关键词检索数据集,我们首先探索使用大语言模型将问答式查询转化为关键词格式,再以此训练专用的关键词型ColBERT排名模型(ColBERTKP_QD)。为进一步降低训练成本,我们还研究仅训练关键词查询编码器而固定文档编码器权重的可行性(ColBERTKP_Q)。通过自动与人工标注的关键词评估,结果表明晚交互架构在关键词搜索场景下具有潜力。
原文摘要 · Abstract (English)
While question-like queries are gaining popularity and search engines' users increasingly adopt them, keyphrase search has traditionally been the cornerstone of web search. This query type is also prevalent in specialised search tasks such as academic or professional search, where experts rely on keyphrases to articulate their information needs. However, current dense retrieval models often fail with keyphrase-like queries, primarily because they are mostly trained on question-like ones. This paper introduces a novel model that employs the ColBERT architecture to enhance document ranking for keyphrase queries. For that, given the lack of large keyphrase-based retrieval datasets, we first explore how Large Language Models can convert question-like queries into keyphrase format. Then, using those keyphrases, we train a keyphrase-based ColBERT ranker (ColBERTKP_QD) to improve the performance when working with keyphrase queries. Furthermore, to reduce the training costs associated with training the full ColBERT model, we investigate the feasibility of training only a keyphrase query encoder while keeping the document encoder weights static (ColBERTKP_Q). We assess our proposals' ranking performance using both automatically generated and manually annotated keyphrases. Our results reveal the potential of the late interaction architecture when working under the keyphrase search scenario.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。