用大模型生成查询建议,还能根据用户点击反馈优化推荐结果。
From Prompting to Alignment: A Generative Framework for Query Recommendation
- 统一用提示词框架处理各类查询推荐任务。
- 通过点击率预测和列表偏好对齐提升推荐点击率。
- 结合共现查询信息,让推荐更贴近用户主动搜索意图。
在现代搜索系统中,搜索引擎常通过各种组件向用户推荐相关查询以明确信息需求。传统方法严重依赖历史搜索日志建模,存在冷启动与长尾问题。此外,查询建议、补全或澄清等任务通常独立设计,缺乏通用性且难以适应新场景。尽管近期尝试利用大语言模型(LLM)进行查询推荐,但多数方法仅依赖模型内嵌知识或外部示例、文档或知识库,忽视了与用户反馈的校准与对齐,限制了实际应用。为此,我们提出通用生成式查询推荐(GQR)框架,将基于LLM的查询生成与用户偏好对齐。首先,通过统一提示框架整合多种查询推荐任务,利用LLM的指令遵循能力实现高效生成。其次,设计点击率对齐(CTR-alignment)框架,训练查询级点击率预测器作为过程奖励模型,并采用列表级偏好对齐最大化生成查询列表的点击概率。此外,为缓解因用户发起查询与模型知识分离导致的意图不一致问题,当有历史日志时,引入共现查询作为辅助信息对齐模型与用户主动性。
原文摘要 · Abstract (English)
In modern search systems, search engines often suggest relevant queries to users through various panels or components, helping refine their information needs. Traditionally, these recommendations heavily rely on historical search logs to build models, which suffer from cold-start or long-tail issues. Furthermore, tasks such as query suggestion, completion or clarification are studied separately by specific design, which lacks generalizability and hinders adaptation to novel applications. Despite recent attempts to explore the use of LLMs for query recommendation, these methods mainly rely on the inherent knowledge of LLMs or external sources like few-shot examples, retrieved documents, or knowledge bases, neglecting the importance of the calibration and alignment with user feedback, thus limiting their practical utility. To address these challenges, we first propose a general Generative Query Recommendation (GQR) framework that aligns LLM-based query generation with user preference. Specifically, we unify diverse query recommendation tasks by a universal prompt framework, leveraging the instruct-following capability of LLMs for effective generation. Secondly, we align LLMs with user feedback via presenting a CTR-alignment framework, which involves training a query-wise CTR predictor as a process reward model and employing list-wise preference alignment to maximize the click probability of the generated query list. Furthermore, recognizing the inconsistency between LLM knowledge and proactive search intents arising from the separation of user-initiated queries from models, we align LLMs with user initiative via retrieving co-occurrence queries as side information when historical logs are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。