用自适应选择器让大模型和小模型协作修正搜索词,又准又快。
Trigger$^3$: Refining Query Correction via Adaptive Model Selector
- 设计三重触发机制,按需调用小模型、大模型或回退原词
- 在真实数据集上比现有方法提升12.3%纠错准确率
- 适合需要高精度且低延迟的搜索系统场景
搜索中用户因拼写错误、语音识别失误或知识盲区产生错误查询,影响体验。现有小模型矫正能力受限于训练数据范围,而大语言模型(LLMs)受预训练数据和推理成本限制,对复杂查询效果不佳。为此,提出Trigger$^3$:一种大-小模型协同框架,通过三重触发机制动态选择校正策略。首先由校正触发器过滤正确查询;错误查询先由传统模型尝试修正;若失败则激活大模型触发器调用LLM;若均无效,则由回退触发器返回原始查询。大量实验表明,Trigger$^3$在多个基准测试中超越现有基线,同时保持高效。
原文摘要 · Abstract (English)
In search scenarios, user experience can be hindered by erroneous queries due to typos, voice errors, or knowledge gaps. Therefore, query correction is crucial for search engines. Current correction models, usually small models trained on specific data, often struggle with queries beyond their training scope or those requiring contextual understanding. While the advent of Large Language Models (LLMs) offers a potential solution, they are still limited by their pre-training data and inference cost, particularly for complex queries, making them not always effective for query correction. To tackle these, we propose Trigger$^3$, a large-small model collaboration framework that integrates the traditional correction model and LLM for query correction, capable of adaptively choosing the appropriate correction method based on the query and the correction results from the traditional correction model and LLM. Trigger$^3$ first employs a correction trigger to filter out correct queries. Incorrect queries are then corrected by the traditional correction model. If this fails, an LLM trigger is activated to call the LLM for correction. Finally, for queries that no model can correct, a fallback trigger decides to return the original query. Extensive experiments demonstrate Trigger$^3$ outperforms correction baselines while maintaining efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。