用多源信息解决模糊搜索意图,提升外卖平台查询准确率
Agentic Multi-Source Grounding for Enhanced Query Intent Understanding: A DoorDash Case Study
- 通过商品目录和自主网页搜索双重校准大模型推理
- 在长尾查询上达90.7%准确率,比基线高13.0个百分点
- 适合需要结合私有数据与实时网络信息的场景
准确将用户查询映射到业务类别是多品类电商平台的核心信息检索挑战。对于上下文稀疏的查询如'Wildflower',其意图存在歧义,可能指向餐厅、零售品或花卉商品。传统分类器强制单标签输出,而通用大模型则会虚构不存在的商品。本文提出一种基于代理的多源接地系统,通过分阶段商品实体检索管道和自主触发的网页搜索工具,同时解决上述两种失效模式。模型不输出单一标签,而是生成有序的多意图集合,由可配置的消歧层按确定性商业规则处理,并支持个性化信号扩展。该解耦设计可跨领域泛化,任何电商平台均可接入自有数据源与解析规则,无需修改核心架构。在DoorDash多垂直搜索平台上的评估显示,系统相较未接地的大模型基线提升10.9个百分点,较旧生产系统提升4.6个百分点。对长尾查询的增量分析表明,目录接地贡献+8.3pp,代理网页搜索接地贡献+3.2pp,双重意图消歧贡献+1.5pp,最终实现90.7%准确率(较基线+13.0pp)。系统已上线生产,覆盖日均95%以上的搜索请求,为需结合专有上下文与实时网络知识解决模糊决策问题提供了可复用范式。
原文摘要 · Abstract (English)
Accurately mapping user queries to business categories is a fundamental Information Retrieval challenge for multi-category marketplaces, where context-sparse queries such as "Wildflower" exhibit intent ambiguity, simultaneously denoting a restaurant chain, a retail product, and a floral item. Traditional classifiers force a winner-takes-all assignment, while general-purpose LLMs hallucinate unavailable inventory. We introduce an Agentic Multi-Source Grounded system that addresses both failure modes by grounding LLM inference in (i) a staged catalog entity retrieval pipeline and (ii) an agentic web-search tool invoked autonomously for cold-start queries. Rather than predicting a single label, the model emits an ordered multi-intent set, resolved by a configurable disambiguation layer that applies deterministic business policies and is designed for extensibility to personalization signals. This decoupled design generalizes across domains, allowing any marketplace to supply its own grounding sources and resolution rules without modifying the core architecture. Evaluated on DoorDash's multi-vertical search platform, the system achieves +10.9pp over the ungrounded LLM baseline and +4.6pp over the legacy production system. On long-tail queries, incremental ablations attribute +8.3pp to catalog grounding, +3.2pp to agentic web search grounding, and +1.5pp to dual intent disambiguation, yielding 90.7% accuracy (+13.0pp over baseline). The system is deployed in production, serving over 95% of daily search impressions, and establishes a generalizable paradigm for applications requiring foundation models grounded in proprietary context and real-time web knowledge to resolve ambiguous, context-sparse decision problems at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。