用统一模型同时搞定搜索、推荐和推理,让大模型直接操作真实物品。
A Unified Language Model for Large Scale Search, Recommendation, and Reasoning
- 把物品变成编号(SID),让大模型在文本中混合写编号和文字。
- 在百万级商品库上测试,表现优于专用模型且能跨任务通用。
- 无需外部工具,指令就能控制输出格式,适合落地应用。
大语言模型在推荐、检索和推理中应用日益广泛,但部署一个能统一支持这些行为的端到端模型,在大规模异构目录下仍具挑战。此类系统需生成明确指向真实物品的引用,处理多种实体类型,并满足严格的延迟与可靠性要求,仅靠纯文本生成难以实现。虽有工具增强的推荐系统部分解决此问题,但引入了编排复杂性并限制端到端优化。本文将此视为更广泛的科研问题:如何让大模型以自洽方式联合推理多领域实体、用户与语言。为此,我们提出NEO框架,将预训练的解码器类大模型改造为无工具、基于目录的生成器。NEO将物品表示为SID,并训练单一模型在共享序列中交错自然语言与类型化物品标识符。文本提示可控制任务、目标实体类型及输出格式(编号、文本或混合),约束解码确保生成结果符合目录规范,又不限制自由文本。我们将这种指令可控性称为语言可引导性。将SID视为独立模态,研究通过分阶段对齐与指令微调整合离散实体表示的方法。在包含超过1000万件商品的真实目录上进行大规模评估,覆盖多种媒体类型与发现任务(如推荐、搜索、用户理解)。离线实验表明,NEO始终优于强基线模型,并展现出跨任务迁移能力,为将大规模发现功能整合至单一语言可引导生成模型提供了可行路径。
原文摘要 · Abstract (English)
LLMs are increasingly applied to recommendation, retrieval, and reasoning, yet deploying a single end-to-end model that can jointly support these behaviors over large, heterogeneous catalogs remains challenging. Such systems must generate unambiguous references to real items, handle multiple entity types, and operate under strict latency and reliability constraints requirements that are difficult to satisfy with text-only generation. While tool-augmented recommender systems address parts of this problem, they introduce orchestration complexity and limit end-to-end optimization. We view this setting as an instance of a broader research problem: how to adapt LLMs to reason jointly over multiple-domain entities, users, and language in a fully self-contained manner. To this end, we introduce NEO, a framework that adapts a pre-trained decoder-only LLM into a tool-free, catalog-grounded generator. NEO represents items as SIDs and trains a single model to interleave natural language and typed item identifiers within a shared sequence. Text prompts control the task, target entity type, and output format (IDs, text, or mixed), while constrained decoding guarantees catalog-valid item generation without restricting free-form text. We refer to this instruction-conditioned controllability as language-steerability. We treat SIDs as a distinct modality and study design choices for integrating discrete entity representations into LLMs via staged alignment and instruction tuning. We evaluate NEO at scale on a real-world catalog of over 10M items across multiple media types and discovery tasks, including recommendation, search, and user understanding. In offline experiments, NEO consistently outperforms strong task-specific baselines and exhibits cross-task transfer, demonstrating a practical path toward consolidating large-scale discovery capabilities into a single language-steerable generative model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。