NEZHA让生成式推荐更快更准,无需额外模型。
NEZHA: A Zero-sacrifice and Hyperspeed Decoding Architecture for Generative Recommendations
- 在主模型中内置自动生成草稿头,实现无需额外模型的快速推理。
- 在淘宝上线后日均服务超亿级用户,广告收入达百亿级别。
- 用哈希集合实现无模型验证,有效抑制幻觉问题,适合高并发推荐场景。
生成式推荐(GR)依托大语言模型(LLM),为工业级推荐系统带来了新范式。然而,高推理延迟严重制约其在高吞吐、实时服务中的应用,限制了整体业务影响。尽管推测解码(SD)被提出以加速自回归生成过程,但现有方案通常依赖独立的草稿模型和基于模型的验证器,需额外训练并引入延迟开销。本文提出NEZHA,一种零牺牲、超高速解码架构,可在不损失推荐质量的前提下实现生成式推荐的高效推理。具体而言,NEZHA将轻量级自回归草稿头直接集成于主模型中,实现高效的自生成草稿;结合专用输入提示结构,保持序列到序列生成的完整性。此外,针对幻觉这一性能下降的主要原因,提出基于哈希集合的高效无模型验证机制。通过在公开数据集上的大量实验验证了其有效性,并自2025年10月起在淘宝成功部署,驱动百亿级广告收入,服务数亿日活跃用户。
原文摘要 · Abstract (English)
Generative Recommendation (GR), powered by Large Language Models (LLMs), represents a promising new paradigm for industrial recommender systems. However, their practical application is severely hindered by high inference latency, which makes them infeasible for high-throughput, real-time services and limits their overall business impact. While Speculative Decoding (SD) has been proposed to accelerate the autoregressive generation process, existing implementations introduce new bottlenecks: they typically require separate draft models and model-based verifiers, requiring additional training and increasing the latency overhead. In this paper, we address these challenges with NEZHA, a novel architecture that achieves hyperspeed decoding for GR systems without sacrificing recommendation quality. Specifically, NEZHA integrates a nimble autoregressive draft head directly into the primary model, enabling efficient self-drafting. This design, combined with a specialized input prompt structure, preserves the integrity of sequence-to-sequence generation. Furthermore, to tackle the critical problem of hallucination, a major source of performance degradation, we introduce an efficient, model-free verifier based on a hash set. We demonstrate the effectiveness of NEZHA through extensive experiments on public datasets and have successfully deployed the system on Taobao since October 2025, driving the billion-level advertising revenue and serving hundreds of millions of daily active users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。