arXiv:2608.00938cs.IR2026-08

GRACE让生成式广告实时召回更快更准,解决匹配率低和算力贵难题。

GRACE: Generative Recommender Acceleration Engine for Real-Time Ads Retrieval

论文配图:GRACE: Generative Recommender Acceleration Engine for Real-Time Ads Retrieval
图 1 · 摘自论文原文
  • 用语义ID前缀匹配技术提升广告目标匹配率
  • 自注意力延迟降低23.4倍,整体解码提速11.1倍
  • 适合大规模实时广告系统部署使用

将生成式推荐系统用于高吞吐、实时广告召回面临两大挑战:合规性(确保生成广告符合广告主受众定位规则)与计算开销(需满足严格延迟与GPU成本要求,同时支持每请求生成数千条广告)。本文提出GRACE系统,分别应对这两类问题。在合规性方面,引入生成式目标匹配(GTM),基于语义ID(SID)前缀,结合位掩码与布隆过滤器匹配器,对候选广告进行个性化筛选,使最终广告级目标匹配通过率从仅23.55%提升至40.42%。在计算效率方面,针对编码器-解码器架构的Transformer,重构解码器以适配宽束搜索与短序列场景,优化注意力核、KV缓存及束搜索策略。在NVIDIA GH200上,相较FlashAttention-2与FlashAttention-3中更快者,跨注意力延迟降低68.0倍,自注意力延迟降低23.4–25.8倍。整体解码延迟下降11.1倍,使生成式广告召回满足实际部署的延迟与算力要求。

原文摘要 · Abstract (English)

Productionizing generative recommenders for high-volume, real-time ads retrieval creates two serving challenges: eligibility, ensuring that each generated ad is eligible for the request under the advertiser's audience targeting rules, and compute, which requires meeting strict latency and GPU cost requirements while remaining capable of generating thousands of ads per request with wide-beam decoding. This paper presents GRACE, a serving system for ads generative retrieval that addresses both challenges. For eligibility, GRACE introduces Generative Target Matching (GTM), which extends catalog-valid constrained decoding with personalized filtering over Semantic ID (SID) prefixes using bitmask and Bloom filter matchers derived from targeting rules. SID-level GTM improves final ad-level target matching pass rate from 23.55% to 40.42% over constrained decoding alone. For compute-cost and latency, GRACE targets encoder-decoder Transformers, which are more lightweight than LLMs. It redesigns the decoder around the wide-beam, short-sequence regime, covering attention kernels, KV cache, and beam search optimizations. On NVIDIA GH200, compared with the faster of FlashAttention-2 and FlashAttention-3 baselines, GRACE improves cross-attention latency by 68.0 times and self-attention latency by 23.4-25.8 times across decode steps. Together, these changes reduce decoder latency by 11.1 times, keeping ads generative retrieval within latency and compute requirements.

生成推荐广告系统推理加速注意力优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。