用离线编码用户长历史,实现广告实时排序不超时
Long-History User Transformers for Real-Time Ad Ranking

- 离线用大模型处理用户全量历史,缓存压缩表示
- 线上轻量模型结合缓存与最新行为,保持毫秒级响应
- 生产实验提升点击率2.77%~2.1%,零延迟增加
长交互历史是点击率预测的重要输入,但在在线广告中受限于响应时间(数百毫秒内完成打分),无法在请求时运行大型序列编码器。本文提出一种解耦方案:离线使用高容量Transformer异步编码用户跨场景交互历史,生成紧凑表征并缓存至特征库;线上轻量模型在服务时将该缓存表征与用户最新行为及请求上下文结合进行推理。离线编码器在大规模交互日志上以反馈预测和下一物品预测双目标自回归预训练,再通过两阶段微调适配目标广告场景的点击率预测。离线设计恢复了全历史实时Transformer 72%-80%的性能,缓存表征对过期具有鲁棒性,支持低成本刷新策略。生产A/B测试显示,搜索广告点击率提升+2.77%,Yandex广告网络提升+2.1%,收入分别增长+2.26%和+0.43%,且未增加服务延迟。
原文摘要 · Abstract (English)
Long interaction histories are among the most informative inputs for click-through rate (CTR) prediction, yet in online advertising they collide with a hard serving constraint: ads must be scored within a few hundred milliseconds to enter the auction, which rules out running a large sequence encoder at request time. We describe how a production advertising system resolves this conflict by decoupling history encoding from real-time inference. A high-capacity offline transformer asynchronously encodes the user's full cross-surface interaction history into a compact representation cached in a feature store, while a lightweight runtime model combines this cached representation with the user's most recent events and the request context at serving time. The offline encoder is pre-trained autoregressively on large-scale interaction logs with a dual objective - feedback prediction and next-item prediction - and the two-stage architecture is then fine-tuned for CTR prediction on the target advertising surface. Offline, the split design recovers 72-80% of the quality of a full-history runtime transformer that would be too expensive to deploy, and the cached representation is robust enough to staleness to permit inexpensive refresh policies. In production A/B experiments, the system improves the primary ranking metric by +2.77% in search advertising and +2.1% on the Yandex Advertising Network, with revenue gains of +2.26% and +0.43% respectively - without increasing serving latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。