提出生成式出价遮蔽模型,解决实时竞价中出价过高的问题。
Generative Bid Shading in Real-Time Bidding Advertising
- 用自回归生成遮蔽比例,捕捉复杂价值依赖关系。
- 在线实验显示显著提升短期与长期收益,支持百亿级请求量。
- 适合广告投放平台优化出价策略,尤其擅长处理非凸收益曲线。
出价遮蔽在实时竞价(RTB)中至关重要,能动态调整出价以避免广告主超支。现有主流两阶段方法先建模出价格局,再用运筹学技术优化盈余,但受限于单峰假设,难以适应非凸盈余曲线,且顺序流程易产生误差累积。此外,离散化连续值的模型忽略区间间依赖,削弱纠错能力;出价场景中的样本选择偏差也增加了预测难度。为此,本文提出生成式出价遮蔽(GBS),包含两大组件:1)端到端生成模型,采用自回归方法逐步生成残差遮蔽比例,无需预设先验即可捕捉复杂价值依赖;2)奖励偏好对齐系统,引入通道感知分层动态网络(CHNet)作为奖励模型提取细粒度特征,并结合盈余优化与探索效用奖励对齐模块,最终通过组相对策略优化(GRPO)同时优化短长期盈余。大量离线与线上A/B测试验证了GBS的有效性。此外,GBS已在美团DSP平台上线,日均处理数十亿次出价请求。
原文摘要 · Abstract (English)
Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using operations research techniques, are constrained by unimodal assumptions that fail to adapt for non-convex surplus curves and are vulnerable to cascading errors in sequential workflows. Additionally, existing discretization models of continuous values ignore the dependence between discrete intervals, reducing the model's error correction ability, while sample selection bias in bidding scenarios presents further challenges for prediction. To address these issues, this paper introduces Generative Bid Shading (GBS), which comprises two primary components: 1) an end-to-end generative model that utilizes an autoregressive approach to generate shading ratios by stepwise residuals, capturing complex value dependencies without relying on predefined priors; and 2) a reward preference alignment system, which incorporates a channel-aware hierarchical dynamic network (CHNet) as the reward model to extract fine-grained features, along with modules for surplus optimization and exploration utility reward alignment, ultimately optimizing both short-term and long-term surplus using group relative policy optimization (GRPO). Extensive experiments on both offline and online A/B tests validate GBS's effectiveness. Moreover, GBS has been deployed on the Meituan DSP platform, serving billions of bid requests daily.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。