arXiv:2606.14192cs.LG2026-06中稿 · ICML被引 1

提出DRIVE框架,用多策略生成和检索增强提升广告竞价效果

DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation

论文配图:DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
图 1 · 摘自论文原文
  • 分离候选生成与决策,用分布建模和历史检索生成多策略
  • 在AuctionNet上胜过基线3.8%~6.1%,长尾流量表现更稳定
  • 适合需要高鲁棒性的离线竞价系统,尤其适配稀疏数据场景

自动竞价是实时广告系统的核心,需在预算和成本约束下优化长期绩效,但在线探索风险过高。以往基于离线强化学习和Transformer序列建模的方法虽有进展,但其单一模式、纯参数化设计常将多种有效竞价策略压缩为次优平均动作,在稀疏或长尾流量下表现不可靠。为此,我们提出DRIVE(分布式与检索增强的竞价评估框架),一种统一的Transformer架构,将候选动作生成与决策过程解耦。DRIVE结合分布式动作建模、从高质量历史决策中检索增强的候选生成,以及基于价值的评估,于推理时选择最优出价。在AuctionNet及多个离线强化学习基准上的大量实验表明,DRIVE持续提升竞价性能,并在多种Transformer方法间具有良好泛化能力。

原文摘要 · Abstract (English)

Auto-bidding is a core component of real-time advertising systems, where decisions must optimize long-term performance under budget and cost constraints, while online exploration is prohibitively risky. Offline reinforcement learning and, more recently, Transformer-based sequence modeling have shown promise for learning bidding policies from logged data, but their unimodal and purely parametric formulations often collapse multiple effective bidding strategies into suboptimal averaged actions and perform unreliably under sparse or long-tail traffic. To mitigate these limitations, we propose DRIVE (Distributional and Retrieval-Augmented Bidding with Value Evaluation), a unified Transformer-based framework that decouples candidate action generation from decision making for offline auto-bidding. DRIVE combines distributional action modeling, retrieval-augmented candidate generation from high-quality historical decisions, and value-based evaluation to select the most promising bid at inference time. Extensive experiments on AuctionNet and additional offline reinforcement learning benchmarks demonstrate that DRIVE consistently improves bidding performance and generalizes well across multiple Transformer-based methods.

自动竞价Transformer离线学习广告系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。