提出统一建模与探索的生成式自动出价框架,兼顾高效探索与安全防护。
Generative Auto-Bidding with Unified Modeling and Exploration

- 用决策变换器联合建模历史行为与环境状态,统一处理决策过程
- 通过价值模块引导探索,逆动力学模块提供安全动作备选,提升出价稳定性
- 在淘宝大规模部署中实现广告GMV提升4.10%,适合工业界智能投放场景
自动化出价是现代数字广告的核心。早期基于规则的方法适应性差,后续强化学习方法虽将出价建模为马尔可夫决策过程,但难以处理长期依赖。近期生成模型展现潜力,却缺乏显式的探索与安全平衡机制,仅依赖动作扰动或轨迹引导,无安全兜底,导致探索效率低且平台财务风险高。为此,本文提出GUIDE(Generative Auto-Bidding with Unified Modeling and Exploration)框架,协同集成定向探索与安全回退机制。GUIDE采用决策变换器(DT)联合建模历史出价行为与环境状态转移;通过Q值模块以正则化约束引导DT探索;逆动力学模块(IDM)利用DT预测的未来状态推断鲁棒、行为一致的动作作为安全策略回退。最终,Q值模块自适应选择两种方案中的最优动作,形成“探索-防护-选择”一体化流程。我们在公开数据集、模拟拍卖环境及淘宝大规模在线部署上进行了实验。结果表明,GUIDE在所有场景下均优于现有最先进基线。真实部署中,广告GMV提升4.10%,点击率提升1.40%,成本提升1.66%,广告投资回报率(ROI)提升3.52%,验证了其有效性与强工业适用性。
原文摘要 · Abstract (English)
Automated bidding is central to modern digital advertising. Early rule-based methods lacked adaptability, while subsequent Reinforcement Learning approaches modeled bidding as a Markov Decision Process but struggled with long-term dependencies. Recent generative models show promise, yet they lack explicit mechanisms to balance exploration and safety, relying solely on action perturbations or trajectory guidance without a safety fallback. This results in inefficient exploration and elevated financial risk for advertising platforms. To address this gap, we propose GUIDE (Generative Auto-Bidding with Unified Modeling and Exploration), a framework that synergistically integrates directed exploration with a safe fallback mechanism. GUIDE employs a Decision Transformer (DT) to jointly model historical bidding actions and environmental state transitions. A Q-value module guides the DT's exploration via regularization constraints, while an Inverse Dynamics Module (IDM) leverages DT-predicted future states to infer robust, behaviorally consistent actions as a safe policy fallback. The Q-value module then adaptively selects the final action between these two options, balancing exploration and safety. Together, these components form an integrated "explore-safeguard-select" pipeline that unifies efficiency and safety. We conduct extensive experiments on public datasets, in simulated auction environments, and through large-scale online deployment on Taobao, a leading Chinese advertising platform. Results show GUIDE consistently outperforms state-of-the-art baselines across all scenarios. In real-world deployment, GUIDE achieves notable gains: +4.10% ad GMV, +1.40% ad clicks, +1.66% ad cost, and +3.52% ad ROI, demonstrating its effectiveness and strong industrial applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。