统一评测传统与强化学习的自动出价算法,助力电商高效选型。
Autobidding Arena: unified evaluation of the classical and RL-based autobidding algorithms
- 构建标准化评估框架,对比控制器、强化学习、最优公式等多类算法
- 在真实工业级环境中测试,覆盖预算控制、成本效率与性能指标
- 揭示各类算法的优缺点,为实际应用提供可复现的决策依据
广告拍卖在电商收入中起关键作用。为应对数千个拍卖的可扩展性需求,业界积极开发自动出价(autobidding)算法。因此,公平且可复现地评估这些算法至关重要。本文提出一种标准化、透明的评估协议,用于比较经典方法与基于强化学习(RL)的自动出价算法。我们选取不同类别中最高效的算法,如基于控制器、强化学习、最优公式等,并在最新开源工业级竞价环境中进行基准测试。该环境精确模拟实际竞价流程。实验揭示了各类算法最具潜力的应用场景,同时指出其令人意外的缺陷,并从多个维度进行评估。所选指标涵盖算法性能、对应成本及预算节奏控制,使结果适用于广泛平台。本研究为从业者从多角度评估候选算法提供支持,帮助根据企业目标选择最高效的方案。
原文摘要 · Abstract (English)
Advertisement auctions play a crucial role in revenue generation for e-commerce companies. To make the bidding procedure scalable to thousands of auctions, the automatic bidding (autobidding) algorithms are actively developed in the industry. Therefore, the fair and reproducible evaluation of autobidding algorithms is an important problem. We present a standardized and transparent evaluation protocol for comparing classical and reinforcement learning (RL) autobidding algorithms. We consider the most efficient autobidding algorithms from different classes, e.g., ones based on the controllers, RL, optimal formulas, etc., and benchmark them in the bidding environment. We utilize the most recent open-source environment developed in the industry, which accurately emulates the bidding process. Our work demonstrates the most promising use cases for the considered autobidding algorithms, highlights their surprising drawbacks, and evaluates them according to multiple metrics. We select the evaluation metrics that illustrate the performance of the autobidding algorithms, the corresponding costs, and track the budget pacing. Such a choice of metrics makes our results applicable to the broad range of platforms where autobidding is effective. The presented comparison results help practitioners to evaluate the candidate autobidding algorithms from different perspectives and select ones that are efficient according to their companies' targets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。