arXiv:2411.04843cs.GTcs.LG2024-11中稿 · EC'25被引 5

让竞价者在预算内均匀分布获胜时间,提升长期收益效率

Learning in Budgeted Auctions with Spacing Objectives

  • 用时间间隔决定胜率价值,实现胜出的均匀分布
  • 提出 $ ilde O( ext{√}T)$ 低遗憾在线学习算法,适用于有转化概率的情境
  • 状态依赖策略优于无状态策略,尤其在长期竞价中

在多次竞价场景中,参与者不仅关注获胜频率,更关心获胜时间的分布。该问题出现在在线零售、计算服务及需持续曝光的广告投放等场景。本文提出一种预算约束下的竞价模型,其中单次获胜的价值是距上次获胜时间的凹函数,表明在固定胜出次数下,均匀分布时间最优。进一步扩展至部分胜出不产生实际收益(转化)的情况,且转化概率依赖上下文。目标变为最大化并均匀分布转化次数。研究了在第二价格拍卖中的最优策略,并设计了在贝叶斯在线设定下实现低遗憾的竞价学习算法。主要结果为:通过证明带期望预算约束的无限时域马尔可夫决策过程与本问题本质等价,即使仅用极少数状态即可逼近最优;所提算法通过根据上下文和距上次胜出(或转化)的时间状态选择出价,实现 $ ilde O( ext{√}T)$ 的遗憾。同时证明,无状态策略即使在无转化不确定性下仍导致线性遗憾;但存在能达成 $(1- rac{1}{e})$ 近似最优收益的无状态策略。

原文摘要 · Abstract (English)

In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial, such as online retail sales and compute services, as well as in advertising campaigns that require sustained visibility over time. We introduce a simple model of this phenomenon, modeling it as a budgeted auction where the value of a win is a concave function of the time since the last win. This implies that for a given number of wins, even spacing over time is optimal. We also extend our model and results to the case when not all wins result in "conversions" (realization of actual gains), and the probability of conversion depends on a context. The goal is to maximize and evenly space conversions rather than just wins. We study the optimal policies for this setting in second-price auctions and offer learning algorithms for the bidders that achieve low regret against the optimal bidding policy in a Bayesian online setting. Our main result is a computationally efficient online learning algorithm that achieves $\tilde O(\sqrt T)$ regret. We achieve this by showing that an infinite-horizon Markov decision process (MDP) with the budget constraint in expectation is essentially equivalent to our problem, even when limiting that MDP to a very small number of states. The algorithm achieves low regret by learning a bidding policy that chooses bids as a function of the context and the system's state, which will be the time elapsed since the last win (or conversion). We show that state-independent strategies incur linear regret even without uncertainty of conversions. We complement this by showing that there are state-independent strategies that, while still having linear regret, achieve a $(1-\frac 1 e)$ approximation to the optimal reward.

在线学习竞价优化预算约束均匀分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。