arXiv:2409.00561stat.MLcs.LG2024-09KDD被引 4

用多任务组合博弈优化广告预算分配,提升整体回报

Multi-Task Combinatorial Bandits for Budget Allocation

  • 基于贝叶斯分层模型共享跨广告活动信息,提升效率
  • 结合线性回归、高斯过程等方法,适应不同复杂环境
  • 采用汤普森采样平衡探索与利用,适合动态营销场景

当今顶级广告商通常同时管理数百个广告活动,并持续全年推出新活动。营销经理面临的关键挑战是在各广告条目间合理分配有限预算,以最大化累积回报,尤其在回报结果存在巨大不确定性的情况下。本文将预算分配问题建模为多任务组合强化学习问题,提出一种新型在线预算分配系统:(i) 利用贝叶斯分层模型,智能整合广告活动与广告条目的元数据及预算规模信息,实现高效的信息共享;(ii) 支持多种建模方法(如线性回归、高斯过程、神经网络),适应不同环境的复杂性;(iii) 采用汤普森采样(Thompson Sampling)策略,在探索与利用之间取得平衡。通过离线评估与在线实验,该系统展现出强鲁棒性与自适应能力,有效提升整体累积回报。代码已公开于 https://anonymous.4open.science/r/MCMAB。

原文摘要 · Abstract (English)

Today's top advertisers typically manage hundreds of campaigns simultaneously and consistently launch new ones throughout the year. A crucial challenge for marketing managers is determining the optimal allocation of limited budgets across various ad lines in each campaign to maximize cumulative returns, especially given the huge uncertainty in return outcomes. In this paper, we propose to formulate budget allocation as a multi-task combinatorial bandit problem and introduce a novel online budget allocation system. The proposed system: i) integrates a Bayesian hierarchical model to intelligently utilize the metadata of campaigns and ad lines and budget size, ensuring efficient information sharing; ii) provides the flexibility to incorporate diverse modeling techniques such as Linear Regression, Gaussian Processes, and Neural Networks, catering to diverse environmental complexities; and iii) employs the Thompson sampling (TS) technique to strike a balance between exploration and exploitation. Through offline evaluation and online experiments, our system demonstrates robustness and adaptability, effectively maximizing the overall cumulative returns. A Python implementation of the proposed procedure is available at https://anonymous.4open.science/r/MCMAB.

预算分配强化学习贝叶斯建模广告优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。