arXiv:2409.13655cs.LGstat.AP2024-09中稿 · the CONSEQUENCES '…

AMIS动态调整采样分布,提升广告拍卖调优的准确性与效率。

Adaptive Mixture Importance Sampling for Automated Ads Auction Tuning

  • 用可变混合分布动态调整采样参数和权重,增强搜索多样性。
  • 在噪声环境中比简单高斯采样收敛更快,优化效果更稳定。
  • 已在真实搜索引擎上通过A/B实验验证,适合大规模推荐系统调优。

本文提出自适应混合重要性采样(AMIS),用于优化大规模推荐系统中的关键绩效指标(KPI),如在线广告拍卖。传统重要性采样(IS)在动态环境中面临挑战,难以应对多模态分布并易陷入局部最优。与经典自适应IS和多重IS不同,AMIS将混合分布作为提议分布,并在每轮迭代中动态调整混合参数及其混合率,从而提升搜索效率与多样性。通过大量离线仿真,AMIS显著优于简单高斯重要性采样(GIS),尤其在噪声环境下表现突出。此外,该方法在主流搜索引擎的真实线上A/B实验中得到验证,始终能识别出更可能被采纳为主流配置的最优调参点。结果表明,AMIS增强了噪声环境下的收敛性,提升了重要性采样离策略估计器的准确性和可靠性。

原文摘要 · Abstract (English)

This paper introduces Adaptive Mixture Importance Sampling (AMIS) as a novel approach for optimizing key performance indicators (KPIs) in large-scale recommender systems, such as online ad auctions. Traditional importance sampling (IS) methods face challenges in dynamic environments, particularly in navigating through complexities of multi-modal landscapes and avoiding entrapment in local optima for the optimization task. Instead of updating importance weights and mixing samples across iterations, as in canonical adaptive IS and multiple IS, our AMIS framework leverages a mixture distribution as the proposal distribution and dynamically adjusts both the mixture parameters and their mixing rates at each iteration, thereby enhancing search diversity and efficiency. Through extensive offline simulations, we demonstrate that AMIS significantly outperforms simple Gaussian Importance Sampling (GIS), particularly in noisy environments. Moreover, our approach is validated in real-world scenarios through online A/B experiments on a major search engine, where AMIS consistently identifies optimal tuning points that are more likely to be adopted as mainstream configurations. These findings indicate that AMIS enhances convergence in noisy environments, leading to more accurate and reliable decision-making in the context of importance sampling off-policy estimators.

重要性采样广告拍卖优化算法离策略学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。