提出双向感知过滤族,解决实时竞价中测试数据干扰问题。
BAFF: Bid-Aware Filter Family for Mitigating Training Data Interference in RTB A/B Tests

- 设计可调参数的硬过滤机制,分别控制排名与出价差异容忍度。
- 实验显示其在离线模拟中偏差更小,线上部署时指标更接近基准模型。
- 适合需要精准评估广告策略的实时竞价平台使用。
在线实时竞价(RTB)的A/B测试中,对照组与实验组模型通常共享一个包含对方行为数据的服务日志,导致训练数据因广告排名差异和出价差异而产生偏差,扭曲测试结果。日志拆分虽消除偏差但牺牲数据量,日志共享保留全部数据却未解决偏差问题。本文提出双向感知过滤族(BAFF),一种由(k,l)参数化的硬过滤方法,可独立控制两种偏差通道的容忍度,构建介于两者之间的结构化搜索空间。进一步提出三阶段在线评估协议,通过与无干扰参考模型的偏差来衡量数据共享策略。离线仿真显示,(k,l)扫描曲线在多个操作点上表现优于日志共享与拆分;在需求方平台(DSP)的真实部署中,基于滤波器的变体在关键业务指标(如CPC、CTR)上比基线更接近参考模型。最佳配置依赖具体场景,凸显该搜索空间的实用价值。
原文摘要 · Abstract (English)
In online A/B tests for real-time bidding (RTB), control and treatment models are typically trained on a shared serving log that includes data generated by the counterpart model. This shared-log training biases each model's training data through two channels: the counterpart model may have selected a different ad from the ad-candidate pool (ad-ranking disagreement) and may have bid a different price (bid-pricing disagreement), potentially distorting the A/B test outcome. Log-splitting eliminates the bias but sacrifices training data; log-sharing retains all data but leaves the bias unaddressed. We formalize the Bid-Aware Filter Family (BAFF), a class of (k,l)-parameterized hard filters that controls tolerance to each channel independently, providing a structured search space between these two extremes. We further propose a three-stage online measurement protocol that enables evaluating data-sharing strategies by their deviation from an interference-free reference model in production. In offline simulation, a (k,l) sweep surfaces operating points with smaller deviation from the interference-free reference model than both log-sharing and log-splitting. In a live RTB deployment on a demand-side platform (DSP), filter-based variants preserve the reference model's business metrics (e.g., CPC, CTR) more closely than both baselines. The best operating point is setting-dependent, underscoring the practical value of the search space itself.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。