解决流式数值特征嵌入中的分布漂移问题,提升点击率预测精度。
Distribution-Aware End-to-End Embedding for Streaming Numerical Features in Click-Through Rate Prediction
- 基于蓄水池采样动态估计分布,实时捕捉流数据特性。
- 引入领域感知调制机制,适应不同特征字段的分布变化。
- 已在百万级日活平台上线,显著优于传统方法。
本文研究流式环境下点击率预测中的数值特征嵌入问题。传统静态分箱依赖离线统计,易引发分箱边界更新时的语义漂移;而神经嵌入方法常忽略显式分布信息。由于流数据违反独立同分布假设,难以通过顺序统计量期望无偏估计总体分布,且特征分布的上下文依赖性常被忽视。为此,提出DAES框架,通过高效蓄水池采样实现分布估计,并设计两种场感知分布调制策略,以融合分布信息与上下文语义。大量离线与在线实验表明,DAES显著优于现有方法,并已部署于头部短视频平台,服务超亿级日活用户。
原文摘要 · Abstract (English)
This paper explores effective numerical feature embedding for Click-Through Rate prediction in streaming environments. Conventional static binning methods rely on offline statistics of numerical distributions; however, this inherently two-stage process often triggers semantic drift during bin boundary updates. While neural embedding methods enable end-to-end learning, they often discard explicit distributional information. Integrating such information end-to-end is challenging because streaming features often violate the i.i.d. assumption, precluding unbiased estimation of the population distribution via the expectation of order statistics. Furthermore, the critical context dependency of numerical distributions is often neglected. To this end, we propose DAES, an end-to-end framework designed to tackle numerical feature embedding in streaming training scenarios by integrating distributional information with an adaptive modulation mechanism. Specifically, we introduce an efficient reservoir-sampling-based distribution estimation method and two field-aware distribution modulation strategies to capture streaming distributions and field-dependent semantics. DAES significantly outperforms existing approaches as demonstrated by extensive offline and online experiments and has been fully deployed on a leading short-video platform with hundreds of millions of daily active users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。