arXiv:2609.03290cs.IR2026-09

UniCon统一以上下文为单位建模,提升点击率预测效果

UniCon: A Unified Context-Centric Modeling Paradigm for CTR Prediction

论文配图:UniCon: A Unified Context-Centric Modeling Paradigm for CTR Prediction
图 1 · 摘自论文原文
  • 将历史行为与当前请求视为同质上下文单元,统一建模
  • 在美团广告上实现离线AUC提升0.0139,线上RPM增3.09%
  • 适合电商、信息流等复杂上下文场景的精准推荐系统

统一建模已成为工业级点击率(CTR)预测的主要方向。现有方法通常在令牌级别统一序列与非序列信号,在共享主干中建模其交互,并通过增加模型容量来改善扩展性。然而,这种划分源于传统的特征工程实践,与用户决策过程的本质不符。用户行为本质上是同质上下文单元的序列;在输入组织层面,历史行为与当前请求仅在于结果是否被观测。将它们视为异质信号会掩盖用户决策上下文中的结构依赖,限制了扩展效率与预测质量,尤其在电商货架和瀑布流等上下文丰富的场景中更为明显。为此,我们提出UniCon,一种统一的上下文中心建模范式,将请求上下文作为基本建模单元,将历史与预测目标组织为同质上下文单元。上下文内注意力捕捉上下文内项目间的局部耦合(局部性),上下文间注意力建模跨上下文的决策状态动态演化(动态性)。该组织方式弥合了历史与目标之间的结构鸿沟,支持更高效的统一CTR模型扩展。上下文单元级序列压缩进一步降低部署开销。在美团搜索广告上,UniCon相比强基线离线AUC提升0.0139,线上实现显著提升:RPM增长3.09%,CTR提升2.07%,收入增长2.95%。

原文摘要 · Abstract (English)

Unified modeling has become a major direction for industrial click-through rate (CTR) prediction. Existing approaches typically unify sequential and non-sequential signals at the token level, model their interactions in a shared backbone, and increase model capacity to improve scaling behavior. However, this division originates from legacy feature-engineering practice and is misaligned with the underlying decision process. User behavior is inherently a sequence of homogeneous context units; at the level of input organization, historical behavior and the current request differ only in whether their outcomes are observed or remain to be predicted. Treating them as heterogeneous signals obscures structural dependencies within the user's decision context, limiting both scaling efficiency and prediction quality. This limitation is particularly pronounced in context-rich scenarios such as e-commerce shelves and waterfall feeds. To address this, we propose UniCon, a unified context-centric modeling architecture that treats the request context as the basic modeling unit and organizes history and prediction targets as homogeneous context units. Intra-context attention captures local coupling among items within a context (Locality), while inter-context attention models the dynamic evolution of decision states across contexts (Dynamics). This organization bridges the structural gap between history and target and supports more effective scaling of unified CTR models. Context-unit-level sequence compression further reduces deployment overhead. On Meituan search advertising, UniCon improves offline AUC by 0.0139 over a strong production baseline and achieves statistically significant online lifts of 3.09% in RPM, 2.07% in CTR, and 2.95% in revenue.

CTR预测上下文建模推荐系统深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。