arXiv:2510.11100cs.IRcs.AI2025-10被引 3

解决推荐系统中特征、上下文和架构三类异质性问题,提升点击率预测精度。

HoMer: Addressing Heterogeneities by Modeling Sequential and Set-wise Contexts for CTR Prediction

  • 通过对齐序列与非序列特征,实现更精细的兴趣建模。
  • 采用集合理解范式,显式建模多物品间的交互关系,提升预测效果。
  • 统一架构设计兼顾效率与可扩展性,适合工业级部署。

点击率(CTR)预测通过建模行为序列与非序列特征(如用户/物品画像或交叉特征)来推断用户兴趣,是工业推荐系统的核心。然而,现有方法面临三类异质性:(i) 特征异质性——序列侧特征有限,难以精细表征用户兴趣,影响序列建模;(ii) 上下文异质性——用户对某物品的兴趣受其他物品影响,但点对点预测忽略整个物品集合的交互上下文;(iii) 架构异质性——专用模块分散集成,导致模型在工业部署中效率低、难扩展。为此,我们提出 HoMer:一种面向同质性的转换器模型,用于建模序列与集合理解上下文。首先,对齐序列与非序列特征以实现精准建模与细粒度兴趣表示;其次,将预测范式从点对点转向集合理解,高效并行建模跨物品交互;最后,通过统一编码器-解码器结构实现结构简化与共享计算,兼顾性能与可扩展性。无需修改预测流程,HoMer 在工业基线基础上提升 AUC 0.0099,线上业务指标 CTR/RPM 分别提升 1.99%/2.46%。初步工程优化节省 27% GPU 资源,验证其高效性与实用性。

原文摘要 · Abstract (English)

Click-through rate (CTR) prediction, which models behavior sequence and non-sequential features (e.g., user/item profiles or cross features) to infer user interest, underpins industrial recommender systems. However, most methods face three forms of heterogeneity that degrade predictive performance: (i) Feature Heterogeneity persists when limited sequence side features provide less granular interest representation compared to extensive non-sequential features, thereby impairing sequence modeling performance; (ii) Context Heterogeneity arises because a user's interest in an item will be influenced by other items, yet point-wise prediction neglects cross-item interaction context from the entire item set; (iii) Architecture Heterogeneity stems from the fragmented integration of specialized network modules, which compounds the model's effectiveness, efficiency and scalability in industrial deployments. To tackle the above limitations, we propose HoMer, a Homogeneous-Oriented TransforMer for modeling sequential and set-wise contexts. First, we align sequence side features with non-sequential features for accurate sequence modeling and fine-grained interest representation. Second, we shift the prediction paradigm from point-wise to set-wise, facilitating cross-item interaction in a highly parallel manner. Third, HoMer's unified encoder-decoder architecture achieves dual optimization through structural simplification and shared computation, ensuring computational efficiency while maintaining scalability with model size. Without arduous modification to the prediction pipeline, HoMer successfully scales up and outperforms our industrial baseline by 0.0099 in the AUC metric, and enhances online business metrics like CTR/RPM by 1.99%/2.46%. Additionally, HoMer saves 27% of GPU resources via preliminary engineering optimization, further validating its superiority and practicality.

CTR预测推荐系统序列建模工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。