arXiv:2606.01396cs.IR2026-06被引 1

用用户在信息流中的行为数据,生成可迁移的语义标识,提升广告点击率预测效果。

Quantizing Intent: Cross-Domain Semantic IDs from Organic Activity for Industrial Ranking

  • 从信息流行为中提取跨域用户语义标识,解决广告冷启动问题
  • 最高提升0.351% AUC,存储量仅为原始嵌入的1/30
  • 适合广告系统中低互动用户、冷启动场景的排序优化

广告点击率(CTR)预测受限于用户标注稀疏:多数用户广告互动少,但在信息流等自然场景中产生密集行为数据。将这些跨域信号用于广告排序面临领域差异、服务成本与生产复杂性挑战。本文提出基于信息流活动的跨域用户语义标识(SIDs),发现行为丰富度决定迁移质量:来自用户画像文本的SIDs提升+0.036% AUC,基于活动调优的LLaMA嵌入模型生成的SIDs提升+0.107%,直接使用信息流行为嵌入的SIDs提升+0.213%。进一步提出RQ-FSQ——一种残差有限标量量化方法,在大幅降低存储的同时保持密集嵌入性能:在两个异构源上,分别实现约30倍和280倍的存储压缩,分别带来+0.351%和+0.265% AUC提升。还引入分层离散嵌入模块,通过端到端训练的前缀n-gram稀疏表编码多层级SIDs,优化目标为CTR。在大规模工业广告排序系统中,对冷启动用户分析显示,历史互动极低的用户最高获得+1.522%收益,验证了跨域行为迁移在稀疏历史排序中的有效性。

原文摘要 · Abstract (English)

Ads click-through rate (CTR) prediction is constrained by sparse user supervision: most users engage with ads infrequently while generating dense behavioral evidence in organic surfaces such as feed. Transferring these cross-domain signals into ads ranking is difficult due to domain mismatch, serving cost, and production complexity. We introduce cross-domain user Semantic IDs (SIDs) derived from organic feed activity and show that behavioral activity richness governs cross-domain transfer quality: SIDs from user profile text yield +0.036% AUC, SIDs from an activity-tuned LLaMA-based user embedding model yield +0.107%, and SIDs from direct feed activity behavioral embeddings yield +0.213%. We further propose RQ-FSQ, a residual finite scalar quantization method that discretizes pre-trained embeddings while matching dense-embedding AUC at substantially smaller storage. Across two heterogeneous sources, RQ-FSQ matches or slightly exceeds dense source embeddings, achieving +0.351% AUC for Feed Activity at about 30x smaller storage and +0.265% AUC for Activity-Tuned LLaMA at about 280x smaller storage. We also introduce a Hierarchical Discrete Embedding module that encodes multi-level SIDs through prefix n-gram sparse embedding tables trained end-to-end under the CTR objective. In a large-scale industrial ads ranking system, cold-start segment analysis shows gains up to +1.522% for users with near-zero ad interaction history, validating cross-domain behavioral transfer as an effective bridge for sparse-history ranking.

CTR预测跨域迁移嵌入压缩冷启动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。