用文本和用户行为嵌入结合,提升苹果电视搜索的个性化排序效果。
Personalizing Incremental Video Search with Hybrid Text and ID Embeddings
- 融合文本语义与用户行为数据,实时生成个性化推荐信号。
- 在短关键词搜索中,相关性指标提升8.63%,长查询仅提升1.46%。
- 长期使用用户受益更明显,转化率和点击率均显著上升。
增量式视频搜索需在每次输入后快速生成高质量排序结果,但用户意图常不明确(如仅1-3字符前缀)。本文提出一种苹果电视搜索的个性化系统,通过在排序时融合语义与协同信号。学习两个物品嵌入空间:(i) 基于多语言文本编码器(TextEmb),通过对比学习在共观看三元组上微调;(ii) 基于用户交互正样本训练的ID协同嵌入模型(IdEmb)。服务阶段,从近期观看历史构建用户表征,并将文本与ID相似度注入双项XGBoost排序器。离线评估使用时间隔离数据集,有历史记录的会话中,个性化排序使NDCG@10提升2.99%,MRR提升3.30%。在模糊前缀查询(1-3字符)中,NDCG@10提升达+8.63%,而完整查询仅+1.46%。历史越长的用户受益越多:1-5条历史时提升+2.13%,51-100条时达+4.37%,尽管其基础相关性较低(NDCG@10从0.733降至0.680),说明个性化在弱排序场景下价值更高。在线实验持续三周,处理组实现+1.14%点击率、+1.23%转化率提升,已转化项目排名改善2.91%。通过消融实验分析语义与协同信号的覆盖-精度权衡,并在独立语料上用LLM判断相似性标签验证嵌入质量,降低点击/曝光偏差。
原文摘要 · Abstract (English)
Incremental video search requires high-quality ranking after each keystroke, where intent is often underspecified (e.g., 1-3 character prefixes). We present a personalization system for Apple TV search that combines complementary semantic and collaborative signals at ranking time. Our approach learns two item embedding spaces: (i) a text-based multilingual encoder (TextEmb) fine-tuned on co-engagement triplets via contrastive learning, and (ii) an ID-based collaborative embedding model (IdEmb) trained on interaction-derived positives. At serving time, we construct user representations from recent watch history and inject text- and ID-based user-item cosine similarities into a pairwise XGBoost ranker. We evaluate with temporally held-out offline datasets and a three-week online controlled experiment. Offline, for sessions with user history, the personalized ranker improves NDCG@10 by 2.99% and MRR by 3.30% over the non-personalized baseline. Slice analyses show that personalization is most needed in incremental search, where intent is still forming: on ambiguous prefix queries (1-3 characters), NDCG@10 lift is +8.63%, versus +1.46% on longer, fully specified queries. Longer-history users benefit more: NDCG lift rises from +2.13% for users with 1-5 history items to +4.37% for users with 51-100, even though baseline relevance is lower for these cohorts (NDCG@10 drops from 0.733 to 0.680), indicating that personalization adds the most value where default ranking underperforms. Online, treatment yields statistically significant gains of +1.14% tap-through rate and +1.23% conversion rate, with a 2.91% improvement in converted-item rank position. We further analyze coverage-precision trade-offs between semantic and collaborative embeddings via ablations isolating each signal, and evaluate embedding quality on a held-out corpus with LLM-judged similarity labels to reduce click/exposure bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。