arXiv:2604.10471cs.IR2026-04被引 3

用可学习的语义标识提升短视频搜索长尾内容效果

SID-Coord: Coordinating Semantic IDs for ID-based Ranking in Short-Video Search

  • 将语义信息作为结构化标识融入排名模型,实现记忆与泛化的统一
  • 在真实系统中提升长播放率0.664%,搜索播放时长增加0.369%
  • 轻量改造现有系统,适合工业级短视频推荐场景

大规模短视频搜索排名模型通常基于哈希物品标识符(HIDs)的稀疏共现信号进行训练。这类基于ID的模型虽能有效记忆高频交互,但在曝光有限的长尾物品上泛化能力差,记忆与泛化之间的权衡是工业系统长期存在的挑战。本文提出SID-Coord,一种轻量级语义标识框架,将可训练的离散语义标识符(SIDs)直接引入基于ID的排名模型。不同于将语义信号作为辅助稠密特征,SID-Coord将语义表示为结构化标识,并在统一框架内协调基于HID的记忆与基于SID的泛化。为实现有效协同,该框架引入三个组件:(1) 基于注意力的层级SIDs融合模块,捕捉多粒度语义;(2) 目标感知的HID-SID门控机制,自适应平衡记忆与泛化;(3) 基于SID的兴趣对齐模块,建模目标项与用户历史间的语义相似分布。SID-Coord可无缝集成至现有生产排名系统,无需修改主干模型。线上A/B实验显示,搜索场景长播放率提升0.664%,搜索播放时长增加0.369%,均具统计显著性。

原文摘要 · Abstract (English)

Large-scale short-video search ranking models are typically trained on sparse co-occurrence signals over hashed item identifiers (HIDs). While effective at memorizing frequent interactions, such ID-based models struggle to generalize to long-tailed items with limited exposure. This memorization-generalization trade-off remains a longstanding challenge in such industrial systems. We propose SID-Coord, a lightweight Semantic ID framework that incorporates discrete, trainable semantic IDs (SIDs) directly into ID-based ranking models. Instead of treating semantic signals as auxiliary dense features, SID-Coord represents semantics as structured identifiers and coordinates HID-based memorization with SID-based generalization within a unified modeling framework. To enable effective coordination, SID-Coord introduces three components: (1) an attention-based fusion module over hierarchical SIDs to capture multi-level semantics, (2) a target-aware HID-SID gating mechanism that adaptively balances memorization and generalization, and (3) a SID-driven interest alignment module that models the semantic similarity distribution between target items and user histories. SID-Coord can be integrated into existing production ranking systems without modifying the backbone model. Online A/B experiments in a real-world production environment show statistically significant improvements, with a +0.664% gain in long-play rate in search and a +0.369% increase in search playback duration.

短视频搜索语义标识长尾泛化在线排序

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。