提出可无限深度检索的导航框架,解决推荐系统搜索漂移问题
From Extraction to Navigation: Progressive Retrieval with Indirectly Infinite Depth

- 用目标感知策略替代被动扩张,主动追踪用户意图
- 通过跨请求状态复用实现间接无限深度,延迟不随深度线性增长
- 基于轨迹对齐训练与图硬负样本,稳定长路径优化
现代大规模推荐检索正从静态相似度匹配转向动态物品空间导航,将检索视为迭代的目标驱动图遍历。传统item-to-item方法陷入“兴趣隧道”,无法挖掘深层用户兴趣;现有基于索引的检索则存在持续的“搜索漂移”,源于静态入口节点和固定图结构无法跟踪实时用户意图的变化。为解决上述问题,我们提出IID-Nav框架,将检索建模为有状态的自主图探索,包含三项核心贡献:(1) 目标感知导航策略,以目标判别器监督的主动意图路由替代被动邻域扩展;(2) 递归状态演化机制,通过跨请求状态复用实现间接无限深度(IID),在不引发线性推理延迟的情况下支持逻辑上无限制的深度图遍历;(3) 轨迹对齐训练范式,结合图硬负样本采样,稳定全路径优化过程。在百亿级工业数据集上的评估表明,IID-Nav在严格延迟预算下超越主流检索基线。实证结果验证了该方法显著缓解搜索漂移,并保持深层检索路径的高精度,为工业推荐系统提供高效稳健的检索解决方案。
原文摘要 · Abstract (English)
Modern large-scale recommender retrieval is shifting from static similarity matching to dynamic item space navigation, framing retrieval as iterative goal-driven graph traversal. Conventional item-to-item (i2i) methods fall into the "interest tunnel" and fail to excavate deep user interests, while existing index-based retrieval suffers from persistent "search drift", caused by static entry nodes and fixed graph topologies unable to track shifting real-time user intent. To resolve the above defects, we present IID-Nav, a framework modeling retrieval as stateful autonomous graph exploration with three core contributions: (1) A goal-aware navigation policy substituting passive neighborhood expansion with active intent routing supervised by a target discriminator; (2) A recursive state evolution mechanism supporting Indirectly Infinite Depth (IID) via cross-request state reuse, which enables logical unlimited-depth graph traversal without linearly rising inference latency; (3) A trajectory-aligned training paradigm equipped with graph hard negative sampling to stabilize optimization over full navigation paths. Evaluations on billion-level industrial datasets show IID-Nav surpasses mainstream retrieval baselines under strict latency budgets. Empirical results verify that our method alleviates search drift remarkably and retains high precision for deep retrieval paths, offering an efficient, robust retrieval solution for industrial recommendation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。