让推荐系统持续学习用户新兴趣,成本更低更高效。
SCoRD: Semantic-Assisted Continual Retriever-Reranker Distillation for LLM-Based Recommendation

- 用语义助手提取用户意图,指导检索器更新。
- 只在低置信度场景下蒸馏知识,节省计算资源。
- 适合需要长期迭代的推荐系统研发人员。
推荐系统常采用两阶段流程:基于ID的检索器召回候选,大模型重排器优化排序。为提升检索质量,通常将重排器的知识蒸馏到检索器中。但在实际部署中,系统需持续适应用户兴趣变化和新增交互数据。直接反复更新大模型并重蒸馏代价高昂;仅更新检索器则因容量有限难以从稀疏数据中有效学习。本文提出SCoRD框架,通过引入语义推理助手,将大模型推断用户深层意图的能力转化为可复用的意图级指导信号。该框架仅在低置信度序列上选择性蒸馏知识,支持仅更新检索器而无需重复大模型推理,并将检索器输出的表示与意图漂移信号反馈给重排器。在真实数据集上的实验表明,SCoRD实现了高效且有效的检索-重排协同自适应。
原文摘要 · Abstract (English)
Recommendation systems increasingly adopt a two-stage pipeline, where an ID-based retriever retrieves candidates and an LLM-based reranker refines their rankings. To improve retrieval quality, reranker-to-retriever distillation is commonly used to transfer the reranker's knowledge to the retriever. For practical deployment, however, this pipeline must continually adapt to evolving interests and incoming interactions. A naive solution is to repeatedly update the LLM reranker and distill its latest knowledge, but this incurs prohibitive costs. Updating the retriever alone is cheaper, but its limited capacity makes adaptation from sparse data difficult. We propose SCoRD, a continual knowledge distillation framework for LLM-based reranking pipelines under a non-stationary data stream. SCoRD introduces a semantic reasoning assistant that distills the LLM's ability to infer underlying user intents into reusable intent-level guidance. It selectively distills reranker knowledge to the retriever on low-confidence sequences, guides retriever-only updates without repeated LLM inference, and feeds retriever-derived representations and intent-drift signals back to the reranker. Experiments on real-world datasets show that SCoRD enables effective and efficient retriever-reranker co-adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。