arXiv:2511.19514cs.IR2025-11被引 2

让大模型推理更高效,推荐系统效果提升2.14%。

SCoTER: Structured Chain-of-Thought Transfer for Enhanced Recommendation

  • 自动发现有效推理模式,替代人工模板。
  • 保留推理步骤逻辑,线上无大模型开销。
  • 适合需要高效精准推荐的工业场景。

将大语言模型(LLM)的推理能力应用于推荐系统面临两大挑战:其一,现有方法缺乏自动化、数据驱动的推理模式发现机制,依赖脆弱的手动模板或不稳定的零样本提示;其二,采用结构坍缩式整合方式,直接调用大模型导致高昂在线推理成本,而特征提取则将推理链压缩为单一向量,丢失了逐步逻辑。为此,我们提出SCoTER(Structured Chain-of-Thought Transfer for Enhanced Recommendation),一个统一框架,将模式发现与结构感知迁移联合优化。具体通过生成-验证-挖掘(GVM)管道实现自动化模式发现,并设计保持结构的集成架构,将分步推理传递给高效模型。在四个基准上的实验表明,该方法在多种主干模型上均取得持续提升。此外,在腾讯广告平台的生产环境中部署后,SCoTER实现了GMV提升2.14%,同时完全消除在线大模型推理开销。总体而言,SCoTER为推荐系统中结构化大模型推理提供了实用且统一的解决方案,在离线评测和线上生产环境均得到验证。

原文摘要 · Abstract (English)

Harnessing the reasoning power of Large Language Models (LLMs) for recommender systems is hindered by two fundamental challenges. First, current approaches lack a mechanism for automated, data-driven discovery of effective reasoning patterns, relying instead on brittle manual templates or unstable zero-shot prompting. Second, they employ structure-collapsing integration: direct prompting incurs prohibitive online inference costs, while feature extraction collapses reasoning chains into single vectors, discarding stepwise logic. To address these challenges, we propose SCoTER (Structured Chain-of-Thought Transfer for Enhanced Recommendation), a unified framework that treats pattern discovery and structure-aware transfer as a jointly optimized problem. Specifically, SCoTER operationalizes this through two synergistic components: a Generate-Validate-Mine (GVM) pipeline for automated pattern discovery and a structure-preserving integration architecture that transfers stepwise logic to efficient models. Empirically, experiments on four benchmarks demonstrate consistent improvements across diverse backbones. Moreover, in production deployment on the Tencent Advertising Platform, SCoTER achieved a 2.14\% lift in Gross Merchandise Value (GMV) while eliminating online LLM inference costs. Overall, SCoTER presents a practical and unified framework for integrating structured LLM reasoning into recommender systems, validated by consistent improvements in both offline benchmarks and online production environments.

推荐系统大模型推理链工业落地

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。