arXiv:2510.08626cs.CLcs.AI2025-10

用小模型生成的思考文本提升推荐系统准确性和泛化能力

From What to Why: Thought-Space Recommendation with Small Language Models

  • 用小模型生成的解释作为学习信号,联合建模用户行为与动机
  • 在多个数据集上超越主流推荐模型,跨域迁移性能更好
  • 适合需要可解释性与低推理成本的推荐场景

大型语言模型虽提升了推荐的推理能力,但部署成本高。小语言模型(SLMs)虽高效,其推荐推理能力尚未充分探索。现有系统仅将自然语言解释当作无监督描述文本,未发挥其作为学习信号的潜力。本文提出PULSE框架,利用SLM生成的语义解释作为指导信号,结合用户交互历史,共同建模用户行为(做什么)及其语义动机(为什么)。不同于仅依赖交互序列和嵌入的方法,PULSE将解释视为首要信号,使嵌入更具鲁棒性和泛化性。大量实验表明,PULSE在多个基准数据集上优于主流的ID、协同过滤(CF)及基于LLM的序列推荐模型。同时,在跨域推荐中表现出更强迁移能力,并在面向推理的问题回答等下游任务中表现优异。代码已公开。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have advanced recommendation capabilities through enhanced reasoning, but pose significant challenges for real-world deployment due to high inference costs. Conversely, while Small Language Models (SLMs) offer an efficient alternative, their reasoning capabilities for recommendation remain underexplored. Existing systems often use natural language rationales merely as unsupervised descriptive text, failing to harness their full potential as learning signals. In this work our main idea is to create a common understanding of user and items across multiple domains called Thought Space with SLMs instead of using LLMs' distilled knowledge. To that end we propose PULSE (Preference Understanding by Latent Semantic Embeddings), a framework that treats SLM-generated rationales as director learning signals, supervising them with interaction histories to jointly model user actions (what) and their semantic drivers (why). Existing methods consider only interactions such as sequences and embeddings, whereas PULSE treats rationales as first-class signals, this novel design yields embeddings that are more robust and generalizable. Extensive experiments demonstrate that PULSE outperforms leading ID, Collaborative Filtering (CF), and LLM-based sequential recommendation models across multiple benchmark datasets. Furthermore, PULSE exhibits superior transferability in cross-domain recommendation and demonstrates strong performance on downstream tasks such as reasoning-oriented question answering. Our code is available \href{https://anonymous.4open.science/r/Thinking_PULSE-0FC5/README.md}{here}.

推荐系统小模型可解释性语义嵌入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。