将用户偏好分解为多个独立因素,提升大模型推荐的准确性与可解释性。
Factorized Latent Reasoning for LLM-based Recommendation

- 将用户意图拆分为多个解耦的偏好因子,通过多因子注意力机制建模
- 在多个数据集上超越基线模型,提升推荐准确率与鲁棒性
- 适合关注推荐系统可解释性与个性化建模的研究者
大型语言模型(LLM)近年来被用于推荐系统,将用户偏好建模转化为语言生成任务。然而,现有隐式推理方法通常用单一隐向量表示用户意图,难以捕捉用户偏好的多维度本质。本文提出因子化隐式推理(FLR),一种面向LLM的序列推荐新框架,将隐式推理分解为多个解耦的偏好因子。FLR引入轻量级多因子注意力模块,迭代优化隐式思维表征,每个因子关注用户交互历史的不同方面。为促进多样性与专属性,设计正交性、注意力多样性及稀疏性正则化目标,并动态聚合因子贡献以完成最终预测。进一步结合基于组相对策略优化的高效强化学习策略,实现隐式推理空间内的稳定对齐。在多个基准数据集上的实验表明,FLR持续优于强基线,同时提升鲁棒性与可解释性。
原文摘要 · Abstract (English)
Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning approaches typically represent user intent with a single latent vector, which struggles to capture the inherently multi-faceted nature of user preferences. We propose Factorized Latent Reasoning (FLR), a novel framework for LLM-based sequential recommendation that decomposes latent reasoning into multiple disentangled preference factors. FLR introduces a lightweight multi-factor attention module that iteratively refines a latent thought representation, where each factor attends to distinct aspects of the user's interaction history. To encourage diversity and specialization, we design orthogonality, attention diversity, and sparsity regularization objectives, and dynamically aggregate factor contributions for the final prediction. We further integrate FLR with an efficient reinforcement learning strategy based on group-relative policy optimization, enabling stable alignment directly in the latent reasoning space. Experiments on multiple benchmarks show that FLR consistently outperforms strong baselines while improving robustness and interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。