用分层隐式推理提升大模型推荐效果,更懂用户从泛到精的偏好变化。
Hierarchical Latent Reasoning for LLM-based Recommendation

- 构建从泛化到精细的分层偏好表征,对齐大模型多层隐式推理状态。
- 在四个亚马逊数据集上超越主流推荐基线,平均提升显著。
- 通过过程奖励优化推理路径,适合研究大模型推荐与可解释性的人。
大语言模型(LLMs)凭借其语义理解与上下文建模能力,在推荐系统中展现出巨大潜力。近期研究引入推理机制以增强用户偏好建模,但显式的自然语言推理带来高昂的推理开销,而现有隐式推理方法主要关注中间状态生成或验证,未能充分刻画各层偏好角色与贡献。本文提出HiLaR——一种具有层感知强化优化的分层隐式推理框架。该框架构建时序引导的分层用户偏好表示,将其与多个LLM隐式推理状态对齐,并组织从宽泛偏好到细粒度当前意图的推理流程。为进一步优化推理轨迹,结合最终推荐反馈与每层状态的边际目标似然增益计算出的层感知过程奖励。在四个Amazon基准数据集上的实验表明,HiLaR普遍优于强基线,包括序列、生成及基于LLM的推荐模型。消融与敏感性分析进一步验证了分层表征学习、隐式对齐与过程级优化的有效性。代码已开源:https://github.com/hupeiyu21/HiLaR。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown strong potential for recommendation by leveraging their semantic understanding and contextual modeling capabilities. Recent studies further introduce reasoning mechanisms to improve user preference modeling. However, explicit natural-language reasoning incurs substantial inference overhead, whereas existing latent reasoning methods mainly focus on generating or verifying intermediate states, leaving their layer-wise preference roles and contributions insufficiently characterized. We propose HiLaR, a Hierarchical Latent Reasoning framework with layer-aware reinforcement optimization for LLM-based recommendation. HiLaR constructs temporal-guided hierarchical user preference representations, aligns them with multiple LLM latent reasoning states, and organizes the reasoning process from broad preferences to fine-grained current intents. To further optimize the reasoning trajectory, HiLaR combines final recommendation feedback with layer-aware process rewards derived from the marginal target-likelihood gain of each state. Experiments on four Amazon benchmark datasets show that HiLaR generally outperforms strong sequential, generative, and LLM-based recommendation baselines. Ablation and sensitivity analyses further verify the contribution of hierarchical representation learning, latent alignment, and process-level optimization. Our code is available in https://github.com/hupeiyu21/HiLaR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。