让推荐模型自己思考:生成式推荐的新框架,提升稀疏场景效果
HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation

- 用分层语义矩阵统一表示、推理与生成,无需外部思维链标注
- 在多个数据集上超越基线,稀疏场景下提升显著,推理模式精度更高
- 支持快速预测与深度推理双模式,适合对可解释性有要求的场景
生成式推荐将任务建模为序列生成,解决了传统级联架构的目标碎片化问题。然而现有方法仍存在语义表征扁平、缺乏多步推理的层次结构,且依赖昂贵标注的外部思维链(CoT)。本文提出 HoloRec,一种内生式思维链推荐机制,通过多粒度嵌套残差量化构建层次化语义编码矩阵,并以整体重建损失进行优化。该模型支持两种推理模式:非思考模式采用轻量级多粒度监督对齐实现快速预测;思考模式则采用交错推理策略,在生成过程中实时构造思维链步骤,完全脱离外部数据。在多个公开推荐数据集上的实验表明,HoloRec持续优于基线,尤其在稀疏场景下表现突出,思考模式精度高于非思考模式,仅带来适度的推理开销。
原文摘要 · Abstract (English)
Generative recommendation models that formulate the task as sequence generation overcome the objective fragmentation problem of traditional cascade architectures, yet existing approaches still suffer from flat semantic representations lacking hierarchical structure for multi-step reasoning and an externally constructed chain-of-thought (CoT) that requires expensive annotations and remains disconnected from the generation objective. We propose HoloRec, an endogenous chain-of-thought recommendation mechanism that unifies representation, reasoning, and generation by constructing a hierarchical semantic encoding matrix via multi-granularity nested residual quantization optimized by a holistic reconstruction loss. HoloRec supports two inference modes: a non-thinking mode that uses lightweight multi-granularity supervised alignment for fast prediction, and a thinking mode that employs an interleaved reasoning scheme to generate CoT steps on the fly, directly embedding reasoning into the generation process without external data. Experiments on multiple public recommendation datasets demonstrate that HoloRec consistently outperforms baselines, with especially significant gains in sparse scenarios, and the thinking mode achieves better accuracy than the non-thinking mode with only modest inference overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。