arXiv:2510.24431cs.IRcs.AI2025-10被引 28

开源生成式推荐框架,用小模型实现高效精准推荐

MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation

  • 用自回归模型生成语义编号序列替代传统嵌入表
  • 0.5B到7B参数模型在亚马逊数据集上损失持续下降
  • 轻量后训练提升排名精度与候选多样性,适合工业落地

大型语言模型的成功激发了推荐系统是否也能获得类似扩展收益的思考。传统推荐系统依赖海量嵌入表,嵌入维度增大时性能趋于饱和。而新兴生成范式将嵌入替换为由自回归Transformer生成的紧凑语义编号(SID)序列。然而多数工业部署仍为私有,存在两个关键问题:(1)公开基准上预期扩展规律是否成立?(2)最小后训练方案能否实现竞争力表现?我们提出MiniOneRec,据知是首个完全开源的生成式推荐框架,提供从SID构建、监督微调到面向推荐的强化学习的端到端流程。通过残差量化变分自编码器生成SID,对0.5B至7B参数的Qwen骨干模型在Amazon Review数据集上进行后训练。实验显示,随着模型规模增加,训练和评估损失均持续下降,验证了生成方法的参数效率。为进一步提升性能,我们提出轻量但有效的后训练流程:(1)强制全过程SID对齐;(2)采用约束解码与混合奖励的强化学习。二者协同显著提升排序准确率与候选多样性。

原文摘要 · Abstract (English)

The recent success of large language models (LLMs) has renewed interest in whether recommender systems can achieve similar scaling benefits. Conventional recommenders, dominated by massive embedding tables, tend to plateau as embedding dimensions grow. In contrast, the emerging generative paradigm replaces embeddings with compact Semantic ID (SID) sequences produced by autoregressive Transformers. Yet most industrial deployments remain proprietary, leaving two fundamental questions open: (1) Do the expected scaling laws hold on public benchmarks? (2) What is the minimal post-training recipe that enables competitive performance? We present MiniOneRec, to the best of our knowledge, the first fully open-source generative recommendation framework, which provides an end-to-end workflow spanning SID construction, supervised fine-tuning, and recommendation-oriented reinforcement learning. We generate SIDs via a Residual Quantized VAE and post-train Qwen backbones ranging from 0.5B to 7B parameters on the Amazon Review dataset. Our experiments reveal a consistent downward trend in both training and evaluation losses with increasing model size, validating the parameter efficiency of the generative approach. To further enhance performance, we propose a lightweight yet effective post-training pipeline that (1) enforces full-process SID alignment and (2) applies reinforcement learning with constrained decoding and hybrid rewards. Together, these techniques yield significant improvements in both ranking accuracy and candidate diversity.

生成推荐轻量模型SID强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。