用可变长度的LLM原生语义标识,让推荐更精准高效
VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation

- 直接从LLM词汇中提取重要词元构建可变长度标识
- 在四个数据集上超越基线模型,冷启动性能优异
- 无需自回归生成,推理速度提升87倍以上
生成式推荐通常使用聚类和量化构建固定长度的语义标识符(SIDs),但这些人工编码可能过度压缩物品语义,与预训练LLM词汇不匹配,且需昂贵的自回归解码。为此,我们提出VaLiDRec,一种基于可变长度、与LLM对齐的语义标识符的生成式推荐框架。VaLiDRec通过词元重要性估计、语义质量感知剪枝和冲突感知优化,直接从LLM原生词汇中构建标识符,使标识长度能自适应物品语义复杂度。为建模用户偏好,该框架引入图感知软提示,并将推荐重定义为词元集预测与词元级物品评分,消除了自回归SID生成和束搜索。在四个真实世界数据集上的实验表明,VaLiDRec在所有评估指标上均持续优于强基线模型,且零样本物品冷启动表现更优,推理速度比LC-Rec快87.49倍。结果表明,基于LLM原生的可变长度语义标识符为生成式推荐提供了一种更具表现力和效率的新范式。
原文摘要 · Abstract (English)
Generative recommendation commonly represents items using fixed-length semantic identifiers (SIDs) constructed through clustering and quantization. However, these artificial codes may overcompress item semantics, remain misaligned with pretrained LLM vocabularies, and require costly autoregressive decoding. In light of this, we propose VaLiDRec, a generative recommendation framework based on variable-length, LLM-aligned semantic identifiers. VaLiDRec constructs SIDs directly from informative native LLM vocabulary tokens via token importance estimation, semantic-quality-aware pruning, and collision-aware refinement, allowing identifier lengths to adapt to item semantic complexity. To model user preferences, VaLiDRec incorporates graph-aware soft prompts and reformulates recommendation as token-set prediction with token-level item scoring, eliminating autoregressive SID generation and beam search. Experiments on four real-world datasets show that VaLiDRec consistently outperforms strong sequential and generative recommendation baselines across all evaluation metrics. It further achieves superior zero-shot item cold-start performance and 87.49$\times$ faster inference than LC-Rec. These results demonstrate that LLM-native variable-length semantic identifiers provide a more expressive and efficient paradigm for generative recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。