arXiv:2604.05329cs.IR2026-04被引 1

解决推荐系统语义编码冗余问题,提升训练效率与模型稳定性。

Semantic Trimming and Auxiliary Multi-step Prediction for Generative Recommendation

论文配图:Semantic Trimming and Auxiliary Multi-step Prediction for Generative Recommendation
图 1 · 摘自论文原文
  • 动态剪枝输入序列,去除冗余语义信息
  • 多步辅助预测增强稀疏反馈信号,提升长程依赖建模
  • 适合大规模工业推荐系统与资源受限场景

生成式推荐(GR)正从原子项索引转向基于语义标识符(SID)的框架,以捕捉项间的内在关系并增强泛化能力。然而,高粒度的SID导致两大挑战:因序列膨胀带来的巨大训练开销,以及性能波动不稳定。我们发现其根本原因在于语义稀释效应——冗余令牌浪费大量计算,并稀释本就稀疏的学习信号。为此,提出STAMP(语义剪枝与多步辅助预测)框架,采用双端优化策略。输入端通过语义自适应剪枝(SAP)在前向传播中动态过滤冗余,将噪声密集序列转化为紧凑的信息丰富表示;输出端采用多标记目标的多步辅助预测(MAP),增强反馈密度,强化长距离依赖捕获,确保压缩输入下的鲁棒学习信号。统一输入净化与信号放大,显著提升训练效率与表征能力。在公开亚马逊数据集和大规模工业数据集上的实验表明,STAMP实现1.23–1.38倍加速,显存降低17.2%–54.7%,且在多种架构下保持或提升性能。

原文摘要 · Abstract (English)

Generative Recommendation (GR) has recently transitioned from atomic item-indexing to Semantic ID (SID)-based frameworks to capture intrinsic item relationships and enhance generalization. However, the adoption of high-granularity SIDs leads to two critical challenges: prohibitive training overhead due to sequence expansion and unstable performance reliability characterized by non-monotonic accuracy fluctuations. We identify that these disparate issues are fundamentally rooted in the Semantic Dilution Effect, where redundant tokens waste massive computation and dilute the already sparse learning signals in recommendation. To counteract this, we propose STAMP (Semantic Trimming and Auxiliary Multi-step Prediction), a framework utilizing a dual-end optimization strategy. We argue that effective SID learning requires simultaneously addressing low input information density and sparse output supervision. On the input side, Semantic Adaptive Pruning (SAP) dynamically filters redundancy during the forward pass, converting noise-laden sequences into compact, information-rich representations. On the output side, Multi-step Auxiliary Prediction (MAP) employs a multi-token objective to densify feedback, strengthening long-range dependency capture and ensuring robust learning signals despite compressed inputs. Unifying input purification and signal amplification, STAMP enhances both training efficiency and representation capability. Experiments on public Amazon and large-scale industrial datasets show STAMP achieves 1.23--1.38$\times$ speedup and 17.2\%--54.7\% VRAM reduction while maintaining or improving performance across multiple architectures.

生成推荐语义编码高效训练序列剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。