用人类先验知识指导生成式推荐,提升多样性与个性化。
Don't Waste It: Guiding Generative Recommenders with Structured Human Priors via Multi-Head Decoding
- 通过多头解码将结构化人类先验融入生成推荐模型训练
- 在三个大规模数据集上同时提升准确率与多样性等指标
- 适合需要可解释推荐的工业场景,尤其适配大模型长上下文
优化推荐系统以兼顾准确性之外的目标(如多样性、新颖性、个性化)对长期用户满意度至关重要。工业界积累了大量结构化领域知识,我们称之为人类先验(如商品分类体系、时间模式)。这些知识通常仅在排序或排序后阶段做后处理调整,与核心模型学习脱节,而随着行业向端到端生成式推荐基础模型发展,这种分离愈发不利。许多现有方法虽针对此类目标,但需特定架构修改,并完全忽略这些多年积累的人类先验。为此,我们提出一种无需依赖主干网络的框架,将人类先验直接嵌入生成推荐模型的端到端训练中。采用受高效大语言模型解码启发的轻量级先验条件化适配头,引导模型沿人类可理解维度(如交互类型、长期与短期兴趣)解耦用户意图。同时引入分层组合策略建模跨先验类型的复杂交互。在三个大规模数据集上的实验表明,该方法显著提升准确率及超出准确率的目标表现。此外,人类先验使主干模型更有效利用更长上下文和更大模型规模。
原文摘要 · Abstract (English)
Optimizing recommender systems for objectives beyond accuracy, such as diversity, novelty, and personalization, is crucial for long-term user satisfaction. To this end, industrial practitioners have accumulated vast amounts of structured domain knowledge, which we term human priors (e.g., item taxonomies, temporal patterns). This knowledge is typically applied through post-hoc adjustments during ranking or post-ranking. However, this approach remains decoupled from the core model learning, which is particularly undesirable as the industry shifts to end-to-end generative recommendation foundation models. On the other hand, many methods targeting these beyond-accuracy objectives often require architecture-specific modifications and discard these valuable human priors by learning user intent in a fully unsupervised manner. Instead of discarding the human priors accumulated over years of practice, we introduce a backbone-agnostic framework that seamlessly integrates these human priors directly into the end-to-end training of generative recommenders. With lightweight, prior-conditioned adapter heads inspired by efficient LLM decoding strategies, our approach guides the model to disentangle user intent along human-understandable axes (e.g., interaction types, long- vs. short-term interests). We also introduce a hierarchical composition strategy for modeling complex interactions across different prior types. Extensive experiments on three large-scale datasets demonstrate that our method significantly enhances both accuracy and beyond-accuracy objectives. We also show that human priors allow the backbone model to more effectively leverage longer context lengths and larger model sizes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。