用分层行为建模提升短视频推荐生成效果
Generative Sequential Recommendation via Hierarchical Behavior Modeling
- 设计跨层级交互模块捕捉行为序列复杂依赖
- 在多个指标上优于判别与生成基线方法
- 发布新数据集ShortVideoAD支持生成式推荐研究
多行为场景(如广告和电商)的推荐系统旨在引导用户达成高价值转化,但转化行为本身稀疏。利用点击、点赞、分享等辅助行为至关重要。近年来生成式推荐为多行为序列推荐带来新可能,但现有方法存在两大挑战:一是序列建模不足,难以捕捉用户行为序列中的复杂跨层级依赖;二是缺乏合适数据集,现有公开数据集几乎全部来自电商,限制了其他领域可行性验证,且缺乏足够的侧信息用于语义ID生成。为此,我们提出新型生成框架GAMER(Generative Augmentation and Multi-lEvel behavior modeling for Recommendation),基于解码器仅架构,引入跨层级交互层以捕捉行为间的层次依赖,并采用序列增强策略提升训练鲁棒性。为进一步推动该方向,我们收集并发布了来自主流短视频平台的大型多行为数据集ShortVideoAD,其与传统电商数据集本质不同,且提供预训练语义ID,助力生成式方法研究。大量实验表明,GAMER在多个指标上持续优于判别与生成基线。
原文摘要 · Abstract (English)
Recommender systems in multi-behavior domains, such as advertising and e-commerce, aim to guide users toward high-value but inherently sparse conversions. Leveraging auxiliary behaviors (e.g., clicks, likes, shares) is therefore essential. Recent progress on generative recommendations has brought new possibilities for multi-behavior sequential recommendation. However, existing generative approaches face two significant challenges: 1) Inadequate Sequence Modeling: capture the complex, cross-level dependencies within user behavior sequences, and 2) Lack of Suitable Datasets: publicly available multi-behavior recommendation datasets are almost exclusively derived from e-commerce platforms, limiting the validation of feasibility in other domains, while also lacking sufficient side information for semantic ID generation. To address these issues, we propose a novel generative framework, GAMER (Generative Augmentation and Multi-lEvel behavior modeling for Recommendation), built upon a decoder-only backbone. GAMER introduces a cross-level interaction layer to capture hierarchical dependencies among behaviors and a sequential augmentation strategy that enhances robustness in training. To further advance this direction, we collect and release ShortVideoAD, a large-scale multi-behavior dataset from a mainstream short-video platform, which differs fundamentally from existing e-commerce datasets and provides pretrained semantic IDs for research on generative methods. Extensive experiments show that GAMER consistently outperforms both discriminative and generative baselines across multiple metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。