arXiv:2605.30772cs.IR2026-05

用20条合成数据实现文本推荐高精度训练,效率大幅提升。

FOSTER: First-order Dataset Distillation for Text-based Sequential Recommendation

论文配图:FOSTER: First-order Dataset Distillation for Text-based Sequential Recommendation
图 1 · 摘自论文原文
  • 用随机采样和一阶优化替代复杂梯度计算,提升训练效率。
  • 仅用20条合成序列就接近全量数据效果,准确率领先现有方法。
  • 适合需要快速训练的推荐系统场景,尤其文本推荐任务。

基于文本的序列推荐系统虽能提升推荐精度,但训练成本高昂。通过将大规模数据集压缩为少量合成样本进行训练,数据蒸馏提供了有效解决方案。然而,在包含大量离散物品且使用语言模型编码物品的场景下,传统双层优化的蒸馏方法代价过高。为此,我们提出面向文本序列推荐的一阶数据蒸馏方法 FOSTER,包含三个创新组件:(1) 随机物品子集采样,替代每步蒸馏中的全库嵌入提取;(2) 带轨迹锚定参数重置的一阶优化,避免昂贵的双层梯度计算;(3) 显式促进语义相似物品在合成序列中的共现。在三个基准数据集上的实验表明,FOSTER持续优于现有数据蒸馏与核心集选择方法,仅需20条合成交互序列即可逼近全数据集性能。

原文摘要 · Abstract (English)

Text-based sequential recommender systems, while greatly improving recommendation accuracy by incorporating item contexts, are undeniably more expensive to train. By condensing a large dataset into a compact set of synthetic samples for model training, dataset distillation offers a promising solution. However, its adoption in text-based sequential recommendation is non-trivial given the large pool of discrete items. This challenge is further compounded by language model-based item encoding, which makes bi-level optimization commonly used in dataset distillation prohibitively expensive. To this end, we propose First-order dataset distillation for Text-based Sequential Recommendation (FOSTER), which facilitates effectiveness and efficiency via three novel components: (1) stochastic item subset sampling that replaces costly full-corpus embedding extraction at each distillation step; (2) first-order optimization with trajectory-anchored parameter reset to avoid expensive bi-level gradient computation; and (3) regularization that explicitly promotes co-occurrence between semantically similar items in the synthetic sequences. Extensive experiments on three benchmarks show that FOSTER consistently outperforms existing dataset distillation and coreset selection baselines, approximating full-dataset performance using as few as 20 synthetic interaction sequences.

序列推荐数据蒸馏高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。