arXiv:2602.08067cs.LG2026-02被引 2

用大模型辅助冷启动,让推荐系统更懂用户随时间变化的偏好。

Enhancing Bandit Algorithms with LLMs for Time-varying User Preferences in Streaming Recommendations

  • 通过时间感知的超网络捕捉用户偏好与时间的关系。
  • 利用大模型生成模拟数据,提升早期探索效率,累积收益更高。
  • 适合需要实时响应的流式推荐场景,尤其在冷启动阶段表现突出。

在真实世界的流式推荐系统中,用户偏好随时间动态变化。现有基于贝叶斯的方法仅将时间视为时间戳,忽视其与用户偏好的显式关联,导致性能不佳。此外,在线学习方法在初期常面临探索-利用效率低的问题。为此,我们提出 HyperBandit+,一种融合时间感知超网络的上下文贝叶斯策略,并引入大语言模型辅助的热启动机制(LLM Start),以提升早期在线阶段的探索-利用效率。具体而言,HyperBandit+ 使用神经网络接收时间特征并生成参数,以建模随时间变化的奖励;同时,LLM Start 通过多步数据增强生成逼真的交互数据,实现有效离线预训练,为贝叶斯策略提供热启动参数。为满足实时推荐需求,采用低秩分解降低超网络训练复杂度。理论分析证明了其具有次线性后悔上界,涵盖超网络与大模型热启动机制。在真实数据集上的大量实验表明,HyperBandit+ 在累积收益方面持续优于当前最优基线。

原文摘要 · Abstract (English)

In real-world streaming recommender systems, user preferences evolve dynamically over time. Existing bandit-based methods treat time merely as a timestamp, neglecting its explicit relationship with user preferences and leading to suboptimal performance. Moreover, online learning methods often suffer from inefficient exploration-exploitation during the early online phase. To address these issues, we propose HyperBandit+, a novel contextual bandit policy that integrates a time-aware hypernetwork to adapt to time-varying user preferences and employs a large language model-assisted warm-start mechanism (LLM Start) to enhance exploration-exploitation efficiency in the early online phase. Specifically, HyperBandit+ leverages a neural network that takes time features as input and generates parameters for estimating time-varying rewards by capturing the correlation between time and user preferences. Additionally, the LLM Start mechanism employs multi-step data augmentation to simulate realistic interaction data for effective offline learning, providing warm-start parameters for the bandit policy in the early online phase. To meet real-time streaming recommendation demands, we adopt low-rank factorization to reduce hypernetwork training complexity. Theoretically, we rigorously establish a sublinear regret upper bound that accounts for both the hypernetwork and the LLM warm-start mechanism. Extensive experiments on real-world datasets demonstrate that HyperBandit+ consistently outperforms state-of-the-art baselines in terms of accumulated rewards.

推荐系统在线学习大模型应用时间动态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。