arXiv:2508.00450cs.IRcs.AI2025-08

用动态闭环优化让推荐更意外又贴合用户真实兴趣。

When Relevance Meets Novelty: Dual-Stable Periodic Optimization for Serendipitous Recommendation

  • 双稳定探索模块并行建模群体身份与个体短期兴趣。
  • 周期性协同优化使模型持续吸收新数据,推荐更灵活。
  • 适合追求惊喜感且厌倦重复推荐的用户群体。

传统推荐系统易陷入强化反馈循环,过度推送符合历史偏好的内容,限制探索机会并导致内容疲劳。尽管大语言模型(LLM)具备多样内容生成潜力,现有增强型双模型框架存在两大缺陷:一是忽略由群体身份驱动的长期偏好,造成兴趣建模偏差;二是优化过程静态,一次性对齐无法利用增量数据实现闭环优化。为此,我们提出共进化对齐(CoEA)方法。针对兴趣建模偏差,引入双稳定兴趣探索(DSIE)模块,通过并行处理行为序列,联合建模长期群体身份与短期个体兴趣。针对静态优化问题,设计周期性协同优化(PCO)机制:定期使用相关性LLM对增量数据进行偏好验证,指导新颖性LLM基于验证结果进行微调,并将持续微调后的新颖性LLM输出反馈至相关性LLM进行重新评估,从而实现动态闭环优化。大量在线与离线实验验证了CoEA在意外推荐中的有效性。

原文摘要 · Abstract (English)

Traditional recommendation systems tend to trap users in strong feedback loops by excessively pushing content aligned with their historical preferences, thereby limiting exploration opportunities and causing content fatigue. Although large language models (LLMs) demonstrate potential with their diverse content generation capabilities, existing LLM-enhanced dual-model frameworks face two major limitations: first, they overlook long-term preferences driven by group identity, leading to biased interest modeling; second, they suffer from static optimization flaws, as a one-time alignment process fails to leverage incremental user data for closed-loop optimization. To address these challenges, we propose the Co-Evolutionary Alignment (CoEA) method. For interest modeling bias, we introduce Dual-Stable Interest Exploration (DSIE) module, jointly modeling long-term group identity and short-term individual interests through parallel processing of behavioral sequences. For static optimization limitations, we design a Periodic Collaborative Optimization (PCO) mechanism. This mechanism regularly conducts preference verification on incremental data using the Relevance LLM, then guides the Novelty LLM to perform fine-tuning based on the verification results, and subsequently feeds back the output of the continually fine-tuned Novelty LLM to the Relevance LLM for re-evaluation, thereby achieving a dynamic closed-loop optimization. Extensive online and offline experiments verify the effectiveness of the CoEA model in serendipitous recommendation.

推荐系统大模型闭环优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。