arXiv:2501.11391cs.IR2025-01被引 7

大语言模型未必提升新闻推荐,但对冷启动用户更有效。

Revisiting Language Models in Neural News Recommender Systems

  • 用真实数据集验证大模型在新闻推荐中的表现
  • 大模型需更严调参和更高算力才能发挥优势
  • 对新用户推荐效果更好,减少对历史行为依赖

神经新闻推荐系统(RS)常使用语言模型(LM)将文章文本编码为向量以提升推荐效果。现有研究认为大预训练模型(PLM)优于小模型(SLM),且大语言模型(LLM)胜过PLM。但也有研究指出PLM有时表现更差。本文基于真实世界MIND数据集重新审视并统一比较不同语言模型在新闻推荐中的有效性。结果表明:(1)更大语言模型不必然带来更好性能;(2)大模型需更严格的微调超参数设置和更高的计算资源才能达到最优推荐效果。正面发现是,大模型在冷启动用户场景下表现更优——能缓解对大量用户交互历史的依赖,使推荐更侧重新闻内容本身。

原文摘要 · Abstract (English)

Neural news recommender systems (RSs) have integrated language models (LMs) to encode news articles with rich textual information into representations, thereby improving the recommendation process. Most studies suggest that (i) news RSs achieve better performance with larger pre-trained language models (PLMs) than shallow language models (SLMs), and (ii) that large language models (LLMs) outperform PLMs. However, other studies indicate that PLMs sometimes lead to worse performance than SLMs. Thus, it remains unclear whether using larger LMs consistently improves the performance of news RSs. In this paper, we revisit, unify, and extend these comparisons of the effectiveness of LMs in news RSs using the real-world MIND dataset. We find that (i) larger LMs do not necessarily translate to better performance in news RSs, and (ii) they require stricter fine-tuning hyperparameter selection and greater computational resources to achieve optimal recommendation performance than smaller LMs. On the positive side, our experiments show that larger LMs lead to better recommendation performance for cold-start users: they alleviate dependency on extensive user interaction history and make recommendations more reliant on the news content.

新闻推荐语言模型冷启动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。