用大模型增强新闻标题和摘要,提升个性化推荐效果
Enhancing News Recommendation with Hierarchical LLM Prompting
- 用大模型生成更深层语义和实体信息,丰富原始新闻内容
- 在MIND数据集上显著优于现有最优方法,点击率明显提升
- 模块可通用,适配多种推荐模型,提升效果且无需改动主架构
个性化新闻推荐系统常因依赖文章标题和摘要等浅层表示,难以准确捕捉用户偏好。为此,本文提出PNR-LLM方法,利用大语言模型的生成能力对新闻标题和摘要进行增强,从而提升推荐质量。PNR-LLM包含一个新颖的“基于大模型的新闻增强”模块,能从文章中生成更深层次的语义信息和相关实体,将浅层内容转化为更丰富的表示。此外,我们设计了一种注意力机制,用于聚合增强后的语义与实体级信息,形成统一的用户与新闻嵌入,揭示更精准的用户-新闻匹配关系。在MIND数据集上的大量实验表明,PNR-LLM显著优于当前主流基线方法。同时,所提数据增强模块具备模型无关性,实验证明将其应用于多个现有模型后,均能进一步提升性能,验证了该设计的有效性。
原文摘要 · Abstract (English)
Personalized news recommendation systems often struggle to effectively capture the complexity of user preferences, as they rely heavily on shallow representations, such as article titles and abstracts. To address this problem, we introduce a novel method, namely PNR-LLM, for Large Language Models for Personalized News Recommendation. Specifically, PNR-LLM harnesses the generation capabilities of LLMs to enrich news titles and abstracts, and consequently improves recommendation quality. PNR-LLM contains a novel module, News Enrichment via LLMs, which generates deeper semantic information and relevant entities from articles, transforming shallow contents into richer representations. We further propose an attention mechanism to aggregate enriched semantic- and entity-level data, forming unified user and news embeddings that reveal a more accurate user-news match. Extensive experiments on MIND datasets show that PNR-LLM outperforms state-of-the-art baselines. Moreover, the proposed data enrichment module is model-agnostic, and we empirically show that applying our proposed module to multiple existing models can further improve their performance, verifying the advantage of our design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。