用用户偏好和事实一致性增强大模型,生成更精准个性化的新闻标题。
CAP-LLM: Context-Augmented Personalized Large Language Models for News Headline Generation
- 引入用户兴趣编码器与上下文注入模块,融合长期偏好与实时内容。
- 事实一致性得分87.50,显著优于基线模型,同时提升个性化与覆盖度。
- 适合需要平衡个性化与真实性的新闻推荐系统开发者使用。
信息过载时代,个性化新闻标题生成对吸引用户至关重要,需兼顾用户偏好与事实准确性。现有方法难以有效捕捉复杂用户兴趣且易产生虚假陈述。本文提出上下文增强型个性化大语言模型(CAP-LLM),将用户偏好与事实一致性约束融入预训练大模型。CAP-LLM包含用户兴趣编码器、上下文注入适配器,以及采用新型对比损失的事实一致性强化模块。在真实世界PENS数据集上评估显示,其各项指标均达领先水平:事实一致性(FactCC)达87.50,显著高于BART的86.67;个性化得分(Pc(avg) 2.73, Pc(max) 17.25)与内容覆盖率(ROUGE-1 26.55, ROUGE-2 9.95, ROUGE-L 23.01)均表现优异。消融实验、人工评估与敏感性分析验证了各组件有效性及方法鲁棒性,证明其在个性化与真实性间取得更优平衡。
原文摘要 · Abstract (English)
In the era of information overload, personalized news headline generation is crucial for engaging users by tailoring content to their preferences while accurately conveying news facts. Existing methods struggle with effectively capturing complex user interests and ensuring factual consistency, often leading to generic or misleading headlines. Leveraging the unprecedented capabilities of Large Language Models (LLMs) in text generation, we propose Context-Augmented Personalized LLM (CAP-LLM), a novel framework that integrates user preferences and factual consistency constraints into a powerful pre-trained LLM backbone. CAP-LLM features a User Preference Encoder to capture long-term user interests, a Context Injection Adapter to seamlessly integrate these preferences and current article context into the LLM's generation process, and a Fact-Consistency Reinforcement Module employing a novel contrastive loss to mitigate hallucination. Evaluated on the real-world PENS dataset, CAP-LLM achieves state-of-the-art performance across all metrics. Notably, it significantly improves factual consistency (FactCC of 87.50) over strong baselines like BART (86.67), while simultaneously enhancing personalization (Pc(avg) 2.73, Pc(max) 17.25) and content coverage (ROUGE-1 26.55, ROUGE-2 9.95, ROUGE-L 23.01). Our ablation studies, human evaluations, and sensitivity analyses further validate the effectiveness of each component and the robustness of our approach, demonstrating CAP-LLM's ability to achieve a superior balance between personalization and factual accuracy in news headline generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。