arXiv:2409.06297cs.IRcs.HC2024-09被引 2

用大模型生成电影推荐解释,比模板更生动吸引人。

User Preferences for Large Language Model versus Template-Based Explanations of Movie Recommendations: A Pilot Study

  • 用大模型重写或直接生成推荐理由,替代传统模板
  • 25人测试显示大模型解释更丰富、更符合用户期待
  • 适合想提升推荐系统可懂性和用户信任的研究者

推荐系统已融入数字生活,但其推荐逻辑常对用户不透明。现有方法中,图结构可提供路径解释,但非专业用户难以理解;另一种常见做法是将图解释转为模板化文本,但常显生硬乏味。本文提出使用大语言模型(LLM)生成解释,分三种形式:模板式、模板经大模型重写、纯大模型生成。通过25名参与者的小规模实验发现,尽管结果存在较大波动,但大模型生成的解释在内容丰富性和用户体验上更具优势,更贴近用户预期。该研究揭示了现有解释方法的局限,并为利用大模型提升推荐系统的可解释性与用户满意度提供了新方向。

原文摘要 · Abstract (English)

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach, offering inherent explainability through paths associating recommended items and seed items, non-experts could not easily understand these explanations. A popular alternative is to convert graph-based explanations into textual ones using a template and an algorithm, which we denote here as ''template-based'' explanations. Yet, these can sometimes come across as impersonal or uninspiring. A novel method would be to employ large language models (LLMs) for this purpose, which we denote as ''LLM-based''. To assess the effectiveness of LLMs in generating more resonant explanations, we conducted a pilot study with 25 participants. They were presented with three explanations: (1) traditional template-based, (2) LLM-based rephrasing of the template output, and (3) purely LLM-based explanations derived from the graph-based explanations. Although subject to high variance, preliminary findings suggest that LLM-based explanations may provide a richer and more engaging user experience, further aligning with user expectations. This study sheds light on the potential limitations of current explanation methods and offers promising directions for leveraging large language models to improve user satisfaction and trust in recommender systems.

推荐系统可解释性大模型用户研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。