通过推荐冷门但契合兴趣的物品,提升用户意外惊喜感。
Engineering Serendipity through Recommendations of Items with Atypical Aspects
- 用大模型提取商品评论中的冷门特征,评估其对用户的潜在吸引力。
- 系统生成的推荐排序与人工标注的惊喜度高度一致,相关性达0.72。
- 适合追求个性化体验、想超越传统精准推荐的研究者和开发者。
一次餐厅晚餐或酒店入住若能带来意外惊喜,往往令人难忘。例如,喜欢纸艺的顾客可能对餐厅等候区的折纸站感到惊喜又愉悦;喜爱巴洛克音乐的客人可能对酒店大堂展出的18世纪古钢琴产生浓厚兴趣。受此启发,本文提出新任务:通过推荐具有非常规特征的物品来制造惊喜。我们设计了一个基于大模型的系统流程,从商品评论中提取非常规特征,再估算并聚合其对用户的个性化价值,形成‘惊喜潜力’评分以重排推荐列表。为支持开发与评估,我们构建了标注有非常规特征的Yelp评论数据集,以及人工生成的用户画像数据集,并通过众包获取用户-特征效用值。此外,提出一种动态选择上下文学习样本的方法,显著提升了大模型判断非常规性和效用的能力。实验表明,该系统生成的惊喜排序与人工标注的惊喜度高度相关(皮尔逊相关系数0.72)。我们希望这一新任务及系统能推动推荐研究从精度转向用户满意度的全面提升。数据集与代码已开源。
原文摘要 · Abstract (English)
A restaurant dinner or a hotel stay may lead to memorable experiences when guests encounter unexpected aspects that also match their interests. For example, an origami-making station in the waiting area of a restaurant may be both surprising and enjoyable for a customer who is passionate about paper crafts. Similarly, an exhibit of 18th century harpsichords would be atypical for a hotel lobby and likely pique the interest of a guest who has a passion for Baroque music. Motivated by this insight, in this paper we introduce the new task of engineering serendipity through recommendations of items with atypical aspects. We describe an LLM-based system pipeline that extracts atypical aspects from item reviews, then estimates and aggregates their user-specific utility in a measure of serendipity potential that is used to rerank a list of items recommended to the user. To facilitate system development and evaluation, we introduce a dataset of Yelp reviews that are manually annotated with atypical aspects and a dataset of artificially generated user profiles, together with crowdsourced annotations of user-aspect utility values. Furthermore, we introduce a custom procedure for dynamic selection of in-context learning examples, which is shown to improve LLM-based judgments of atypicality and utility. Experimental evaluations show that serendipity-based rankings generated by the system are highly correlated with ground truth rankings for which serendipity scores are computed from manual annotations of atypical aspects and their user-dependent utility. Overall, we hope that the new recommendation task and the associated system presented in this paper catalyze further research into recommendation approaches that go beyond accuracy in their pursuit of enhanced user satisfaction. The datasets and the code are made publicly available at https://github.com/ramituncc49er/ATARS .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。