不微调大模型也能实现高质量推荐,靠检索+排序双阶段设计。
STAR: A Simple Training-free Approach for Recommendations using Large Language Models
- 用大模型语义嵌入结合用户行为信息检索候选商品。
- 通过大模型对商品对进行排序,提升下一商品预测准确率。
- 无需微调,在多个数据集上表现接近甚至超越有监督模型。
大语言模型在推荐系统中展现出巨大潜力,但当前主流方法依赖微调,成本高且工程复杂。而直接使用大模型又常因无法捕捉协同信息导致性能下降。本文提出无需微调的推荐框架STAR:先利用大模型语义嵌入与用户协同信息检索候选商品,再通过大模型进行成对排序以优化下一商品预测。在Amazon Review数据集上的实验表明,仅检索阶段即已具备竞争力;完整方法在Beauty、Toys & Games和Sports & Outdoors三个品类上,相对最佳有监督模型分别提升23.8%、37.5%和下降1.8%,验证了该框架在不依赖训练或定制架构下实现高性能推荐的可行性。
原文摘要 · Abstract (English)
Recent progress in large language models (LLMs) offers promising new approaches for recommendation system tasks. While the current state-of-the-art methods rely on fine-tuning LLMs to achieve optimal results, this process is costly and introduces significant engineering complexities. Conversely, methods that directly use LLMs without additional fine-tuning result in a large drop in recommendation quality, often due to the inability to capture collaborative information. In this paper, we propose a Simple Training-free Approach for Recommendation (STAR), a framework that utilizes LLMs and can be applied to various recommendation tasks without the need for fine-tuning, while maintaining high quality recommendation performance. Our approach involves a retrieval stage that uses semantic embeddings from LLMs combined with collaborative user information to retrieve candidate items. We then apply an LLM for pairwise ranking to enhance next-item prediction. Experimental results on the Amazon Review dataset show competitive performance for next item prediction, even with our retrieval stage alone. Our full method achieves Hits@10 performance of +23.8% on Beauty, +37.5% on Toys & Games, and -1.8% on Sports & Outdoors relative to the best supervised models. This framework offers an effective alternative to traditional supervised models, highlighting the potential of LLMs in recommendation systems without extensive training or custom architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。