构建20万条指令数据,让大模型更好理解推荐任务
ITDR: An Instruction Tuning Dataset for Enhancing Large Language Models in Recommendations
- 用13个数据集+标准化模板构造20万条推荐指令数据
- 在GLM-4、Qwen等模型上显著提升推荐效果
- 适合想改进推荐系统的AI研究者和开发者
大型语言模型(LLMs)在自然语言处理中表现优异,但在推荐系统领域,由于用户行为数据与自然语言结构差异大,难以有效建模用户偏好与物品间的关联。尽管提示方法可生成推荐结果,但对推荐任务理解不足,性能受限。为此,我们构建了涵盖七项子任务的指令微调数据集ITDR,覆盖用户-物品交互与理解两大核心任务。数据集整合13个公开推荐数据集,采用人工设计的标准化模板,共约20万条实例。实验表明,ITDR显著提升了GLM-4、Qwen2.5、Qwen2.5-Instruct及LLaMA-3.2等主流开源模型在推荐任务上的表现。我们还分析了任务间相关性,并探讨任务描述与数据规模对微调效果的影响。最后,与参数量巨大的闭源模型进行对比。ITDR数据集、微调后的推荐模型、所有LoRA模块及完整实验结果已开源:https://github.com/hellolzk/ITDR。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated outstanding performance in natural language processing tasks. However, in the field of recommender systems, due to the inherent structural discrepancy between user behavior data and natural language, LLMs struggle to effectively model the associations between user preferences and items. Although prompt-based methods can generate recommendation results, their inadequate understanding of recommendation tasks leads to constrained performance. To address this gap, we construct a comprehensive instruction tuning dataset, ITDR, which encompasses seven subtasks across two root tasks: user-item interaction and user-item understanding. The dataset integrates data from 13 public recommendation datasets and is built using manually crafted standardized templates, comprising approximately 200,000 instances. Experimental results demonstrate that ITDR significantly enhances the performance of mainstream open-source LLMs such as GLM-4, Qwen2.5, Qwen2.5-Instruct and LLaMA-3.2 on recommendation tasks. Furthermore, we analyze the correlations between tasks and explore the impact of task descriptions and data scale on instruction tuning effectiveness. Finally, we perform comparative experiments against closed-source LLMs with massive parameters. Our tuning dataset ITDR, the fine-tuned large recommendation models, all LoRA modules, and the complete experimental results are available at https://github.com/hellolzk/ITDR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。