arXiv:2506.04015cs.IR2025-06KDD被引 4

用群体最优传输选小样本,让大模型推荐更省力高效

GORACS: Group-level Optimal Transport-guided Coreset Selection for LLM-based Recommender Systems

  • 基于群体层面的最优传输思想选关键数据
  • 减少训练成本的同时超越全量数据效果
  • 适合追求高效大模型推荐落地的研究者

尽管大语言模型在推荐系统中展现出巨大潜力,但其在完整数据集上微调带来的高昂计算成本限制了实际应用。为构建经济高效的LLM推荐系统,本文聚焦核心数据集选择任务,旨在通过选取少量微调数据来最小化测试损失,从而实现高效微调。现有基于分布或重要性的方法常因与下游微调目标不匹配或个体样本选择导致泛化能力弱而表现不佳。为此,提出GORACS框架,遵循两大原则:一是最小化测试损失以对齐微调目标,二是通过群体级数据选择提升模型泛化能力。对应设计两个组件:1)代理优化目标(POO),利用最优传输和梯度信息逼近难以计算的测试损失,避免重复训练,显著降低计算开销;2)两阶段初始化-精炼算法(ITRA),实现高效的群体级数据选择。在多个推荐数据集和任务上的实验证明,GORACS大幅降低LLM微调成本,性能优于当前最先进基线及全量数据训练。代码已开源。

原文摘要 · Abstract (English)

Although large language models (LLMs) have shown great potential in recommender systems, the prohibitive computational costs for fine-tuning LLMs on entire datasets hinder their successful deployment in real-world scenarios. To develop affordable and effective LLM-based recommender systems, we focus on the task of coreset selection which identifies a small subset of fine-tuning data to optimize the test loss, thereby facilitating efficient LLMs' fine-tuning. Although there exist some intuitive solutions of subset selection, including distribution-based and importance-based approaches, they often lead to suboptimal performance due to the misalignment with downstream fine-tuning objectives or weak generalization ability caused by individual-level sample selection. To overcome these challenges, we propose GORACS, which is a novel Group-level Optimal tRAnsport-guided Coreset Selection framework for LLM-based recommender systems. GORACS is designed based on two key principles for coreset selection: 1) selecting the subsets that minimize the test loss to align with fine-tuning objectives, and 2) enhancing model generalization through group-level data selection. Corresponding to these two principles, GORACS has two key components: 1) a Proxy Optimization Objective (POO) leveraging optimal transport and gradient information to bound the intractable test loss, thus reducing computational costs by avoiding repeated LLM retraining, and 2) a two-stage Initialization-Then-Refinement Algorithm (ITRA) for efficient group-level selection. Our extensive experiments across diverse recommendation datasets and tasks validate that GORACS significantly reduces fine-tuning costs of LLMs while achieving superior performance over the state-of-the-art baselines and full data training. The source code of GORACS are available at https://github.com/Mithas-114/GORACS.

大模型推荐核心数据集最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。