arXiv:2605.16704cs.LG2026-05

用凸优化方法选数据,省钱省力还提效。

Convex Dataset Valuation for Post-Training

论文配图:Convex Dataset Valuation for Post-Training
图 1 · 摘自论文原文
  • 基于梯度空间的核均值匹配,兼顾任务对齐与数据冗余。
  • 在多任务实验中显著优于现有方法,性能提升明显。
  • 适合预算受限的大模型微调场景,实用性强。

提升大语言模型在下游任务上的表现有时需要在后训练阶段利用辅助数据集。然而,开发者常受计算、标注和许可成本限制,无法使用全部数据,因此需有原则地进行数据集级选择。这些约束日益受数据市场影响,数据获取由预算和协商决定。本文将数据集估值视为大模型后训练中的子集选择问题,目标是在预算受限条件下,通过识别和加权辅助数据集以最大化目标任务性能。我们首先表明,常用的梯度对齐分数虽合理但不完整,因忽略了数据集间的冗余性。为此,提出一种基于梯度空间核均值匹配(KMM)的可扩展凸数据集估值方法,联合考虑与目标任务的对齐性及辅助数据集间的冗余性。在多种后训练设置和任务上的大量实验表明,该方法持续优于现有估值基线,以低计算开销实现更强性能。结果表明,数据集估值可作为市场约束下大模型后训练数据选择的实用决策工具。代码已公开于 https://github.com/uiuctml/convex_data_valuation。

原文摘要 · Abstract (English)

Improving LLM performance on downstream tasks sometimes requires leveraging auxiliary datasets during post-training. In practice, however, developers face constraints on compute, labeling, and licensing costs that preclude using all available data, necessitating principled dataset-level selection. These constraints are increasingly shaped by dataset marketplaces, where data acquisition is governed by budgets and negotiation. We study dataset valuation as a subset selection problem during LLM post-training. Our goal is to identify and weight auxiliary datasets so as to maximize target task performance given constrained budgets. We first show that commonly used gradient alignment scores provide a reasonable yet incomplete valuation signal, as they ignore redundancy among datasets. To address this, we propose a scalable convex dataset-level valuation method based on kernel mean matching (KMM) in gradient space, which jointly accounts for alignment with the target task and redundancy across auxiliary datasets. Through extensive experiments across diverse post-training settings and tasks, we show that our approach consistently outperforms existing valuation baselines, achieving stronger performance with low computational overhead. Our results position dataset valuation as a practical decision tool for post-training data selection in market-constrained large language model settings. The code is available at https://github.com/uiuctml/convex_data_valuation.

大模型数据估值后训练凸优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。