arXiv:2605.15691cs.LG2026-05

SEED通过图优化方法,高效选出高质量且多样化的数据子集。

SEED: Targeted Data Selection by Weighted Independent Set

论文配图:SEED: Targeted Data Selection by Weighted Independent Set
图 1 · 摘自论文原文
  • 构建相似性图,用加权独立集选择兼具质量与多样性的样本。
  • 在多种任务上优于现有方法,如指令微调和语义分割,提升显著。
  • 适合需要高效筛选大规模训练数据的研究者使用。

数据选择旨在从大规模训练语料中识别出紧凑而信息丰富的子集,平衡样本质量与数据多样性。本文将该问题形式化为相似性图上的加权独立集(WIS),其中节点代表数据样本并按其影响加权,边连接语义冗余的样本对。该方法自然生成高质且多样化的子集。然而实际应用中存在两个挑战:原始节点权重难以区分有效信号与梯度噪声;跨领域分布差异导致边构建产生结构失衡图,使选择偏向稀疏区域。为此,本文提出两个统一图视角下的改进:(1) 节点价值校准——仅在双向显著子空间内估计影响,使节点重要性基于任务相关信号而非表层统计;(2) 局部尺度归一化——根据局部邻域密度自适应调整边阈值,缓解跨域分布偏移带来的图失衡。二者结合形成鲁棒且可扩展的数据选择流程,称为SEED。我们进一步构建了由SEED筛选的紧凑多模态数据集Honeybee-Remake-SEED-200K。大量实验表明,SEED在指令微调、视觉指令微调及语义分割等任务上,对多种模型架构均持续优于当前最优方法。

原文摘要 · Abstract (English)

Data selection seeks to identify a compact yet informative subset from large-scale training corpora, balancing sample quality against collection diversity. We formulate this problem as a Weighted Independent Set (WIS) on a similarity graph, where nodes represent data samples weighted by influence, and edges connect semantically redundant pairs. This formulation naturally yields subsets that are simultaneously high-quality and diverse. However, two challenges arise in practice: naive node weights fail to distinguish informative signals from gradient noise, and edge construction under heterogeneous domain distributions produces structurally imbalanced graphs that bias selection toward sparse regions. To address these issues, we introduce two principled refinements from a unified graph perspective: (1) \textit{node value calibration} that restricts influence estimation to the bilateral salient subspace to ground node importance in task-relevant signals rather than surface-level statistics; (2) \textit{local scale normalization} that adapts edge thresholds to local neighborhood density, mitigating graph imbalance induced by cross-domain distribution shifts. Together, these components yield a robust and scalable data selection pipeline dubbed SEED. We further construct \texttt{Honeybee-Remake-SEED-200K}, a compact multimodal dataset curated by SEED. Extensive experiments show that SEED consistently outperforms state-of-the-art methods on instruction tuning, visual instruction tuning, and semantic segmentation across diverse model families.

数据选择图学习多模态高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。