arXiv:2604.26170cs.CL2026-04

用筛选机制提升大模型任务适应效率,避免噪声数据干扰。

EvoSelect: Data-Efficient LLM Evolution for Targeted Task Adaptation

  • 生成数据后先筛选,兼顾任务相关性与多样性。
  • 通过最优传输估计相关性,减少冗余样本,提升学习信号。
  • 适合资源有限时高效微调大模型,尤其适合合成数据场景。

将大语言模型(LLM)高效适配到特定任务仍是核心挑战。传统方法依赖人工标注数据,成本高且难扩展;因此合成数据成为替代方案。然而,生成数据常含噪声、冗余或偏离目标分布,直接训练会稀释有效信号甚至降低性能。为此,本文提出EvoSelect框架,采用迭代生成-筛选-训练闭环,先对候选数据进行筛选。通过最优传输结合代理梯度表示评估任务相关性,量化样本与目标分布的匹配程度;同时引入去重机制,促进样本多样性覆盖。双重策略协同优化,实现渐进式模型演化。在多个基准测试中,无论使用弱或强生成器,EvoSelect均显著优于现有数据选择方法,证明其在低数据成本下有效提升任务适配能力。

原文摘要 · Abstract (English)

Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge. Such adaptation often requires iteratively improving the model toward a targeted task, yet collecting high-quality human-labeled data to support this process is costly and difficult to scale. As a result, synthetic data generation has emerged as a flexible and scalable alternative. One straightforward approach is through an iterative generation-training loop, where candidate data are synthesized through an external generator, the model is updated using these data and the process is repeated over iterations. However, generated samples can be noisy, highly redundant, or even misaligned with the targeted task distribution. Training indiscriminately on such data can dilute useful learning signals and even degrade model performance. To address this, we introduce a refined paradigm, namely an iterative generation-selection-training loop, which incorporates a selection step prior to model updates. Building on this paradigm, we propose EvoSelect, a data-efficient framework to evolve LLM effectively. Given candidate samples produced by the data generator, EvoSelect selects training data by jointly modeling targeted task alignment and diversity. We estimate task relevance through optimal transport with proxy gradient representations, which quantifies how well candidate samples align with the targeted task distribution. To mitigate redundancy, we incorporate a diversification mechanism that promotes coverage of complementary training samples. By interleaving alignment and diversification, EvoSelect enables progressive LLM evolution toward targeted tasks. Extensive experiments on various benchmarks demonstrate that with either weak or strong data generators, EvoSelect consistently improves adaptation efficacy over existing data selection methods.

大模型微调数据筛选合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。