arXiv:2605.09665cs.LGcs.AI2026-05中稿 · IJCAI

根据任务和模型动态调整数据权重,用少量样本实现高效指令微调。

Learning Multi-Indicator Weights for Data Selection: A Joint Task-Model Adaptation Framework with Efficient Proxies

论文配图:Learning Multi-Indicator Weights for Data Selection: A Joint Task-Model Adaptation Framework with Efficient Proxies
图 1 · 摘自论文原文
  • 基于上下文学习信号,在小验证集上学习多指标权重。
  • 仅用30%样本即达到全量训练性能,部分任务更优。
  • 适合需高效微调的场景,尤其对资源受限的模型有帮助。

数据选择是大型语言模型高效指令微调的关键,研究表明数据质量往往比数量更重要。现有方法虽引入多维度启发式评估与过滤,但普遍采用静态、任务无关、模型无关的权重分配,忽略了下游任务需求与模型预训练能力的差异。本文提出一种联合任务-模型自适应的数据选择框架,通过在紧凑的小型验证集上利用上下文学习(ICL)信号,无需全量微调即可识别最优权重配置。这些信号作为高效性能代理,实现低成本高保真评估。在GSM8K等多基准测试中,该方法仅使用30%训练样本,性能媲美甚至超越全数据微调;分析还揭示了推理任务中语义多样性与逻辑复杂性间的权衡,凸显联合适配的必要性。

原文摘要 · Abstract (English)

Data selection is a key component of efficient instruction tuning for large language models, as recent work has shown that data quality often matters more than data quantity. Accordingly, prior studies have introduced various multi-dimensional heuristics to evaluate and filter instruction data. However, most existing methods rely on static task-agnostic and model-agnostic weighting schemes, which overlook the varying requirements of specific downstream tasks and the differing pre-existing capabilities of models. In this paper, we propose a framework for learning multi-indicator weights that jointly adapts data selection to both the downstream task and the specific model. Our method identifies optimal weight configurations without full-scale fine-tuning by utilizing in-context learning (ICL) signals on compact tiny-validation sets. These signals serve as efficient performance proxies that ensure high-fidelity evaluation at minimal computational cost. Experiments across multiple benchmarks and model families, including Mistral, Qwen, and Llama, show that the approach achieves performance comparable to or exceeding full-dataset tuning while using only 30\% of the training samples on GSM8K. Furthermore, our analysis reveals a trade-off between semantic diversity and logical complexity in reasoning tasks, highlighting the necessity of joint task-model adaptation.

数据选择指令微调轻量化训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。