用联合优化方法高效筛选视觉指令数据,节省算力且性能接近全量训练。
CoIDO: Efficient Data Selection for Visual Instruction Tuning via Coupled Importance-Diversity Optimization
- 通过轻量级评分器联合优化数据重要性和多样性,避免重复计算。
- 仅用20%样本训练评分器,最终选出的20%数据达到全量训练98.2%性能。
- 适合需要降低视觉指令微调成本的研究者或部署场景使用。
多模态大语言模型依赖指令微调来对齐视觉与语言能力,但大规模数据集上的训练仍面临巨大计算瓶颈。现有数据选择方法虽旨在缓解此问题,但普遍存在两个关键缺陷:需处理整个数据集导致高计算开销,以及将重要性与多样性分开处理造成次优选择。本文提出CoIDO,一种新型双目标框架,联合优化数据重要性与多样性以克服上述挑战。不同于需对全数据集进行昂贵评估的方法,CoIDO采用轻量级插件式评分器,仅需在少量随机采样数据上训练即可学习候选集分布,显著降低计算成本。通过同方差不确定性建模,CoIDO在训练中有效平衡重要性与多样性,实现高效可扩展的数据选择。实验中,仅用20%随机样本训练评分器,随后应用于全数据集,筛选出20%子集用于指令微调。在广泛使用的LLaVA-1.5-7B模型上,该子集在十项下游任务中平均达到全数据微调98.2%的性能。
原文摘要 · Abstract (English)
Multimodal large language models (MLLMs) rely heavily on instruction tuning to align vision and language capabilities, yet the computational cost of training on large-scale datasets remains a major bottleneck. Existing data selection methods aim to mitigate this by selecting important and diverse subsets, but they often suffer from two critical drawbacks: high computational overhead from processing the entire dataset and suboptimal data selection due to separate treatment of importance and diversity. We introduce CoIDO, a novel dual-objective framework that jointly optimizes data importance and diversity to overcome these challenges. Unlike existing approaches that require costly evaluations across the whole dataset, CoIDO employs a lightweight plug-in scorer. This scorer is trained on just a small random sample of data to learn the distribution of the candidate set, drastically reducing computational demands. By leveraging a homoscedastic uncertainty-based formulation, CoIDO effectively balances importance and diversity during training, enabling efficient and scalable data selection. In our experiments, we trained the CoIDO scorer using only 20 percent of randomly sampled data. Once trained, CoIDO was applied to the entire dataset to select a 20 percent subset for instruction tuning. On the widely used LLaVA-1.5-7B model across ten downstream tasks, this selected subset achieved an impressive 98.2 percent of the performance of full-data fine-tuning, on average.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。