用最优传输理论优化数据选择,提升复杂数据场景下的模型性能。
TAROT: Targeted Data Selection via Optimal Transport
- 基于白化特征距离计算数据影响,减少高维特征偏差。
- 通过最小化目标域与选中数据间的最优传输距离,实现精准匹配。
- 适用于分割、预测、指令调优等多任务,适合需要高质量数据筛选的研究者。
我们提出TAROT,一种基于最优传输理论的靶向数据选择框架。以往的方法主要依赖基于影响的贪心启发式策略来提升特定领域性能,但在复杂、多模态数据上表现不佳,因无法捕捉多种内在模式。本文识别出两个关键限制:(i) 高维影响估计中主导特征分量的过度影响;(ii) 贪心策略固有的线性叠加假设。TAROT引入白化特征距离以缓解主导特征偏差,提供更可靠的影响力度量,并据此量化并最小化所选数据与目标域之间的最优传输距离。该最小化过程还支持最优选择比例的估计。我们在语义分割、运动预测和指令调优等多个任务上评估了TAROT,结果一致表明其优于现有先进方法,展现出在多种深度学习任务中的通用性。代码已公开于https://github.com/vita-epfl/TAROT。
原文摘要 · Abstract (English)
We propose TAROT, a targeted data selection framework grounded in optimal transport theory. Previous targeted data selection methods primarily rely on influence-based greedy heuristics to enhance domain-specific performance. While effective on limited, unimodal data (i.e., data following a single pattern), these methods struggle as target data complexity increases. Specifically, in multimodal distributions, these heuristics fail to account for multiple inherent patterns, leading to suboptimal data selection. This work identifies two primary factors contributing to this limitation: (i) the disproportionate impact of dominant feature components in high-dimensional influence estimation, and (ii) the restrictive linear additive assumptions inherent in greedy selection strategies. To address these challenges, TAROT incorporates whitened feature distance to mitigate dominant feature bias, providing a more reliable measure of data influence. Building on this, TAROT uses whitened feature distance to quantify and minimize the optimal transport distance between the selected data and target domains. Notably, this minimization also facilitates the estimation of optimal selection ratios. We evaluate TAROT across multiple tasks, including semantic segmentation, motion prediction, and instruction tuning. Results consistently show that TAROT outperforms state-of-the-art methods, highlighting its versatility across various deep learning tasks. Code is available at https://github.com/vita-epfl/TAROT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。