arXiv:2604.10952cs.LG2026-04中稿 · as a poster at AIS…被引 2

让少数类更公平:用最优传输选原型,提升不平衡数据表现

UniPROT: Uniform Prototype Selection via Partial Optimal Transport with Submodular Guarantees

  • 通过部分最优传输重构目标函数,实现均匀权重原型选择
  • 在多个基准上显著提升少数类准确率,且不牺牲多数类性能
  • 适用于大模型微调与预训练,特别适合领域分布不均场景

从源分布中选取代表性原型以表示目标数据分布是机器学习中的基础问题。现有子集选择方法常依赖隐式重要性评分,易偏向多数类,导致少数类原型质量差。本文提出UniPROT,一种最小化均匀加权原型分布与目标分布之间最优传输(OT)距离的新框架。该形式虽直观,但对应超可加性目标的基数约束最大化问题通常难以高效近似。为此,我们对OT边缘约束进行原则性重参数化,得到基于部分最优传输的子模目标函数,并证明其支持贪婪算法达到(1-1/e)的近似保证。实验表明,在不平衡分类基准中,强制原型均匀加权能持续改善少数类表示,且不降低多数类准确率。在大语言模型的微调与预训练中,面对领域不均衡,UniPROT确保源数据贡献均等,带来稳健性能提升。结果表明,UniPROT是一种可扩展、理论严谨的均匀权重原型选择方案。代码已开源。

原文摘要 · Abstract (English)

Selecting prototypical examples from a source distribution to represent a target data distribution is a fundamental problem in machine learning. Existing subset selection methods often rely on implicit importance scores, which can be skewed towards majority classes and lead to low-quality prototypes for minority classes. We present $\methodprop$, a novel subset selection framework that minimizes the optimal transport (OT) distance between a uniformly weighted prototypical distribution and the target distribution. While intuitive, this formulation leads to a cardinality-constrained maximization of a \emph{super-additive} objective, which is generally intractable to approximate efficiently. To address this, we propose a principled reformulation of the OT marginal constraints, yielding a partial optimal transport-based submodular objective. We prove that this reformulation enables a greedy algorithm with a $(1-1/e)$ approximation guarantee relative to the original super-additive maximization problem. Empirically, we showcase that enforcing uniform prototype weights in UniPROT consistently improves minority-class representation in imbalanced classification benchmarks without compromising majority-class accuracy. In both finetuning and pretraining regimes for large language models under domain imbalance, UniPROT enforces uniform source contributions, yielding robust performance gains. Our results establish UniPROT as a scalable, theoretically grounded solution for uniform-weighted prototype selection. Our code is publicly available at GitHub\footnote{Code: https://github.com/efficiency-learning/UniPROT}

原型选择最优传输不平衡学习子模优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。