arXiv:2510.03950cs.LG2025-10

通过类别影响函数,找出分类器性能上限并实现全类别提升。

What Is The Performance Ceiling of My Classifier? Utilizing Category-Wise Influence Functions for Pareto Frontier Analysis

  • 提出类别级影响函数,量化样本对各分类的影响。
  • 在多个数据集上实现全类别准确率提升,无牺牲任何类别。
  • 适合关注公平性与整体性能的模型优化研究者。

数据驱动学习从数据质量角度提升模型性能,受到越来越多关注。影响函数可量化单个训练样本对模型预测的影响,帮助识别有害样本并重训以提升性能。然而现有工作多聚焦于‘哪些数据有益’,本文进一步探讨更根本的问题:‘模型性能上限是什么?’不同于以往仅看整体准确率,我们关注类别级准确率,追求帕累托改进——确保所有类别同时提升,避免某些类别改善而其他类别受损。为此,我们提出类别级影响函数,引入影响向量以衡量样本对所有类别的综合影响。基于此,设计了判断模型是否仍有提升空间的理论准则,并构建基于线性规划的样本重加权框架,实现帕累托性能改进。在合成数据、视觉和文本基准上的大量实验表明,该方法能有效估计并达成多类别性能提升。

原文摘要 · Abstract (English)

Data-centric learning seeks to improve model performance from the perspective of data quality, and has been drawing increasing attention in the machine learning community. Among its key tools, influence functions provide a powerful framework to quantify the impact of individual training samples on model predictions, enabling practitioners to identify detrimental samples and retrain models on a cleaner dataset for improved performance. However, most existing work focuses on the question: "what data benefits the learning model?" In this paper, we take a step further and investigate a more fundamental question: "what is the performance ceiling of the learning model?" Unlike prior studies that primarily measure improvement through overall accuracy, we emphasize category-wise accuracy and aim for Pareto improvements, ensuring that every class benefits, rather than allowing tradeoffs where some classes improve at the expense of others. To address this challenge, we propose category-wise influence functions and introduce an influence vector that quantifies the impact of each training sample across all categories. Leveraging these influence vectors, we develop a principled criterion to determine whether a model can still be improved, and further design a linear programming-based sample reweighting framework to achieve Pareto performance improvements. Through extensive experiments on synthetic datasets, vision, and text benchmarks, we demonstrate the effectiveness of our approach in estimating and achieving a model's performance improvement across multiple categories of interest.

影响函数性能上限帕累托优化分类器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。