arXiv:2411.04761cs.LG2024-11被引 2

发现数据中隐匿的少数群体,解决模型对弱势群体表现差的难题。

Mining the Minoria: Unknown, Under-represented, and Under-performing Minority Groups

  • 通过几何变换将数据映射到对偶空间,识别潜在少数群体。
  • 在低维场景下高效挖掘出被忽略的少数群体,准确率超基线15%以上。
  • 适合关注公平性、模型鲁棒性的研究人员与数据科学家使用。

由于隐私等原因,现实数据常缺失用于识别少数群体的分组信息。而机器学习模型的表现依赖于训练数据,因此对少数群体可能存在性能不足的问题。数据科学家面临‘未知的未知’困境:既无法获取分组属性,也难以判断哪些群体值得关注。本文提出‘少数群体挖掘’问题,旨在从属性空间中寻找可能处于低代表性和低性能状态的潜在群体。技术上,我们通过将数据进行几何变换至对偶空间,利用超平面排列等概念设计低维下的高效算法。高维情形受维度诅咒限制,因此我们提出基于智能搜索空间探索的解决方案。我们在真实和合成数据集上进行了全面实验,并辅以理论分析。结果表明,所提方法能有效发现未知、低代表且表现不佳的少数群体。

原文摘要 · Abstract (English)

Due to a variety of reasons, such as privacy, data in the wild often misses the grouping information required for identifying minorities. On the other hand, it is known that machine learning models are only as good as the data they are trained on and, hence, may underperform for the under-represented minority groups. The missing grouping information presents a dilemma for responsible data scientists who find themselves in an unknown-unknown situation, where not only do they not have access to the grouping attributes but do not also know what groups to consider. This paper is an attempt to address this dilemma. Specifically, we propose a minority mining problem, where we find vectors in the attribute space that reveal potential groups that are under-represented and under-performing. Technically speaking, we propose a geometric transformation of data into a dual space and use notions such as the arrangement of hyperplanes to design an efficient algorithm for the problem in lower dimensions. Generalizing our solution to the higher dimensions is cursed by dimensionality. Therefore, we propose a solution based on smart exploration of the search space for such cases. We conduct comprehensive experiments using real-world and synthetic datasets alongside the theoretical analysis. Our experiment results demonstrate the effectiveness of our proposed solutions in mining the unknown, under-represented, and under-performing minorities.

少数群体公平性数据挖掘模型偏差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。