arXiv:2410.14588cs.LGcs.CY2024-10ICML被引 3

为可聚类子群体设计学习方法,确保每个子群预测都可靠。

Learning With Multi-Group Guarantees For Clusterable Subpopulations

  • 基于数据自然聚类定义子群体,动态分配个体归属
  • 在线校准中实现 $O(T^{1/2})$ 收敛率,无需子群完全分离
  • 适合关注公平性与子群表现的机器学习应用

预测任务的理想目标是不仅在总体上表现良好,还对人口中的有意义子群体提供性能保证。但什么才算有意义的子群体?本文认为,相关子群体应基于预测对象分布中自然形成的聚类来定义。在此视角下,整体人口被视为一个混合模型,其成分即为关键子群体。我们提出两种形式化子群体保障的方法:一是根据特征将每个个体归于最可能来源的成分;二是按各成分的相对可能性比例分配个体至所有成分。以在线校准为例,我们设计了一种多目标算法,能同时处理所有可能的子群体结构,实现 $O(T^{1/2})$ 的收敛速率,即使子群体未充分分离也成立。相比之下,先聚类再预测的方法需 $O(T^{2/3})$ 速率,且要求子群可分。进一步证明,为底层聚类提供子群校准保障比学习聚类本身更简单:后者需要子群特征中位数分离,而前者无需。

原文摘要 · Abstract (English)

A canonical desideratum for prediction problems is that performance guarantees should hold not just on average over the population, but also for meaningful subpopulations within the overall population. But what constitutes a meaningful subpopulation? In this work, we take the perspective that relevant subpopulations should be defined with respect to the clusters that naturally emerge from the distribution of individuals for which predictions are being made. In this view, a population refers to a mixture model whose components constitute the relevant subpopulations. We suggest two formalisms for capturing per-subgroup guarantees: first, by attributing each individual to the component from which they were most likely drawn, given their features; and second, by attributing each individual to all components in proportion to their relative likelihood of having been drawn from each component. Using online calibration as a case study, we study a multi-objective algorithm that provides guarantees for each of these formalisms by handling all plausible underlying subpopulation structures simultaneously, and achieve an $O(T^{1/2})$ rate even when the subpopulations are not well-separated. In comparison, the more natural cluster-then-predict approach that first recovers the structure of the subpopulations and then makes predictions suffers from a $O(T^{2/3})$ rate and requires the subpopulations to be separable. Along the way, we prove that providing per-subgroup calibration guarantees for underlying clusters can be easier than learning the clusters: separation between median subgroup features is required for the latter but not the former.

子群体聚类校准公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。