arXiv:2504.15206cs.LGcs.CC2025-04被引 9

多准确+全局校准可大幅提升公平预测的性能。

How Global Calibration Strengthens Multiaccuracy

  • 用多准确与全局校准结合,实现更强的学习能力。
  • 校准后能恢复强弱盲学习,而仅多准确无法做到。
  • 适合研究公平机器学习与复杂性理论的学者。

多准确性和多校准性是预测中的多组公平性概念,在学习和计算复杂性中应用广泛。它们可由单一学习原语——弱盲学习获得。本文研究多准确性作为学习原语的能力,无论是否附加校准假设。发现多准确性本身较弱,但加入全局校准(称为校准多准确性)后,其能力显著增强,足以恢复此前仅在更强的多校准假设下才成立的结论。我们证明,仅靠多准确预测无法通过后处理获得弱学习器,即使最优假设相关性为1/2;相反,它仅支持一种受限的弱盲学习,要求类别中存在概念与标签相关性超过1/2。然而,若同时要求校准,则可恢复强盲学习。类似结果也出现在从公平预测器推导硬核测度时:多准确仅得密度为最优一半的硬核测度,而校准多准确则达到最优密度。这些结果揭示了多准确与校准在各类设置中的互补作用,解释了为何两者单独不强,合起来却显著增强。

原文摘要 · Abstract (English)

Multiaccuracy and multicalibration are multigroup fairness notions for prediction that have found numerous applications in learning and computational complexity. They can be achieved from a single learning primitive: weak agnostic learning. Here we investigate the power of multiaccuracy as a learning primitive, both with and without the additional assumption of calibration. We find that multiaccuracy in itself is rather weak, but that the addition of global calibration (this notion is called calibrated multiaccuracy) boosts its power substantially, enough to recover implications that were previously known only assuming the stronger notion of multicalibration. We give evidence that multiaccuracy might not be as powerful as standard weak agnostic learning, by showing that there is no way to post-process a multiaccurate predictor to get a weak learner, even assuming the best hypothesis has correlation $1/2$. Rather, we show that it yields a restricted form of weak agnostic learning, which requires some concept in the class to have correlation greater than $1/2$ with the labels. However, by also requiring the predictor to be calibrated, we recover not just weak, but strong agnostic learning. A similar picture emerges when we consider the derivation of hardcore measures from predictors satisfying multigroup fairness notions. On the one hand, while multiaccuracy only yields hardcore measures of density half the optimal, we show that (a weighted version of) calibrated multiaccuracy achieves optimal density. Our results yield new insights into the complementary roles played by multiaccuracy and calibration in each setting. They shed light on why multiaccuracy and global calibration, although not particularly powerful by themselves, together yield considerably stronger notions.

公平学习校准弱学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。