arXiv:2502.11429cs.LGcs.CY2025-02被引 2

提出基于注意力分布的公平排序新度量,更真实反映排序公平性。

What's in a Query: Polarity-Aware Distribution-Based Fair Ranking

  • 用分布差异度量注意力与相关性偏离程度,提升公平性评估可靠性。
  • 证明个体公平可上界群体公平,在优化个体公平时也提升群体公平。
  • 指出现有方法忽略查询极性,可能造成虚假公平的误导风险。

机器学习驱动的排序在多种关键安全场景中决定搜索曝光或关注度,因此确保公平性至关重要。在等机会目标下,个体在排序界面获得的关注应与其跨查询的相关性成比例。本文研究摊销公平排序——将相关性和关注度在一系列用户查询中累计,使实际应用中实现公平排序更可行。不同于以往基于期望摊销关注的度量,本文提出新的基于散度的注意力分布公平度量(DistFaiR),将不公平性定义为个体随时间累积的关注分布与相关性分布之间的差异。这使得公平性度量在测试时更具可靠性。其次,我们证明对于一类有用的散度度量,群体公平性被个体公平性所上界,并实验表明通过整数线性规划优化个体公平通常也利于群体公平。最后,我们发现先前的摊销公平排序研究忽略了查询极性的重要信息,可能导致实践中出现‘公平伪装’风险,即排序看似公平,实则不然。

原文摘要 · Abstract (English)

Machine learning-driven rankings, where individuals (or items) are ranked in response to a query, mediate search exposure or attention in a variety of safety-critical settings. Thus, it is important to ensure that such rankings are fair. Under the goal of equal opportunity, attention allocated to an individual on a ranking interface should be proportional to their relevance across search queries. In this work, we examine amortized fair ranking -- where relevance and attention are cumulated over a sequence of user queries to make fair ranking more feasible in practice. Unlike prior methods that operate on expected amortized attention for each individual, we define new divergence-based measures for attention distribution-based fairness in ranking (DistFaiR), characterizing unfairness as the divergence between the distribution of attention and relevance corresponding to an individual over time. This allows us to propose new definitions of unfairness, which are more reliable at test time. Second, we prove that group fairness is upper-bounded by individual fairness under this definition for a useful class of divergence measures, and experimentally show that maximizing individual fairness through an integer linear programming-based optimization is often beneficial to group fairness. Lastly, we find that prior research in amortized fair ranking ignores critical information about queries, potentially leading to a fairwashing risk in practice by making rankings appear more fair than they actually are.

公平排序注意力分布查询极性算法公平

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。