arXiv:2502.09319cs.IRcs.LG2025-02ICLR被引 5

提出FairDual算法,有效缓解推荐系统中群体公平优化的偏差问题。

Bridging Jensen Gap for Max-Min Group Fairness Optimization in Recommendation

  • 将群体最大最小公平重构为加权优化,通过双重优化缩小偏差
  • 在小批量采样下实现次线性收敛,理论证明偏差可被有效控制
  • 适用于追求高公平性的推荐系统,尤其适合资源受限场景

群体最大最小公平(MMF)常用于公平感知推荐系统作为优化目标,旨在保护边缘化物品组并确保公平竞争。然而,我们的理论分析表明,引入MMF约束会破坏优化中的样本独立性假设,导致损失函数偏离线性可加性,从而在小批量采样下产生Jensen差距。理论与实证研究均显示,当小批量大小减小且群体规模增大时,该差距会加剧。现有采用启发式重加权或去偏策略的方法要么缺乏理论保证,要么计算开销过大。为此,我们首次理论上证明MMF约束目标可等价重构为分组加权优化目标,并提出高效算法FairDual,利用双重优化技术最小化Jensen差距。理论分析表明,FairDual可在随机打乱的小批量采样下实现次线性收敛率,且Jensen差距可被良好界定。在三个公开数据集上,使用六种大规模推荐模型的大量实验表明,FairDual在准确率和公平性上均优于所有基线方法。代码与数据已开源。

原文摘要 · Abstract (English)

Group max-min fairness (MMF) is commonly used in fairness-aware recommender systems (RS) as an optimization objective, as it aims to protect marginalized item groups and ensures a fair competition platform. However, our theoretical analysis indicates that integrating MMF constraint violates the assumption of sample independence during optimization, causing the loss function to deviate from linear additivity. Such nonlinearity property introduces the Jensen gap between the model's convergence point and the optimal point if mini-batch sampling is applied. Both theoretical and empirical studies show that as the mini-batch size decreases and the group size increases, the Jensen gap will widen accordingly. Some methods using heuristic re-weighting or debiasing strategies have the potential to bridge the Jensen gap. However, they either lack theoretical guarantees or suffer from heavy computational costs. To overcome these limitations, we first theoretically demonstrate that the MMF-constrained objective can be essentially reformulated as a group-weighted optimization objective. Then we present an efficient and effective algorithm named FairDual, which utilizes a dual optimization technique to minimize the Jensen gap. Our theoretical analysis demonstrates that FairDual can achieve a sub-linear convergence rate to the globally optimal solution and the Jensen gap can be well bounded under a mini-batch sampling strategy with random shuffle. Extensive experiments conducted using six large-scale RS backbone models on three publicly available datasets demonstrate that FairDual outperforms all baselines in terms of both accuracy and fairness. Our data and codes are shared at https://github.com/XuChen0427/FairDual.

推荐系统公平性优化双优化小批量偏差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。