一个模型实现任意公平性-准确率权衡,推理时灵活调整。
You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Time
- 通过构建权重空间中的最优路径线,单次训练即可支持多级权衡。
- 在真实数据集上实现100种权衡配置仅需3.53秒,远快于训练百个模型。
- 适合对公平性要求不同的场景,如法律、医疗等高风险应用。
深度神经网络易受各种偏差影响,威胁其在高风险决策中的应用。现有公平性方法通常提供固定的准确率-公平性权衡,因为训练好的模型权重是权重空间中的固定点(公平性最优)。然而,实际应用中更希望在推理阶段实现灵活的权衡,原因有二:一是同一下游任务对不同个体的风险程度不同;二是不同地区对公平性的法规或正则化要求各异。若使用传统方法,需为每种权衡训练多个模型,这不仅计算成本高、耗时长,且难以部署。为此,本文提出 You Only Debias Once (YODO),仅需一次训练即可在推理时实现灵活的准确率-公平性权衡。不同于寻找单一固定点(公平性最优),我们旨在用单个模型找到连接准确率最优与公平性最优两点的“线”。该线上任意点均可实现不同级别的权衡。推理时手动选择位置,即可适配不同用户与场景。在表格和图像数据集上的实验表明,YODO在极低开销下实现了灵活的权衡。例如,在 exttt{ACSE} 数据集上实现100种权衡仅需3.53秒,而训练100个固定模型需425秒。代码已公开于 https://github.com/ahxt/yodo。
原文摘要 · Abstract (English)
Deep neural networks are prone to various bias issues, jeopardizing their applications for high-stake decision-making. Existing fairness methods typically offer a fixed accuracy-fairness trade-off, since the weight of the well-trained model is a fixed point (fairness-optimum) in the weight space. Nevertheless, more flexible accuracy-fairness trade-offs at inference time are practically desired since: 1) stakes of the same downstream task can vary for different individuals, and 2) different regions have diverse laws or regularization for fairness. If using the previous fairness methods, we have to train multiple models, each offering a specific level of accuracy-fairness trade-off. This is often computationally expensive, time-consuming, and difficult to deploy, making it less practical for real-world applications. To address this problem, we propose You Only Debias Once (YODO) to achieve in-situ flexible accuracy-fairness trade-offs at inference time, using a single model that trained only once. Instead of pursuing one individual fixed point (fairness-optimum) in the weight space, we aim to find a "line" in the weight space that connects the accuracy-optimum and fairness-optimum points using a single model. Points (models) on this line implement varying levels of accuracy-fairness trade-offs. At inference time, by manually selecting the specific position of the learned "line", our proposed method can achieve arbitrary accuracy-fairness trade-offs for different end-users and scenarios. Experimental results on tabular and image datasets show that YODO achieves flexible trade-offs between model accuracy and fairness, at ultra-low overheads. For example, if we need $100$ levels of trade-off on the \acse dataset, YODO takes $3.53$ seconds while training $100$ fixed models consumes $425$ seconds. The code is available at https://github.com/ahxt/yodo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。