测试ChatGPT在薪资谈判建议中的偏见,发现性别、学校等属性影响报价,模型表现不一致。
Asking an AI for salary negotiation advice is a matter of concern: Controlled experimental perturbation of ChatGPT for protected and non-protected group discrimination on a contextual task with no clear ground truth answers
- 系统测试4版ChatGPT对不同性别、学校、专业的薪资建议
- 性别差异导致报价显著不同,学校和专业也引发大偏差
- 适用于关注AI公平性与职场决策风险的研究者与从业者
我们对四个版本的ChatGPT进行了受控实验偏见审计,要求其为新员工推荐薪资谈判起始报价。共发送98,800条提示,系统性地改变员工性别、大学和专业,并以雇员与雇主双重视角提问。结果显示,所有四款模型在性别变化下均出现统计显著的报价差异,尽管幅度小于其他属性;最大差距出现在不同模型版本之间及雇员/雇主视角间。大学和专业变化也引发显著偏差,但结果在各版本间不一致。测试虚构或虚假大学时,结果差异巨大。本研究挑战主流AI公平性评估范式,聚焦非受保护类别(如大学、专业)与无明确真值的上下文任务,揭示模型在动态发展平台中难以信赖。虽无法断言模型普遍有偏,但研究结果对利益相关方提出重要警示。
原文摘要 · Abstract (English)
We conducted controlled experimental bias audits for four versions of ChatGPT, which we asked to recommend an opening offer in salary negotiations for a new hire. We submitted 98,800 prompts to each version, systematically varying the employee's gender, university, and major, and tested prompts in voice of each side of the negotiation: the employee versus employer. We find ChatGPT as a multi-model platform is not robust and consistent enough to be trusted for such a task. We observed statistically significant salary offers when varying gender for all four models, although with smaller gaps than for other attributes tested. The largest gaps were different model versions and between the employee- vs employer-voiced prompts. We also observed substantial gaps when varying university and major, but many of the biases were not consistent across model versions. We tested for fictional and fraudulent universities and found wildly inconsistent results across cases and model versions. We make broader contributions to the AI/ML fairness literature. Our scenario and our experimental design differ from mainstream AI/ML auditing efforts in key ways. Bias audits typically test discrimination for protected classes like gender, which we contrast with testing non-protected classes of university and major. Asking for negotiation advice includes how aggressive one ought to be in a negotiation relative to known empirical salary distributions and scales, which is a deeply contextual and personalized task that has no objective ground truth to validate. These results raise concerns for the specific model versions we tested and ChatGPT as a multi-model platform in continuous development. Our epistemology does not permit us to definitively certify these models as either generally biased or unbiased on the attributes we test, but our study raises matters of concern for stakeholders to further investigate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。