用双票机制防AI简历造假,提升招聘公平与准确
Two Tickets are Better than One: Fair and Accurate Hiring Under Strategic LLM Manipulations
- 提出双票方案:对每份简历生成一份AI改写版,结合原稿综合判断
- 理论证明在零误判前提下,可同时提升公平性与准确率
- 实测验证有效,适合关注招聘公正性的企业或平台使用
随着大模型能力增强,求职者越来越多地使用生成式AI优化简历。然而,对AI工具的获取不均和使用差异,会降低招聘准确性并造成不公平优势。为此,我们提出一种针对大语言模型操纵的新策略分类框架,支持不同程度的操纵与随机结果。引入“双票”机制:招聘算法对每份提交的简历额外生成一个被修改版本,并将原始简历与修改版一并考虑。理论证明,在最大化真正例率且无假阳性约束下,该机制能同时提升公平性与准确性。进一步推广至n票机制,证明招聘结果将收敛至与群体无关的固定决策,消除因LLM使用差异带来的不平等。最后,通过开源简历筛选工具在真实简历上进行实证验证,确认双票方案的有效性。
原文摘要 · Abstract (English)
In an era of increasingly capable foundation models, job seekers are turning to generative AI tools to enhance their application materials. However, unequal access to and knowledge about generative AI tools can harm both employers and candidates by reducing the accuracy of hiring decisions and giving some candidates an unfair advantage. To address these challenges, we introduce a new variant of the strategic classification framework tailored to manipulations performed using large language models, accommodating varying levels of manipulations and stochastic outcomes. We propose a ``two-ticket'' scheme, where the hiring algorithm applies an additional manipulation to each submitted resume and considers this manipulated version together with the original submitted resume. We establish theoretical guarantees for this scheme, showing improvements for both the fairness and accuracy of hiring decisions when the true positive rate is maximized subject to a no false positives constraint. We further generalize this approach to an $n$-ticket scheme and prove that hiring outcomes converge to a fixed, group-independent decision, eliminating disparities arising from differential LLM access. Finally, we empirically validate our framework and the performance of our two-ticket scheme on real resumes using an open-source resume screening tool.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。