arXiv:2511.16073cs.LGcs.AI2025-11

用强化学习设计奖励函数,让小模型更像人一样评估简历。

Mathematical Framework for Custom Reward Functions in Job Application Evaluation using Reinforcement Learning

  • 两阶段微调:先监督训练,再用GRPO优化奖励函数。
  • 测试准确率91%,筛选合格候选人召回率达85%、精确率100%。
  • 解决奖励滥用问题,适合想改进招聘系统的开发者使用。

传统求职者追踪系统(ATS)依赖关键词严格匹配,常因细微语义差异误筛高适配候选人。本文提出基于参数少于600M的小语言模型的两阶段简历评估系统:第一阶段为监督微调(SFT),使模型超越关键词表层匹配;第二阶段采用GRPO进行强化学习优化,引入多组件奖励函数,避免单纯依赖词汇匹配。初始实验发现奖励滥用导致训练不稳,通过反复调试奖励机制与超参数,实现稳定可控的渐进优化。最终模型在未见数据上达到91%准确率,对“入选”类别的召回率为0.85,精确率为1.0,展现出极高的可靠性。结果表明,合理设计的两步微调流程可有效将小模型转化为类人化候选评估工具,克服传统ATS和未经调优的强化学习的局限。

原文摘要 · Abstract (English)

Most of the traditional Applicant Tracking Systems (ATS) depend on strict matching using keywords, where candidates that are highly qualified are many times disqualified because of minor semantic differences. In this article, the two-stage process of developing a more comprehensive resume assessment system based on a small language model that is trained with fewer than 600M parameters is introduced and fine-tuned by using GRPO with a uniquely designed reward function. The initial stage is Supervised Fine-Tuning (SFT), which is used to create a strong base model with the ability to perceive resumes beyond superficial overlap of keywords. This SFT model is further optimized in the second step with Reinforcement Learning (RL) via GRPO with the help of multi-component-based rewarding, which will not be considered as a commission of tokens matching. In the initial RL experiments, we found a severe difficulty in the shape of reward hacking: overly aggressive penalty terms resulted in unstable training dynamics and prohibitively negative model behavior. This was solved by trial-and-error refinement of the reward and careful training hyperparameter tuning, which led to a stable and controlled process of gentle polishing. The GRPO-refined model shows high real-life performance, as it shows an accuracy of 91% on unseen data used for testing. It has a high recall of 0.85 on the SELECTED class with a perfect precision of 1.0, which highlights its high reliability for identifying qualified applicants. These findings demonstrate that an appropriately structured two-step fine-tuning pipeline can effectively be used to transfer a small language model into human-like candidate evaluation, surpassing the shortcomings of both traditional ATS systems and unrefined uses of reinforcement learning.

简历评估强化学习小模型GRPO

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。