用真人打分对比AI招聘工具，发现自研系统表现最佳。
Evaluating AI Recruitment Sourcing Tools by Human Preference
- 用真人专家评分+爱洛评级，量化比较多个AI招聘工具
- 自研系统Pearch.ai在候选人相关性上领先LinkedIn Recruiter
- AI评估结果与人工判断高度一致，适合招聘团队参考
本研究提出一种评估AI招聘搜寻工具性能的基准方法。我们构建并使用了一个数据集，对主流AI解决方案、LinkedIn Recruiter及自研系统Pearch.ai生成的搜索结果进行对比分析。由人类专家评估返回候选人的相关性，并采用爱洛（Elo）评分系统定量衡量各工具的表现。结果表明，基于AI的招聘工具在候选人相关性上持续优于LinkedIn Recruiter，其中Pearch.ai得分最高。此外，我们发现AI评估结果与人工判断具有强一致性，表明先进AI技术可显著提升人才获取效率。代码与支持数据已公开于https://github.com/vslaykovsky/ai-sourcing-benchmark。
原文摘要 · Abstract (English)
This study introduces a benchmarking methodology designed to evaluate the performance of AI-driven recruitment sourcing tools. We created and utilized a dataset to perform a comparative analysis of search results generated by leading AI-based solutions, LinkedIn Recruiter, and our proprietary system, Pearch.ai. Human experts assessed the relevance of the returned candidates, and an Elo rating system was applied to quantitatively measure each tool's comparative performance. Our findings indicate that AI-driven recruitment sourcing tools consistently outperform LinkedIn Recruiter in candidate relevance, with Pearch.ai achieving the highest performance scores. Furthermore, we found a strong alignment between AI-based evaluations and human judgments, highlighting the potential for advanced AI technologies to substantially enhance talent acquisition effectiveness. Code and supporting data are publicly available at https://github.com/vslaykovsky/ai-sourcing-benchmark
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。