arXiv:2507.13275cs.CLcs.AI2025-07综述被引 14

首个面向人才管理的技能与职位智能评估基准,助力公平高效招聘系统

Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management

  • 构建多语言职位匹配与技能预测任务,基于真实求职数据
  • 跨语言场景下模型表现受训练策略影响大于模型规模
  • 适合研究公平性、多语言NLP及人力资源AI的学者与工程师

自然语言处理与大模型的发展正推动人力资本管理的变革,催生基于语言技术的智能招聘、技能提升与人力资源规划系统。然而,这些技术的落地依赖可靠且公平的模型,以及公开数据与评测基准,而该领域此前尚无此类资源。为此,我们推出TalentCLEF 2025——首个聚焦技能与职位智能的评估竞赛,包含两项任务:任务A为多语言职位匹配(涵盖英语、西班牙语、德语和中文),任务B为英文职位导向的技能预测。两组数据均来自真实求职申请,经匿名化与人工标注,涵盖语言多样性与性别标记表达。评测涵盖单语与跨语言场景,并评估性别偏见。共吸引76支队伍、超过280次提交。多数系统采用微调的多语言编码器结合对比学习的信息检索方法,部分引入大模型进行数据增强或重排序。结果显示,训练策略对性能的影响大于模型大小。TalentCLEF提供了该领域的首个公开基准,推动鲁棒、公平且可迁移的语言技术发展。

原文摘要 · Abstract (English)

Advances in natural language processing and large language models are driving a major transformation in Human Capital Management, with a growing interest in building smart systems based on language technologies for talent acquisition, upskilling strategies, and workforce planning. However, the adoption and progress of these technologies critically depend on the development of reliable and fair models, properly evaluated on public data and open benchmarks, which have so far been unavailable in this domain. To address this gap, we present TalentCLEF 2025, the first evaluation campaign focused on skill and job title intelligence. The lab consists of two tasks: Task A - Multilingual Job Title Matching, covering English, Spanish, German, and Chinese; and Task B - Job Title-Based Skill Prediction, in English. Both corpora were built from real job applications, carefully anonymized, and manually annotated to reflect the complexity and diversity of real-world labor market data, including linguistic variability and gender-marked expressions. The evaluations included monolingual and cross-lingual scenarios and covered the evaluation of gender bias. TalentCLEF attracted 76 registered teams with more than 280 submissions. Most systems relied on information retrieval techniques built with multilingual encoder-based models fine-tuned with contrastive learning, and several of them incorporated large language models for data augmentation or re-ranking. The results show that the training strategies have a larger effect than the size of the model alone. TalentCLEF provides the first public benchmark in this field and encourages the development of robust, fair, and transferable language technologies for the labor market.

人才管理多语言公平性技能预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。