arXiv:2604.13055cs.CLcs.AI2026-04被引 1

首个面向职场AI的开源评测框架,解决研究碎片化问题。

WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain

论文配图:WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain
图 1 · 摘自论文原文
  • 构建13项职场任务的统一评测体系,涵盖招聘与技能推荐
  • 支持多语言评估,动态加载多语种职业术语库
  • 社区驱动设计,适合学术界、企业及公共机构协作使用

当前劳动力市场日益依赖推荐系统进行招聘、人才管理与人力分析,自然语言处理技术为核心支撑。然而该领域研究高度碎片化:研究采用不同的职业分类体系(如ESCO、O*NET、国家分类标准)、任务定义不一、模型类型多样,导致跨研究比较和复现极为困难。通用基准缺乏对职场特定任务的覆盖,且就业数据敏感性限制了公开评测。本文提出首个开源、社区共建的职场领域AI评测基准——WorkRB(Work Research Benchmark)。WorkRB将来自7个任务类别的13项任务整合为统一的推荐与NLP任务体系,包括职位/技能推荐、候选人推荐、相似项推荐、技能提取与归一化等。通过动态加载多语言术语库,支持单语与跨语言评估。基于学术界、产业界与公共机构的多方协作生态构建,采用模块化设计,支持无缝贡献,并可在不披露敏感数据的前提下集成专有任务。WorkRB已开放源代码,许可协议为Apache 2.0,地址见 https://github.com/techwolf-ai/WorkRB。

原文摘要 · Abstract (English)

Today's evolving labor markets rely increasingly on recommender systems for hiring, talent management, and workforce analytics, with natural language processing (NLP) capabilities at the core. Yet, research in this area remains highly fragmented. Studies employ divergent ontologies (ESCO, O*NET, national taxonomies), heterogeneous task formulations, and diverse model families, making cross-study comparison and reproducibility exceedingly difficult. General-purpose benchmarks lack coverage of work-specific tasks, and the inherent sensitivity of employment data further limits open evaluation. We present \textbf{WorkRB} (Work Research Benchmark), the first open-source, community-driven benchmark tailored to work-domain AI. WorkRB organizes 13 diverse tasks from 7 task groups as unified recommendation and NLP tasks, including job/skill recommendation, candidate recommendation, similar item recommendation, and skill extraction and normalization. WorkRB enables both monolingual and cross-lingual evaluation settings through dynamic loading of multilingual ontologies. Developed within a multi-stakeholder ecosystem of academia, industry, and public institutions, WorkRB has a modular design for seamless contributions and enables integration of proprietary tasks without disclosing sensitive data. WorkRB is available under the Apache 2.0 license at https://github.com/techwolf-ai/WorkRB.

职场AI评测基准推荐系统多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。