用嵌入对齐技术打通德国职业分类体系,实现跨源职业数据智能匹配。
Ontology-Aligned Embeddings for Data-Driven Labour Market Analytics
- 通过微调Sentence-BERT模型,将自由格式德语职位名称映射到两个职业分类体系中。
- 构建相似性图结构后,实现高效近似最近邻搜索,支持灵活扩展新类别。
- 适用于劳动市场分析、职位推荐等场景,尤其适合多源异构职业数据整合。
跨不同来源的职业数据难以推理,是数据驱动劳动力市场分析的长期瓶颈。以往研究依赖人工设计的本体,虽能支持推理但计算成本高且需专家维护。语言处理类机器学习模型提供了可扩展替代方案,可通过学习共享语义空间,在无需大量人工干预的情况下弥合多样职业词汇差异。本文提出一种基于嵌入的对齐方法,将任意自由格式的德语职位名称关联至两个权威本体:德国职业分类(Klassifikation der Berufe)和国际教育分类(International Standard Classification of Education)。利用德国联邦就业局公开数据,我们构建数据集以微调Sentence-BERT模型,学习本体所施加的结构。由此生成的(职位名称, 嵌入)对构成相似性图结构,可用于高效近似最近邻搜索,将分类任务转化为语义搜索问题。该方法具备更高灵活性,例如可轻松添加新类别。我们讨论了设计决策、开放挑战,并规划未来工作:将图结构扩展至其他本体及多语言职位标题。
原文摘要 · Abstract (English)
The limited ability to reason across occupational data from different sources is a long-standing bottleneck for data-driven labour market analytics. Previous research has relied on hand-crafted ontologies that allow such reasoning but are computationally expensive and require careful maintenance by human experts. The rise of language processing machine learning models offers a scalable alternative by learning shared semantic spaces that bridge diverse occupational vocabularies without extensive human curation. We present an embedding-based alignment process that links any free-form German job title to two established ontologies - the German Klassifikation der Berufe and the International Standard Classification of Education. Using publicly available data from the German Federal Employment Agency, we construct a dataset to fine-tune a Sentence-BERT model to learn the structure imposed by the ontologies. The enriched pairs (job title, embedding) define a similarity graph structure that we can use for efficient approximate nearest-neighbour search, allowing us to frame the classification process as a semantic search problem. This allows for greater flexibility, e.g., adding more classes. We discuss design decisions, open challenges, and outline ongoing work on extending the graph with other ontologies and multilingual titles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。