用图神经网络和混合密度模型,预测薪资分布而非单一数值。
Probabilistic Salary Prediction with Graph Attention Networks and a Mixture Density Network

- 构建岗位属性图,融合层级与语义相似性关系
- 在百万级荷兰职位数据上,NLL和MSE均显著更优
- 适合需评估薪资不确定性的招聘或求职场景
准确的薪资预测对弥合现代劳动力市场中雇主与求职者间的信息鸿沟至关重要。现有方法多给出单一数值估计,并将地理位置、职业、行业等属性视为独立类别特征,忽略了真实薪酬数据的固有不确定性与多模态特性,以及影响薪酬规范的丰富层次结构与语义相似关系。本文提出GAT-MDN统一框架,同时解决上述问题。针对三类属性分别构建领域特定图,边编码(i)层级包含关系与(ii)基于预训练Sentence-Transformer的加权语义相似度。并行的图注意力网络(GATs)结合边特征注意力,从多关系图中学习上下文敏感的节点表示。优先级驱动的层次选择模块整合复合特征向量,有效处理缺失或粗粒度属性;混合密度网络(MDN)头将该向量映射为高斯混合模型(GMM)参数,输出完整的条件薪资分布。在超过100万条记录的真实荷兰职位数据集上进行大量实验表明,GAT-MDN在负对数似然(NLL)和均方误差(MSE)上均显著优于非图基的MLP-MDN基线。
原文摘要 · Abstract (English)
Accurate salary prediction is critical for bridging the information gap between employers and job seekers in modern labor markets. Existing approaches predominantly yield a single point estimate and treat job attributes such as location, occupation, and industry as independent categorical features, ignoring both the inherent uncertainty and multi-modality of real-world compensation data and the rich hierarchical and semantic-similarity relationships that govern pay norms. In this paper we propose GAT-MDN, a unified framework that addresses both limitations simultaneously. For each of the three attribute domains we construct a domain-specific graph whose edges encode (i) hierarchical parent-child containment and (ii) weighted similarity links derived from a pre-trained Sentence-Transformer. Parallel Graph Attention Networks (GATs) with edge-feature-aware attention learn rich, context-sensitive node representations from these multi-relational graphs. A priority-based hierarchical selection module then assembles a composite feature vector that gracefully handles missing or coarse attributes, and a Mixture Density Network (MDN) head maps this vector to the parameters of a Gaussian Mixture Model (GMM), yielding a full conditional salary distribution. Extensive experiments on a real-world Dutch job-posting dataset of over 1 million records demonstrate that GAT-MDN significantly outperforms a non-graph MLP-MDN baseline in both Negative Log-Likelihood (NLL) and Mean Squared Error (MSE).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。