被忽略的异常岗位文本，反而是新兴职业的早期信号。
Noise is Signal: Density-Based Outliers as Leading Indicators of Occupational Emergence in Labor Market Text
- 用密度异常检测识别潜在新兴职业，发现低密度反而是新岗位标志。
- 高异常分组在1.4个季度内形成稳定集群，远快于普通岗位的4.1个季度。
- 可提前2-3季度预警新兴职业，适合人才规划与政策制定者参考。
主流NLP职业聚类流程会丢弃10%-15%被密度方法标记为噪声的职位信息。我们提出，在快速变化领域中，低发布密度恰恰代表新颖性而非无效信息。为此提出‘涌现-密度倒置’（EDI）假设，并基于84,988份职位招聘信息（2022年Q4至2024年Q3）进行纵向验证。结果部分支持该假设：高异常度（EOS）群体在1.4 ± 0.6个季度内形成稳定聚类，显著快于低EOS群体的4.1 ± 1.2个季度（p < 0.001），但约19%案例未能成功预测。通过引入时间速度与跨平台一致性改进了新兴职业评分（EOS），使2季度内聚类预测的F1值从0.61提升至0.74，优于孤立森林、LOF、GLOSH和BERTrend等基线模型。对三个已确立岗位（MLOps工程师、DevOps/SRE、数据工程师）的回溯研究显示，EOS在聚类形成前2-3个季度即发出信号，提供外部验证。独立标注员评估（kappa = 0.74）表明，当EOS > 0.75时，有77%的准确率判断为合理新兴职业。包括提示工程师、人工智能安全研究员、基础模型工程师和代理系统工程师在内的四项新角色，虽未收录于O*NET，但在2024年Q3位列前四，并于2025年Q1形成稳定聚类。
原文摘要 · Abstract (English)
Standard NLP pipelines for occupational clustering discard the 10-15% of job postings that density-based methods assign to noise. We argue this is an error: in rapidly evolving domains, low posting density signals novelty, not incoherence. We formalize this as the Emergence-Density Inversion (EDI) hypothesis and test it longitudinally on 84,988 job postings across eight quarters (Q4 2022-Q3 2024). EDI is partially confirmed: high-EOS outlier groups transition to stable clusters in 1.4 +/- 0.6 quarters vs. 4.1 +/- 1.2 for low-EOS groups (p < 0.001), though the signal fails in approximately 19% of cases, which we characterize as a failure analysis. We extend the Emerging Occupation Score (EOS) with Temporal Velocity and Cross-Platform Convergence, improving 2-quarter cluster-formation prediction from F1 = 0.61 to 0.74, outperforming Isolation Forest, LOF, GLOSH, and BERTrend baselines. A retrospective study on three now-established roles (MLOps Engineer, DevOps/SRE, Data Engineer) confirms EOS signalled 2-3 quarters before cluster formation, providing held-out validation. A held-out annotator panel (kappa = 0.74) rates EOS > 0.75 as coherent emerging occupations with 77% precision. Prompt Engineer, AI Safety Researcher, Foundation Model Engineer, and Agent Systems Engineer, all absent from O*NET, are top-4 in Q3 2024 and form stable clusters by Q1 2025.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。