用大模型提升人才推荐效果,解决位置偏见和重复计算问题
Towards Position-Robust Talent Recommendation via Large Language Models
- 采用列表式推荐框架,通过块注意力机制提升候选人间关系建模
- 在两个真实数据集上显著优于基线,减少token消耗并改善推荐质量
- 适合需要高精度人才匹配的招聘系统开发者参考
人才招聘是许多行业的关键环节,但成本高昂且周期长。现有推荐系统虽逐渐采用大语言模型(LLMs)以利用其强大的语言理解能力,但多数方法仍沿用逐点(pointwise)范式,需反复处理文本,无法捕捉候选人列表中的相互关系,导致更高的token消耗与次优推荐结果。此外,LLMs在多选题回答或多文档处理中存在位置偏差和中间信息丢失问题。为此,本文提出L3TR框架,通过隐式策略利用大模型输出潜力,引入块注意力机制与局部位置编码,增强文档间交互建模,缓解位置偏差与并发token偏差。设计了候选集大小不一致下的ID采样方法,并开发评估与无训练去偏方法。在两个真实数据集上的大量实验验证了该方法的有效性,持续优于现有基线。
原文摘要 · Abstract (English)
Talent recruitment is a critical, yet costly process for many industries, with high recruitment costs and long hiring cycles. Existing talent recommendation systems increasingly adopt large language models (LLMs) due to their remarkable language understanding capabilities. However, most prior approaches follow a pointwise paradigm, which requires LLMs to repeatedly process some text and fails to capture the relationships among candidates in the list, resulting in higher token consumption and suboptimal recommendations. Besides, LLMs exhibit position bias and the lost-in-the-middle issue when answering multiple-choice questions and processing multiple long documents. To address these issues, we introduce an implicit strategy to utilize LLM's potential output for the recommendation task and propose L3TR, a novel framework for listwise talent recommendation with LLMs. In this framework, we propose a block attention mechanism and a local positional encoding method to enhance inter-document processing and mitigate the position bias and concurrent token bias issue. We also introduce an ID sampling method for resolving the inconsistency between candidate set sizes in the training phase and the inference phase. We design evaluation methods to detect position bias and token bias and training-free debiasing methods. Extensive experiments on two real-world datasets validated the effectiveness of L3TR, showing consistent improvements over existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。