用大模型提升人才表格的语义理解,让问答准确率从0%升到100%。
TalentMine: LLM-Based Extraction and Question-Answering from Multimodal Talent Tables
- 将表格结构与语义融合,避免信息丢失
- 问答准确率达100%,远超传统方法
- 适合需要精准人才数据决策的系统
在人才管理系统中,关键信息常以复杂表格形式存在,传统语言模型难以有效检索。尤其在需精确理解表格关系的员工福利文档中,现有表格提取方法因缺乏语义理解,导致下游问答失败。本文指出核心瓶颈:虽能提取表格结构,但元素间语义关系丢失。为此提出TalentMine框架,利用大模型将提取表格转化为语义增强表示。不同于依赖CSV或文本线性化的常规方法,本方案采用专用多模态推理,同时保留表格的结构与语义。在员工福利文档集上的实验表明,TalentMine在问答任务中达到100%准确率,而标准AWS Textract为0%,AWS Textract Visual Q&A为40%。对比分析显示Claude v3 Haiku模型在人才管理应用中表现最佳。主要贡献包括:(1) 系统分析现有表格提取流程中的语义信息损失;(2) 提出基于大模型的语义增强表格表示方法;(3) 构建端到端可集成的检索增强系统框架;(4) 在人才分析任务上建立全面基准,多类别性能显著提升。
原文摘要 · Abstract (English)
In talent management systems, critical information often resides in complex tabular formats, presenting significant retrieval challenges for conventional language models. These challenges are pronounced when processing Talent documentation that requires precise interpretation of tabular relationships for accurate information retrieval and downstream decision-making. Current table extraction methods struggle with semantic understanding, resulting in poor performance when integrated into retrieval-augmented chat applications. This paper identifies a key bottleneck - while structural table information can be extracted, the semantic relationships between tabular elements are lost, causing downstream query failures. To address this, we introduce TalentMine, a novel LLM-enhanced framework that transforms extracted tables into semantically enriched representations. Unlike conventional approaches relying on CSV or text linearization, our method employs specialized multimodal reasoning to preserve both structural and semantic dimensions of tabular data. Experimental evaluation across employee benefits document collections demonstrates TalentMine's superior performance, achieving 100% accuracy in query answering tasks compared to 0% for standard AWS Textract extraction and 40% for AWS Textract Visual Q&A capabilities. Our comparative analysis also reveals that the Claude v3 Haiku model achieves optimal performance for talent management applications. The key contributions of this work include (1) a systematic analysis of semantic information loss in current table extraction pipelines, (2) a novel LLM-based method for semantically enriched table representation, (3) an efficient integration framework for retrieval-augmented systems as end-to-end systems, and (4) comprehensive benchmarks on talent analytics tasks showing substantial improvements across multiple categories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。