arXiv:2607.24745cs.IRcs.AI2026-07

用AI自动标注文档信息,大幅提升数据集构建效率。

DocAnnot -- Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation

  • 结合视觉大模型与空间位置分析,智能匹配标签与值
  • 在CORD和SROIE上生成标注的F1分别达0.679和0.846
  • 适合需要快速构建数据集的研究者和资源有限团队

关键信息提取(KIE)对文档应用至关重要,但传统数据集构建依赖耗时的人工标注。本文提出DocAnnot框架,利用大视觉语言模型提取标签值,结合OCR检测文本与边界框,并引入新颖的时空上下文匹配(SICM)算法,通过空间关系、邻近性分析与文本匹配提升标签-值关联准确率。在CORD和SROIE基准上评估,自动标注的F1得分分别为0.679和0.846。进一步实验表明,仅用自动生成数据微调的下游模型也表现可观(如LayoutLMv3在CORD上达到F1=0.6765)。结果表明,该框架虽仍需人工校验,但显著降低人工投入,使高质量标注效率远超从零开始的人工标注,适用于资源受限场景与快速原型开发。

原文摘要 · Abstract (English)

Key Information Extraction (KIE) is vital for many document applications, but creating training datasets is traditionally a time-consuming manual process. We introduce DocAnnot, a framework that significantly accelerates KIE dataset generation. DocAnnot leverages a Large Vision Language Model (LVLM) for label value extraction, OCR for text/bounding box detection, and a novel Spatially Informed Contextual Matching (SICM) algorithm. SICM improves label-value association by combining spatial relationships and proximity analysis with textual matching. We evaluate our framework on the CORD and SROIE benchmarks, demonstrating its ability to auto-generate annotations with F1-scores of 0.679 and 0.846, respectively. Furthermore, we investigate the effectiveness of using auto-annotated data for fine-tuning downstream KIE models. While human-annotated data remains superior, models trained exclusively on DocAnnot's outputs attain respectable performance (e.g., LayoutLMv3 achieving an F1-score of 0.6765 on CORD). These results show that while our framework significantly reduces reliance on manual effort, it does not yet fully eliminate the need for human intervention. However, by automating the process to a point where reviewers can efficiently refine outputs, our system enables near-perfect annotations with much greater efficiency than manual annotation from scratch. This approach offers substantial time and cost savings, making it valuable for resource-constrained settings and rapid model prototyping.

信息提取自动标注视觉模型数据生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。