首个大规模开源表单字段检测数据集，支持多语言和多种字段类型。
CommonForms: A Large, Diverse Dataset for Form Field Detection
- 将表单字段检测视为目标检测任务，用图像定位并分类字段类型。
- 含45万页、5.5万文档，覆盖14个领域，非英文内容占三分之一。
- 模型训练成本低于500美元，可识别复选框等复杂字段，优于商用工具。
本文提出CommonForms，一个面向表单字段检测的网络规模数据集。将该问题建模为对象检测：给定页面图像，预测字段位置与类型（文本输入、选择按钮、签名）。通过筛选Common Crawl中的可填写PDF文档构建数据集，初始800万份文档经过滤后保留约5.5万份，涵盖超45万页。分析显示数据集具有丰富的语言与领域多样性：三分之一页面非英文，14个分类领域中无一超过25%。本文还提出FFDNet-Small与FFDNet-Large两套检测模型，在CommonForms测试集上表现优异，训练成本均低于500美元。消融实验表明高分辨率输入对检测质量至关重要，清洗流程显著提升数据效率。定性分析显示其性能优于主流商用PDF阅读器，且首次实现对复选框的准确识别。这是首个公开发布的大型表单字段检测数据集及开源模型，相关数据、模型与代码将发布于https://github.com/jbarrow/commonforms。
原文摘要 · Abstract (English)
This paper introduces CommonForms, a web-scale dataset for form field detection. It casts the problem of form field detection as object detection: given an image of a page, predict the location and type (Text Input, Choice Button, Signature) of form fields. The dataset is constructed by filtering Common Crawl to find PDFs that have fillable elements. Starting with 8 million documents, the filtering process is used to arrive at a final dataset of roughly 55k documents that have over 450k pages. Analysis shows that the dataset contains a diverse mixture of languages and domains; one third of the pages are non-English, and among the 14 classified domains, no domain makes up more than 25% of the dataset. In addition, this paper presents a family of form field detectors, FFDNet-Small and FFDNet-Large, which attain a very high average precision on the CommonForms test set. Each model cost less than $500 to train. Ablation results show that high-resolution inputs are crucial for high-quality form field detection, and that the cleaning process improves data efficiency over using all PDFs that have fillable fields in Common Crawl. A qualitative analysis shows that they outperform a popular, commercially available PDF reader that can prepare forms. Unlike the most popular commercially available solutions, FFDNet can predict checkboxes in addition to text and signature fields. This is, to our knowledge, the first large scale dataset released for form field detection, as well as the first open source models. The dataset, models, and code will be released at https://github.com/jbarrow/commonforms
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。