解析复杂表单信息，提升文档智能理解能力
VRD-IU: Lessons from Visually Rich Document Intelligence and Understanding
- 采用分层分解与多模态融合，精准提取表单关键信息
- 在Form-NLU数据集上实现新基准，实体识别准确率显著提升
- 适合从事文档智能、表单识别研究的开发者参考
视觉丰富文档理解（VRDU）已成为文档智能中的关键领域，能够自动从医疗、金融、教育等复杂文档中提取关键信息。然而，表单类文档因布局复杂、多方参与及结构高度变异而带来独特挑战。为此，提出了VRD-IU竞赛，聚焦于Form-NLU数据集中的多格式表单（含数字、印刷和手写文档），进行关键信息抽取与定位。竞赛设两个赛道：Track A关注基于实体的关键信息检索，Track B则面向从原始文档图像中端到端定位信息。超过20支队伍参与，展示了包括层次化分解、基于Transformer的检索、多模态特征融合及先进目标检测在内的多种前沿方法。顶尖模型在VRDU任务上建立了新基准，为文档智能发展提供了重要洞见。
原文摘要 · Abstract (English)
Visually Rich Document Understanding (VRDU) has emerged as a critical field in document intelligence, enabling automated extraction of key information from complex documents across domains such as medical, financial, and educational applications. However, form-like documents pose unique challenges due to their complex layouts, multi-stakeholder involvement, and high structural variability. Addressing these issues, the VRD-IU Competition was introduced, focusing on extracting and localizing key information from multi-format forms within the Form-NLU dataset, which includes digital, printed, and handwritten documents. This paper presents insights from the competition, which featured two tracks: Track A, emphasizing entity-based key information retrieval, and Track B, targeting end-to-end key information localization from raw document images. With over 20 participating teams, the competition showcased various state-of-the-art methodologies, including hierarchical decomposition, transformer-based retrieval, multimodal feature fusion, and advanced object detection techniques. The top-performing models set new benchmarks in VRDU, providing valuable insights into document intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。