arXiv:2510.23066cs.IR2025-10被引 1

用分阶段方法高效提取扫描财务文档中的结构化信息。

Multi-Stage Field Extraction of Financial Documents with OCR and Compact Vision-Language Models

  • 先图像预处理再分段提取,结合OCR与轻量视觉语言模型
  • 字段级准确率提升8.8倍,显存消耗仅大型模型的0.7%
  • 适合处理多语言、长篇幅、低质量扫描件的金融文档

财务文档是监管机构、审计师和金融机构评估中小企业财富与合规性的关键信息源。然而,中小企业文档通常非数字原生,多为低分辨率扫描件,存在倾斜、旋转和背景噪声问题,且内容异构,混合叙述、表格、图表及多语言信息。这给自动化信息抽取带来挑战,尤其是依赖端到端大视觉语言模型时,计算成本高、对噪声敏感、处理百页文档速度慢。本文提出多阶段流水线:先进行图像分割、方向检测与尺寸归一化预处理;再应用多语言OCR恢复页面文本;根据文本分析定位连贯章节;最后在缩小范围内使用轻量级视觉语言模型提取结构化财务指标。在内部多语言扫描财务文档数据集上评估,该方法相较直接输入整份文档至大模型,字段级准确率提升8.8倍,仅需0.7%的GPU资源,端到端服务延迟降低92.6%。

原文摘要 · Abstract (English)

Financial documents are essential sources of information for regulators, auditors, and financial institutions, particularly for assessing the wealth and compliance of Small and Medium-sized Businesses. However, SMB documents are often difficult to parse. They are rarely born digital and instead are distributed as scanned images that are none machine readable. The scans themselves are low in resolution, affected by skew or rotation, and often contain noisy backgrounds. These documents also tend to be heterogeneous, mixing narratives, tables, figures, and multilingual content within the same report. Such characteristics pose major challenges for automated information extraction, especially when relying on end to end large Vision Language Models, which are computationally expensive, sensitive to noise, and slow when applied to files with hundreds of pages. We propose a multistage pipeline that leverages traditional image processing models and OCR extraction, together with compact VLMs for structured field extraction of large-scale financial documents. Our approach begins with image pre-processing, including segmentation, orientation detection, and size normalization. Multilingual OCR is then applied to recover page-level text. Upon analyzing the text information, pages are retrieved for coherent sections. Finally, compact VLMs are operated within these narrowed-down scopes to extract structured financial indicators. Our approach is evaluated using an internal corpus of multi-lingual, scanned financial documents. The results demonstrate that compact VLMs, together with a multistage pipeline, achieves 8.8 times higher field level accuracy relative to directly feeding the whole document into large VLMs, only at 0.7 percent of the GPU cost and 92.6 percent less end-to-end service latency.

文档理解轻量模型财务分析OCR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。