用粗到精框架自动检查文档中表格数值一致性,提升准确率与效率。
Document-Level Tabular Numerical Cross-Checking: A Coarse-to-Fine Approach
- 先用嵌入过滤候选对,再用专用大模型细查,分步解决计算爆炸和语义理解难题。
- 在三类真实披露文档上,准确率显著超越现有方法,且推理速度快。
- 无需人工标注,通过跨表数值相等关系自学习,适合金融、财报等场景使用。
披露文档中表格间数值的一致性对确保准确性、维护信誉及避免声誉与经济风险至关重要。自动化表格数值交叉检查面临两大挑战:(C1) 文档层面候选实例的组合爆炸问题;(C2) 多维度数值语义的理解。以往研究多依赖启发式过滤或简化上下文提取,难以兼顾性能与效率。近期大型语言模型(LLMs)展现出出色的上下文理解能力,有助于解决实例级的语义理解问题(C2),但受限于计算效率(C1)和领域知识不足。本文提出CoFiTCheck,一种基于大模型的粗到精框架,通过两个阶段依次应对:嵌入式过滤与判别分类。嵌入式过滤阶段引入指令并行编码方法,高效表示表格中所有数值提及,并采用解耦InfoNCE目标缓解孤立提及问题。判别分类阶段使用专用大模型对剩余候选对进行细粒度分析,进一步通过跨表数值对齐预训练范式,利用跨表数值相等关系的弱监督增强任务特定先验,无需人工标注。在三类真实披露文档上的综合评估表明,CoFiTCheck显著优于现有方法,同时保持实际效率。
原文摘要 · Abstract (English)
Numerical consistency across tables in disclosure documents is critical for ensuring accuracy, maintaining credibility, and avoiding reputational and economic risks. Automated tabular numerical cross-checking presents two significant challenges: (C1) managing the combinatorial explosion of candidate instances at the document level and (C2) comprehending multi-faceted numerical semantics. Previous research typically depends on heuristic-based filtering or simplified context extraction, often struggling to balance performance and efficiency. Recently, large language models (LLMs) have demonstrated remarkable contextual understanding capabilities that helps address C2 at the instance level, yet they remain hampered by computational inefficiency (C1) and limited domain expertise. This paper introduces CoFiTCheck, a novel LLM-based coarse-to-fine framework that addresses these challenges through two sequential stages: embedding-based filtering and discriminative classification. The embedding-based filtering stage introduces an instructional parallel encoding method to efficiently represent all numerical mentions in a table with LLMs, as well as a decoupled InfoNCE objective to mitigate the isolated mention problem. The discriminative classification stage employs a specialized LLM for fine-grained analysis of the remaining candidate pairs. This stage is further enhanced by our crosstable numerical alignment pretraining paradigm, which leverages weak supervision from cross-table numerical equality relationships to enrich task-specific priors without requiring manual annotation. Comprehensive evaluation across three types of real-world disclosure documents demonstrates that CoFiTCheck significantly outperforms previous methods while maintaining practical efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。