用重建验证文档提取结果,确保信息忠实还原。
RaV-IDP: A Reconstruction-as-Validation Framework for Faithful Intelligent Document Processing
- 提取后通过重建回原始区域,用对比分数验证准确性。
- 重建精度低于阈值时触发GPT-4.1重试,错误不被忽略。
- 无需标签,自动检测提取偏差,适合高可靠性场景。
智能文档处理系统从文档中提取表格、图像和文本等结构化实体,用于知识库、检索增强生成和分析等下游任务。现有流程缺乏内在机制验证提取结果是否忠实于原文。模型内部置信度衡量推理确定性,而非与文档的对应关系,导致错误无声传递至下游。本文提出重建即验证(RaV-IDP)框架,将重建作为核心组件:每个实体提取后,专用重构器将其还原为可与原始文档区域对比的形式,比较器计算重建与原始未修改区域间的保真度得分。该得分是基于真实数据的无标签质量信号。当保真度低于每类实体的阈值时,触发结构化GPT-4.1视觉模型重试,验证循环重复进行。我们强制实施启动约束:比较始终锚定在原始文档区域,而非提取结果,防止验证循环。此外,提出分阶段评估框架,为每个组件匹配合适基准。代码已开源,供实验与使用。
原文摘要 · Abstract (English)
Intelligent document processing pipelines extract structured entities (tables, images, and text) from documents for use in downstream systems such as knowledge bases, retrieval-augmented generation, and analytics. A persistent limitation of existing pipelines is that extraction output is produced without any intrinsic mechanism to verify whether it faithfully represents the source. Model-internal confidence scores measure inference certainty, not correspondence to the document, and extraction errors pass silently into downstream consumers. We present Reconstruction as Validation (RaV-IDP), a document processing pipeline that introduces reconstruction as a first-class architectural component. After each entity is extracted, a dedicated reconstructor renders the extracted representation back into a form comparable to the original document region, and a comparator scores fidelity between the reconstruction and the unmodified source crop. This fidelity score is a grounded, label-free quality signal. When fidelity falls below a per-entity-type threshold, a structured GPT-4.1 vision fallback is triggered and the validation loop repeats. We enforce a bootstrap constraint: the comparator always anchors against the original document region, never against the extraction, preventing the validation from becoming circular. We further propose a per-stage evaluation framework pairing each pipeline component with an appropriate benchmark. The code pipeline is publicly available at https://github.com/pritesh-2711/RaV-IDP for experimentation and use.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。