用统一智能体系统处理文档识别、问答和信息提取任务。
DocClaw: A Unified Agentic System for Intelligent Document Processing

- 设计智能体与文档交互的统一框架,动态调用工具并迭代优化结果。
- 在多个基准上表现接近通用视觉语言模型和专用方法。
- 适合需要跨任务协同的文档自动化场景,如金融、医疗审核。
智能文档处理(IDP)涵盖光学字符识别(OCR)、文档问答(DocQA)和关键信息抽取(KIE)等任务。尽管目标各异,这些任务均需感知文档内容、获取相关知识并逐步优化中间结果。然而,它们通常被建模为独立预测问题,由特定任务的模型或流水线解决。本文提出DocClaw,一个统一的智能体系统,将多样化的智能文档处理任务建模为智能体与文档之间的交互过程。给定文档和任务查询,DocClaw根据任务需求选择相应文档技能,迭代识别所需信息、调用相关工具,并将观察结果整合为最终输出。过程中,结构化文档状态管理可复用的文档知识和任务上下文,支持智能体累积、回溯并逐步精炼信息。该框架共享交互循环、工具空间和文档状态,而任务特定需求由智能体对查询目标和对应文档技能的理解捕获。在多个智能文档处理基准上的实验证明,DocClaw能在单一智能体框架内有效处理多样化任务,性能媲美通用视觉语言模型和专用方法。
原文摘要 · Abstract (English)
Intelligent document processing (IDP) encompasses a broad range of tasks, including optical character recognition (OCR), document question answering (DocQA), and key information extraction (KIE). Despite their distinct objectives, these tasks share a common need to perceive document content, acquire task-relevant information, and progressively refine intermediate results. However, they are typically formulated as separate prediction problems and addressed by task-specific models or processing pipelines. We introduce DocClaw, a unified agentic system that formulates diverse intelligent document processing tasks as a shared process of interaction between an agent and a document. Given a document and a task-specific query, DocClaw follows an appropriate document skill to iteratively identify the information required, invoke relevant tools, and integrate the resulting observations into the desired output. Throughout this process, a structured document state organizes reusable document knowledge and task-specific interaction context, allowing the agent to accumulate, revisit, and progressively refine information as the interaction proceeds. Under this formulation, task-specific requirements are captured by the agent's interpretation of the query objective and the corresponding document skill, while the underlying interaction loop, tool space, and document state are shared across tasks. Extensive experiments across multiple intelligent document processing benchmarks demonstrate that DocClaw effectively handles diverse tasks within a single agentic framework and achieves competitive performance compared with both general-purpose VLMs and task-specific methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。