arXiv:2603.09677cs.AI2026-03被引 5

构建统一框架,让模型从多模态数据中提取可追溯的结构化知识。

Logics-Parsing-Omni Technical Report

  • 分三阶段解析:整体定位、精细识别、多层推理
  • 实现高阶认知与底层事实严格对齐,支持证据链推理
  • 适用于需要逻辑推理的多模态理解任务

针对多模态解析中任务定义分散与非结构化数据异构的问题,本文提出Omni Parsing框架。该框架建立覆盖文档、图像与音视频流的统一分类体系,引入渐进式解析范式,融合感知与认知。具体包含三个层级:1)整体检测,在时空上精确定位对象或事件,建立感知几何基线;2)细粒度识别,对局部对象执行符号化(如OCR/ASR)与属性提取,完成结构化实体解析;3)多层次解释,从局部语义构建到全局逻辑的推理链。框架的核心优势在于证据锚定机制,强制高阶语义描述与底层事实严格对齐,实现基于证据的逻辑归纳,将非结构化信号转化为可定位、可枚举、可追溯的标准知识。基于此,我们构建了标准化数据集并发布Logics-Parsing-Omni模型,成功将复杂音视频信号转为机器可读结构化知识。实验表明,细粒度感知与高层认知协同提升模型可靠性。为进一步量化评估,我们提出OmniParsingBench。代码、模型与基准已开源:https://github.com/alibaba/Logics-Parsing/tree/master/Logics-Parsing-Omni。

原文摘要 · Abstract (English)

Addressing the challenges of fragmented task definitions and the heterogeneity of unstructured data in multimodal parsing, this paper proposes the Omni Parsing framework. This framework establishes a Unified Taxonomy covering documents, images, and audio-visual streams, introducing a progressive parsing paradigm that bridges perception and cognition. Specifically, the framework integrates three hierarchical levels: 1) Holistic Detection, which achieves precise spatial-temporal grounding of objects or events to establish a geometric baseline for perception; 2) Fine-grained Recognition, which performs symbolization (e.g., OCR/ASR) and attribute extraction on localized objects to complete structured entity parsing; and 3) Multi-level Interpreting, which constructs a reasoning chain from local semantics to global logic. A pivotal advantage of this framework is its evidence anchoring mechanism, which enforces a strict alignment between high-level semantic descriptions and low-level facts. This enables ``evidence-based'' logical induction, transforming unstructured signals into standardized knowledge that is locatable, enumerable, and traceable. Building on this foundation, we constructed a standardized dataset and released the Logics-Parsing-Omni model, which successfully converts complex audio-visual signals into machine-readable structured knowledge. Experiments demonstrate that fine-grained perception and high-level cognition are synergistic, effectively enhancing model reliability. Furthermore, to quantitatively evaluate these capabilities, we introduce OmniParsingBench. Code, models and the benchmark are released at https://github.com/alibaba/Logics-Parsing/tree/master/Logics-Parsing-Omni.

多模态解析逻辑推理知识抽取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。