arXiv:2604.00270cs.CV2026-04被引 2

首个面向电路图理解的多模态基准,评测大模型对原理图的结构化解析能力

OmniSch: A Multimodal PCB Schematic Benchmark For Structured Diagram Visual Reasoning

论文配图:OmniSch: A Multimodal PCB Schematic Benchmark For Structured Diagram Visual Reasoning
图 1 · 摘自论文原文
  • 构建包含1854张真实电路图的多任务基准,支持细粒度定位与拓扑推理
  • 在10.9万实例上验证模型对元件位置与连接关系的理解,存在显著误判率
  • 适合电子设计自动化研究者,尤其关注视觉-符号联合建模的场景

近期的大规模多模态模型(LMMs)在视觉定位、文档理解和图表推理任务中取得快速进展。然而,其将印刷电路板(PCB)原理图转化为可机器读取的空间加权网表图的能力——该过程需同时捕捉元件属性、连接关系与几何布局——仍鲜有研究。为此,我们提出OmniSch,首个专为评估LMMs在原理图理解与空间网表图构建方面表现而设计的综合性基准。OmniSch包含1,854张真实世界原理图,涵盖四项任务:(1) 原理图实体的视觉定位,共109.9万个标注实例,将423.4万条语义标签与视觉区域对齐;(2) 图表到图的推理,理解元素间的拓扑关系;(3) 几何推理,基于布局生成连接权重;(4) 工具增强型智能体推理,调用外部工具完成前三个任务。实验表明当前主流LMMs在解析电路工程实体方面存在明显短板,包括不稳定的细粒度定位、脆弱的布局到图转换、不一致的全局连通性推理以及低效的视觉探索。

原文摘要 · Abstract (English)

Recent large multimodal models (LMMs) have made rapid progress in visual grounding, document understanding, and diagram reasoning tasks. However, their ability to convert Printed Circuit Board (PCB) schematic diagrams into machine-readable spatially weighted netlist graphs, jointly capturing component attributes, connectivity, and geometry, remains largely underexplored, despite such graph representations are the backbone of practical electronic design automation (EDA) workflows. To bridge this gap, we introduce OmniSch, the first comprehensive benchmark designed to assess LMMs on schematic understanding and spatial netlist graph construction. OmniSch contains 1,854 real-world schematic diagrams and includes four tasks: (1) visual grounding for schematic entities, with 109.9K grounded instances aligning 423.4K diagram semantic labels to their visual regions; (2) diagram-to-graph reasoning, understanding topological relationship among diagram elements; (3) geometric reasoning, constructing layout-dependent weights for each connection; and (4) tool-augmented agentic reasoning for visual search, invoking external tools to accomplish (1)-(3). Our results reveal substantial gaps of current LMMs in interpreting schematic engineering artifacts, including unreliable fine-grained grounding, brittle layout-to-graph parsing, inconsistent global connectivity reasoning and inefficient visual exploration.

电路图理解多模态基准视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。