arXiv:2509.22339cs.CV2025-09被引 1

评测大模型从电路图中推导数学方程的能力,发现视觉理解与数学推理严重脱节。

CircuitSense: A Hierarchical MLLM Benchmark Bridging Visual Comprehension and Symbolic Reasoning in Engineering Design Process

  • 构建分层电路图基准,涵盖元件级到系统级的8000+问题
  • 闭源模型视觉识别超85%准确率,但推导公式不足19%
  • 揭示数学推理是电路设计的核心能力,适合工程AI研究者

工程设计通过从系统规格到部件实现的层级抽象进行,每个层级都需结合视觉理解与数学推理。尽管多模态大模型在自然图像任务上表现优异,其从技术图纸中提取数学模型的能力尚未被探索。我们提出 extbf{CircuitSense},一个全面的基准,评估模型在从元件级原理图到系统级框图的层次结构中对电路的理解能力,包含8,006+个问题。该基准独特地覆盖了感知、分析与设计全流程,尤其关注从视觉输入推导符号方程这一关键但未充分研究的能力。我们引入一种分层合成生成流程,包括基于网格的原理图生成器和可自动生成符号方程标签的框图生成器。对六种先进MLLM(含闭源与开源模型)的全面评估显示,视觉-数学推理存在根本性缺陷:闭源模型在组件识别与拓扑识别等感知任务上准确率超85%,但在符号推导与分析推理任务上低于19%,暴露出视觉解析与符号推理之间的显著断层。具备更强符号推理能力的模型在设计任务中表现更优,证实数学理解在电路合成中的核心作用,并确立符号推理为工程能力的关键指标。

原文摘要 · Abstract (English)

Engineering design operates through hierarchical abstraction from system specifications to component implementations, requiring visual understanding coupled with mathematical reasoning at each level. While Multi-modal Large Language Models (MLLMs) excel at natural image tasks, their ability to extract mathematical models from technical diagrams remains unexplored. We present \textbf{CircuitSense}, a comprehensive benchmark evaluating circuit understanding across this hierarchy through 8,006+ problems spanning component-level schematics to system-level block diagrams. Our benchmark uniquely examines the complete engineering workflow: Perception, Analysis, and Design, with a particular emphasis on the critical but underexplored capability of deriving symbolic equations from visual inputs. We introduce a hierarchical synthetic generation pipeline consisting of a grid-based schematic generator and a block diagram generator with auto-derived symbolic equation labels. Comprehensive evaluation of six state-of-the-art MLLMs, including both closed-source and open-source models, reveals fundamental limitations in visual-to-mathematical reasoning. Closed-source models achieve over 85\% accuracy on perception tasks involving component recognition and topology identification, yet their performance on symbolic derivation and analytical reasoning falls below 19\%, exposing a critical gap between visual parsing and symbolic reasoning. Models with stronger symbolic reasoning capabilities consistently achieve higher design task accuracy, confirming the fundamental role of mathematical understanding in circuit synthesis and establishing symbolic reasoning as the key metric for engineering competence.

多模态电路理解符号推理工程AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。