用视觉模型自动从电路图生成符号表达式,准确率提升超50%。
AutoVSR: Automatic Visual-to-Symbolic Reasoning for Symbolic Expression Generation from Circuit Schematic

- 通过视觉理解重建电路为可执行中间表示,结合反馈验证保证结构正确
- 多步符号推导准确率提升30%至59%,超越主流方法
- 轻量高效,推理成本低于闭源顶尖模型,适合工程应用
符号表达式能有效表征和预测电路行为,但直接从电路图生成极具挑战:需精确完成视觉到符号的结构构建及多步推导,对正确性要求极高。本文提出AutoVSR,一种基于视觉语言模型(VLMs)的自动化视觉到符号表达式生成框架。通过将电路图重构为可执行中间表示(Executable IR),并借助符号求解器进行推理,显著提升生成准确性。AutoVSR引入两项核心创新:基于组件规则检索与验证的IR构造方法,以及作为规划代理的符号求解器,配备符号工具库实现可靠多步推导。在主流符号表达式生成任务上,相较于端到端VLM方法与专用方法,准确率分别提升30.01%–59.45%和41.96%–51.84%。此外,AutoVSR在推理开销与计算效率上优于闭源最先进VLM。代码已开源:https://github.com/LongfeiLi1/AutoVSR。
原文摘要 · Abstract (English)
Symbolic expressions can effectively characterize and predict circuit behavior, but deriving them directly from circuit schematics is challenging. This process requires accurate visual-to-symbolic construction of circuit structure from images and correct multi-step symbolic derivation, both of which impose strict correctness requirements. This work proposes AutoVSR, an automated framework for visual-to-symbolic generation of circuit expressions using Vision Language Models (VLMs). By reconstructing circuit diagrams into an executable intermediate representation (Executable IR) and leveraging a symbolic solver for reasoning, AutoVSR significantly improves the accuracy of symbolic expression generation. AutoVSR introduces two key innovations: an IR construction method guided by component rule retrieval and verification-based feedback, and a symbolic solver implemented as a planning agent equipped with a symbolic tool library for reliable multi-step derivation. Compared with end-to-end VLM approaches and specialized methods on the main symbolic expression generation task, AutoVSR achieves accuracy improvements of 30.01--59.45% and 41.96--51.84%, respectively. Moreover, AutoVSR surpasses closed-source state-of-the-art VLMs in inference cost and computational efficiency. Code is available at https://github.com/LongfeiLi1/AutoVSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。