arXiv:2609.05880cs.LGcs.AI2026-09

让视觉语言模型回答管道图问题时必须依据可验证的连接图,提升决策可靠性。

Grounded and Faithful P&ID Reasoning: Constraining Vision-Language Models with Recovered Evidence Graphs

论文配图:Grounded and Faithful P&ID Reasoning: Constraining Vision-Language Models with Recovered Evidence Graphs
图 1 · 摘自论文原文
  • 从图纸中重建符号、连接和标签构成的显式连接图
  • 在新数据集上准确率从36.7%提升至74.3%以上
  • 适合工业安全、运维等需高可信推理的场景

管道与仪表图(P&IDs)是流程工厂的核心图纸,隔离、维护和危险与可操作性分析(HAZOP)决策依赖于设备间的连接关系。当前视觉语言模型虽能流畅描述图纸,但常虚构或遗漏关键连接,导致错误判断。本文通过恢复图纸中的符号、连接及标签构成的显式证据图,强制模型仅通过七种只读操作查询该图来作答,确保拓扑结论有据可查。在新构建的TopoPID-VQA数据集(3000个拓扑问题)上,基于图约束的Graph-Grounded Harness使Qwen3-VL-4B、Qwen3-VL-8B和Gemma-4-E4B的精确匹配准确率从图像单输入的36.7%~41.3%提升至74.3%~76.0%。尽管在Digitize-PID数据集上恢复的图在精确连接上的F1为0.742,合并符号与标签后升至0.801,残余误差仍反映感知错误对拓扑判断的影响——图约束仅在图正确时生效,但显著提升了可信度。

原文摘要 · Abstract (English)

Piping and Instrumentation Diagrams (P&IDs) are the authoritative maps of process plants: isolation, maintenance, and HAZOP decisions depend on what connects to what. Vision-language models describe these sheets fluently, yet they often invent or miss process connections---and an invented or missed link can reverse an isolation or reachability call, so a plant decision cannot trust a fluent answer that was never checked against the linework. We instead recover an explicit graph of the drawing---its symbols, the process connections between them, and the tags that name them---and then require the model to answer only by querying that graph through seven read-only operators, so a topology claim is returned only when it cites the query results that support it. On TopoPID-VQA, a new suite of 3000 topology questions over these sheets, Graph-Grounded Harness (Ours) raises exact match accuracy from 36.7--41.3% under image-only prompting to 74.3--76.0% for Qwen3-VL-4B, Qwen3-VL-8B, and Gemma-4-E4B. It does so on an imperfect substrate: on Digitize-PID dataset the recovered graph scores F1 0.742 on exact process connections, and 0.801 once symbols and tags are pooled in. The residual errors track that gap---grounding pays off where the recovered graph is right, and perception error still breaks topology questions where it is not.

视觉语言模型工业AI可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。