arXiv:2601.14261cs.CVcs.HC2026-01综述

用智能提示让大模型读懂高压电网图,查错更准更可靠

Intelligent Power Grid Design Review via Active Perception-Enabled Multimodal Large Language Models

  • 分三阶段:先看全局提区域,再细查局部,最后综合判断
  • 在真实电网图上错误发现率显著提升,判断可靠性更强
  • 适合电力设计审查、工程智能化领域研究人员参考

电网工程图纸的智能审查对电力系统安全至关重要。然而,现有自动化系统在处理超高清图纸时面临计算压力大、信息丢失及缺乏整体语义理解等问题,难以准确识别设计错误。本文提出一种基于预训练多模态大模型(MLLM)和先进提示工程的三阶段智能审查框架。第一阶段,利用MLLM进行全局语义理解,从低分辨率概览中智能提出领域特定的语义区域;第二阶段,在这些区域内执行高分辨率细粒度识别,获取详细信息并附带置信度评分;第三阶段,通过综合决策模块整合置信度感知的结果,精准诊断设计错误并提供可靠性评估。在真实电网图纸上的初步实验表明,该方法显著提升了MLLM对宏观语义信息的把握能力,有效定位设计错误,相较于传统被动式MLLM推理,缺陷发现准确率更高,审查判断更可靠。本研究为电网图纸智能审查提供了新颖的提示驱动范式。

原文摘要 · Abstract (English)

The intelligent review of power grid engineering design drawings is crucial for power system safety. However, current automated systems struggle with ultra-high-resolution drawings due to high computational demands, information loss, and a lack of holistic semantic understanding for design error identification. This paper proposes a novel three-stage framework for intelligent power grid drawing review, driven by pre-trained Multimodal Large Language Models (MLLMs) through advanced prompt engineering. Mimicking the human expert review process, the first stage leverages an MLLM for global semantic understanding to intelligently propose domain-specific semantic regions from a low-resolution overview. The second stage then performs high-resolution, fine-grained recognition within these proposed regions, acquiring detailed information with associated confidence scores. In the final stage, a comprehensive decision-making module integrates these confidence-aware results to accurately diagnose design errors and provide a reliability assessment. Preliminary results on real-world power grid drawings demonstrate our approach significantly enhances MLLM's ability to grasp macroscopic semantic information and pinpoint design errors, showing improved defect discovery accuracy and greater reliability in review judgments compared to traditional passive MLLM inference. This research offers a novel, prompt-driven paradigm for intelligent and reliable power grid drawing review.

电网审查多模态大模型智能识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。