arXiv:2602.11588cs.CV2026-02

用大模型将灾后结构影像自动转为可读报告,提升救援效率。

A Large Language Model for Disaster Structural Reconnaissance Summarization

  • 构建统一框架,融合图像与文本元数据生成结构损伤摘要。
  • 通过提示工程让大模型输出结构化报告,减少人工分析负担。
  • 适合灾害应急评估、土木工程人员快速获取灾损信息。

基于人工智能的视觉结构健康监测(SHM)通过分析图像和视频数据,已成为评估结构状况的有效方法。结合计算机视觉(CV)与深度学习(DL),视觉式SHM可自动识别并定位与结构损伤相关的视觉模式。然而,以往工作通常仅生成离散输出,如损伤类别标签和区域坐标,需工程师进一步整理分析以用于评估与决策。2022年末,大语言模型(LLMs)在多个领域兴起,为AI辅助视觉式SHM提供了新思路。本文提出一种基于大模型的灾后结构勘测摘要框架(LLM-DRS)。该框架引入标准化勘测流程,规范现场图像数据及对应元数据的采集方式。文本型元数据与图像型视觉数据被处理并整合为统一格式,经预训练的深度卷积神经网络提取关键属性,包括损伤状态、材料类型和损伤等级。最终,所有数据输入大模型,并通过精心设计的提示词,使LLM-DRS能根据聚合属性与元数据生成单个结构或受灾区域的总结报告。结果显示,将大模型融入视觉式结构健康监测,特别是在灾后快速勘测中,展现出显著潜力,有助于通过高效勘测提升建成环境韧性。

原文摘要 · Abstract (English)

Artificial Intelligence (AI)-aided vision-based Structural Health Monitoring (SHM) has emerged as an effective approach for monitoring and assessing structural condition by analyzing image and video data. By integrating Computer Vision (CV) and Deep Learning (DL), vision-based SHM can automatically identify and localize visual patterns associated with structural damage. However, previous works typically generate only discrete outputs, such as damage class labels and damage region coordinates, requiring engineers to further reorganize and analyze these results for evaluation and decision-making. In late 2022, Large Language Models (LLMs) became popular across multiple fields, providing new insights into AI-aided vision-based SHM. In this study, a novel LLM-based Disaster Reconnaissance Summarization (LLM-DRS) framework is proposed. It introduces a standard reconnaissance plan in which the collection of vision data and corresponding metadata follows a well-designed on-site investigation process. Text-based metadata and image-based vision data are then processed and integrated into a unified format, where well-trained Deep Convolutional Neural Networks extract key attributes, including damage state, material type, and damage level. Finally, all data are fed into an LLM with carefully designed prompts, enabling the LLM-DRS to generate summary reports for individual structures or affected regions based on aggregated attributes and metadata. Results show that integrating LLMs into vision-based SHM, particularly for rapid post-disaster reconnaissance, demonstrates promising potential for improving resilience of the built environment through effective reconnaissance.

灾后评估大模型结构健康监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。