用视觉语言模型实现大规模卫星图像灾损自动评估
DamageScope: Vision-Language Retrieval at Scale for Disaster Damage Assessment from Satellite Imagery

- 基于检索增强生成框架,融合卫星影像与多模态模型
- 多向量聚类使索引速度提升14倍,响应延迟降低3倍
- 适合应急响应、城市规划等需要快速灾损分析的场景
自然灾害后及时准确评估财产损失至关重要。传统现场勘查耗时耗力且存在安全风险。卫星影像与视觉语言模型(VLMs)的发展为大规模遥感损伤评估提供了可能,但将其集成到地球观测系统中仍面临计算效率、数据组织和信息检索的挑战。为此,我们提出DamageScope,一种基于检索增强生成(RAG)框架的自动损伤分析系统,结合卫星影像、视觉语言模型(VLMs)与大语言模型(LLMs),支持自然语言交互式查询。为提升可扩展性,我们引入一种新型多向量嵌入聚类算法,相较传统单向量方法性能更优,索引时间缩短达14倍;同时采用双存储架构,减少约3倍的LLM API调用,显著降低运行成本与响应延迟。通过在可扩展性与运行效率间取得平衡,DamageScope为实际灾损评估任务提供了高效可靠的解决方案。
原文摘要 · Abstract (English)
Timely and accurate assessment of property damage is critical following natural disasters. Traditional on-site inspections are labor-intensive, costly, and often pose safety risks. Advances in satellite imagery and vision-language models (VLMs) enable scalable remote damage assessment; however, integrating VLMs into large-scale Earth observation pipelines presents challenges in computational efficiency, data organization, and information retrieval. To address these challenges, we present DamageScope, a retrieval-augmented framework that combines satellite imagery with Vision-Language Models (VLMs) and Large Language Models (LLMs) to automate property damage analysis. Built on a Retrieval-Augmented Generation (RAG) framework, DamageScope extracts structured visual representations from satellite imagery to support interactive natural language queries for damage assessment. To address scalability, we introduce a novel multi-vector embedding-based clustering algorithm that outperforms traditional single-vector embedding approaches while reducing indexing time by up to 14x. Furthermore, a dual-store data architecture minimizes LLM API calls, reducing both operational cost and response latency by up to approximately 3x. By effectively balancing scalability and operational efficiency, DamageScope provides a robust and practical solution for real-world damage assessment tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。