arXiv:2501.06184cs.CVcs.AI2025-01CVPR被引 15

用AI智能体提升地质图理解能力,显著超越现有模型。

PEACE: Empowering Geologic Map Holistic Understanding with MLLMs

  • 构建分层信息提取+领域知识注入+提示增强问答的智能体架构
  • 在首个地质图评测集上达到0.811得分,远超GPT-4o的0.369
  • 适合地质调查、资源勘探等需要精准地图理解的科研与工程场景

地质图是地质科学中的基础图示,对地球表层与深层结构与组成提供关键洞察,在灾害探测、资源勘探和土木工程等领域不可或缺。然而,当前多模态大模型在地质图理解方面表现不足,主要源于制图综合的复杂性——包括高分辨率地图处理、多重关联要素管理及领域专业知识要求。为量化这一差距,我们构建了首个评估多模态大模型地质图理解能力的基准测试集GeoMap-Bench,涵盖信息提取、指代、定位、推理与分析等全方位能力。为填补该空白,我们提出首个专用于地质图理解的GeoMap-Agent智能体,包含三个模块:分层信息提取(HIE)、领域知识注入(DKI)与提示增强问答(PEQA)。受跨学科科学家协作启发,该智能体以人工智能专家小组形式运作,利用多样化工具池对问题进行综合分析。大量实验表明,GeoMap-Agent在GeoMap-Bench上取得0.811的总体得分,显著优于GPT-4o的0.369。本研究名为PEACE(emPowering gEologic mAp holistiC undErstanding with MLLMs),为地质学中先进AI应用开辟道路,提升地质调查的效率与准确性。

原文摘要 · Abstract (English)

Geologic map, as a fundamental diagram in geology science, provides critical insights into the structure and composition of Earth's subsurface and surface. These maps are indispensable in various fields, including disaster detection, resource exploration, and civil engineering. Despite their significance, current Multimodal Large Language Models (MLLMs) often fall short in geologic map understanding. This gap is primarily due to the challenging nature of cartographic generalization, which involves handling high-resolution map, managing multiple associated components, and requiring domain-specific knowledge. To quantify this gap, we construct GeoMap-Bench, the first-ever benchmark for evaluating MLLMs in geologic map understanding, which assesses the full-scale abilities in extracting, referring, grounding, reasoning, and analyzing. To bridge this gap, we introduce GeoMap-Agent, the inaugural agent designed for geologic map understanding, which features three modules: Hierarchical Information Extraction (HIE), Domain Knowledge Injection (DKI), and Prompt-enhanced Question Answering (PEQA). Inspired by the interdisciplinary collaboration among human scientists, an AI expert group acts as consultants, utilizing a diverse tool pool to comprehensively analyze questions. Through comprehensive experiments, GeoMap-Agent achieves an overall score of 0.811 on GeoMap-Bench, significantly outperforming 0.369 of GPT-4o. Our work, emPowering gEologic mAp holistiC undErstanding (PEACE) with MLLMs, paves the way for advanced AI applications in geology, enhancing the efficiency and accuracy of geological investigations.

地质图多模态智能体知识注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。