用大模型整合多源灾情信息,提升应急响应的准确与及时性。
DisastRAG: A Multi-Source Disaster Information Integration and Access System Based on Retrieval-Augmented Large Language Models
- 构建多路径架构,融合文档、结构化数据与外部网络信息检索。
- 相比无检索基线,多项选择准确率提升12-23个百分点,关键点覆盖提高最多10.5个百分点。
- 适合应急决策、灾害管理领域研究者及智能系统开发者使用。
有效的灾害管理需要快速获取分布在结构化操作记录、非结构化机构文档和动态外部来源中的信息。然而,现有灾害信息系统与检索增强生成框架大多依赖单一访问路径,难以满足异构、时效性强且上下文敏感的信息需求。本文提出DisastRAG,一种基于大语言模型的灾害感知信息集成与访问系统,通过检索增强机制融合结构化、非结构化及上下文相关灾情信息。该框架采用多路径架构,支持在精选灾害语料库中进行文档检索、对关系型灾害记录进行结构化访问,并在语料外请求时启用外部网络回退。系统统一集成查询理解、策略路由、响应生成与上下文记忆。我们在多个开放源代码大模型上,针对多项选择与开放问答任务评估了不同检索配置的表现。结果表明,检索增强显著优于无检索基线,多项选择准确率提升12-23个百分点,开放问答关键点覆盖率最高提升10.5个百分点。更大候选池对弱模型帮助最大,而强模型更易受检索噪声影响。混合检索在开放问答中表现最佳,向量检索与浅层重排序则更利于封闭式事实判断。案例研究进一步证明,结构化访问与网络回退使系统突破仅文档RAG的局限。
原文摘要 · Abstract (English)
Effective disaster management requires rapid access to information distributed across structured operational records, unstructured institutional documents, and dynamic external sources. However, most existing disaster information systems and retrieval-augmented generation frameworks remain organized around a single access pathway, limiting their ability to support heterogeneous, time-sensitive, and context-dependent information needs. This study presents DisastRAG, a disaster-aware information integration and access system that combines large language models with retrieval-augmented access to structured, unstructured, and contextual disaster information. The framework is built around a multi-path architecture that supports document retrieval over a curated hazard corpus, structured access over relational disaster records, and external web fallback for out-of-corpus requests, while also incorporating query understanding, strategy routing, response generation, and contextual memory within a unified system. We evaluated the document retrieval performance using four open-source large language models across multiple retrieval configurations on multiple-choice and open-ended disaster information tasks. Retrieval augmentation consistently improves performance over no-retrieval baselines, yielding multiple-choice gains of 12-23 percentage points and open-ended keypoint coverage gains of up to 10.5 percentage points. Results show that larger candidate pools are most helpful for weaker models, while stronger models are more sensitive to retrieval noise. Hybrid retrieval performs best for open-ended coverage, whereas vector retrieval and shallower reranking more often favor closed-form factual selection. Case studies further show that structured access and web fallback extend the framework beyond document-only RAG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。