用大模型自动生成可验证的人道主义灾情报告,提升决策效率。
A Large-Language-Model Framework for Automated Humanitarian Situation Reporting
- 整合文本聚类与问答生成,将杂乱文档转为结构化报告。
- 答案相关性达86.3%,引用准确率与召回率均超76%。
- 适合人道救援机构快速生成可信、可行动的灾情摘要。
及时准确的情报报告对人道主义决策至关重要,但当前流程仍以人工为主,耗时且不一致。本文提出一个完全自动化框架,利用大语言模型(LLMs)将异构人道主义文档转化为结构化且基于证据的报告。系统集成语义文本聚类、自动问题生成、带引文的检索增强答案提取、多层级摘要及执行摘要生成,并配备模拟专家推理的内部评估指标。在13个灾害与冲突事件中评估,涵盖超过1,100份来自ReliefWeb等可信来源的文档。生成问题的相关性、重要性和紧迫性分别达到84.7%、84.0%和76.4%;答案相关性为86.3%,引用精度与召回率均超过76%。人工与LLM评估间的一致性F1分数超过0.80。对比分析表明,该框架生成的报告更结构化、可解释且更具操作性。通过结合生成式AI推理、透明引文链接与多层级评估,证明了生成式AI可自主产出准确、可验证且实用的人道主义情境报告。
原文摘要 · Abstract (English)
Timely and accurate situational reports are essential for humanitarian decision-making, yet current workflows remain largely manual, resource intensive, and inconsistent. We present a fully automated framework that uses large language models (LLMs) to transform heterogeneous humanitarian documents into structured and evidence-grounded reports. The system integrates semantic text clustering, automatic question generation, retrieval augmented answer extraction with citations, multi-level summarization, and executive summary generation, supported by internal evaluation metrics that emulate expert reasoning. We evaluated the framework across 13 humanitarian events, including natural disasters and conflicts, using more than 1,100 documents from verified sources such as ReliefWeb. The generated questions achieved 84.7 percent relevance, 84.0 percent importance, and 76.4 percent urgency. The extracted answers reached 86.3 percent relevance, with citation precision and recall both exceeding 76 percent. Agreement between human and LLM based evaluations surpassed an F1 score of 0.80. Comparative analysis shows that the proposed framework produces reports that are more structured, interpretable, and actionable than existing baselines. By combining LLM reasoning with transparent citation linking and multi-level evaluation, this study demonstrates that generative AI can autonomously produce accurate, verifiable, and operationally useful humanitarian situation reports.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。