arXiv:2508.15846cs.CL2025-08AAAI被引 4

首个针对港口防台的多模态大模型评测基准,提升极端天气下决策效率。

CyPortQA: Benchmarking Multimodal Large Language Models for Cyclone Preparedness in Port Operation

  • 构建真实台风场景数据集,融合多源气象与港口运营信息。
  • 覆盖145个美国主要港口、90个命名风暴,生成超11万问答对。
  • 揭示多模态模型在灾情推演与决策判断上的短板,助力改进。

随着热带气旋强度增强及路径预测不确定性上升,美国港口在极端天气下的供应链风险加剧。港口运营方需快速整合概率风场图、路径扇形区和官方预警等多模态预报产品,形成清晰、可执行的应对指引。多模态大语言模型(MLLMs)具备融合异构数据与上下文知识的能力,但其在港口防台场景中的准确性和可靠性尚未被系统评估。为此,本文提出CyPortQA,首个专为台风威胁下港口运营设计的多模态基准。该基准汇集2015至2023年间145个美国主要港口的2,917个真实扰动场景,涵盖90个命名风暴。每个场景融合热带气旋产品、港口影响记录与状态通报,并通过自动化流程扩展为117,178个结构化问答对。基于此,我们在多种开源与闭源MLLM上开展实验,发现模型在态势理解方面潜力显著,但在影响估计与决策推理等任务上仍面临严峻挑战。

原文摘要 · Abstract (English)

As tropical cyclones intensify and track forecasts become increasingly uncertain, U.S. ports face heightened supply-chain risk under extreme weather conditions. Port operators need to rapidly synthesize diverse multimodal forecast products, such as probabilistic wind maps, track cones, and official advisories, into clear, actionable guidance as cyclones approach. Multimodal large language models (MLLMs) offer a powerful means to integrate these heterogeneous data sources alongside broader contextual knowledge, yet their accuracy and reliability in the specific context of port cyclone preparedness have not been rigorously evaluated. To fill this gap, we introduce CyPortQA, the first multimodal benchmark tailored to port operations under cyclone threat. CyPortQA assembles 2,917 realworld disruption scenarios from 2015 through 2023, spanning 145 U.S. principal ports and 90 named storms. Each scenario fuses multisource data (i.e., tropical cyclone products, port operational impact records, and port condition bulletins) and is expanded through an automated pipeline into 117,178 structured question answer pairs. Using this benchmark, we conduct extensive experiments on diverse MLLMs, including both open-source and proprietary model. MLLMs demonstrate great potential in situation understanding but still face considerable challenges in reasoning tasks, including potential impact estimation and decision reasoning.

多模态港口安全台风预测大模型评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。