arXiv:2607.27597cs.ROcs.AI2026-07中稿 · manuscript of AIAA…

用视觉语言模型做无人机灾情调度协调员,减轻人工负担。

A Systems Engineering Framework for Vision-Language-Enabled UAV Triage and Disaster Response

论文配图:A Systems Engineering Framework for Vision-Language-Enabled UAV Triage and Disaster Response
图 1 · 摘自论文原文
  • 将VLM作为人机协同中的任务协调者,实现自然语言交互与任务分配
  • 7名参与者测试显示认知负荷降低,对AI信任度和沟通清晰度评价高
  • 结合系统工程方法,适合高危灾害响应、航空自主等场景

视觉语言模型(VLM)的进展为灾情响应带来了新机遇,应对人员需在时间压力下解析大量传感器数据。现有VLM应用包括社交媒体监测以获取态势感知、生成行动方案草稿,以及将技术警报翻译为公众信息。尽管这些手段可加速信息流转,仍主要限于辅助决策角色,且易增加操作员负担——因人类仍需将输出转化为跨团队与机器人资产的协调行动。本研究探索将VLM嵌入人-无人机协同环路中作为协调代理的可行性。所提架构融合自然语言交互、任务层级协调、软件在回路实现,并与事件指挥系统(ICS)通信对齐。不同于仅作建议工具,该框架使VLM在人操作员、任务控制逻辑与无人机执行之间建立通信桥梁。采用基于模型的系统工程(MBSE)方法构建,通过用例图与框图定义系统角色、内部结构与组件交互。三个核心模块:VLM协调代理、无人机任务控制、任务分配器,在集成仿真与控制环境中实现。初步人因学评估中,7名参与者表现出更低的心理需求、努力程度与挫败感,同时对人工智能信任度与沟通清晰度评分较高。通过整合MBSE、软件在回路测试与人因评估,本工作推动了高风险灾情响应中的可扩展人机协同,对航空航天自主与公共安全具有广泛影响。

原文摘要 · Abstract (English)

Recent advances in Vision Language Models (VLMs) have created new opportunities for disaster response, where responders must interpret large volumes of sensor data under time pressure. Current VLM applications include social media monitoring for situational awareness, generation of draft action plans, and translation of technical alerts into public-facing messages. While these efforts can accelerate information flow, they remain largely limited to decision-support roles. Such approaches can increase operator burden because humans must still translate outputs into coordinated actions across teams and robotic assets. This study explores the viability of embedding VLMs as coordination agents within the human-UAV loop. The proposed architecture integrates natural language interaction, mission-level task coordination, software-in-the-loop implementation, and communication aligned with the Incident Command System (ICS). Rather than functioning solely as advisory tools, VLMs facilitate communication between human operators, mission control logic, and UAV task execution. The framework was developed using a Model-Based Systems Engineering (MBSE) approach, with use case and block definition diagrams representing system roles, internal structure, and component interactions. Three key elements, the VLM Coordinator Agent, UAV Mission Control, and Task Allocator, were implemented within an integrated simulation and control environment. A preliminary human-factors evaluation with seven participants showed reduced perceived workload across mental demand, effort, and frustration, along with high ratings for AI trust and communication clarity. By integrating MBSE, software-in-the-loop testing, and human-factors evaluation, this work advances scalable human-autonomy teaming for high-stakes disaster response, with broader implications for aerospace autonomy and civil safety.

灾情响应人机协同视觉语言模型无人机调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。