arXiv:2602.17394cs.NIcs.AI2026-02

让无人机网络听懂救援人员的语音指令,自动提取关键信息

Voice-Driven Semantic Perception for UAV-Assisted Emergency Networks

  • 用语音识别+大模型分析救援语音,转为结构化数据
  • 在多种噪音和多人对话下仍保持90%以上语义识别准确率
  • 适合应急指挥、人机协同的智能网络管理场景

无人飞行器(UAV)辅助网络正成为应急响应的有力手段,可在地面设施损毁时提供快速、灵活且可靠的通信。尽管语音对讲因其鲁棒性仍是救援人员主要通信方式,但其非结构化特性难以直接用于自动化无人机网络管理。本文提出SIREN框架,通过集成自动语音识别(ASR)、基于大语言模型(LLM)的语义提取及自然语言处理(NLP)验证,将紧急语音流量转化为包含响应单位、位置参考、事件严重程度和质量保障(QoS)需求等结构化机器可读信息。在模拟应急场景下,该框架在语言风格、说话人数、背景噪声和消息复杂度变化条件下均表现稳健,具备高精度语音转录与可靠语义提取能力,仅受限于说话人分离与地理定位模糊问题。结果验证了语音驱动态势感知在无人机辅助网络中的可行性,为人类参与决策支持与自适应网络管理提供了实践基础。

原文摘要 · Abstract (English)

Unmanned Aerial Vehicle (UAV)-assisted networks are increasingly foreseen as a promising approach for emergency response, providing rapid, flexible, and resilient communications in environments where terrestrial infrastructure is degraded or unavailable. In such scenarios, voice radio communications remain essential for first responders due to their robustness; however, their unstructured nature prevents direct integration with automated UAV-assisted network management. This paper proposes SIREN, an AI-driven framework that enables voice-driven perception for UAV-assisted networks. By integrating Automatic Speech Recognition (ASR) with Large Language Model (LLM)-based semantic extraction and Natural Language Processing (NLP) validation, SIREN converts emergency voice traffic into structured, machine-readable information, including responding units, location references, emergency severity, and Quality-of-Service (QoS) requirements. SIREN is evaluated using synthetic emergency scenarios with controlled variations in language, speaker count, background noise, and message complexity. The results demonstrate robust transcription and reliable semantic extraction across diverse operating conditions, while highlighting speaker diarization and geographic ambiguity as the main limiting factors. These findings establish the feasibility of voice-driven situational awareness for UAV-assisted networks and show a practical foundation for human-in-the-loop decision support and adaptive network management in emergency response operations.

无人机网络语音理解应急响应大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。