arXiv:2603.07824cs.RO2026-03AAAI被引 1

用大模型主动问问题,减少无人机操作中的人工干预。

Reasoning Knowledge-Gap in Drone Planning via LLM-based Active Elicitation

  • 通过神经符号树识别障碍物和目标的知识盲区,生成可查询的问题。
  • 在仿真与真实场景中,任务成功率提升,人机交互次数减少60%以上。
  • 适合非专业人员操作复杂搜救任务,降低认知负担。

无人飞行器(UAV)的人机协同规划通常在环境不确定性下依赖控制权移交,这对非专业操作员而言效率低且负担重。为此,我们提出一种新框架,将协作模式从控制接管转变为主动信息获取。引入最小信息神经符号树(MINT),将障碍物与目标相关的知识盲区结构化为可查询格式。利用大语言模型生成最优二元问题,以最少的人工交互解决特定模糊性。通过整合视觉-语言模型感知、语音接口与底层无人机控制模块的全流程,在高保真NVIDIA Isaac仿真及真实部署中验证了该方法的有效性。实验结果表明,本方法在复杂搜救任务中显著提升了成功率,同时相比穷尽式提问基线,显著降低了人机交互频率。

原文摘要 · Abstract (English)

Human-AI joint planning in Unmanned Aerial Vehicles (UAVs) typically relies on control handover when facing environmental uncertainties, which is often inefficient and cognitively demanding for non-expert operators. To address this, we propose a novel framework that shifts the collaboration paradigm from control takeover to active information elicitation. We introduce the Minimal Information Neuro-Symbolic Tree (MINT), a reasoning mechanism that explicitly structures knowledge gaps regarding obstacles and goals into a queryable format. By leveraging large language models, our system formulates optimal binary queries to resolve specific ambiguities with minimal human interaction. We demonstrate the efficacy of this approach through a comprehensive workflow integrating a vision-language model for perception, voice interfaces, and a low-level UAV control module in both high-fidelity NVIDIA Isaac simulations and real-world deployments. Experimental results show that our method achieves a significant improvement in the success rate for complex search-and-rescue tasks while significantly reducing the frequency of human interaction compared to exhaustive querying baselines.

无人机大模型人机协同主动学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。