arXiv:2606.00104cs.ROcs.AI2026-06中稿 · ICRA

用大模型分步规划无人机任务,提升可解释性与安全性

PEACE: A Planner-Executor Agent with Constraint Enforcement for UAVs

论文配图:PEACE: A Planner-Executor Agent with Constraint Enforcement for UAVs
图 1 · 摘自论文原文
  • 大模型单次生成任务计划,执行通过ROS 2工具调用完成
  • 支持高度限高和地理围栏,失败时可自动重规划恢复
  • 相比紧耦合控制,减少30%以上LLM调用,更易解释

基础模型正被广泛用于驱动自主系统,但现有方法要么将模型置于紧密控制回路中,导致延迟高、幻觉风险大;要么将自然语言编译为难以解释的端到端策略,且需领域数据微调。本文提出一种面向PX4无人机的规划-执行代理(PEACE),将高层任务规划与底层控制解耦。大语言模型进行单次任务规划,执行通过结构化的ROS 2工具调用接口连接MAVLink实现。系统结合模块化2D检测器(如YOLO或视觉-语言模型)与针孔深度投影模块,构建世界模型以实现3D物体定位。约束执行层强制实施高度限制和水平地理围栏,有界重规划机制可在执行失败时恢复。我们在三种典型基于基础模型的机器人系统设计模式中定位本方法,并在Gazebo中基于PX4软件在环仿真验证其可行性。结果表明,相比紧密耦合的LLM控制,本方法显著提升可解释性、约束执行能力,并减少超过30%的LLM调用。代码、数据集、视频等材料详见:https://github.com/erdemuysalx/PEACE

原文摘要 · Abstract (English)

Foundation models are increasingly used to drive autonomous systems, yet existing approaches either keep the model in a tight control loop, raising latency and hallucination risk, or compile natural language into opaque end-to-end policies that are hard to explain, constraint and require domain-specific datasets and fine-tuning. We propose a planner-executor agent for PX4-based drones that decouples high-level mission planning from low-level control. A large language model performs single-pass task planning, while execution is handled through a structured ROS 2 tool-calling interface bridged to MAVLink. The system constructs a world model by combining modular 2D detectors (e.g., YOLO or vision-language models) with a pinhole depth projection module for 3D object localization. A constraint enforcement layer enforces altitude limits and horizontal geofencing, and bounded replanning enables recovery from execution-time action failures. We position our approach within three common design patterns for foundation-model-based robotics systems and demonstrate its feasibility in PX4 software-in-the-loop simulations in Gazebo. Results highlight improved explainability, constraint enforcement, and reduced LLM calls compared to tightly coupled LLM control. The code, dataset, videos, and other material can be found at the following link: https://github.com/erdemuysalx/PEACE

无人机大模型规划执行约束控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。