arXiv:2607.17951cs.CRcs.AI2026-07

让大模型控制无人机更安全实时,通过合约式技能调用保障飞行决策可追溯可验证。

RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Control

论文配图:RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Control
图 1 · 摘自论文原文
  • 将大模型输出转为带时间、状态、权限等约束的合约式飞行技能
  • 云端推理任务理解,机载系统只执行合规且及时的指令
  • 支持故障降级、可信准入和操作留痕,适合高安全要求的无人机应用

自然语言控制为无人机提供了有前景的交互方式,但直接将自托管计算机使用代理(SHCUA)应用于无人机控制存在结构不匹配问题。SHCUA原本设计用于允许延迟迭代的主机端工具交互,而无人机控制则涉及持续变化的物理状态、严格的时序约束、安全风险与责任可追溯性。过时、未经授权或被篡改的代理决策可能导致不安全或不可追溯的飞行行为。本文提出一种面向实时性与安全性的SHCUA无人机控制重构方案:不直接让SHCUA发出飞行指令,而是将其输出转化为带有显式时间、状态、权限、回退与证据语义的合约化无人机技能调用。基于此抽象,设计了语义推理与机载执行、安全/防护分离的架构。慢速的云或边缘推理用于任务理解,机载组件仅验证并分发及时、授权且状态一致的技能。关键安全节点可通过TEE或微控制器隔离机制保护,无需将完整语言代理或高频飞控环路纳入可信组件。原型评估表明,RT-SHCUA在保持任务级响应时间有界的同时,支持降级处理、可信准入及可审计的证据保留,实现对SHCUA驱动无人机行为的安全管控。

原文摘要 · Abstract (English)

Natural-language control offers a promising interface for unmanned aerial vehicles (UAVs), but directly applying self-hosted computer-use agents (SHCUAs) to UAV control introduces a structural mismatch. SHCUAs are designed for interactive host-side tool use, where delayed agent iterations are often acceptable. UAV control, however, is coupled with continuously changing physical states, strict timing constraints, safety risks, and security accountability. A stale, unauthorized, or tampered agent decision may therefore lead to unsafe or untraceable vehicle behavior. This paper proposes a real-time and security-oriented restructuring of SHCUA-based UAV control. Instead of allowing an SHCUA to directly issue flight commands, we transform its outputs into contract-bound UAV skill invocations with explicit timing, state, authority, fallback, and evidence semantics. Based on this abstraction, we design an architecture that separates semantic reasoning from onboard execution and security/safety enforcement. Slow cloud or edge reasoning is used for mission understanding, while onboard components validate and dispatch only timely, authorized, and state-consistent skills. Security-critical enforcement points can be protected by TEE-style or microcontroller isolation mechanisms without moving the full language agent or high-frequency flight-control loop into trusted components. Prototype evaluation shows that RT-SHCUA maintains bounded task-level responsiveness while supporting degraded handling, trusted admission, and auditable evidence preservation for SHCUA-mediated UAV actions.

无人机控制大模型安全合约式控制实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。