arXiv:2605.07764cs.RO2026-05

让机器人蜂群听懂自然语言指令,还能保证安全执行。

CommandSwarm: Safety-Aware Natural Language-to-Behavior-Tree Generation for Robotic Swarms

论文配图:CommandSwarm: Safety-Aware Natural Language-to-Behavior-Tree Generation for Robotic Swarms
图 1 · 摘自论文原文
  • 用大模型把自然语言转为可执行的蜂群行为树,结合安全过滤和语法校验
  • 微调后模型零样本生成准确率提升至BLEU 0.663,语法正确率从0%升至72%
  • 适合非专家操作者快速控制多机器人系统,尤其关注安全性与可靠性

自然语言接口可使非专家用户更易操作机器人蜂群,但必须将模糊意图转化为无误、安全且可执行的蜂群行为。本文提出CommandSwarm,一个安全感知的语言到行为树转换系统,能从语音或文本指令生成XML格式的行为树(BT)。该系统结合多语言翻译、命令级安全过滤、约束提示、4比特量化下的LoRA微调大模型(LLM),以及基于可执行原始动作白名单的确定性解析验证。我们在11个参数规模在6.7B至14B之间的量化LLM上评估了零样本、单样本和双样本提示场景下的表现。Falcon3-Instruct-10B与Mistral-7B-v3在少样本设置下达到高于0.60的BLEU分数和高语法正确率。对2,063条合成指令-行为树数据进行微调后,零样本下BLEU由0.267提升至0.663,ROUGE-L由0.366升至0.692,解析接受的语法正确率从0%增至72%。多语言翻译实验表明SeamlessM4T v2-large和EuroLLM-9B在质量与延迟之间表现最优。结果表明,在经过验证的系统流程中,紧凑、量化且领域适配的LLM可有效生成实用的蜂群行为树;同时,解析接受与安全过滤仍是部署必需的执行门控,仅靠生成质量不足以实现自主运行。

原文摘要 · Abstract (English)

Natural-language interfaces can make swarm robotics more accessible to non-expert operators, but they must translate ambiguous user intent into executable swarm behaviors without unsupported actions, malformed programs, or unsafe plans. This paper presents CommandSwarm, a safety-aware language-to-behavior-tree pipeline for generating XML behavior trees (BTs) from speech or text commands. The system combines multilingual translation, command-level safety filtering, constrained prompting, a LoRA-adapted large language model (LLM), and deterministic parser validation against a whitelist of executable swarm primitives. We evaluate eleven open 6.7B--14B parameter LLMs, all using 4-bit quantization, on representative swarm-control scenarios under zero-shot, one-shot, and two-shot prompting. Falcon3-Instruct-10B and Mistral-7B-v3 are the strongest prompt-engineered candidates, reaching BLEU scores above 0.60 and high syntactic validity in few-shot settings. LoRA adaptation of Falcon3-Instruct-10B on a 2,063-example synthetic instruction--BT corpus improves zero-shot BLEU from 0.267 to 0.663, ROUGE-L from 0.366 to 0.692, and parser-accepted syntactic validity from 0% to 72%. Translation experiments further show that SeamlessM4T v2-large and EuroLLM-9B provide the best quality-latency trade-offs for the multilingual front end. The results indicate that compact, quantized, domain-adapted LLMs can generate useful swarm BTs when embedded in a validated systems pipeline. They also show that parser acceptance and safety filtering remain necessary execution gates; generation quality alone is not sufficient for autonomous deployment.

机器人蜂群自然语言生成行为树安全控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。