arXiv:2604.03890cs.RO2026-04被引 3

LLM控制机器人时,攻击者可植入隐蔽后门,让指令变物理动作。

From Prompt to Physical Action: Structured Backdoor Attacks on LLM-Mediated Robotic Control Systems

  • 在语言推理阶段设后门不生效,但直接匹配命令格式则成功
  • 攻击成功率83%,正常性能保持93%以上,延迟低于1秒
  • 防御需牺牲速度,适合对实时性要求高的机器人系统

将大语言模型(LLMs)融入机器人控制流程,可实现自然语言到执行命令的转换。然而,这种数字到物理的接口引入了关键且未被充分研究的漏洞:微调过程中嵌入的结构化后门攻击。本文实验研究了基于LoRA的供应链后门在LLM驱动的ROS2机器人控制系统中的影响,构建了针对命令生成流程不同阶段的两种污染微调策略。结果揭示一个关键系统级洞察:在自然语言推理阶段嵌入的后门无法可靠传递至可执行控制输出,而与结构化JSON命令格式对齐的后门能成功通过翻译并触发物理动作。在仿真和真实世界实验中,受控模型平均攻击成功率(ASR)达83%,同时保持超过93%的干净性能准确率(CPA)且延迟低于1秒,展现出高可靠性与隐蔽性。进一步采用二级LLM进行语义一致性检查的代理验证防御机制,虽使攻击成功率降至20%,但端到端延迟增至8-9秒,暴露出实时机器人系统中安全与响应速度间的显著权衡。这些结果揭示了LLM驱动机器人控制架构的结构性漏洞,强调了面向机器人系统的特异性防御必要性。

原文摘要 · Abstract (English)

The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introduces a critical and underexplored vulnerability: structured backdoor attacks embedded during fine-tuning. In this work, we experimentally investigate LoRA-based supply-chain backdoors in LLM-mediated ROS2 robotic control systems and evaluate their impact on physical robot execution. We construct two poisoned fine-tuning strategies targeting different stages of the command generation pipeline and reveal a key systems-level insight: back-doors embedded at the natural-language reasoning stage do not reliably propagate to executable control outputs, whereas backdoors aligned directly with structured JSON command formats successfully survive translation and trigger physical actions. In both simulation and real-world experiments, backdoored models achieve an average Attack Success Rate of 83% while maintaining over 93% Clean Performance Accuracy (CPA) and sub-second latency, demonstrating both reliability and stealth. We further implement an agentic verification defense using a secondary LLM for semantic consistency checking. Although this reduces the Attack Success Rate (ASR) to 20%, it increases end-to-end latency to 8-9 seconds, exposing a significant security-responsiveness trade-off in real-time robotic systems. These results highlight structural vulnerabilities in LLM-mediated robotic control architectures and underscore the need for robotics-aware defenses for embodied AI systems.

后门攻击机器人控制LLM安全结构化指令

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。