arXiv:2508.16292cs.AIcs.RO2025-08EMNLP被引 4

教机器人识别并拒绝不可能指令,提升对话安全性。

Do What? Teaching Vision-Language-Action Models to Reject the Impossible

  • 设计统一框架让模型先检测指令是否基于虚假前提。
  • 对无法执行的指令,能自然语言澄清或提出可行替代方案。
  • 在错误指令场景下成功率提升50.78%,检测准确率提高近98%。

近期视觉-语言-动作(VLA)模型在多种机器人任务中表现优异。这些模型依赖多模态输入,语言指令不仅用于预测动作,还用于鲁棒地理解用户意图,即使请求无法实现。本文研究如何让VLA模型识别、解释并回应虚假前提指令:即引用环境中不存在对象或条件的自然语言命令。我们提出Instruct-Verify-and-Act(IVA)框架,具备三项能力:(i) 检测因虚假前提导致无法执行的指令;(ii) 通过语言进行澄清或修正;(iii) 基于感知与动作生成合理替代方案。为此,我们构建了大规模指令微调设置,使用结构化语言提示,并训练出可处理正确与错误请求的VLA模型。方法利用上下文增强的半合成数据集,包含成对的正向与虚假前提指令,支持鲁棒检测与自然语言修正。实验表明,相比基线,IVA在虚假前提检测准确率上提升97.56%,在错误指令场景下的成功响应率提升50.78%。

原文摘要 · Abstract (English)

Recently, Vision-Language-Action (VLA) models have demonstrated strong performance on a range of robotic tasks. These models rely on multimodal inputs, with language instructions playing a crucial role -- not only in predicting actions, but also in robustly interpreting user intent, even when the requests are impossible to fulfill. In this work, we investigate how VLAs can recognize, interpret, and respond to false-premise instructions: natural language commands that reference objects or conditions absent from the environment. We propose Instruct-Verify-and-Act (IVA), a unified framework that (i) detects when an instruction cannot be executed due to a false premise, (ii) engages in language-based clarification or correction, and (iii) grounds plausible alternatives in perception and action. Towards this end, we construct a large-scale instruction tuning setup with structured language prompts and train a VLA model capable of handling both accurate and erroneous requests. Our approach leverages a contextually augmented, semi-synthetic dataset containing paired positive and false-premise instructions, enabling robust detection and natural language correction. Our experiments show that IVA improves false premise detection accuracy by 97.56% over baselines, while increasing successful responses in false-premise scenarios by 50.78%.

机器人指令理解多模态纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。