arXiv:2605.30660cs.LGcs.RO2026-05

提出BOKBO机制,让视觉-语言-动作模型在推理时自动放弃不安全动作选择。

BOKBO (Best of K Bad Options): Calibrated Abstention for VLA Policies

  • 引入校准的拒绝机制,基于K个候选动作判断是否执行,避免危险操作。
  • 在libero数据集上实现86%的条件置信率覆盖,净任务成功率70%。
  • 适合对安全性要求高的机器人控制场景,尤其应对复杂任务中的极端情况。

针对视觉-语言-动作(VLA)策略在推理时采样K个候选动作并执行验证器最优解的问题,当所有候选均不安全时,系统仍会执行违规动作且无预警。本文提出BOKBO,首个面向K样本推理的保形拒绝层,提供有限样本、分布无关的违规执行率保证。提供全局与任务特定(Mondrian)两种变体,后者显著缩小最难任务上的条件差距。分析揭示:基于扰动的K采样下,策略内部非符合度分数与动作噪声参数σ相关性高达0.98,却与真实违规无关。在令牌级温度采样下复现该现象,发现其为机制特异性问题,部分缓解于策略随机性采样。基于语义视觉特征和任务身份的可学习违规预测器实现紧密校准:在libero_object_temp_x0.1上,ε=0.05时,条件置信区间覆盖率78%,86%的自助抽样分片满足边界,净任务成功率70%。Mondrian-BOKBO将最低任务级条件满足率从0.71提升至0.93。结果在5个训练种子下稳定,π_0-FAST内重复性良好,libero_spatial_temp_x0.1上表现一致,经受住四次套内分布偏移。此外,识别并修正一方法论缺陷:全局强制阈值远低于专家典型操作力,混淆了正常操作与危险行为,使违规率虚高5倍。

原文摘要 · Abstract (English)

Test-time scaling for vision-language-action (VLA) policies, methods such as RoboMonkey, SEAL, MG-Select, and V-GPS, samples K candidate action chunks at inference and executes the verifier-best. When all K candidates are unsafe, the system executes a violating action with no warning. We propose BOKBO, the first conformal abstention layer for K-sample VLA inference, providing finite-sample distribution-free guarantees on executed-violation rate. We provide both global and per-task (Mondrian) variants, with the per-task variant closing the conditional gap on the hardest tasks. Our analysis exposes a structural failure of policy-internal nonconformity scores under perturbation-based K-sampling: the base-policy confidence proxy and K-sample disagreement correlate at 0.98 with the action-noise hyperparameter $σ$, while correlating at the noise floor with actual safety violations. We test the failure's scope by replicating the analysis under token-level temperature sampling and find the failure is mechanism-specific and partially mitigated under policy-stochasticity-based sampling. A learned violation predictor conditioned on semantic visual features and task identity supports tight calibration: at $ε$ = 0.05 on libero_object_temp_x0.1 with OpenVLA-OFT, the conditional CRC bound holds on 86% of bootstrap splits with 78% coverage and 70% net task success. Mondrian-BOKBO raises the minimum per-task conditional hold fraction from 0.71 to 0.93. Results are stable across 5 training seeds, replicate within bootstrap noise on $π_0$-FAST, hold on libero_spatial_temp_x0.1 as a co-equal benchmark, and survive four within-suite distribution shifts. We additionally identify and correct a methodological pitfall: globally-set force thresholds well below expert-typical manipulation forces conflate unsafe behavior with normal manipulation, inflating violation rates by $5\times$.

机器人控制拒绝推理安全机制视觉语言动作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。