arXiv:2509.14143cs.RO2025-09被引 3

让机器人根据称重数值精准抓取,避免过载或不足

CLAW: A Vision-Language-Action Framework for Weight-Aware Robotic Grasping

  • 将重量判断与动作生成分离,用CLIP模型实时读取秤值并生成指令
  • 在双臂操作任务中,成功率超基线模型,且能稳定满足重量阈值
  • 适合需要精确重量控制的工业场景,如分拣、装配

视觉-语言-动作(VLA)模型为机器人控制提供了端到端的自然语言驱动方案,但现有方法难以满足精确的任务约束(如基于数值的停止条件),因其观察到动作的映射依赖训练数据,缺乏显式的条件监控机制。本文提出CLAW(CLIP-Language-Action for Weight),通过解耦条件评估与动作生成,利用微调后的CLIP模型作为轻量级提示生成器,持续监测秤的数字读数,并根据任务设定的重量阈值生成离散指令。这些指令由$π_0$——一个基于流的VLA策略——接收,结合多视角摄像头观测生成连续机械臂动作。该设计实现了符号化重量推理与高频视觉运动控制的融合。我们在三个实验设置中验证了CLAW:单物体抓取和需双臂协同的混合物体任务。在所有条件下,CLAW均可靠执行重量感知行为,显著优于原始$π_0$及微调后的$π_0$模型。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models have recently emerged as a promising paradigm for robotic control, enabling end-to-end policies that ground natural language instructions into visuomotor actions. However, current VLAs often struggle to satisfy precise task constraints, such as stopping based on numeric thresholds, since their observation-to-action mappings are implicitly shaped by training data and lack explicit mechanisms for condition monitoring. In this work, we propose CLAW (CLIP-Language-Action for Weight), a framework that decouples condition evaluation from action generation. CLAW leverages a fine-tuned CLIP model as a lightweight prompt generator, which continuously monitors the digital readout of a scale and produces discrete directives based on task-specific weight thresholds. These prompts are then consumed by $π_0$, a flow-based VLA policy, which integrates the prompts with multi-view camera observations to produce continuous robot actions. This design enables CLAW to combine symbolic weight reasoning with high-frequency visuomotor control. We validate CLAW on three experimental setups: single-object grasping and mixed-object tasks requiring dual-arm manipulation. Across all conditions, CLAW reliably executes weight-aware behaviors and outperforms both raw-$π_0$ and fine-tuned $π_0$ models. A video of our paper is available online https://youtu.be/MuMYj2QgReI.

机器人抓取多模态重量感知VLA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。