arXiv:2608.21031cs.RO2026-08

让机器人通过物理交互主动感知物体属性,减少盲目探索。

PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration

论文配图:PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration
图 1 · 摘自论文原文
  • 引入物理感知层,通过动作主动获取物体质量与刚度信息
  • 无需额外传感器,仅凭机器人自身感知即可估算物理属性
  • 双代理设计实现高效探索,交互次数更少、执行更快

我们提出PhysCaP,一种用于机器人操作中主动感知的物理信息引导型代码即策略(Code-as-Policy)智能体。尽管视觉-语言-动作策略在模仿演示方面表现优异,但依赖被动观察,难以推断操纵所必需的潜在物理属性。PhysCaP在代码即策略框架中引入物理信息探索层,通过交互实现显式的探知行为。其提出无需训练的物理属性提取模块,仅利用机器人本体感知即可估计物体质量与刚度。为平衡探索成本与信息获取效率,PhysCaP采用双代理设计:规划器决定何时探索与停止,优先级处理器过滤不合理的交互并基于启发式得分排序剩余动作,实现高效定向探索。我们在真实桌面操作任务(寻找隐藏物体、检测空罐、发现成熟牛油果)及LIBERO仿真任务上评估了PhysCaP。结果表明,现有被动或盲目交互基线在物理属性未知时失败或过度探索,而PhysCaP以更少交互次数和更短执行时间达到相当性能。消融实验进一步验证了所提物理属性提取模块的有效性。

原文摘要 · Abstract (English)

We present PhysCaP, a Physics-Informed Code-as-Policy agent for active perception in robotic manipulation. While vision-language-action policies excel at imitating demonstrations, they rely on passive observation and fail to infer latent physical properties critical for manipulation. PhysCaP augments code-as-policy frameworks with a physics-informed exploration layer that enables explicit information-seeking through interaction. It introduces training-free physical property extraction modules that estimate object mass and stiffness from robot proprioception without additional sensors. To balance exploration costs and the efficiency of information obtained, PhysCaP employs a dual-agent design: a Planner that decides when to explore and when to stop, and a Prioritizer that filters implausible interactions and ranks the remainder using a heuristic priority score, enabling efficient, targeted exploration. We evaluate PhysCaP on real-world tabletop manipulation tasks (searching for hidden objects, detecting empty cans, and finding ripe avocados) and a simulated task in LIBERO. The results show that existing passive and naive interactive baselines either fail when physical properties are hidden or over-explore, whereas PhysCaP achieves comparable performance with fewer interactions and reduced execution time. Ablation studies further validate the effectiveness of the proposed physical property extraction modules. Project page: https://physcap.github.io

机器人操作主动感知物理建模代码即策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。