分两阶段抓取并诊断失败原因,提升机器人操作的精准与泛化能力
Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation

- 先抓取后规划,失败时用模型定位故障根源
- 在多种算法下任务成功率显著提升,实测表现更优
- 适合需要高可靠性的机器人操作场景
在机器人操作中,抓取与路径规划紧密耦合常掩盖真实失败原因,导致试错效率低下。为实现高效长时程操作,我们提出 GTP-FA(Grasp-Then-Plan with Failure Attribution)——一种面向任务的两阶段抓取-规划框架,生成抓取候选并基于选定抓取执行下游运动规划。针对失败的操作轨迹,我们训练一个可泛化至未见抓取的失败归因模型,输出稳定的失败模式分布以支持诊断引导优化。基于此归因结果,我们以诊断驱动方式优化两个模块:在抓取侧,引入任务级先验和风险惩罚改进抓取评分与优化,抑制不稳或任务不兼容的抓取;在规划侧,通过数据收集与微调聚焦高风险初始状态,解决真正的规划瓶颈。我们在仿真与真实机器人实验中验证该框架,结果显示 GTP-FA 在强化学习、模仿学习、扩散策略及视觉语言动作(VLA)等多种设置下均显著优于基线模型,整体任务成功率大幅提升。
原文摘要 · Abstract (English)
In robotic manipulation, the tight coupling between grasping and motion planning often obscures the true source of failure, leading to inefficient trial-and-error. To enable efficient long-horizon manipulation, we propose GTP-FA (Grasp-Then-Plan with Failure Attribution), a task-oriented two-stage grasp-then-plan framework that generates grasp candidates and performs downstream motion planning conditioned on the selected grasp. Given a failed manipulation trajectory, we learn a failure attribution model that generalizes to unseen grasps and produces a stable distribution over failure modes for diagnosis-guided optimization. Based on these attribution results, we then optimize both modules in a diagnosis-driven manner: on the grasping side, we inject task-level priors and risk penalties into grasp candidate scoring and optimization to suppress unstable or task-incompatible grasps; on the planning side, we target high-risk initial states through data collection and fine-tuning to address genuine planning bottlenecks. We evaluate the proposed framework in both simulation and real-robot experiments, and show that GTP-FA improves the corresponding base learners across RL, IL, diffusion-policy, and VLA-based settings, achieving substantially higher overall task success rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。