arXiv:2605.09046cs.RO2026-05

让机器人更可靠地抵达目标,通过优化终点质量提升成功率。

Terminal Matters: Kinodynamic Planning with a Terminal Cost and Learned Uncertainty in Belief State-Cost Space

论文配图:Terminal Matters: Kinodynamic Planning with a Terminal Cost and Learned Uncertainty in Belief State-Cost Space
图 1 · 摘自论文原文
  • 引入终端代价项,同时优化路径成本与终点可靠性。
  • 在不确定性下,成功率提升至92%以上,显著优于传统方法。
  • 适合需要高可靠性规划的现实机器人任务,如自动驾驶、机械臂操作。

在众多实际机器人任务中,机器人需生成动态可行的运动轨迹,在不确定性下仍能可靠到达目标。然而现有基于采样的动力学规划器通常仅优化路径累积成本,将到达目标视为可行性检查,而非显式优化终点状态质量(如目标偏好或到达可靠性)。本文提出一种终端代价公式,使终点质量可与累积轨迹成本共同优化。我们证明,AO-RRT这一渐近最优的动力学规划器在该增强目标下仍保持渐近最优性。进一步将该公式扩展至信念空间,并证明最小化终端信念与目标之间的Wasserstein距离可提升到达目标区域的概率下界。由此提出的规划器KiTe利用此终端代价项编码目标偏好并提升不确定性下的可靠性。为支持无解析不确定性模型的系统,我们直接从数据中学习动态与过程不确定性,并将学习到的信念动力学融入规划。在Flappy Bird、Car Parking和平面推挤任务上的实验表明,KiTe在不确定性下持续提升目标达成成功率。真实世界平面推挤实验进一步证明,KiTe可在学习动态与不确定性的情况下有效规划。源代码见https://github.com/elpis-lab/KiTe。

原文摘要 · Abstract (English)

In many real-world robotic tasks, robots must generate dynamically feasible motions that reliably reach desired goals even under uncertainty. Yet existing sampling-based kinodynamic planners typically optimize accumulated trajectory costs and treat goal reaching as a feasibility check, rather than explicitly optimizing terminal-state quality, such as goal preference or goal-reaching reliability. In this work, we introduce a terminal-cost formulation for kinodynamic planning that allows terminal-state quality to be optimized alongside accumulated trajectory cost. We prove that AO-RRT, an asymptotically optimal kinodynamic planner, preserves its asymptotic optimality under this augmented objective. We further extend the formulation to belief space and prove that minimizing the Wasserstein distance between the terminal belief and the goal improves a lower bound on the probability of reaching the goal region. The resulting planner, KiTe, uses this terminal-cost objective to encode goal preferences and improve reliability under uncertainty. To support systems without analytical uncertainty models, we learn dynamics and process uncertainty directly from data and integrate the learned belief dynamics into planning. Experiments on Flappy Bird, Car Parking, and Planar Pushing show that KiTe consistently improves goal-reaching success under uncertainty. Real-world Planar Pushing experiments further demonstrate that KiTe can plan effectively with learned dynamics and uncertainty. Source code is available at https://github.com/elpis-lab/KiTe.

机器人规划不确定性建模强化学习运动规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。