arXiv:2508.10511cs.RO2025-08被引 4

用核密度估计筛选扩散策略生成的轨迹,提升机器人动作安全性

KDPE: A Kernel Density Estimation Strategy for Diffusion Policy Trajectory Selection

  • 基于流形感知核密度估计过滤异常动作轨迹
  • 在仿真和真实机器人上均优于原扩散策略性能
  • 测试时计算开销低,适合实时控制场景

学习能捕捉训练数据多模性的机器人策略是行为克隆中的长期挑战。近期方法通过生成模型建模条件动作分布来解决此问题,其中扩散策略利用扩散模型将随机点去噪为机器人动作轨迹。尽管表现优异,但存在两大缺陷:去噪过程的随机性会影响动作轨迹质量;作为监督学习方法,可能从训练数据中学习到异常值。现有工作尝试通过大规模训练或结合经典行为克隆算法缓解这些问题。本文提出KDPE,一种基于核密度估计的策略,在保持低测试时计算开销的前提下,过滤扩散策略输出的潜在有害轨迹。针对末端执行器笛卡尔位置、姿态和夹持器状态构成的动作,设计了流形感知核函数以建模概率密度。KDPE在模拟单臂任务及真实机器人实验中均优于扩散策略。更多材料与代码见项目页:https://hsp-iit.github.io/KDPE/

原文摘要 · Abstract (English)

Learning robot policies that capture multimodality in the training data has been a long-standing open challenge for behavior cloning. Recent approaches tackle the problem by modeling the conditional action distribution with generative models. One of these approaches is Diffusion Policy, which relies on a diffusion model to denoise random points into robot action trajectories. While achieving state-of-the-art performance, it has two main drawbacks that may lead the robot out of the data distribution during policy execution. First, the stochasticity of the denoising process can highly impact on the quality of generated trajectory of actions. Second, being a supervised learning approach, it can learn data outliers from the dataset used for training. Recent work focuses on mitigating these limitations by combining Diffusion Policy either with large-scale training or with classical behavior cloning algorithms. Instead, we propose KDPE, a Kernel Density Estimation-based strategy that filters out potentially harmful trajectories output of Diffusion Policy while keeping a low test-time computational overhead. For Kernel Density Estimation, we propose a manifold-aware kernel to model a probability density function for actions composed of end-effector Cartesian position, orientation, and gripper state. KDPE overall achieves better performance than Diffusion Policy on simulated single-arm tasks and real robot experiments. Additional material and code are available on our project page at https://hsp-iit.github.io/KDPE/.

机器人策略扩散模型轨迹选择核密度估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。