通过预测未来视觉引导扩散策略,提升机器人操作的准确性与稳定性。
ForeDiffusion: Foresight-Conditioned Diffusion Policy via Future View Construction for Robot Manipulation
- 将未来视觉预测融入扩散过程,实现前瞻式动作规划
- 在复杂任务中成功率达80%,比现有方法高23%
- 适合需要高精度视觉引导的机器人抓取场景
扩散策略通过逐步去噪高维动作序列,为机器人操作提供了有前景的视觉运动控制方法。然而,随着任务复杂度上升,现有基线模型的成功率显著下降。分析表明,当前扩散策略存在两大局限:一是仅依赖短期观测作为条件;二是训练目标局限于单一去噪损失,导致误差累积和抓取偏差。为此,本文提出前瞻性条件扩散(ForeDiffusion),通过将预测的未来视图表示注入扩散过程,使策略具备前瞻性,从而纠正轨迹偏差。基于此设计,ForeDiffusion采用双损失机制,结合传统去噪损失与未来观测的一致性损失,实现统一优化。在Adroit套件和MetaWorld基准上的大量评估表明,ForeDiffusion在整体任务上平均成功率达80%,在复杂任务中显著优于主流扩散方法23%,且全程表现更稳定。
原文摘要 · Abstract (English)
Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing baseline models decreases considerably. Analysis indicates that current diffusion strategies are confronted with two limitations. First, these strategies only rely on short-term observations as conditions. Second, the training objective remains limited to a single denoising loss, which leads to error accumulation and causes grasping deviations. To address these limitations, this paper proposes Foresight-Conditioned Diffusion (ForeDiffusion), by injecting the predicted future view representation into the diffusion process. As a result, the policy is guided to be forward-looking, enabling it to correct trajectory deviations. Following this design, ForeDiffusion employs a dual loss mechanism, combining the traditional denoising loss and the consistency loss of future observations, to achieve the unified optimization. Extensive evaluation on the Adroit suite and the MetaWorld benchmark demonstrates that ForeDiffusion achieves an average success rate of 80% for the overall task, significantly outperforming the existing mainstream diffusion methods by 23% in complex tasks, while maintaining more stable performance across the entire tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。