arXiv:2505.13431cs.RO2025-05NeurIPS被引 8

让扩散策略轻松利用对称性,提升泛化能力且无需复杂设计

A Practical Guide for Incorporating Symmetry in Diffusion Policy

  • 用相对动作和眼在手上感知实现不变表示
  • 结合等变视觉编码器使策略性能显著提升
  • 方法简单易用,适合实际部署的机器人控制场景

最近,用于策略学习的等变神经网络在样本效率和泛化能力方面展现出显著优势,但其广泛应用受限于实现复杂性。等变架构通常需要专门的数学表达和定制网络结构,难以与现代策略框架(如基于扩散模型的方法)集成。本文探索了若干简单实用的方法,将对称性优势引入扩散策略,而无需完整等变设计。具体包括:(i) 通过相对轨迹动作和眼在手上感知实现不变表示;(ii) 集成等变视觉编码器;(iii) 使用帧平均法对预训练编码器进行对称特征提取。我们首先证明,将眼在手上感知与相对或增量动作参数化结合可自然实现SE(3)不变性,从而增强策略泛化能力。随后,在扩散策略中系统评估了这些设计选择,结果表明,结合不变表示与等变特征提取能显著提升策略性能。所提方法在性能上达到或超越完全等变架构,同时大幅简化实现流程。

原文摘要 · Abstract (English)

Recently, equivariant neural networks for policy learning have shown promising improvements in sample efficiency and generalization, however, their wide adoption faces substantial barriers due to implementation complexity. Equivariant architectures typically require specialized mathematical formulations and custom network design, posing significant challenges when integrating with modern policy frameworks like diffusion-based models. In this paper, we explore a number of straightforward and practical approaches to incorporate symmetry benefits into diffusion policies without the overhead of full equivariant designs. Specifically, we investigate (i) invariant representations via relative trajectory actions and eye-in-hand perception, (ii) integrating equivariant vision encoders, and (iii) symmetric feature extraction with pretrained encoders using Frame Averaging. We first prove that combining eye-in-hand perception with relative or delta action parameterization yields inherent SE(3)-invariance, thus improving policy generalization. We then perform a systematic experimental study on those design choices for integrating symmetry in diffusion policies, and conclude that an invariant representation with equivariant feature extraction significantly improves the policy performance. Our method achieves performance on par with or exceeding fully equivariant architectures while greatly simplifying implementation.

扩散模型机器人控制对称性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。