通过自动随机化场景因素,提升视觉运动策略的泛化能力。
A Study on Enhancing the Generalization Ability of Visuomotor Policies via Data Augmentation
- 自动生成多样化场景数据,涵盖相机姿态、光照、桌台纹理等
- 在6个任务上验证,随机化显著提升策略泛化性能
- 适用于低成本机械臂,支持零样本仿真到现实迁移
视觉运动策略的泛化能力至关重要,理想策略应能在多种场景中部署。现有方法虽能收集大量轨迹增强数据以应对物体在水平面上的随机摆放,但生成数据多样性仍不足,限制了策略泛化。为此,本文系统研究了现有方法在不同场景布局因素下的表现,通过自动化生成对泛化影响显著的随机化因素,构建了一个更广泛随机化的数据集。该数据集仅需少量人类示范即可高效生成,涵盖五类机械臂和两类夹爪,包含相机姿态、光照条件、桌台纹理、桌高六个操纵任务中的多种随机化因素。实验发现,所有因素均影响策略泛化能力;任何随机化形式都能提升泛化效果,尤其多样化轨迹能有效弥合视觉差距。特别地,本文在低成本机械臂上验证了所提场景随机化对实现零样本仿真到现实迁移的有效性。
原文摘要 · Abstract (English)
The generalization ability of visuomotor policy is crucial, as a good policy should be deployable across diverse scenarios. Some methods can collect large amounts of trajectory augmentation data to train more generalizable imitation learning policies, aimed at handling the random placement of objects on the scene's horizontal plane. However, the data generated by these methods still lack diversity, which limits the generalization ability of the trained policy. To address this, we investigate the performance of policies trained by existing methods across different scene layout factors via automate the data generation for those factors that significantly impact generalization. We have created a more extensively randomized dataset that can be efficiently and automatically generated with only a small amount of human demonstration. The dataset covers five types of manipulators and two types of grippers, incorporating extensive randomization factors such as camera pose, lighting conditions, tabletop texture, and table height across six manipulation tasks. We found that all of these factors influence the generalization ability of the policy. Applying any form of randomization enhances policy generalization, with diverse trajectories particularly effective in bridging visual gap. Notably, we investigated on low-cost manipulator the effect of the scene randomization proposed in this work on enhancing the generalization capability of visuomotor policies for zero-shot sim-to-real transfer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。