用多视角摄像头提升机器人模仿学习的数据效率和泛化能力
Multi-Camera View Scaling for Data-Efficient Robot Imitation Learning
- 同一示范轨迹生成多视角伪示范,增强数据多样性
- 多视角策略在仿真与真实任务中显著提升泛化性能
- 无需额外人力,可无缝集成现有模仿学习算法
机器人操作的模仿学习策略泛化能力受限于专家示范的多样性,而跨环境收集示范成本高、难度大。本文提出一种实用框架,在示范采集过程中通过扩展摄像头视角来利用场景内在多样性,无需额外人工参与。通过同步多视角拍摄,从每条专家轨迹生成伪示范,丰富训练分布并提升视觉表征的视角不变性。分析不同动作空间与视角缩放的交互关系,发现相机空间表征能进一步增加多样性。此外,引入多视角动作聚合方法,使单视角策略在部署时也能受益于多相机信息。大量仿真实验与真实世界操作任务验证了该方法在数据效率和泛化能力上的显著提升。结果表明,视角扩展是一种低成本、可扩展的模仿学习解决方案,仅需少量额外硬件,且能无缝融入现有算法。项目网站:https://yichen928.github.io/robot_multiview。
原文摘要 · Abstract (English)
The generalization ability of imitation learning policies for robotic manipulation is fundamentally constrained by the diversity of expert demonstrations, while collecting demonstrations across varied environments is costly and difficult in practice. In this paper, we propose a practical framework that exploits inherent scene diversity without additional human effort by scaling camera views during demonstration collection. Instead of acquiring more trajectories, multiple synchronized camera perspectives are used to generate pseudo-demonstrations from each expert trajectory, which enriches the training distribution and improves viewpoint invariance in visual representations. We analyze how different action spaces interact with view scaling and show that camera-space representations further enhance diversity. In addition, we introduce a multiview action aggregation method that allows single-view policies to benefit from multiple cameras during deployment. Extensive experiments in simulation and real-world manipulation tasks demonstrate significant gains in data efficiency and generalization compared to single-view baselines. Our results suggest that scaling camera views provides a practical and scalable solution for imitation learning, which requires minimal additional hardware setup and integrates seamlessly with existing imitation learning algorithms. The website of our project is https://yichen928.github.io/robot_multiview.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。