arXiv:2501.10395cs.LGcs.AI2025-01被引 1

让机器人长期在真实环境自主运行,关键靠记忆与持续学习。

Towards General Purpose Robots at Scale: Lifelong Learning and Learning to Use Memory

  • 用轨迹生成重放技术实现持续学习,性能超越现有方法。
  • 借助人类示范教机器人高效使用记忆,任务成功率显著提升。
  • 适合研究通用机器人、长时序任务与终身学习的团队参考。

人工智能在自然语言处理和计算机视觉领域取得广泛应用,但在机器人领域进展受限于大规模训练数据缺乏以及现实任务的复杂性。为突破瓶颈,研究者正推动机器人在家庭等非结构化日常环境中规模化部署,以启动数据飞轮。当前机器人学习系统虽能完成短时任务,但难以在非结构化环境中长期自主运行。本论文聚焦长时序操作中的两大核心挑战:记忆与终身学习。提出两项新方法:一是引入基于轨迹的深度生成回放(t-DGR),在Continual World基准上达到当前最优表现,推进了终身学习能力;二是构建利用人类示范教导智能体有效使用记忆的框架,在Memory Gym任务中显著提升学习效率与成功概率。最后讨论了实现机器人在真实世界规模化运行所需的关键未来方向。

原文摘要 · Abstract (English)

The widespread success of artificial intelligence in fields like natural language processing and computer vision has not yet fully transferred to robotics, where progress is hindered by the lack of large-scale training data and the complexity of real-world tasks. To address this, many robot learning researchers are pushing to get robots deployed at scale in everyday unstructured environments like our homes to initiate a data flywheel. While current robot learning systems are effective for certain short-horizon tasks, they are not designed to autonomously operate over long time horizons in unstructured environments. This thesis focuses on addressing two key challenges for robots operating over long time horizons: memory and lifelong learning. We propose two novel methods to advance these capabilities. First, we introduce t-DGR, a trajectory-based deep generative replay method that achieves state-of-the-art performance on Continual World benchmarks, advancing lifelong learning. Second, we develop a framework that leverages human demonstrations to teach agents effective memory utilization, improving learning efficiency and success rates on Memory Gym tasks. Finally, we discuss future directions for achieving the lifelong learning and memory capabilities necessary for robots to function at scale in real-world settings.

机器人终身学习记忆机制长时序任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。