arXiv:2604.23570cs.RO2026-04被引 10

EgoLive是首个大规模真实任务人类视角数据集,助力机器人学习。

EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks

论文配图:EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks
图 1 · 摘自论文原文
  • 用定制头戴设备采集真实场景下的人类操作视频,实现自然数据收集。
  • 包含超过100小时的高质量多模态标注数据,覆盖家庭、零售等多场景。
  • 适合研究通用机器人模型与真实世界部署,推动具身智能发展。

当前机器人学习受限于大规模高质量数据集的缺乏。尽管远程操控和通用操作接口是主流数据采集方法,但其可扩展性和真实部署能力有限。相比之下,人类第一人称视频采集展现出规模化、自然化、在野化数据收集的潜力。为此,我们提出EgoLive——一个专为机器人操作学习设计的大规模高质第一人称数据集。EgoLive具有三大技术优势:首先,它是迄今最大且开源的聚焦真实任务导向人类行为的第一人称数据集;其次,通过定制头戴采集设备和全面高精度多模态标注,实现了领先的数据质量;第三,所有数据均来自无约束的真实世界场景,涵盖家庭服务、零售及其他实际工作场景,具备高度多样性和生态有效性。EgoLive旨在为研究社区提供可扩展、高质量的数据支持,加速通用机器人模型的突破,并促进机器人系统的真实世界应用。

原文摘要 · Abstract (English)

The advancement of robot learning is currently hindered by the scarcity of large-scale, high-quality datasets. While established data collection methods such as teleoperation and universal manipulation interfaces dominate current datasets, they suffer from inherent limitations in scalability and real-world deployability. Human egocentric video collection, by contrast, has emerged as a promising approach to enable scalable, natural and in-the-wild data collection. As such, we present EgoLive, a large-scale, high-quality egocentric dataset designed explicitly for robot manipulation learning. EgoLive establishes three distinctive technical advantages over existing egocentric datasets: first, it represents the largest open-source annotated egocentric dataset focused on real-world task-oriented human routines to date; second, it delivers leading data quality via a customized head-mounted capture device and comprehensive high-precision multi-modal annotations; third, all data is collected exclusively in unconstrained real-world scenarios and encompasses vertical field human working data, including home service, retail, and other practical work scenarios, providing superior diversity and ecological validity. With the introduction of EgoLive, we aim to provide the research community with a scalable, high-quality dataset that accelerates breakthroughs in generalizable robotic models and facilitates the real-world deployment of robot systems.

第一人称数据机器人学习真实场景多模态标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。