arXiv:2603.01474cs.RO2026-03

用少量示范从连续日志中提取可复用的任务片段,提升机器人学习数据利用率。

ROSER: Few-Shot Robotic Sequence Retrieval for Scalable Robot Learning

  • 基于少量示范,通过度量空间匹配提取任务片段,无需任务训练。
  • 在三个大数据集上达到最高精度,单次匹配耗时低于1毫秒。
  • 适合希望高效利用海量未标注机器人数据的研究者。

机器人学习的关键瓶颈在于任务标注且分段的训练数据稀缺,尽管大规模机器人数据集以长时连续交互日志形式存在。现有数据集包含丰富多样的行为,但与现代学习框架所需的清晰分段、任务专属轨迹不兼容。我们提出机器人序列检索问题:仅用少量参考示例,从未标注日志中提取可复用的任务中心片段。引入ROSER,一种轻量级少样本检索框架,通过在时间窗口上学习任务无关度量空间,实现仅需3-5个示范即可准确检索,且无需任何任务特定训练。为验证方法,我们在三个大规模数据集(如LIBERO、DROID、nuScenes)上建立全面评估协议,对比经典对齐方法、学习嵌入及语言模型基线。实验表明,ROSER在准确率和效率上均显著优于所有先前方法,单次匹配耗时低于1毫秒,同时保持优异分布对齐能力。通过将数据整理重构为少样本检索,ROSER为解锁未充分利用的机器人数据提供实用路径,从根本上提升机器人学习的数据可用性。

原文摘要 · Abstract (English)

A critical bottleneck in robot learning is the scarcity of task-labeled, segmented training data, despite the abundance of large-scale robotic datasets recorded as long, continuous interaction logs. Existing datasets contain vast amounts of diverse behaviors, yet remain structurally incompatible with modern learning frameworks that require cleanly segmented, task-specific trajectories. We address this data utilization crisis by formalizing robotic sequence retrieval: the task of extracting reusable, task-centric segments from unlabeled logs using only a few reference examples. We introduce ROSER, a lightweight few-shot retrieval framework that learns task-agnostic metric spaces over temporal windows, enabling accurate retrieval with as few as 3-5 demonstrations, without any task-specific training required. To validate our approach, we establish comprehensive evaluation protocols and benchmark ROSER against classical alignment methods, learned embeddings, and language model baselines across three large-scale datasets (e.g., LIBERO, DROID, and nuScenes). Our experiments demonstrate that ROSER consistently outperforms all prior methods in both accuracy and efficiency, achieving sub-millisecond per-match inference while maintaining superior distributional alignment. By reframing data curation as few-shot retrieval, ROSER provides a practical pathway to unlock underutilized robotic datasets, fundamentally improving data availability for robot learning.

机器人学习少样本检索数据利用序列提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。