自监督筛选低质数据对齐动作,提升机器人模仿学习效率
SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
- 用任务进展预测自监督识别无效动作对
- 通过去重模块消除重复状态-动作模式
- 在多个基准上用更少数据提升15.4%性能
模仿学习通过人类示范获取多样化行为,推动机器人能力发展。但大规模训练数据常包含质量差异显著的样本,影响策略表现。现有方法依赖昂贵的人工标注,且仅在数据集或轨迹层面粗粒度过滤,无法识别单个状态-动作对的质量。为此,我们提出SCIZOR,一种自监督数据清洗框架,可过滤低质量状态-动作对以提升模仿学习性能。该框架针对两类低质数据:次优数据(含不良动作)与冗余数据(重复模式稀释训练)。SCIZOR利用自监督任务进展预测器剔除无任务进展的样本,并通过联合状态-动作表示的去重模块清除重复模式。实验证明,使用SCIZOR后,模仿学习策略在多个基准上平均性能提升15.4%,且所需数据更少。
原文摘要 · Abstract (English)
Imitation learning advances robot capabilities by enabling the acquisition of diverse behaviors from human demonstrations. However, large-scale datasets used for policy training often introduce substantial variability in quality, which can negatively impact performance. As a result, automatically curating datasets by filtering low-quality samples to improve quality becomes essential. Existing robotic curation approaches rely on costly manual annotations and perform curation at a coarse granularity, such as the dataset or trajectory level, failing to account for the quality of individual state-action pairs. To address this, we introduce SCIZOR, a self-supervised data curation framework that filters out low-quality state-action pairs to improve the performance of imitation learning policies. SCIZOR targets two complementary sources of low-quality data: suboptimal data, which hinders learning with undesirable actions, and redundant data, which dilutes training with repetitive patterns. SCIZOR leverages a self-supervised task progress predictor for suboptimal data to remove samples lacking task progression, and a deduplication module operating on joint state-action representation for samples with redundant patterns. Empirically, we show that SCIZOR enables imitation learning policies to achieve higher performance with less data, yielding an average improvement of 15.4% across multiple benchmarks. More information is available at: https://ut-austin-rpl.github.io/SCIZOR/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。