提出可快速计算的无模型多样性度量,提升机器人模仿学习数据集质量。
Diversity You Can Actually Measure: A Fast, Model-Free Diversity Metric for Robotics Datasets
- 基于轨迹核的签名变换定义熵度量,直接作用于演示数据集
- 在多个基准上验证,多样性强的数据集提升下游成功率10%-25%
- FAKTUAL算法无需模型、不依赖策略,计算开销极低
机器人模仿学习数据集通常包含不同长度的长时程轨迹,涉及状态、动作及高维观测(如RGB视频),难以在保持轨迹结构与几何特性的前提下量化多样性。本文通过在演示数据的签名核格拉姆矩阵上定义基于签名变换的熵,扩展香农与冯诺依曼熵,得到直接作用于演示数据集的熵与多样性度量。基于此,研究了数据集多样性对泛化性能的影响,并提出一种简单、无模型的数据筛选方法。引入FAKTUAL(FAst trajectory Kernel enTropy cUration for imitation Learning)算法,可在给定子集大小预算下选择最大化熵的演示子集。FAKTUAL完全无模型,无需访问模仿策略或仿真轨迹,相对于策略训练增加的开销可忽略。我们在图像与状态基的RoboMimic和MetaWorld基准,以及四个真实世界操作任务上评估该方法。跨任务与架构,使用FAKTUAL进行多样性感知的数据筛选,持续优于随机选择,且相比近期机器人数据筛选方法显著更高效。结果表明,演示数据集的熵是理解并改进机器人模仿学习数据多样性的实用工具。
原文摘要 · Abstract (English)
Robotics datasets for imitation learning typically consist of long-horizon trajectories of different lengths over states, actions, and high-dimensional observations (e.g., RGB video), making it non-trivial to quantify diversity in a way that respects the underlying trajectory structure and geometry. We extend Shannon and von Neumann entropy to this setting by defining signature transform-based entropy on the Gram matrix of a signature kernel over demonstrations, yielding entropy and diversity metrics that operate directly on the demonstration dataset. Building on these metrics, we study how dataset diversity affects generalization performance in robot imitation learning and propose a simple, model-free way to curate diverse demonstrations. We introduce FAKTUAL (FAst trajectory Kernel enTropy cUration for imitation Learning), a data curation algorithm that selects a subset of demonstrations maximizing entropy given a subset-size budget. FAKTUAL is fully model-free, requires no access to the imitation policy or rollouts, and adds negligible overhead relative to policy training. We evaluate our approach on image and state-based RoboMimic and MetaWorld benchmarks, as well as four real-world manipulation tasks. Across tasks and architectures, diversity-aware curation with FAKTUAL consistently improves downstream success rates over random selection, while being substantially more computationally efficient compared to recent robot data curation methods. Our results suggest that the entropy of demonstration datasets is a practical tool for understanding and improving dataset diversity in robot imitation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。