arXiv:2505.07728cs.ROcs.AI2025-05被引 12

用因子分解曲线指导数据收集,省钱提效

Guiding Data Collection via Factored Scaling Curves

  • 构建因子缩放曲线,量化不同环境因素对性能的影响
  • 在有限预算下,使真实任务成功率最高提升26%
  • 无需实地测试,靠离线指标就能高效指导数据采集

在大规模数据集上训练的通用模仿学习策略在解决多样化操作任务方面展现出巨大潜力。然而,为确保在不同条件下的泛化能力,策略需在大量环境因子变化(如相机位姿、桌面高度、干扰物)下收集数据——若全面覆盖则成本极高。本文提出一种系统方法,通过构建因子分解缩放曲线(FSC),量化政策性能随单一或成对因子数据量变化的趋势。该曲线可指导在预算内优先采集最具影响力的因素组合。我们在模拟与真实世界实验中验证了该方法,在从零训练和微调两种场景下均表明,相比现有数据收集策略,新环境中的任务成功率最高提升26%。此外,我们还证明了可通过离线指标有效引导数据采集,无需大规模实测评估。

原文摘要 · Abstract (English)

Generalist imitation learning policies trained on large datasets show great promise for solving diverse manipulation tasks. However, to ensure generalization to different conditions, policies need to be trained with data collected across a large set of environmental factor variations (e.g., camera pose, table height, distractors) $-$ a prohibitively expensive undertaking, if done exhaustively. We introduce a principled method for deciding what data to collect and how much to collect for each factor by constructing factored scaling curves (FSC), which quantify how policy performance varies as data scales along individual or paired factors. These curves enable targeted data acquisition for the most influential factor combinations within a given budget. We evaluate the proposed method through extensive simulated and real-world experiments, across both training-from-scratch and fine-tuning settings, and show that it boosts success rates in real-world tasks in new environments by up to 26% over existing data-collection strategies. We further demonstrate how factored scaling curves can effectively guide data collection using an offline metric, without requiring real-world evaluation at scale.

模仿学习数据收集缩放曲线强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。