SPARC通过时空结构自动标注机器人演示,提升标注可靠性并减少噪声。
SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale

- 利用机器人任务的时空结构生成标注可靠性评分
- 在1.7k演示上定位精度显著优于纯检测基线,高精度下保留样本量多3倍
- 适合需要高质量空间标注的机器人训练与部署场景
本文提出SPARC框架,一种基于风险感知的自动化方法,可从大规模机器人演示中生成结构化空间标注(如边界框、物体轨迹、操作阶段标签)并为每条标注分配可靠性分数。现有自动化流程缺乏可靠的标注质量信号,检测置信度与标注正确性关联弱,导致只能在噪声标签和丢弃有效样本间权衡。SPARC利用机器人任务固有的时空结构构建可靠性信号,有效降低噪声并保留更多可用样本。研究还引入IA-Bench基准,评估模型对交互物体位置的定位能力。在涵盖多样机器人形态与场景的1.7k人工标注演示上,SPARC在定位精度上显著超越仅依赖检测的基线,且在高精度运行点保留样本数量达三倍。实验表明,基于其标注微调的模型在对象定位与指向基准测试中达到同类规模模型最优性能,同时在更广泛的空间推理任务中保持竞争力,无需人工验证数据。使用SPARC标注训练的策略在杂乱、视觉模糊的真实场景中表现优于基线。代码、数据与模型已开源:intuitive-robots.github.io/sparc-labeling。
原文摘要 · Abstract (English)
This work introduces Spatial Annotations from Robot Demonstrations with Reliability Calibration (SPARC), a risk-aware framework that automatically labels robot demonstrations with structured spatial annotations and assigns each annotation a reliability score. Structured spatial annotations, such as bounding boxes, object trajectories, and manipulation phase labels, benefit a broad range of robotics applications from training grounded robot policies and embodied foundation models to motion planning and hierarchical task composition. Existing automated pipelines generate such annotations at scale but provide no reliable quality signal: detector confidence is poorly calibrated for annotation correctness, forcing a choice between accepting noisy labels or discarding useful samples. In contrast to existing automated pipelines, SPARC leverages the spatio-temporal structure inherent to robot tasks to generate a reliability signal, reducing noisy labels and retaining more useful samples. We further introduce Interaction-Aware Bench (IA-Bench), a benchmark that measures model accuracy in grounding the locations of interacted objects in robot demonstrations. On 1.7k human-annotated demonstrations spanning diverse embodiments and scenarios, SPARC significantly outperforms detection-only baselines in localization accuracy while retaining three times more samples at high-precision operating points. Our experiments demonstrate that models finetuned on our annotations achieve state-of-the-art results on object-grounding and pointing benchmarks among similarly sized models, while remaining competitive on broader spatial-reasoning suites without manually verified or annotated training data. Furthermore, policies trained on SPARC-generated annotations outperform baselines in cluttered, visually ambiguous real-world scenes. Code, data, and models are available at intuitive-robots.github.io/sparc-labeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。