arXiv:2512.02018cs.CVcs.RO2025-12

用真实与虚拟数据融合,解决自动驾驶实验室中液体移取的标注数据短缺问题。

Data-Centric Visual Development for Self-Driving Labs

  • 结合真人校验与生成图像,实现高效高质量数据采集
  • 训练模型在真实测试集上达到99.6%准确率,混合数据仍保持99.4%精度
  • 适合需要稀有事件检测的视觉任务,尤其适用于生物实验自动化

自动驾驶实验室(SDLs)为减少生物学研究中繁重、耗时且难以复现的工作流程提供了新路径。然而其对高精度模型的要求依赖大量标注数据,尤其是难获取的负样本。本文聚焦于SDL中最关键且高精度要求的操作——液体移取。为克服数据稀缺问题,提出一种融合真实与虚拟数据生成的混合流水线:真实路径采用人机协同方案,自动采集并选择性人工验证以最小成本保证精度;虚拟路径利用参考条件驱动、提示引导的图像生成技术扩充数据,并进行可靠性筛选与验证。二者结合构建类别平衡数据集,支持鲁棒的气泡检测训练。在独立真实测试集上,仅使用自动采集真实数据训练的模型达99.6%准确率;混合真实与生成数据训练可维持99.4%准确率,同时显著降低数据收集与审核负担。该方法为SDL视觉反馈数据供应提供可扩展、低成本解决方案,亦为罕见事件检测及其他视觉任务中的数据稀缺问题提供实用策略。

原文摘要 · Abstract (English)

Self-driving laboratories offer a promising path toward reducing the labor-intensive, time-consuming, and often irreproducible workflows in the biological sciences. Yet their stringent precision requirements demand highly robust models whose training relies on large amounts of annotated data. However, this kind of data is difficult to obtain in routine practice, especially negative samples. In this work, we focus on pipetting, the most critical and precision sensitive action in SDLs. To overcome the scarcity of training data, we build a hybrid pipeline that fuses real and virtual data generation. The real track adopts a human-in-the-loop scheme that couples automated acquisition with selective human verification to maximize accuracy with minimal effort. The virtual track augments the real data using reference-conditioned, prompt-guided image generation, which is further screened and validated for reliability. Together, these two tracks yield a class-balanced dataset that enables robust bubble detection training. On a held-out real test set, a model trained entirely on automatically acquired real images reaches 99.6% accuracy, and mixing real and generated data during training sustains 99.4% accuracy while reducing collection and review load. Our approach offers a scalable and cost-effective strategy for supplying visual feedback data to SDL workflows and provides a practical solution to data scarcity in rare event detection and broader vision tasks.

自动驾驶实验数据增强视觉检测稀有事件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。