为开源移液机器人设计双重防护,自动检测协议错误和运行异常。
AEGIS: Assay-Aware Protocol Validation and Runtime Monitoring for Open-Source Liquid Handling Robots

- 用大模型+规则库分析实验代码,提前发现违规操作
- 通过视觉监控识别移液异常,对空吸、漏液等错误检测率达89%
- 开源免费,适合实验室自动化研究者与开发者使用
自驱动实验室越来越多依赖低成本开源移液机器人如Opentrons OT-2,但其缺乏压力感应监测,通常采用开环运行。两类故障难以察觉:一是语法正确但违反实验特异性约束的协议(如将同一吸头用于PCR模板与无模板对照),二是运行时物理错误(部分排液、气泡、缺吸头)。我们提出AEGIS,一个双层守护系统。第一层将可机器读取的实验规则数据库与大语言模型结合,对24个协议在五个实验类别上的基准测试中达到调整后F1为0.97,优于仅规则或仅大模型的方案,且使用免费开源模型即可媲美付费模型;第二层基于主成分分析构建世界模型,对YOLO裁剪的四帧移液轨迹进行建模,在无泄漏留一板评估下平均精度达0.89,操作点F1为0.71(AUROC 0.80),与现场演示一致,并量化出小移液器(p20)的分辨率极限(F1 0.47)。真实设备演示中(每组条件五次重复)能确定性捕捉预设缺吸头问题及有色液体部分排液,通过自主视觉语言模型投票机制使部分排液召回率达5/5;透明液体因视图限制为固有挑战,AEGIS以低置信度推理揭示而非误判。级联筛查使每板成本降至约1.63美元,远低于始终启用视觉模型的10.33美元基线。AEGIS开源,据我们所知是首个统一预飞行实验感知验证与运行时视觉监控的开源移液机器人系统。
原文摘要 · Abstract (English)
Self-driving laboratories increasingly rely on low-cost liquid handlers such as the Opentrons OT-2, which ship without the pressure-based aspiration monitoring of Hamilton or Tecan systems and are typically run open-loop. Two failure modes go undetected: protocols that are syntactically valid but violate assay-specific invariants (e.g., tip reuse between a PCR template and a no-template control), and physical execution failures (partial dispense, air bubbles, missing tips) at runtime. We present AEGIS, a two-layer guardian for both. Layer 1 pairs a curated machine-readable assay rule database with an LLM that reasons over OT-2 Python code, reaching an adjusted F1 of 0.97 on a 24-protocol benchmark across five assay families and beating rules-only and LLM-only ablations across five backends; a free open-weight model ties the best proprietary one, so no paid API is required. Layer 2 fits a PCA world model to YOLO-cropped four-frame pipette trajectories; under a leakage-free leave-one-plate-out evaluation it reaches average precision 0.89 and operating-point F1 0.71 (AUROC 0.80), a deployment-faithful number that matches the live demonstration, and we characterize the small-pipette (p20) resolution limit (F1 0.47). A live demonstration on a physical OT-2 (five replicates per condition) catches planted no-tip failures deterministically and partial dispense on coloured dyes, with an always-VLM self-vote gate lifting partial-dispense recall to 5/5; transparent water is a principled limit of any front-view-only monitor, which AEGIS surfaces as low-confidence VLM reasoning rather than a wrong verdict. Cascade triage holds VLM cost near $1.63 per plate versus $10.33 for an always-VLM baseline. AEGIS is open source and, to our knowledge, the first system to unify pre-flight assay-aware validation with runtime visual monitoring for an open-source liquid handler.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。