arXiv:2510.13896q-bio.QMcs.AI2025-10被引 3

用大模型代理自动分图、自适应调参,零训练实现通用细胞图像分割。

GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agents

  • 通过规划-执行-评估循环自动选最优分割工具并动态调整。
  • 在7个数据集上超越所有基线,对未见结构识别率显著提升。
  • 支持文本引导分割新细胞器,适合生物学家快速定制分析流程。

细胞图像分割对定量生物学至关重要,但受成像模态多样、形态差异大和标注有限等因素制约。本文提出GenCellAgent,一种无需训练的多代理框架,通过规划-执行-评估循环(选工具→运行→质量检查)与长期记忆协同工作。系统能自动将图像路由至最佳工具,在成像条件变化时利用少量参考图像实时自适应;支持文本引导分割现有模型未覆盖的细胞器;并将专家修正记录进记忆,实现自我进化与个性化流程。在涵盖7种显微成像模态的4,718张图像上,该方法在每个数据集上均达到或超过最优单一工具性能,整体准确率优于所有基线。在分布外的细胞器数据上,显著优于未在目标域训练的专用模型,成功恢复专用工具遗漏的结构。还能通过迭代文本引导精修分割新对象(如高尔基体),配合少量人工校正进一步提升效果。这些能力为无需重训练的鲁棒、可扩展细胞图像分割提供了实用路径,同时降低标注负担并匹配用户偏好。

原文摘要 · Abstract (English)

Cellular image segmentation is essential for quantitative biology yet remains difficult due to heterogeneous modalities, morphological variability, and limited annotations. We present GenCellAgent, a training-free multi-agent framework that orchestrates specialist segmenters and generalist vision-language models via a planner-executor-evaluator loop (choose tool $\rightarrow$ run $\rightarrow$ quality-check) with long-term memory. The system (i) automatically routes images to the best tool, (ii) adapts on the fly using a few reference images when imaging conditions differ from what a tool expects, (iii) supports text-guided segmentation of organelles not covered by existing models, and (iv) commits expert edits to memory, enabling self-evolution and personalized workflows. Across seven cell-segmentation benchmarks spanning diverse microscopy modalities (4,718 images), this routing consistently matches or exceeds the best individual tool on every dataset and outperforms all baselines in overall accuracy. On out-of-distribution organelle data, GenCellAgent substantially outperforms specialist models that were not trained on the target domain, recovering structures that dedicated tools fail to detect. It also segments novel objects such as the Golgi apparatus via iterative text-guided refinement, with light human correction further boosting performance. Together, these capabilities provide a practical path to robust, adaptable cellular image segmentation without retraining, while reducing annotation burden and matching user preferences.

图像分割大模型应用生物图像零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。