arXiv:2506.11140cs.CVcs.AI2025-06被引 2

用AI自动设计肺、心、肋骨分割的医学影像分析流程

Autonomous Computer Vision Development with Agentic AI

  • 通过自然语言指令自动生成工具配置与执行流程
  • 在50张胸片上实现平均Dice分数0.96~0.83的分割效果
  • 适合医疗AI开发人员快速构建自动化视觉系统

基于大语言模型的智能体系统在复杂推理与工具调用方面展现出巨大潜力。本文展示如何仅凭自然语言提示,利用基于LLM的智能体(OpenManus)自动构建专用计算机视觉系统。我们扩展了开源认知智能环境SimpleMind(SM),使其具备可配置工具以支持医学图像分析。针对“为胸片(CXR)提供肺、心、肋骨分割的SM配置”这一指令,智能体成功生成YAML格式的工具配置文件,并自主执行SM-Learn(训练)与SM-Think(推理)脚本。该系统在50张胸片上完成自动配置、训练与测试,分别获得肺、心、肋骨分割的平均Dice分数0.96、0.82、0.83。此工作证明了传统需数据科学家手动完成的规划与配置任务,可由智能体实现自主完成。

原文摘要 · Abstract (English)

Agentic Artificial Intelligence (AI) systems leveraging Large Language Models (LLMs) exhibit significant potential for complex reasoning, planning, and tool utilization. We demonstrate that a specialized computer vision system can be built autonomously from a natural language prompt using Agentic AI methods. This involved extending SimpleMind (SM), an open-source Cognitive AI environment with configurable tools for medical image analysis, with an LLM-based agent, implemented using OpenManus, to automate the planning (tool configuration) for a particular computer vision task. We provide a proof-of-concept demonstration that an agentic system can interpret a computer vision task prompt, plan a corresponding SimpleMind workflow by decomposing the task and configuring appropriate tools. From the user input prompt, "provide sm (SimpleMind) config for lungs, heart, and ribs segmentation for cxr (chest x-ray)"), the agent LLM was able to generate the plan (tool configuration file in YAML format), and execute SM-Learn (training) and SM-Think (inference) scripts autonomously. The computer vision agent automatically configured, trained, and tested itself on 50 chest x-ray images, achieving mean dice scores of 0.96, 0.82, 0.83, for lungs, heart, and ribs, respectively. This work shows the potential for autonomous planning and tool configuration that has traditionally been performed by a data scientist in the development of computer vision applications.

AI代理医学影像自动化部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。