arXiv:2606.29763cs.CVcs.AI2026-06

用智能体自动选最适合的拓扑特征,提升医学影像分析效果

TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging

论文配图:TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging
图 1 · 摘自论文原文
  • 基于大模型构建智能体,自动选择拓扑描述子
  • 在26个数据集上测试,显著优于单一固定描述子
  • 无需任务训练,适合医疗影像拓扑分析新手

拓扑数据分析(TDA)中的持久同调(PH)能捕捉医学图像中连通区域、环结构和形状特征等几何属性,这些是传统像素级深度学习方法常忽略的。尽管已有多种拓扑描述子可将持久图(PDs)或原始图像转换为拓扑特征向量,但现有方法多采用单一固定描述子(如持久图像),未充分探索拓扑表示的多样性。据我们所知,尚无基于大语言模型(LLM)的智能体框架能自动为给定图像数据集选择最合适的拓扑描述子并生成对应特征向量以支持下游任务。为此,我们提出 extbf{TopoAgent},一个基于LLM的智能体框架,用于自动化医学图像分析中的拓扑学习。TopoAgent通过感知-推理-行动-反思循环运行,依赖21个领域专用工具和双记忆机制,累积跨轮次经验。其技能集源自对15种拓扑描述子在26个数据集上使用六种分类器的系统评估。TopoAgent分析输入图像及其拓扑特性,推理出最适合的描述子及配置,全程无需任务特定训练。

原文摘要 · Abstract (English)

Topological data analysis (TDA), particularly persistent homology (PH), captures geometric structural properties in medical images (e.g., connected components, loops, shape characteristics), which conventional pixel-level deep learning approaches often neglect. While many topological descriptors are known for converting persistence diagrams (PDs) or raw images into topological feature vectors, existing methods mostly default to a single fixed descriptor (e.g., persistence images), leaving the diversity of topological representations largely unexplored. To the best of our knowledge, there is no known large language model (LLM)-based agentic framework that can automatically determine the most suitable topological descriptors for a given image dataset and produce the corresponding topological feature vectors for downstream tasks. To fill this gap, we propose \textbf{TopoAgent}, an LLM-based agentic framework that automates topology learning for medical image analysis.TopoAgent operates through a Perception--Reasoning--Action--Reflection loop supported by 21 domain-specific tools and dual memory that accumulates experience across runs. Its skill set is distilled from systematic evaluation of 15 topological descriptors across 26 datasets with six classifiers. TopoAgent analyzes input images and their topological characteristics, reasons about which topological descriptors best suit the input, and determines the optimal descriptor and its configuration, all without task-specific training.

拓扑分析智能体医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。