arXiv:2602.18773cs.AI2026-02被引 2

用工具调用构建病理诊断智能体,实现分子层面精准分析

LAMMI-Pathology: A Tool-Centric Bottom-Up LVLM-Agent Framework for Molecularly Informed Medical Intelligence in Pathology

  • 以领域自适应工具为基础,分层构建可组合的智能体系统
  • 提出原子执行节点机制,生成可信的多步推理轨迹
  • 适合需要高精度病理分析的医疗研究者和临床辅助开发

基于工具调用的智能体系统为病理图像分析带来了更依赖证据的新范式,取代了粗粒度的图文诊断方法。随着空间转录组技术的大规模应用,分子验证的病理诊断正变得日益开放与可及。本文提出 LAMMI-Pathology(用于病理学分子智能的 LVLM-Agent 系统),一个面向特定领域的可扩展智能体工具调用框架。该框架采用以工具为中心、自下而上的架构,定制化领域适配工具作为基础,按领域风格聚类形成组件智能体,并通过顶层规划器分层协调,避免过长上下文导致的任务漂移。在此基础上,我们提出一种基于原子执行节点(AENs)的新型轨迹构建机制,作为可靠且可组合的单元,生成半模拟的推理轨迹,捕捉可信的智能体-工具交互过程。基于此,我们设计了一种轨迹感知的微调策略,使规划器的决策过程与多步推理轨迹对齐,从而提升病理理解的推理鲁棒性及其对定制化工具集的适应能力。

原文摘要 · Abstract (English)

The emergence of tool-calling-based agent systems introduces a more evidence-driven paradigm for pathology image analysis in contrast to the coarse-grained text-image diagnostic approaches. With the recent large-scale experimental adoption of spatial transcriptomics technologies, molecularly validated pathological diagnosis is becoming increasingly open and accessible. In this work, we propose LAMMI-Pathology (LVLM-Agent System for Molecularly Informed Medical Intelligence in Pathology), a scalable agent framework for domain-specific agent tool-calling. LAMMI-Pathology adopts a tool-centric, bottom-up architecture in which customized domain-adaptive tools serve as the foundation. These tools are clustered by domain style to form component agents, which are then coordinated through a top-level planner hierarchically, avoiding excessively long context lengths that could induce task drift. Based on that, we introduce a novel trajectory construction mechanism based on Atomic Execution Nodes (AENs), which serve as reliable and composable units for building semi-simulated reasoning trajectories that capture credible agent-tool interactions. Building on this foundation, we develop a trajectory-aware fine-tuning strategy that aligns the planner's decision-making process with these multi-step reasoning trajectories, thereby enhancing inference robustness in pathology understanding and its adaptive use of the customized toolset.

病理分析智能体系统空间转录组工具调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。