SurvAgent通过分层思维链构建病例库,实现多模态生存预测的可解释性突破。
SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Prediction
- 分层思维链引导病理与基因数据联合分析,生成可追溯推理过程
- 在五个TCGA队列中显著优于传统方法与医疗大模型
- 适合需要可解释性生存预测的精准肿瘤学研究与临床决策
生存分析对癌症预后与治疗规划至关重要,但现有方法缺乏临床采纳所需的透明性。尽管近期病理智能体在诊断任务中展现可解释性,但在生存预测中仍存在三大局限:无法融合多模态数据、区域关注探索效率低、未能利用历史病例经验学习。本文提出SurvAgent,首个基于分层思维链(CoT)增强的多智能体系统,用于多模态生存预测。系统包含两阶段:(1) 多尺度筛查结合跨模态相似性与置信度感知的切片挖掘,对病理图像进行低倍率筛选与高阶特征提取;同时基于六类功能基因进行分层分析,生成带思维链推理的结构化报告,完整记录分析过程以支持经验学习。(2) 基于二分法的多专家推理模块,通过RAG检索相似病例,并结合多模态报告与专家预测,逐步优化风险区间。在五个TCGA队列上的大量实验表明,SurvAgent显著优于传统方法、专有多模态大模型及医学智能体,确立了精准肿瘤学中可解释人工智能生存预测的新范式。
原文摘要 · Abstract (English)
Survival analysis is critical for cancer prognosis and treatment planning, yet existing methods lack the transparency essential for clinical adoption. While recent pathology agents have demonstrated explainability in diagnostic tasks, they face three limitations for survival prediction: inability to integrate multimodal data, ineffective region-of-interest exploration, and failure to leverage experiential learning from historical cases. We introduce SurvAgent, the first hierarchical chain-of-thought (CoT)-enhanced multi-agent system for multimodal survival prediction. SurvAgent consists of two stages: (1) WSI-Gene CoT-Enhanced Case Bank Construction employs hierarchical analysis through Low-Magnification Screening, Cross-Modal Similarity-Aware Patch Mining, and Confidence-Aware Patch Mining for pathology images, while Gene-Stratified analysis processes six functional gene categories. Both generate structured reports with CoT reasoning, storing complete analytical processes for experiential learning. (2) Dichotomy-Based Multi-Expert Agent Inference retrieves similar cases via RAG and integrates multimodal reports with expert predictions through progressive interval refinement. Extensive experiments on five TCGA cohorts demonstrate SurvAgent's superority over conventional methods, proprietary MLLMs, and medical agents, establishing a new paradigm for explainable AI-driven survival prediction in precision oncology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。