arXiv:2605.06584cs.AI2026-05被引 1

用大模型自动处理多模态脑影像,让科研更高效。

NeuroAgent: LLM Agents for Multimodal Neuroimaging Analysis and Research

论文配图:NeuroAgent: LLM Agents for Multimodal Neuroimaging Analysis and Research
图 1 · 摘自论文原文
  • 构建多智能体系统,用自然语言驱动影像预处理与分析
  • 在1470例数据上实现95.2%阿尔茨海默病分类准确率
  • 适合脑科学、医学影像研究者快速搭建自动化流程

多模态神经影像分析常需复杂且模态特定的预处理流程,涉及精细配置、质量控制及异构工具链协调。下游统计分析与疾病分类还需任务定制代码、评估协议和数据格式规范,增加了原始数据到可复现分析的壁垒。我们提出NeuroAgent,一个基于大模型的智能体框架,可自动完成sMRI、fMRI、dMRI和PET等异构神经影像的关键预处理与分析步骤,并支持通过自然语言进行交互式下游分析。NeuroAgent采用分层多智能体架构,结合反馈驱动的生成-执行-验证引擎:智能体自主生成可执行预处理代码,检测并恢复运行时错误,验证输出完整性。我们在涵盖所有ADNI阶段的1,470名受试者数据上评估该系统(对照组1,000人,阿尔茨海默病患者470人),其中部分数据包含Tau-PET(n=469)、fMRI(n=278)和DTI(n=620)。多模型后端的消融实验表明,性能优异的模型可实现100%意图解析准确率,最强后端(Qwen3.5-27B)达到84.8%的端到端预处理步骤正确率。自动恢复机制将人工干预仅限于边缘情况,通过人机协同接口处理。利用自动预处理的多模态数据进行阿尔茨海默病分类,代理集成模型达到AUC 0.9518,优于所有单模态基线。结果表明,NeuroAgent可显著降低神经影像预处理的人工成本,实现神经影像研究的端到端自动化分析流程。

原文摘要 · Abstract (English)

Multimodal neuroimaging analysis often involves complex, modality-specific preprocessing workflows that require careful configuration, quality control, and coordination across heterogeneous toolchains. Beyond preprocessing, downstream statistical analysis and disease classification commonly require task-specific code, evaluation protocols, and data-format conventions, creating additional barriers between raw acquisitions and reproducible scientific analysis. We present NeuroAgent, an LLM-driven agentic framework that automates key preprocessing and analysis steps for heterogeneous neuroimaging data, including sMRI, fMRI, dMRI, and PET, and supports interactive downstream analysis through natural-language queries. NeuroAgent employs a hierarchical multi-agent architecture with a feedback-driven Generate-Execute-Validate engine: agents autonomously generate executable preprocessing code, detect and recover from runtime errors, and validate output integrity. We evaluate the system on 1,470 subjects pooled across all ADNI phases (CN=1,000, AD=470), where all subjects have sMRI and tabular data, with subsets also having Tau-PET (n=469), fMRI (n=278), and DTI ($n=620$). Pipeline ablation studies across multiple LLM backends show that capable models reach up to 100% intent-parsing accuracy, with the strongest backend (Qwen3.5-27B) reaching 84.8% end-to-end preprocessing step correctness. Automated recovery limits manual intervention to edge cases where human review is required via the Human-In-The-Loop interface. For Alzheimer's Disease classification using automatically preprocessed multimodal data, our agent ensemble achieves an AUC of 0.9518 with four modalities, outperforming all single-modality baselines. These results show that NeuroAgent can reduce the manual effort required for neuroimaging preprocessing and enable end-to-end automated analysis pipelines for neuroimaging research.

脑影像分析大模型应用自动化流程多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。