用可追溯证据增强病理诊断的多模态AI助手,提升医生判断准确率。
A Multimodal Agentic Pathology Co-pilot via Evidence Grounded Reasoning

- 构建覆盖11万份文献的分级证据库,支持多模态推理
- 在20万+真实病例上表现优于现有模型,显著提升医生诊断准确率
- 适合临床病理医生和计算病理研究者使用
病理学是现代医学的核心,精准决策依赖于循证实践。尽管人工智能有潜力变革临床流程,但其与循证医学的结合仍不充分,现有工作多局限于文本类通用医学。本文提出专为循证病理设计的多模态AI代理系统PathPocket。我们构建了迄今最全面的病理证据语料库,包含约110,472份公开及授权文档,按临床指南至专家意见进行严格分级。基于此,构建包含超过455万实体和710万关系的大型多模态病理超图,作为可追溯证据的知识引擎。该系统集成输入理解、证据检索、筛选与诊断生成,支持从纯文本查询到含感兴趣区域(ROI)和千兆像素全切片图像(WSIs)的复杂多模态诊断任务。在涵盖20多万个真实病例的多维基准上评估,其显著优于现有最先进方法。大量用户研究表明,PathPocket显著提升病理科医生的诊断准确性和信心。通过将病理解读直接锚定在可验证的文献基础上,PathPocket为未来循证计算病理提供了实用且可扩展的解决方案。
原文摘要 · Abstract (English)
Pathology is the cornerstone of modern medicine, where accurate decision-making relies heavily on evidence-based practices. While artificial intelligence (AI) has the potential to transform clinical workflows, the intersection of AI and evidence-based medicine remains under-explored, with primitive attempts restricted to text-only general medicine. In this work, we present PathPocket, a multimodal AI agentic co-pilot designed specifically for evidence grounded pathology. We construct the most comprehensive pathology evidence corpus to date, encompassing approximately 110,472 public and authorized documents structured across a rigorous hierarchy of evidence from clinical guideline to expert opinion. From this meticulously graded foundation, we build a large-scale multimodal pathology hypergraph containing over 4.55 million entities and 7.10 million relations. Serving as a robust knowledge engine, this hypergraph provides traceable evidence for a collaborative multi-agent reasoning framework integrating input understanding, evidence retrieval, filtering, and diagnosis generation. This enables PathPocket to seamlessly resolve a wide spectrum of clinical tasks, ranging from text-only queries to complex multimodal diagnostics involving region-of-interest (ROI) and gigapixel whole-slide images (WSIs). We rigorously evaluate the system on a multidimensional benchmark of over 200,000 real-world cases, where it significantly outperforms existing state-of-the-arts. Crucially, extensive user studies demonstrate that PathPocket substantially improves the diagnostic accuracy and confidence of pathologists. By directly grounding pathology interpretations in verifiable literature, PathPocket offers a practical and scalable solution for the future of evidence grounded computational pathology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。