基于类比推理的医学影像模型,提升胃肠镜诊断通用性与鲁棒性。
Analogical Reasoning as a Doctor: A Foundation Model for Gastrointestinal Endoscopy Diagnosis
- 通过循环预训练整合五大数据集的异构标注,实现知识迁移。
- 在六类场景中超越现有模型,零样本迁移与联邦学习表现优异。
- 无需统一标签即可自动融合多源数据,适合资源有限地区使用。
胃肠道疾病带来日益增长的全球健康负担,内镜检查是早期诊断的主要手段。然而,常规内镜图像解读仍存在漏诊和效率低的问题。尽管人工智能辅助诊断展现潜力,但现有模型因医疗数据有限、领域偏移和标注异质性,普遍存在泛化性差、适应性弱、鲁棒性不足和可扩展性差等问题。为此,我们提出RATNet,一种基于类比推理的胃肠道内镜成像基础模型。RATNet通过循环预训练策略,从五个胃肠道内镜数据集的异构专家标注中获取并迁移知识。其架构包含编码器、相关性知识获取与传递(RAT)模块、投影器和多任务头,支持微调、线性探测和零样本迁移。评估显示,RATNet在六种场景中优于现有基础模型(包括GastroNet和GastroVision):常见胃肠道疾病诊断、罕见病少样本学习、新医疗点零样本迁移、长尾疾病分布下的鲁棒性、新疾病适应性以及通过联邦学习实现隐私保护部署。其优势源于类比推理机制,将图像生成的后验知识与学习到的先验知识库匹配,并传递相对知识以指导诊断,从而提升泛化能力与抗偏差性能。RATNet开源且成本低,支持异构标注自动集成而无需人工统一标签,显著降低数据获取成本,是资源受限环境下智能胃肠道诊断的理想基础。
原文摘要 · Abstract (English)
Gastrointestinal diseases impose a growing global health burden, and endoscopy is a primary tool for early diagnosis. However, routine endoscopic image interpretation still suffers from missed lesions and limited efficiency. Although AI-assisted diagnosis has shown promise, existing models often lack generalizability, adaptability, robustness, and scalability because of limited medical data, domain shift, and heterogeneous annotations. To address these challenges, we develop RATNet, a foundation model for gastrointestinal endoscopy imaging based on analogical reasoning. RATNet acquires and transfers knowledge from heterogeneous expert annotations across five gastrointestinal endoscopy datasets through a cyclic pre-training strategy. Its architecture consists of an encoder, a relevance-knowledge acquisition and transfer (RAT) module, a projector, and a multi-task head, and supports fine-tuning, linear probing, and zero-shot transfer. Evaluations show that RATNet outperforms existing foundation models, including GastroNet and GastroVision, across six scenarios: diagnosis of common gastrointestinal diseases, few-shot learning for rare diseases, zero-shot transfer to new medical sites, robustness under long-tailed disease distributions, adaptation to novel diseases, and privacy-preserving deployment via federated learning. Its advantage comes from an analogical reasoning mechanism that matches image-derived posterior knowledge to a learned prior knowledge base and transfers relative knowledge to guide diagnosis, improving generalization and resistance to bias. RATNet is open and cost-effective, supports automatic integration of heterogeneous annotations without manual label unification, and reduces data acquisition costs, making it a practical foundation for intelligent gastrointestinal diagnosis, especially in resource-limited settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。