arXiv:2507.15140cs.AI2025-07

用专家思维诊断118种口腔病,准确率超89%。

Clinical Semantic Intelligence (CSI): Emulating the Cognitive Framework of the Expert Clinician for Comprehensive Oral Disease Diagnosis

  • 模仿专家诊断逻辑,分步推理判断
  • 快速模式准确率73.4%,深度模式达89.5%
  • 适合临床辅助诊断,提升医生决策效率

口腔疾病诊断因病种繁多、症状重叠而困难。为此,我们提出临床语义智能(CSI)框架,通过计算模拟专家认知过程,实现对118种口腔疾病的诊断。核心思想是超越简单模式匹配,复现专家的推理逻辑。系统融合微调后的多模态CLIP模型与专用ChatGLM-6B语言模型,执行分层诊断推理树(HDRT),包含快速筛查与深度交互两种模式。训练数据集含4,310张图像,经临床增强策略扩展至超3万对图文样本,外加176张图像用于最终验证。在431张内部测试图像上,快速模式准确率为73.4%,标准模式使用完整HDRT后提升至89.5%,性能提升源于分层推理机制。本文详述了该框架的设计理念、构建过程与严格评估。

原文摘要 · Abstract (English)

The diagnosis of oral diseases presents a problematic clinical challenge, characterized by a wide spectrum of pathologies with overlapping symptomatology. To address this, we developed Clinical Semantic Intelligence (CSI), a novel artificial intelligence framework that diagnoses 118 different oral diseases by computationally modeling the cognitive processes of an expert clinician. Our core hypothesis is that moving beyond simple pattern matching to emulate expert reasoning is critical to building clinically useful diagnostic aids. CSI's architecture integrates a fine-tuned multimodal CLIP model with a specialized ChatGLM-6B language model. This system executes a Hierarchical Diagnostic Reasoning Tree (HDRT), a structured framework that distills the systematic, multi-step logic of differential diagnosis. The framework operates in two modes: a Fast Mode for rapid screening and a Standard Mode that leverages the full HDRT for an interactive and in-depth diagnostic workup. To train and validate our system, we curated a primary dataset of 4,310 images, supplemented by an external hold-out set of 176 images for final validation. A clinically-informed augmentation strategy expanded our training data to over 30,000 image-text pairs. On a 431-image internal test set, CSI's Fast Mode achieved an accuracy of 73.4%, which increased to 89.5% with the HDRT-driven Standard Mode. The performance gain is directly attributable to the hierarchical reasoning process. Herein, we detail the architectural philosophy, development, and rigorous evaluation of the CSI framework.

口腔诊断专家推理多模态分层推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。