arXiv:2602.22973cs.AI2026-02

用不可篡改的诊断快照,量化医生与AI的纠错过程。

Modeling Expert AI Diagnostic Alignment via Immutable Inference Snapshots

  • 将AI报告存为不可更改快照,对比医生修正结果。
  • 精确匹配率71.4%,综合一致性达100%无分歧案例。
  • 适合临床AI安全评估与可解释性研究者参考。

在关键医疗AI中,人机协同验证至关重要,但初始模型推理与医生修正之间的转换过程很少被系统分析。本文提出一种诊断对齐框架,将基于图像的AI生成报告作为不可更改的推理状态,并与医生确认结果进行系统比对。推理流程整合了视觉增强型大语言模型、基于BERT的医学实体抽取及顺序语言模型推理(SLMI)步骤,以确保领域一致性的优化。在21例皮肤病案例(21组完整AI-医生对)上评估,采用四层一致性标准:精确主诊断匹配率(PMR)、语义相似性调整率(AMR)、跨类别对齐和综合一致性率(CCR)。精确一致率达71.4%,在考虑语义相似性后无显著变化(t=0.60),而结构化跨类别与鉴别诊断重叠分析显示综合一致性为100%(95%置信区间:[83.9%, 100%])。无任何病例出现完全诊断分歧。结果表明,仅依赖二元词汇匹配会严重低估临床有意义的对齐程度。将专家验证建模为结构化转换,可实现信号感知的纠错动态量化,并支持可追溯、以人为本的基于图像的临床决策支持系统评估。

原文摘要 · Abstract (English)

Human-in-the-loop validation is essential in safety-critical clinical AI, yet the transition between initial model inference and expert correction is rarely analyzed as a structured signal. We introduce a diagnostic alignment framework in which the AI-generated image based report is preserved as an immutable inference state and systematically compared with the physician-validated outcome. The inference pipeline integrates a vision-enabled large language model, BERT- based medical entity extraction, and a Sequential Language Model Inference (SLMI) step to enforce domain-consistent refinement prior to expert review. Evaluation on 21 dermatological cases (21 complete AI physician pairs) em- ployed a four-level concordance framework comprising exact primary match rate (PMR), semantic similarity-adjusted rate (AMR), cross-category alignment, and Comprehensive Concordance Rate (CCR). Exact agreement reached 71.4% and remained unchanged under semantic similarity (t = 0.60), while structured cross-category and differential overlap analysis yielded 100% comprehensive concordance (95% CI: [83.9%, 100%]). No cases demonstrated complete diagnostic divergence. These findings show that binary lexical evaluation substantially un- derestimates clinically meaningful alignment. Modeling expert validation as a structured transformation enables signal-aware quantification of correction dynamics and supports traceable, human aligned evaluation of image based clinical decision support systems.

临床AI诊断对齐可解释性人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。