让AI像医生一样动态调用隐性诊断记忆,提升医学影像判断精度。
MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution

- 通过可学习探针从解剖先验编码器中提取结构化隐性记忆
- 在多数据集上诊断准确率超越现有最优方法,尤其优于思维链模型
- 适合需要高可靠医学视觉推理的临床AI研发人员
精准医疗诊断不仅依赖静态影像特征,还依赖专家在阅片时即时调用的隐性诊断经验。我们发现现有医学视觉语言模型因离散分词导致认知错位,引发量化损失、长程信息衰减和缺乏病例自适应专长。为此,我们提出MedSynapse-V,一种潜空间诊断记忆演化框架,模拟临床专家的经验调用机制,在模型隐藏流中动态合成隐性诊断记忆。首先通过元查询先验记忆机制,可学习探针从解剖先验编码器中检索结构化先验,生成凝练的隐性记忆;为保障临床可信度,引入因果反事实精炼(CCR),利用强化学习与区域级特征掩码生成的反事实奖励,量化每段记忆的因果贡献,从而剔除冗余并对齐潜表示与诊断逻辑;最终通过内在记忆迁移(IMT)实现教师分支诊断模式向学生分支的内化,采用全词汇量差异对齐。跨多个数据集的全面实证表明,该框架通过将外部专家知识迁移至内部参数,显著优于现有最先进方法,尤其在诊断准确率上超越思维链范式。代码已开源:https://github.com/zhcz328/MedSynapse-V。
原文摘要 · Abstract (English)
High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs caused by discrete tokenization, leading to quantization loss, long-range information dissipation, and missing case-adaptive expertise. To bridge this gap, we propose ours, a framework for latent diagnostic memory evolution that simulates the experiential invocation of clinicians by dynamically synthesizing implicit diagnostic memories within the model's hidden stream. Specifically, it begins with a Meta Query for Prior Memorization mechanism, where learnable probes retrieve structured priors from an anatomical prior encoder to generate condensed implicit memories. To ensure clinical fidelity, we introduce Causal Counterfactual Refinement (CCR), which leverages reinforcement learning and counterfactual rewards derived from region-level feature masking to quantify the causal contribution of each memory, thereby pruning redundancies and aligning latent representations with diagnostic logic. This evolutionary process culminates in Intrinsic Memory Transition (IMT), a privileged-autonomous dual-branch paradigm that internalizes teacher-branch diagnostic patterns into the student-branch via full-vocabulary divergence alignment. Comprehensive empirical evaluations across multiple datasets demonstrate that ours, by transferring external expertise into endogenous parameters, significantly outperforms existing state-of-the-art methods, particularly chain-of-thought paradigms, in diagnostic accuracy. The code is available at https://github.com/zhcz328/MedSynapse-V.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。