arXiv:2603.29167cs.CV2026-03

用高成本CT数据训练,部署时仅用X-ray,提升诊断准确率。

JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference

  • 基于置信度筛选高可信CT教师输出,仅对高质量样本进行知识蒸馏
  • 在510例配对数据上,准确率提升0.033至0.035,超越所有对比方法
  • 适合医疗影像部署受限场景,兼顾精度与计算成本

我们研究了一种系统级视觉推理问题:训练时使用昂贵的特权模态(如CT),但部署时保持固定成本、单模态(X-ray)路径。本文提出JDCNet,一种置信度门控的CT到X-ray知识蒸馏框架,仅当教师模型置信度超过阈值时,才提供硬标签或温度缩放目标;部署时学生模型仅输入X-ray,参数量、计算量和延迟与监督式X-ray基线完全一致。在包含510名患者的同患者配对BIMCV数据集上,采用患者级别5折交叉验证,两种JDCNet配置均显著优于监督式ResNet-18基线:3切片软KL监督使准确率提升ΔBA=+0.035(95% CI [0.011, 0.057]),中切片硬监督提升+0.033([0.007, 0.058])。在相同划分与阈值下,对数蒸馏、门控对数蒸馏、对比对齐、注意力传递、特征提示、BiomedCLIP微调及模块增强变体均未通过该阈值。置信度门控的辅助目标比均匀软化的CT对数更易迁移。证据局限于单一配对队列,因此需外部配对队列复现后方可考虑实际部署。

原文摘要 · Abstract (English)

We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path. We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline. On a 510-patient same-patient paired BIMCV cohort with patient-level 5-fold cross-validation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice soft-KL supervision yields $Δ\mathrm{BA}{=}{+}0.035$ ($95\%$ CI $[{+}0.011,{+}0.057]$) and mid-slice hard supervision yields $+0.033$ ($[{+}0.007,{+}0.058]$). Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. Confidence-gated auxiliary targets are therefore a more transferable channel than uniformly softened CT logits; the evidence is bounded to one paired cohort, so external paired-cohort replication is required before any deployment claim.

医学影像知识蒸馏低成本推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。