arXiv:2605.27194cs.CLcs.CV2026-05

针对长篇医学报告生成中关键信息被淹没的问题,提出动态注意力机制提升关键词监督。

Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation

论文配图:Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation
图 1 · 摘自论文原文
  • 通过加权关键语义词和结束标记的损失,实现精准内容监督
  • 在MIMIC-CXR与CheXpert Plus上多项指标领先,包括BLEU-4、ROUGE-L和RadGraph F1
  • 适合需要高精度医学文本生成的研究者或临床辅助系统开发

将示范效应蒸馏到隐空间干预是一种轻量级微调替代方案。然而,现有多模态方法主要在短文本任务上评估,输出仅数个词。扩展至长文本生成时暴露一个根本性但未被充分研究的局限:逐令牌蒸馏默认所有输出令牌同等重要,而长文本由高频模板与语法词主导,真正决定质量的关键词分布稀疏。在医学报告生成(MRG)中,两类关键令牌尤为突出:决定诊断内容的病灶相关词,以及决定终止的序列结束(EOS)事件。两者在均匀交叉熵下均受监督不足,自回归解码更因偏离教师强制轨迹而加剧问题。我们提出DIVE框架,通过两种互补机制应对上述缺陷。关键令牌监督通过提升病灶相关词与EOS事件的交叉熵权重,恢复监督平衡,确保内容一致性和终止逻辑在训练阶段学习而非解码时强加。状态感知的动态引导将固定开环残差替换为依赖隐藏状态的适配器,使注入信号随解码漂移自适应调整。在两个医学视觉语言模型骨干网络下,于MIMIC-CXR和CheXpert Plus上的实验表明,DIVE在词汇与临床代理指标上始终位列前列。其在所有数据集-骨干设置中均取得最优的BLEU-4、ROUGE-L和RadGraph F1,同时在粗粒度标签级CheXbert F1上保持竞争力。

原文摘要 · Abstract (English)

Distilling demonstration effects into hidden-space interventions offers a lightweight alternative to full finetuning. However, existing multimodal variants are mostly evaluated on short-form tasks, where outputs end after a few tokens. Extending these methods to long-form generation exposes a fundamental yet underexamined limitation: token-level distillation implicitly treats all output tokens as equally informative, but long-form outputs are dominated by high-frequency template and grammatical tokens, while the tokens that actually determine output quality are sparsely distributed. In medical report generation (MRG), two such decisive tokens stand out: pathology-related tokens that determine diagnostic content, and the end-of-sequence (EOS) event that determines termination. Both receive insufficient supervision under uniform cross-entropy, and autoregressive decoding further compounds the problem by drifting away from teacher-forced trajectories. We propose DIVE, a frozen-backbone distillation framework that addresses long-form report generation through two complementary mechanisms matched to these failures. Decisive-token supervision restores supervision balance by upweighting the cross-entropy contribution of pathology-related tokens and the EOS event, ensuring that content fidelity and termination are learned during training rather than imposed at decoding time. State-conditioned dynamic steering replaces fixed open-loop residuals with hidden-state-dependent adapters, allowing the injected signal to adapt as decoding drifts. Experiments on MIMIC-CXR and CheXpert Plus with two medical VLM backbones show that DIVE consistently ranks among the strongest methods across lexical and clinical-proxy metrics. Our method achieves the best BLEU-4, ROUGE-L, and RadGraph F1 in all dataset--backbone settings, while remaining competitive on coarse label-level CheXbert F1.

医学报告生成长文本生成关键令牌监督蒸馏方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。