arXiv:2606.31099cs.CVcs.AI2026-06中稿 · MICCAI2026

通过选择性激活特定视图神经元,提升多视角胸片报告一致性。

Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation

论文配图:Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation
图 1 · 摘自论文原文
  • 识别并强化仅响应特定视图的神经元,保留通用特征。
  • 在两个基准上显著提升视图特异性报告质量,计算开销低。
  • 适合关注医疗影像生成一致性和效率的研究者与临床应用。

近年来,放射科报告生成(RRG)取得显著进展,但现有方法大多直接融合多视角X光图像特征,忽视了单一模型处理不同视图时可能引发的临床不一致与错误,影响性能和临床可靠性。为此,我们提出视图专用神经元检测与微调框架(View-PNDF),从神经元层面实现视图一致的报告生成。该框架包含:(i) 视图专用神经元检测模块,识别对特定视图敏感的神经元;(ii) 验证模块,量化这些神经元的存在程度;(iii) 选择性微调策略,在强化检测到的神经元的同时保留视图无关表示。仅更新视图专用神经元,实现跨视图诊断一致性且降低计算成本。随后,利用大语言模型(LLM)将视图特异性报告整合为完整报告。我们采用传统自然语言生成(NLG)指标评估整合报告,并使用基于LLM的评估(如GPT-4o)分析视图特异性报告以捕捉临床意义。在两个医学RRG基准上的大量实验表明,View-PNDF显著提升了视图特异性胸部X光报告生成质量,同时保持稳健的泛化性能。

原文摘要 · Abstract (English)

Recent years have seen substantial advances in radiology report generation (RRG), yet existing approaches predominantly adopt direct feature fusion when handling multi-view X-ray images. Such approaches overlook the potential clinical inconsistencies and inaccuracies arising when a single model processes different views, adversely impacting performance and clinical reliability. To this end, we introduce View-PNDF (View-specific Pattern Neuron Detection and Fine-tuning), a parameter-efficient framework that fosters view-consistent report generation from a neuronal perspective. Specifically, View-PNDF comprises: (i) a view-specific neuron detection module identifying neurons responsive to particular views, (ii) a verification module quantifying the existence of these neurons, and (iii) a selective fine-tuning strategy strengthening detected neurons while preserving view-agnostic representations. By updating only view-specific neurons, View-PNDF achieves consistent diagnoses across different views with reduced computational costs. Subsequently, we employ Large Language Models (LLMs) to consolidate the view-specific reports into a complete radiology report. Furthermore, we use traditional Natural Language Generation (NLG) metrics-based assessment on integrated reports for baseline comparison and employ LLM-based assessment (e.g., GPT-4o) on view-specific reports to capture clinical significance. Extensive experiments on two medical RRG benchmarks demonstrate that View-PNDF substantially improves view-specific chest X-ray report generation quality while maintaining robust general-view performance.

医学影像报告生成参数高效多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。