arXiv:2605.22635cs.LGcs.CL2026-05中稿 · ICML被引 1

解决多任务放射科报告生成中的梯度冲突难题,提升临床一致性。

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

论文配图:The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution
图 1 · 摘自论文原文
  • 从梯度动力学分析线性加权失效原因,提出双困境理论。
  • 新优化器使八种方法在两个数据集上平均提升2.3%和1.9%。
  • 无需修改模型结构,可通用插件式部署,适合临床报告生成研究者。

基于多任务学习的自动放射科报告生成(RRG)虽广泛采用以保障临床一致性,但多数工作聚焦于架构设计,仍依赖粗粒度的线性标量策略。此类策略无法有效平衡判别性临床监督的硬约束与报告生成的平滑性要求。本文从梯度动力学视角分析线性标量化的失败机制,利用随机微分方程(SDE)框架将其表征为“漂移项偏差”与“扩散项衰减”的双重困境。基于此,提出一种不依赖主干网络的优化器——冲突回避幅度增强梯度下降(CAME-Grad)。该算法通过冲突回避方向校正与幅度增强能量注入,既保证几何有效性,又避免陷入局部最优。进一步引入自适应梯度融合机制,在理论最优方向与任务特异性归纳偏置间建立动态平衡。实验表明,作为通用即插即用优化器,CAME-Grad在八个不同RRG方法中均带来显著且一致的性能提升,在MIMIC-CXR上平均临床效能提高2.3%,在IU X-Ray上提升1.9%。代码已开源:https://github.com/vpsg-research/CAME-Grad。

原文摘要 · Abstract (English)

While multi-task learning based automatic radiology report generation (RRG) is widely adopted to ensure clinical consistency, most focus on architectural designs yet remain limited to coarse linear scalarization strategies. These strategies cannot effectively balance the hard constraints of discriminative clinical supervision with the smoothness requirements of report generation. To address these problems, we analyze the failure mechanism of linear scalarization from the perspective of gradient dynamics, utilizing the stochastic differential equation (SDE) framework to characterize it as a "Double Dilemma" of drift term deviation and diffusion term decay. Based on this, we propose a backbone-agnostic optimizer named Conflict-Averse Magnitude-Enhanced Gradient Descent (CAME-Grad). Through conflict-averse direction rectification and magnitude-enhanced energy injection, the algorithm not only ensures geometric validity, but also avoids local optimal solutions. Then, the adaptive gradient fusion mechanism is used to establish a dynamic balance between the theoretical optimal direction and the task-specific inductive bias. Experiments show that as a universal plug-and-play optimizer, CAME-Grad brings substantial and consistent improvements across eight diverse RRG methods, elevating overall clinical efficacy performance by an average of 2.3% on MIMIC-CXR and 1.9% on IU X-Ray. Our code is available at https://github.com/vpsg-research/CAME-Grad.

多任务学习报告生成优化器医学AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。