提出梯度对齐机制,让医学图像增强更适配不同视觉任务需求。
Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotion
- 通过主模型与辅助识别模型的梯度对齐策略,智能选择更新方向。
- 在4个医学图像数据集上超越现有最优方法,提升图像质量与任务性能。
- 特别适合需兼顾图像清晰度与下游识别准确率的医疗场景。
得益于如ESTR等任务驱动图像质量增强(IQE)模型的进展,图像增强模型与视觉识别模型可相互促进,在生成人眼感知高质量图像的同时提升量化表现。然而,现有方法常忽视一个关键问题:不同层级的视觉任务对图像特征的需求存在差异甚至冲突。为此,本文提出一种通用的梯度促进(GradProm)训练策略,用于医学图像的任务驱动增强。具体地,将任务驱动的IQE系统拆分为两个子模型:主模型负责图像增强,辅助模型负责视觉识别。训练时,仅当两子模型的梯度方向一致(以余弦相似度衡量)时,才使用辅助模型的梯度更新主模型参数;否则仅使用主模型自身梯度。理论上,该策略确保主模型优化方向不被辅助模型误导。实验证明,该方法在四个公开且具有挑战性的医学图像数据集上均显著优于当前最优方法。
原文摘要 · Abstract (English)
Thanks to the recent achievements in task-driven image quality enhancement (IQE) models like ESTR, the image enhancement model and the visual recognition model can mutually enhance each other's quantitation while producing high-quality processed images that are perceivable by our human vision systems. However, existing task-driven IQE models tend to overlook an underlying fact -- different levels of vision tasks have varying and sometimes conflicting requirements of image features. To address this problem, this paper proposes a generalized gradient promotion (GradProm) training strategy for task-driven IQE of medical images. Specifically, we partition a task-driven IQE system into two sub-models, i.e., a mainstream model for image enhancement and an auxiliary model for visual recognition. During training, GradProm updates only parameters of the image enhancement model using gradients of the visual recognition model and the image enhancement model, but only when gradients of these two sub-models are aligned in the same direction, which is measured by their cosine similarity. In case gradients of these two sub-models are not in the same direction, GradProm only uses the gradient of the image enhancement model to update its parameters. Theoretically, we have proved that the optimization direction of the image enhancement model will not be biased by the auxiliary visual recognition model under the implementation of GradProm. Empirically, extensive experimental results on four public yet challenging medical image datasets demonstrated the superior performance of GradProm over existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。