arXiv:2609.05028cs.CV2026-09

用分层奖励机制提升医学图像生成质量,让模型更懂细节和结构。

Compositional Reward Models for Conditional Medical Image Generation

论文配图:Compositional Reward Models for Conditional Medical Image Generation
图 1 · 摘自论文原文
  • 将图像质量分解为从低到高的多个阶段,分别评估强度、纹理、结构和语义一致性。
  • 在三个医学数据集上生成数据训练下游模型,性能优于基线,最高提升5.9%。
  • 适合需要高精度医学图像生成的研究者,尤其关注细节与结构准确性的任务。

获取高质量标注的医学图像数据对深度学习模型训练至关重要,但标注成本高、耗时长且需领域专长。条件扩散模型(如ControlNet)可通过语义掩码和文本条件生成图像作为替代方案。然而,现有方法难以捕捉细粒度属性(如强度、纹理)及领域专家期望的语义一致性,限制了其下游应用效果。近期基于强化学习微调的方法受限于单一标量奖励,混淆了多种失败模式,提供弱纠正信号。本文提出PRISM,一种用于条件医学图像生成的组合式奖励模型(CRM)框架。不使用单一奖励,而是将图像质量分解为验证器驱动的多个阶段,分别评估低层属性(强度、纹理)、条件输入的结构对齐性以及高层语义保真度。这些阶段奖励通过层次化约束传播(HCP)机制组合,遵循由细到粗的正确性原则,确保低层缺陷解决后才积累高层奖励,避免简单目标掩盖关键错误。我们在三个涵盖多样化医学影像任务的数据集上评估PRISM:PanNuke(多类别细胞分割)、CeDeM(绒毛/隐窝检测与测量)、ISIC(皮肤病变分类)。用PRISM生成的数据训练下游模型,结果优于最接近的基线,在PanNuke上mDice提升2.3%,CeDeM上均相对误差(MRE)降低8.5%,ISIC上F1值提升5.9%。

原文摘要 · Abstract (English)

Acquiring high quality annotated medical image data is critical for training deep learning models; however, annotation is expensive, time consuming, and requires domain expertise. Conditional diffusion models, such as ControlNet, offer an alternative by generating images conditioned on semantic masks and text. However, existing approaches fail to capture fine grained properties (e.g., intensity and texture), as well as semantic consistency expected by domain experts, limiting their effectiveness for downstream tasks. Recent attempts to address these issues using reinforcement learning fine-tuning remain limited due to the reliance on a single scalar reward, which conflates diverse failure modes and provides weak corrective signals. We propose PRISM, a Compositional Reward Model (CRM) framework for conditional medical image generation. Instead of assigning a single reward, we decompose image quality into verifier grounded stages, each evaluating a distinct aspect of correctness from fine to coarse properties, including low level attributes (intensity and texture), structural alignment with conditioning inputs, and high level semantic fidelity. These stage wise rewards are composed through a Hierarchical Constrained Propagation (HCP) mechanism that enforces a fine to coarse notion of correctness, ensuring that lower level deficiencies are resolved before higher level rewards are accrued, preventing easier objectives from masking critical failures. We evaluate PRISM across three datasets spanning diverse medical imaging tasks: PanNuke (multi-class cell segmentation), CeDeM (villi/crypt detection and measurement), and ISIC (skin lesion classification). Training downstream models with data generated by PRISM yields improvements over closest baselines, including a 2.3% increase in mDice on PanNuke, a 8.5% reduction in Mean Relative Error (MRE) on CeDeM, and increases ISIC F1 by 5.9%.

医学图像生成模型奖励设计扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。