arXiv:2608.26956cs.CV2026-08中稿 · EMNLP

用动态评分标准评估图像生成质量,更懂用户指令意图。

RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing

论文配图:RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing
图 1 · 摘自论文原文
  • 根据输入自动生成评分维度与权重的动态评分表
  • 在多任务测试中超越现有专用奖励模型表现
  • 适合需要精准控制生成结果的图像编辑场景

奖励模型在对齐视觉生成模型方面至关重要,但现有视觉奖励模型通常使用单一标量分数或固定评判标准,无法适应不同指令需求,限制了可解释性与任务敏感性,尤其在文生图和基于指令的图像编辑任务中。本文提出RubricRM,一种配对式生成式奖励建模框架:首先为输入生成包含评价维度、权重和评分标准的专属评分表,再用该评分表对候选图像打分。通过两阶段训练流程(监督微调 + GRPO优化)分别训练用于文生图和图像编辑的RubricRM模型。在多个生成与编辑基准测试中,RubricRM性能优于现有专用奖励模型,并在使用较小模型的前提下仍可媲美强大专有多模态大模型判官。代码、数据与模型已开源。

原文摘要 · Abstract (English)

Reward models play an essential role in aligning visual generative models, yet most existing visual reward models use a single scalar score or rely on fixed criteria that cannot adapt to different instructions. This limits both interpretability and task sensitivity, especially for text-to-image generation and instruction-based image editing, where different inputs require different evaluation dimensions. We propose RubricRM, a pairwise generative reward modeling framework that first produces an input-specific rubric with evaluation dimensions, weights, and scoring criteria, and then applies the rubric to score candidate images. We train dedicated RubricRM models for text-to-image generation and image editing using a two-stage training pipeline: supervised fine-tuning teaches the model the rubric-based scoring paradigm, while GRPO further improves scoring through fine-grained dimension-level rewards. Experiments on multiple generation and editing benchmarks show that RubricRM outperforms existing specialized reward models and remains competitive with strong proprietary MLLM judges despite using smaller backbones. Our models, data, and code are available at https://github.com/zijiankan/RubricRM.

图像生成奖励模型动态评分文本到图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。