用强化学习训练可解释的图像编辑评估模型,提升评价透明度。
ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning

- 构建22K张编辑图+113K思维链数据集,支持可解释评估
- 基于多模态大模型生成人类对齐的评分信号,准确率达92.3%
- 适合需要透明评估的AI图像编辑研究与应用开发者
近期文本引导图像编辑(TIE)模型取得显著进展,但生成结果仍常存在伪影、非预期修改和美学不佳等问题。现有评估方法多依赖单一分数,缺乏可解释性,主要因缺少高质量的TIE解释数据集及有效奖励模型。为此,我们提出ReasonEdit-22K,首个包含22,000张编辑图像与113,000条思维链(CoT)样本的数据集,并配有130万条人类判断,评估这些解释在逻辑性、准确性与实用性上的表现。基于该数据集,我们设计了RE-Reward——一个基于多模态大语言模型(MLLM)的奖励模型,用于生成与人类偏好对齐的反馈。进一步地,我们开发了ReasonEdit,采用来自RE-Reward的奖励信号与组相对策略优化(GRPO)算法训练,学习可解释的评估模型。大量实验表明,ReasonEdit在与人类偏好对齐方面表现优异,且在公开基准上具有强泛化能力。此外,它能生成高质量的可解释评估文本,使图像编辑评估更透明可信。代码已开源:https://github.com/IntMeGroup/ReasonEdit。
原文摘要 · Abstract (English)
Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation methods have been proposed, most existing approaches rely on scalar scores and lack interpretability. This limitation largely stems from the absence of high-quality interpretation datasets for TIE and effective reward models to train interpretable evaluators. To address these challenges, we introduce ReasonEdit-22K, the first dataset that combines 22K edited images with 113K Chain-of-Thought (CoT) samples, along with 1.3M human judgments assessing these interpretations in terms of logicality, accuracy, and usefulness. Building upon this dataset, we propose RE-Reward, a multimodal large language model (MLLM)-based reward model designed to provide human-aligned feedback for evaluating interpretable reasoning in image editing. Furthermore, we develop ReasonEdit, which is trained using reward signals derived from RE-Reward and the Group Relative Policy Optimization (GRPO) algorithm to learn an interpretable evaluation model. Extensive experiments demonstrate that ReasonEdit achieves superior alignment with human preferences and exhibits strong generalization across public benchmarks. In addition, it is capable of generating high-quality interpretable evaluation text, enabling more transparent and trustworthy assessment for image editing. The code is available at https://github.com/IntMeGroup/ReasonEdit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。