arXiv:2412.04280cs.CVcs.GR2024-12中稿 · CVPR被引 32

人类偏好驱动的图像编辑数据集,支持自然语言精准操控。

HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing

  • 用人工标注和反馈构建数据对,确保指令与人类偏好一致
  • 含5751张高分辨率图,覆盖6类编辑指令,支持无掩码操作
  • 适合研究可控图像生成、人机协同编辑的学者使用

我们提出HumanEdit,一个高质量、由人类评分的数据集,专为基于指令的图像编辑设计,支持通过自然语言实现精确且多样的图像修改。以往大规模编辑数据集常缺乏有效的人类反馈,导致与人类偏好不一致。HumanEdit通过人工标注者构建数据对,管理员提供反馈,在四个阶段投入超2500小时人力,确保数据准确可靠。数据集包含5751张图像,涵盖动作、添加、计数、关系、移除、替换六类指令,覆盖真实场景。所有图像配有掩码,部分数据支持无掩码编辑。内容来自多个领域,分辨率高达1024×1024,具有高度多样性,是当前最全面的指令式图像编辑基准。项目已开源:https://huggingface.co/datasets/BryanW/HumanEdit。

原文摘要 · Abstract (English)

We present HumanEdit, a high-quality, human-rewarded dataset specifically designed for instruction-guided image editing, enabling precise and diverse image manipulations through open-form language instructions. Previous large-scale editing datasets often incorporate minimal human feedback, leading to challenges in aligning datasets with human preferences. HumanEdit bridges this gap by employing human annotators to construct data pairs and administrators to provide feedback. With meticulously curation, HumanEdit comprises 5,751 images and requires more than 2,500 hours of human effort across four stages, ensuring both accuracy and reliability for a wide range of image editing tasks. The dataset includes six distinct types of editing instructions: Action, Add, Counting, Relation, Remove, and Replace, encompassing a broad spectrum of real-world scenarios. All images in the dataset are accompanied by masks, and for a subset of the data, we ensure that the instructions are sufficiently detailed to support mask-free editing. Furthermore, HumanEdit offers comprehensive diversity and high-resolution $1024 \times 1024$ content sourced from various domains, setting a new versatile benchmark for instructional image editing datasets. With the aim of advancing future research and establishing evaluation benchmarks in the field of image editing, we release HumanEdit at https://huggingface.co/datasets/BryanW/HumanEdit.

图像编辑指令控制人类偏好数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。