首个基于人类偏好的渲染美学评估数据集,助力AI生成图像审美评价
DEAR: Dataset for Evaluating the Aesthetics of Rendering
- 基于麻省理工五千元数据集构建,通过众包收集25人对每组图像的偏好评分
- 共13,648人次参与,涵盖100张带标注图像,反映细腻风格偏好
- 适用于个性化审美建模、风格偏好预测等新任务,填补渲染美学评估空白
传统图像质量评估聚焦噪声、模糊或压缩伪影等技术退化问题,采用全参考与无参考客观指标。然而,摄影编辑、内容创作及AI生成图像中日益重要的渲染美学评估,因缺乏反映主观风格偏好的数据集而研究不足。本文提出首个系统性建模人类审美判断的基准数据集:渲染美学评估数据集(DEAR)。该数据集基于MIT-Adobe FiveK构建,通过大规模众包收集成对图像的人类偏好评分,每对图像由25名不同评估者打分,总计13,648人次参与。这些标注捕捉了细微且上下文敏感的审美偏好,支持开发与评估超越传统失真评估的新任务——渲染美学评估(EAR)。文中详述数据采集流程,分析人类投票模式,并展示风格偏好预测、美学基准测试与个性化审美建模等多种应用。据作者所知,DEAR是首个基于主观人类偏好的渲染美学评估数据集。其中100张图像的标注子集已发布于HuggingFace(huggingface.co/datasets/vsevolodpl/DEAR)。
原文摘要 · Abstract (English)
Traditional Image Quality Assessment~(IQA) focuses on quantifying technical degradations such as noise, blur, or compression artifacts, using both full-reference and no-reference objective metrics. However, evaluation of rendering aesthetics, a growing domain relevant to photographic editing, content creation, and AI-generated imagery, remains underexplored due to the lack of datasets that reflect the inherently subjective nature of style preference. In this work, a novel benchmark dataset designed to model human aesthetic judgments of image rendering styles is introduced: the Dataset for Evaluating the Aesthetics of Rendering (DEAR). Built upon the MIT-Adobe FiveK dataset, DEAR incorporates pairwise human preference scores collected via large-scale crowdsourcing, with each image pair evaluated by 25 distinct human evaluators with a total of 13,648 of them participating overall. These annotations capture nuanced, context-sensitive aesthetic preferences, enabling the development and evaluation of models that go beyond traditional distortion-based IQA, focusing on a new task: Evaluation of Aesthetics of Rendering (EAR). The data collection pipeline is described, human voting patterns are analyzed, and multiple use cases are outlined, including style preference prediction, aesthetic benchmarking, and personalized aesthetic modeling. To the best of the authors' knowledge, DEAR is the first dataset to systematically address image aesthetics of rendering assessment grounded in subjective human preferences. A subset of 100 images with markup for them is published on HuggingFace (huggingface.co/datasets/vsevolodpl/DEAR).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。