揭示用户审美差异对图像美学评估模型的影响机制
On the Role of Individual Differences in Current Approaches to Computational Image Aesthetics
- 构建统一模型,用分布形式编码个体审美特征
- 发现从通用到个人模型需外推,反向则更易实现且效果更好
- 教育、摄影与艺术经验是影响审美的关键因素,艺术类主观性更强
图像美学评估(IAA)因图像多样性与用户主观性而复杂。当前方法分为通用IAA(GIAA)与个性化IAA(PIAA),后者通过迁移学习融合用户偏好。但缺乏对迁移学习中群体构成、规模、审美差异及人口统计关联的理论理解。本文建立理论基础,提出统一模型,以分布形式编码个体特征,用于个体与群体评估。研究表明,从GIAA迁移到PIAA属于外推,反向为内插,通常更有效。在不同群体构成下的大量实验显示,即使在GIAA中也存在显著性能波动,挑战了平均分数可消除主观性的假设。基于地球移动距离(EMD)与吉尼指数的评分分布分析表明,教育、摄影经验与艺术经验是主要审美差异因素,艺术品比照片具有更高主观性。代码已开源。
原文摘要 · Abstract (English)
Image aesthetic assessment (IAA) evaluates image aesthetics, a task complicated by image diversity and user subjectivity. Current approaches address this in two stages: Generic IAA (GIAA) models estimate mean aesthetic scores, while Personal IAA (PIAA) models adapt GIAA using transfer learning to incorporate user subjectivity. However, a theoretical understanding of transfer learning between GIAA and PIAA, particularly concerning the impact of group composition, group size, aesthetic differences between groups and individuals, and demographic correlations, is lacking. This work establishes a theoretical foundation for IAA, proposing a unified model that encodes individual characteristics in a distributional format for both individual and group assessments. We show that transferring from GIAA to PIAA involves extrapolation, while the reverse involves interpolation, which is generally more effective for machine learning. Extensive experiments with varying group compositions, including sub-sampling by group size and disjoint demographics, reveal substantial performance variation even for GIAA, challenging the assumption that averaging scores eliminates individual subjectivity. Score-distribution analysis using Earth Mover's Distance (EMD) and the Gini index identifies education, photography experience, and art experience as key factors in aesthetic differences, with greater subjectivity in artworks than in photographs. Code is available at https://github.com/lwchen6309/aesthetics_transfer_learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。