arXiv:2604.15853cs.CV2026-04中稿 · Poster Presentatio…

让机器像人一样看图审美,提升图像质量评估准确性。

Learning to Look before Learning to Like: Incorporating Human Visual Cognition into Aesthetic Quality Assessment

论文配图:Learning to Look before Learning to Like: Incorporating Human Visual Cognition into Aesthetic Quality Assessment
图 1 · 摘自论文原文
  • 构建双路径模型,融合视觉注意力与语义理解
  • 在多个数据集上显著优于纯语义模型,提升10%以上
  • 适合图像质量评估、内容推荐等需感知真实审美的场景

自动化美学质量评估(AQA)通常将图像视为静态像素向量,主要依赖语义感知来匹配人工评分。然而,这与人类美学认知的动态探索过程相悖——人类通过注视路径、处理流畅性以及自下而上显著性与自上而下意图的交互形成审美判断。本文提出AestheticNet,一种受人类视觉认知启发的新型AQA范式,采用双路径架构:视觉注意力路径使用基于眼动数据离线预训练的注视对齐视觉编码器(GAVE),通过资源高效的对比注视对齐实现;该路径与固定语义编码器(如CLIP)构成的语义路径通过交叉注意力融合。视觉注意力提供反映前景/背景结构、色彩渐变、明暗和光照等美学关键因素的认知先验。假设检验实验验证了其对纯语义基线的持续改进,并表明注视模块可兼容多种AQA主干网络,具备模型无关性与模块化特性,支持人类视觉认知在美学评估中的必要性与普适价值。代码已开源。

原文摘要 · Abstract (English)

Automated Aesthetic Quality Assessment (AQA) treats images primarily as static pixel vectors, aligning predictions with human-rating scores largely through semantic perception. However, this paradigm diverges from human aesthetic cognition, which arises from dynamic visual exploration shaped by scanning paths, processing fluency, and the interplay between bottom-up salience and top-down intention. We introduce AestheticNet, a novel cognitive-inspired AQA paradigm that integrates human-like visual cognition and semantic perception with a two-pathway architecture. The visual attention pathway, implemented as a gaze-aligned visual encoder (GAVE) pre-trained offline on eye-tracking data using resource-efficient contrast gaze alignment, models attention from human vision system. This pathway augments the semantic pathway, which uses a fixed semantic encoder such as CLIP, through cross-attention fusion. Visual attention provides a cognitive prior reflecting foreground/background structure, color cascade, brightness, and lighting, all of which are determinants of aesthetic perception beyond semantics. Experiments validated by hypothesis testing show a consistent improvement over the semantic-alone baselines, and demonstrate the gaze module as a model-agnostic corrector compatible with diverse AQA backbones, supporting the necessity and modularity of human-like visual cognition for AQA. Our code is available at https://github.com/keepgallop/AestheticNet.

美学评估视觉认知注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。