arXiv:2409.00216cs.CV2024-09

量化图像中物体的突出程度,让分析更贴近人类视觉注意力

Structuring Quantitative Image Analysis with Object Prominence

  • 基于大小、位置、深度和显著性图三种方法估算物体突出度
  • 实验证明突出度影响人眼注视点,且能提升意识形态分析效果
  • 适用于媒体分析、政治广告性别呈现等需要理解图像意图的研究

摄影师或媒体从业者在构图时会刻意决定哪些元素突出、哪些退居背景,从而引导观众理解。然而大多数图像分析方法忽视这种结构,将检测到的物体视为同等重要。本文提出一种衡量物体突出度(object prominence)的框架,使计算图像分析能够关注创作者构建的视觉重心。结合认知心理学与计算机视觉研究,提出了三种估算方法:大小与居中性、推断深度、显著性图。在注册的瞳孔追踪实验中验证了创作者设定的突出度确实显著影响人类视觉注意力。进一步应用显示:根据突出度加权特征可提升美国报纸图像的无监督意识形态分析效果;分析2016与2020年美国总统竞选广告发现,共和党候选人比民主党候选人更少突出女性形象。该框架使大规模图像数据分析能兼顾其传播结构与意图。

原文摘要 · Abstract (English)

When photographers or media professionals compose an image, they make deliberate choices about what to foreground and what to background, shaping how viewers interpret visual content. Yet most quantitative approaches to image analysis overlook this structure and treat detected objects as equally important. We introduce a framework for measuring object prominence-- the relative salience of objects in an image-- as a means to make computational image analysis attentive to the compositional emphasis a curator has built into an image. Drawing on research in cognitive psychology and computer vision, we outline three approaches for estimating object prominence: size and centeredness, inferred depth, and saliency maps. Validating that curator-composed prominence measurably shifts human visual attention in a pre-registered eye-tracking study, we illustrate this framework's benefits in two further applications. First, we demonstrate how weighting features in line with their prominence can enhance the unsupervised ideological scaling of U.S. newspaper images. Second, we examine gendered visual prominence in U.S. presidential campaign ads from 2016 and 2020, showing that Republican candidates depict women less prominently than their Democratic counterparts. Our framework lets researchers analyze image data at scale while remaining attentive to its communicative structure and intent.

图像分析突出度视觉注意力政治传播

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。