arXiv:2506.14799cs.HCcs.AI2025-06被引 1

用AI分析影视角色性别年龄分布,验证公众是否信任结果。

Analyzing Character Representation in Media Content using Multimodal Foundation Model: Effectiveness and Trust

  • 基于CLIP模型分析画面数据,量化角色性别与年龄分布
  • 用户研究显示工具整体有用,但对AI信任度中低
  • 适合关注媒体公平性的研究人员和内容创作者

近年来,AI技术使大规模自动化分析复杂媒体内容成为可能,可生成关于角色表征(如性别、年龄)的可行动洞察。以往工作通过AI模型从音视频文本中量化角色表征,但未纳入受众视角。本文提出新工具并开展用户研究,回答:即使获得角色在人口维度上的分布数据,公众认为这些信息有用吗?是否信任AI生成的结果?工具包含两部分:(i) 基于对比语言图像预训练(CLIP)模型的分析提取模块,用于解析视觉屏幕数据以量化性别与年龄表征;(ii) 针对普通观众设计的可视化组件。研究选取特定电影,通过可视化形式呈现分析结果,收集用户反馈。结果显示参与者能理解可视化内容,认为工具整体有用;但对AI生成的性别与年龄判断信任度为中等至偏低,虽不反对使用AI。工具代码、基准测试及研究数据已公开于https://github.com/debadyuti0510/Character-Representation-Media。

原文摘要 · Abstract (English)

Recent advances in AI has made automated analysis of complex media content at scale possible while generating actionable insights regarding character representation along such dimensions as gender and age. Past works focused on quantifying representation from audio/video/text using AI models, but without having the audience in the loop. We ask, even if character distribution along demographic dimensions are available, how useful are those to the general public? Do they actually trust the numbers generated by AI models? Our work addresses these open questions by proposing a new AI-based character representation tool and performing a thorough user study. Our tool has two components: (i) An analytics extraction model based on the Contrastive Language Image Pretraining (CLIP) foundation model that analyzes visual screen data to quantify character representation across age and gender; (ii) A visualization component effectively designed for presenting the analytics to lay audience. The user study seeks empirical evidence on the usefulness and trustworthiness of the AI-generated results for carefully chosen movies presented in the form of our visualizations. We found that participants were able to understand the analytics in our visualizations, and deemed the tool `overall useful'. Participants also indicated a need for more detailed visualizations to include more demographic categories and contextual information of the characters. Participants' trust in AI-based gender and age models is seen to be moderate to low, although they were not against the use of AI in this context. Our tool including code, benchmarking, and the user study data can be found at https://github.com/debadyuti0510/Character-Representation-Media.

角色表征AI可信度可视化分析媒体公平

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。