对比人类与大模型在审美体验中的差异,揭示AI对内在感受的缺失。
Interoceptive Divergence in Aesthetic Evaluation and Implications for Human-AI Alignment

- 用问卷对比人与大模型对图像美感的反应模式
- 发现两者在情绪关联上相似,但身体感受响应差异显著
- 适合关注AI对美感理解局限的研究者或伦理设计者
人工智能(如大语言模型)在多项认知任务中已接近甚至超越人类表现。然而,人类不仅具备智力,还拥有感知和体验视觉之美的情感能力。这引出一个根本问题:人类与AI在审美体验中如何趋同或分化?审美评价不仅依赖图像客观特征,也受观察者内部过程影响。为推进AI对齐研究,我们借鉴先前人类研究中关于美感评分、身体感觉与情绪的关系,将相同问卷项施用于大语言模型,实现人与AI的直接比较。分析显示,尽管人类与大模型在美感评分与情绪的相关性及关注图像特征方面总体模式相似,但在情绪分布以及美感评分与身体感觉的关系上存在明显差异。这表明,当前先进大语言模型虽能在一定程度上模拟人类平均审美倾向,但仍存在局限,尤其在内感受层面,可能源于训练数据不足或对齐过程的意外后果。这些发现凸显了AI对齐的关键挑战,并为发展具有类人审美处理能力的AI系统指明方向。
原文摘要 · Abstract (English)
Artificial intelligence (AI), exemplified by large language models (LLMs), is rapidly approaching and in some cases surpassing human performance across a wide range of cognitive tasks. However, human nature is not limited to intelligence alone; it also encompasses sensibility, including the capacity to perceive and experience beauty in visual scenes. This raises a fundamental question: how humans and AI systems converge or diverge in such aesthetic experiences. Aesthetic evaluation depends not only on objective properties of images but also on internal processes within the observer. As part of ongoing efforts in AI alignment, building upon prior human studies that have examined the relationship between beauty ratings, bodily sensations, and emotions, we adopt a comparable set of questionnaire items and present them to LLMs, enabling a direct comparison between human and AI responses. Our comparative analyses revealed that, while humans and AI exhibited broadly similar patterns in the correlations between beauty ratings and emotions, as well as in the image features they prioritized, notable divergences emerged in both the distribution of emotional responses and the relationship between beauty ratings and bodily sensations. These findings suggest that state-of-the-art LLMs, trained on large-scale textual data, can approximate average human tendencies in aesthetic evaluation to a certain extent. However, they also indicate limitations, particularly in relation to interoceptive aspects, which may reflect insufficient representation in training data or unintended consequences of alignment processes. These findings highlight key challenges for AI alignment and suggest important directions for developing AI systems with human-like aesthetic processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。