仅凭人脸图像推断第一印象人格,提升人机交互初始适应性
Knowing You at First Glance: Inferring Apparent Personality from Faces

- 用视觉-语言模型引入语义先验,增强面部特征对人格的捕捉能力
- 在MBTI人格框架下达到领先性能,揭示面部特征与人格感知关联
- 适合需要快速判断用户性格的机器人、虚拟助手等交互场景
从面部图像推断第一印象人格在人机交互中具有重要意义。与通过对话推断内在人格不同,该任务仅基于外观进行初步人格判断。现有研究多聚焦于大五人格模型,常依赖语言或多模态输入,尚未明确仅凭面部线索是否足以建立有意义的人格关联。尤其对于广泛使用且易于被大模型理解的MBTI类型,这一问题尤为关键。为此,本文提出GlanceFace框架,利用视觉-语言模型引入语义先验,结合语义增强的面部表征模块捕捉细微人格相关特征,并采用不确定性感知学习策略应对标注噪声与主观性。大量实验表明,该方法在基于MBTI的显性人格基准上表现优异,揭示了面部特征与感知人格之间的关联,展示了其在支持具身智能体自适应初始交互策略方面的潜力。代码与数据集已开源。
原文摘要 · Abstract (English)
Inferring apparent personality from facial images is important in social scenarios for embodied agents in human-robot interaction. Unlike inferring intrinsic personality traits via conversation, this task models first-impression personality perception based solely on facial appearance before interaction begins. Existing studies mainly focus on the Big Five personality model and often rely on language or multimodal inputs. As a result, it remains unclear whether facial cues alone can support meaningful associations with perceived personality traits. This question is particularly relevant for MBTI types, which are widely used in practice and more readily interpretable by large language models. To this end, we propose \textbf{GlanceFace}, an end-to-end framework for apparent personality inference leveraging vision-language models to introduce semantic priors and a semantic-enhanced facial representation module to capture subtle personality-related cues, together with an uncertainty-aware learning strategy to handle noisy and subjective annotations. Extensive experiments demonstrate strong performance on MBTI-based apparent personality benchmarks and reveal relationships between facial characteristics and perceived personality traits, highlighting its potential to support adaptive initial interaction strategies for embodied agents. The code and dataset are available at https://github.com/MrHuan3/GlanceFace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。