提出可解释人格识别框架与对话数据集,让模型像人一样说出判断依据。
Revealing Personality Traits: A New Benchmark Dataset for Explainable Personality Recognition on Dialogues
- 构建从语境到短期人格状态再到长期特质的推理链条
- 在对话数据上验证任务难度高,现有模型表现有限
- 适合对人格分析、可解释AI感兴趣的研究者
人格识别旨在从对话、社交媒体等用户数据中推断人格特质。当前研究多将其视为分类任务,忽视了识别结果的支撑证据。本文提出可解释人格识别新任务,旨在揭示人格判断背后的推理过程。基于人格理论,人格特质由稳定的行为模式构成,而这些模式源于具体情境下短暂的思想、情感与行为特征。我们提出链式人格证据(Chain-of-Personality-Evidence, CoPE)框架,实现从具体语境→短期人格状态→长期人格特质的渐进推理。基于此框架,我们构建了一个对话型可解释人格识别数据集PersonalityEvd,包含两个任务:可解释人格状态识别与可解释人格特质识别,要求模型同时输出标签及其支持证据。在大语言模型上的大量实验表明,该任务极具挑战性,并为未来研究提供关键洞见。数据与代码已公开于https://github.com/Lei-Sun-RUC/PersonalityEvd。
原文摘要 · Abstract (English)
Personality recognition aims to identify the personality traits implied in user data such as dialogues and social media posts. Current research predominantly treats personality recognition as a classification task, failing to reveal the supporting evidence for the recognized personality. In this paper, we propose a novel task named Explainable Personality Recognition, aiming to reveal the reasoning process as supporting evidence of the personality trait. Inspired by personality theories, personality traits are made up of stable patterns of personality state, where the states are short-term characteristic patterns of thoughts, feelings, and behaviors in a concrete situation at a specific moment in time. We propose an explainable personality recognition framework called Chain-of-Personality-Evidence (CoPE), which involves a reasoning process from specific contexts to short-term personality states to long-term personality traits. Furthermore, based on the CoPE framework, we construct an explainable personality recognition dataset from dialogues, PersonalityEvd. We introduce two explainable personality state recognition and explainable personality trait recognition tasks, which require models to recognize the personality state and trait labels and their corresponding support evidence. Our extensive experiments based on Large Language Models on the two tasks show that revealing personality traits is very challenging and we present some insights for future research. Our data and code are available at https://github.com/Lei-Sun-RUC/PersonalityEvd.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。