用角色扮演生成心理测试回答,提升性格识别准确率
Ask, Answer, and Detect: Role-Playing LLMs for Personality Detection with Question-Conditioned Mixture-of-Experts
- 让大模型模拟用户回答心理问卷,生成可解释的证据链
- 在Kaggle数据集上提升15.41%,显著优于现有方法
- 适合需要可解释性性格分析的推荐与心理健康应用
理解人类性格对个性化推荐和心理健康评估等网络应用至关重要。现有性格检测多采用“帖子→用户向量→标签”的范式,将社交媒体内容编码为用户表征以预测性格标签(如MBTI)。尽管大语言模型提升了文本编码能力,但受限于标签稀缺和语言与抽象心理概念间语义映射不清。本文提出ROME框架,通过注入心理学知识解决上述问题:利用大模型的角色扮演能力,模拟用户对标准化心理量表的回答。生成的逐题回答将自由文本转化为基于量表的可解释证据,提供丰富的中间监督信号,缓解标签稀缺问题,并构建引导文本到性格映射的语义推理链。一个条件化混合专家模块联合路由帖子与问题表征,学习在显式监督下回答量表题目。预测答案被汇总为可解释的答案向量,与用户表征融合,在多任务学习框架中完成最终预测,其中问答任务作为强大辅助任务。在两个真实数据集上的大量实验表明,ROME持续超越当前最优基线,在Kaggle数据集上提升15.41%。
原文摘要 · Abstract (English)
Understanding human personality is crucial for web applications such as personalized recommendation and mental health assessment. Existing studies on personality detection predominantly adopt a "posts -> user vector -> labels" modeling paradigm, which encodes social media posts into user representations for predicting personality labels (e.g., MBTI labels). While recent advances in large language models (LLMs) have improved text encoding capacities, these approaches remain constrained by limited supervision signals due to label scarcity, and under-specified semantic mappings between user language and abstract psychological constructs. We address these challenges by proposing ROME, a novel framework that explicitly injects psychological knowledge into personality detection. Inspired by standardized self-assessment tests, ROME leverages LLMs' role-play capability to simulate user responses to validated psychometric questionnaires. These generated question-level answers transform free-form user posts into interpretable, questionnaire-grounded evidence linking linguistic cues to personality labels, thereby providing rich intermediate supervision to mitigate label scarcity while offering a semantic reasoning chain that guides and simplifies the text-to-personality mapping learning. A question-conditioned Mixture-of-Experts module then jointly routes over post and question representations, learning to answer questionnaire items under explicit supervision. The predicted answers are summarized into an interpretable answer vector and fused with the user representation for final prediction within a multi-task learning framework, where question answering serves as a powerful auxiliary task for personality detection. Extensive experiments on two real-world datasets demonstrate that ROME consistently outperforms state-of-the-art baselines, achieving improvements (15.41% on Kaggle dataset).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。