arXiv:2601.18582cs.CL2026-01

用排序代替分类,让大模型更准地判断人格类型。

From Classification to Ranking: Enhancing LLM Reasoning Capabilities for MBTI Personality Detection

  • 将人格检测转为排序任务,避免分类误判
  • 引入基于排名的强化学习,提升模型判断能力
  • 适合需要精准人格分析的研究与应用

人格检测旨在通过社交媒体文本推断个体的人格特质。大型语言模型(LLMs)为该任务提供了新思路。现有方法利用LLM从文本中提取语义信息作为提示,再训练分类器进行类别划分。然而,由于人格本身的复杂性及各特质间的细微差异,准确分类仍具挑战。且提示方法过度依赖人工设计的知识,缺乏自主学习模式的能力。为此,本文将人格检测视为一个排序任务,并提出相应的强化学习训练范式。首先通过监督微调(SFT)建立人格特质排序能力,并规范输出格式,形成可靠初始化;随后引入基于组相对策略优化(GRPO)的排名奖励函数。与有明确答案的验证任务不同,人格评估具有主观性,类别边界模糊。本奖励函数显式解决此问题,引导模型学习最优答案排序。大量实验表明,该方法在多个主流人格检测基准上达到当前最佳性能。

原文摘要 · Abstract (English)

Personality detection aims to measure an individual's corresponding personality traits through their social media posts. The advancements in Large Language Models (LLMs) offer novel perspectives for personality detection tasks. Existing approaches enhance personality trait analysis by leveraging LLMs to extract semantic information from textual posts as prompts, followed by training classifiers for categorization. However, accurately classifying personality traits remains challenging due to the inherent complexity of human personality and subtle inter-trait distinctions. Moreover, prompt-based methods often exhibit excessive dependency on expert-crafted knowledge without autonomous pattern-learning capacity. To address these limitations, we view personality detection as a ranking task rather than a classification and propose a corresponding reinforcement learning training paradigm. First, we employ supervised fine-tuning (SFT) to establish personality trait ranking capabilities while enforcing standardized output formats, creating a robust initialization. Subsequently, we introduce Group Relative Policy Optimization (GRPO) with a specialized ranking-based reward function. Unlike verification tasks with definitive solutions, personality assessment involves subjective interpretations and blurred boundaries between trait categories. Our reward function explicitly addresses this challenge by training LLMs to learn optimal answer rankings. Comprehensive experiments have demonstrated that our method achieves state-of-the-art performance across multiple personality detection benchmarks.

人格检测大模型排序学习强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。