用大模型分析学生性格,提升在线课程社交匹配效果
Personality-Enhanced Social Recommendations in SAMI: Exploring the Role of Personality Detection in Matchmaking
- 用GPT零样本分析论坛自我介绍推断五大性格特质
- 在外向、随和、开放三特质上验证了匹配可行性
- 适合教育科技与个性推荐方向的研究者参考
社交归属感对学习至关重要,但在线课程环境阻碍了自然社交群体的形成。SAMI(社会代理中介互动)通过促进学生连接提供解决方案,但其有效性受限于不完整的心理理论,难以构建学生的‘心智模型’。其中关键短板是无法感知性格,可能影响推荐相关性。本文探索自动性格推断的可行性,提出利用GPT零样本能力从论坛自我介绍中推断五大性格特质,并在特定数据集上与已有模型对比。结果显示,尽管GPT在该任务上表现良好,但各特质表现差异显著,且存在乐观倾向,尤其在分布偏斜的特质上。我们实现了性格检测在SAMI基于实体的匹配系统中的概念验证,聚焦与积极社交形成相关的三个特质:外向性、随和性、开放性。本研究为教育场景中性格驱动的社交推荐提供了初步探索,虽技术可行,但仍存诸多疑问。未来工作将深入分析大模型在性格推断中捕捉的具体特征,以及性格匹配是否真正改善学生联结。
原文摘要 · Abstract (English)
Social belonging is a vital part of learning, yet online course environments present barriers to the organic formation of social groups. SAMI (Social Agent Mediated Interactions) offers one solution by facilitating student connections, but its effectiveness may be constrained by an incomplete Theory of Mind, limiting its ability to create an effective 'mental model' of a student. One facet of this is its inability to intuit personality, which may influence the relevance of its recommendations. To explore this gap, we examine the viability of automated personality inference by proposing a personality detection model utilizing GPT's zeroshot capability to infer Big-Five personality traits from forum introduction posts, often encouraged in online courses. We benchmark its performance against established models, finding that while GPT models show promising results on this specific dataset, performance varies significantly across traits. We identify potential biases toward optimistic trait inference, particularly for traits with skewed distributions. We demonstrate a proof-of-concept integration of personality detection into SAMI's entity-based matchmaking system, focusing on three traits with established connections to positive social formation: Extroversion, Agreeableness, and Openness. This work represents an initial exploration of personality-informed social recommendations in educational settings. While our implementation shows technical feasibility, significant questions remain. We discuss these limitations and outline directions for future work, examining what LLMs specifically capture when performing personality inference and whether personality-based matching meaningfully improves student connections in practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。