arXiv:2409.14050cs.AI2024-09被引 4

用GPT-4o等大模型辅助设计人际沟通自评量表

The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skills

  • 用大模型自动生成和优化量表题目
  • 提升量表内容效度评估效率与质量
  • 适合心理学研究者快速构建测评工具

OpenAI的ChatGPT(GPT-4和GPT-4o)及其他大型语言模型(如Microsoft Copilot、Google Gemini 1.5 Pro、Anthropic Claude 3.5 Sonnet)在科学研宄的多个阶段具有有效应用潜力。这些模型在语言任务和推理能力上已接近或超过人类平均水平,展现出较强的心理理论能力。其处理人类心理与沟通信息的能力,为在人格心理学和人际沟通技能研究中的科学应用提供了可能。本文展示了GPT-4o等先进模型在设计人际沟通自评量表时的典型用途,包括题项选择与优化、量表内容效度评估,以及自动化题项生成的潜力。文中提供可复用的提示词示例,并总结了使用大模型在评估、设计与改进人际沟通技能自评量表过程中的潜在优势。

原文摘要 · Abstract (English)

OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their performance in diverse verbal tasks and reasoning is close to or above the average human level and rapidly increasing, providing those models with a capacity that resembles a relatively high level of theory of mind. The current ability of LLMs to process information about human psychology and communication creates an opportunity for their scientific use in the fields of personality psychology and interpersonal communication skills. This article illustrates the possible uses of GPT-4o and other advanced LLMs for typical tasks in designing self-assessment scales for interpersonal communication skills measurement like the selection and improvement of scale items and evaluation of content validity of scales. The potential for automated item generation and application is illustrated as well. The case study examples are accompanied by prompts for LLMs that can be useful for these purposes. Finally, a summary is provided of the potential benefits of using LLMs in the process of evaluation, design, and improvement of interpersonal communication skills self-assessment scales.

大模型量表设计心理测量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。