提出衡量人工智能素养的新框架,揭示其核心能力与影响因素。
From G-Factor to A-Factor: Establishing a Psychometric Framework for AI Literacy
- 以A因子为核心构建可量化的AI素养评估体系
- 实证显示其能有效预测语言类创意任务表现
- 适合教育者与政策制定者用于设计公平培训方案
本研究针对生成式AI背景下人工智能素养的测量需求,通过三轮共517名参与者的研究,确立了人工智能素养作为可量化、具一致性的构念。研究1(N=85)发现主导性潜在因子——“A因子”,解释了44.16%的跨任务差异。研究2(N=286)细化评估维度,涵盖沟通效率、创意生成、内容评估与分步协作,形成18项测评工具。研究3(N=146)在受控实验中验证其预测效度,表明AI素养显著预测复杂语言类创意任务表现,但具有领域特异性。回归分析识别出关键预测因子:认知能力(智商)、教育背景、过往AI经验及训练历史。结果支持人工智能素养的多维特性及其因子结构,说明高效人机协作需兼具通用与专长能力。研究为人类-人工智能协作理论提供依据,并为促进生成式AI普惠应用的教育干预提供实践指导。
原文摘要 · Abstract (English)
This research addresses the growing need to measure and understand AI literacy in the context of generative AI technologies. Through three sequential studies involving a total of 517 participants, we establish AI literacy as a coherent, measurable construct with significant implications for education, workforce development, and social equity. Study 1 (N=85) revealed a dominant latent factor - termed the "A-factor" - that accounts for 44.16% of variance across diverse AI interaction tasks. Study 2 (N=286) refined the measurement tool by examining four key dimensions of AI literacy: communication effectiveness, creative idea generation, content evaluation, and step-by-step collaboration, resulting in an 18-item assessment battery. Study 3 (N=146) validated this instrument in a controlled laboratory setting, demonstrating its predictive validity for real-world task performance. Results indicate that AI literacy significantly predicts performance on complex, language-based creative tasks but shows domain specificity in its predictive power. Additionally, regression analyses identified several significant predictors of AI literacy, including cognitive abilities (IQ), educational background, prior AI experience, and training history. The multidimensional nature of AI literacy and its distinct factor structure provide evidence that effective human-AI collaboration requires a combination of general and specialized abilities. These findings contribute to theoretical frameworks of human-AI collaboration while offering practical guidance for developing targeted educational interventions to promote equitable access to the benefits of generative AI technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。