对比6大模型在10个非洲国家的编程职业建议，发现本土化能力普遍不足。
Evaluating LLMs for Career Guidance: Comparative Analysis of Computing Competency Recommendations Across Ten African Countries
- 用标准提问测试6个大模型对非洲十国编程岗位要求的响应。
- 模型平均仅35.4%体现本地因素，开源模型表现更优但非绝对。
- 揭示西方中心偏见，呼吁教育AI需结合本地语境与人类协作。
随着雇主对毕业生使用大语言模型（LLMs）能力的要求上升，非洲各国计算岗位所需技能仍不清晰。本研究分析了ChatGPT 4、DeepSeek、Gemini、Claude 3.5、Llama 3和Mistral AI六款模型在十个国家对入门级计算职位期望的描述。基于Computing Curricula 2020框架，结合数字殖民主义理论与乌班图哲学，对60条标准化提示的回答进行内容分析显示：技术能力如云计算和编程得到一致覆盖，但非技术能力（如伦理与负责任的AI使用）差异显著；模型在识别本地因素（技术生态、语言需求、政策）方面平均仅35.4%具备上下文意识。开源模型表现更佳，Llama（4.47/5）与DeepSeek（4.25/5）优于专有模型如ChatGPT-4（3.90/5）和Claude（3.46/5），但开放源码的Mistral表现极差（0.00/4），表明开发理念本身无法保证上下文敏感性。这是首次系统比较非洲计算学生职业指导中大模型的表现，暴露了基础设施假设与西方中心偏见，导致技术建议与本地现实脱节。研究挑战了资源匮乏环境下AI工具质量的固有认知，强调教育中需采用去殖民化路径，注重情境相关性与人机协同指导。
原文摘要 · Abstract (English)
Employers increasingly expect graduates to utilize large language models (LLMs) in the workplace, yet the competencies needed for computing roles across Africa remain unclear given varying national contexts. This study examined how six LLMs, namely ChatGPT 4, DeepSeek, Gemini, Claude 3.5, Llama 3, and Mistral AI, describe entry-level computing career expectations across ten African countries. Using the Computing Curricula 2020 framework and drawing on Digital Colonialism Theory and Ubuntu Philosophy, content analysis of 60 LLM responses to standardized prompts reveals consistent coverage of technical competencies such as cloud computing and programming, but notable differences in non-technical competencies, particularly ethics and responsible AI use. Models vary considerably in recognizing country-specific factors, including local technology ecosystems, language requirements, and national policies averaging only 35.4% contextual awareness overall. Open-source models demonstrated stronger contextual awareness and better balance between technical and professional skills, with Llama (4.47/5) and DeepSeek (4.25/5) outperforming proprietary alternatives ChatGPT-4 (3.90/5) and Claude (3.46/5). However, Mistral's poor contextual performance (0.00/4) despite being open-source indicates that development philosophy alone does not guarantee contextual responsiveness. This first comprehensive comparison of LLM career guidance for African computing students uncovers entrenched infrastructure assumptions and Western-centric biases that create gaps between technical recommendations and local realities. The findings challenge assumptions about AI tool quality in resource-constrained settings and underscore the need for decolonial approaches to AI in education, emphasizing contextual relevance and hybrid human-AI guidance models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。