让AI通过对话学习,比单向灌输更有效。
AI Pedagogy: Dialogic Social Learning for Artificial Agents
- AI在教师引导的双向对话中学习知识
- 混合指令与提问的对话方式效果最好
- 适合研究人机协作与智能教育的学者
大型语言模型(LLMs)在处理大规模离线数据方面表现出色,但在获取和整合复杂在线知识时仍面临挑战。传统训练方法多基于监督学习或强化学习,类似于皮亚杰式的独立探索模式,依赖大样本数据和稀疏反馈,限制了模型从互动中高效学习的能力。受维果茨基社会文化理论启发,本研究提出动态环境‘AI社交健身房’,让AI学习者与知识型教师代理进行双人教学对话。该机制强调外部结构化对话作为核心知识获取方式,区别于仅依赖内部推理或模式识别的方法。研究聚焦不同教学策略对知识本体构建的影响。实验证明,尤其是结合自上而下讲解与学习者主动提问的双向对话,显著提升了LLM获取和应用新知识的能力,优于单向教学和直接访问结构化知识格式(常见于训练数据集)。结果表明,将教学与心理学洞见融入AI与机器人训练,可大幅增强其后训练阶段的知识获取与响应质量,为提示工程等现有策略提供互补路径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable capabilities in processing extensive offline datasets. However, they often face challenges in acquiring and integrating complex, knowledge online. Traditional AI training paradigms, predominantly based on supervised learning or reinforcement learning, mirror a 'Piagetian' model of independent exploration. These approaches typically rely on large datasets and sparse feedback signals, limiting the models' ability to learn efficiently from interactions. Drawing inspiration from Vygotsky's sociocultural theory, this study explores the potential of socially mediated learning paradigms to address these limitations. We introduce a dynamic environment, termed the 'AI Social Gym', where an AI learner agent engages in dyadic pedagogical dialogues with knowledgeable AI teacher agents. These interactions emphasize external, structured dialogue as a core mechanism for knowledge acquisition, contrasting with methods that depend solely on internal inference or pattern recognition. Our investigation focuses on how different pedagogical strategies impact the AI learning process in the context of ontology acquisition. Empirical results indicate that such dialogic approaches-particularly those involving mixed-direction interactions combining top-down explanations with learner-initiated questioning-significantly enhance the LLM's ability to acquire and apply new knowledge, outperforming both unidirectional instructional methods and direct access to structured knowledge, formats typically present in training datasets. These findings suggest that integrating pedagogical and psychological insights into AI and robot training can substantially improve post-training knowledge acquisition and response quality. This approach offers a complementary pathway to existing strategies like prompt engineering
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。