构建可审计的教师代理评估基准,检验其真实教学能力。
TeachArena: Are Language Agents Ready for Realistic Teaching Work?

- 基于教学洞察设计354个任务,覆盖判断、互动与系统执行三方面。
- 当前模型仅在有限判断能力上达标,全链条教学仍不达标。
- 适合研究教育智能体、人机协作与教育自动化的人参考。
语言代理正被应用于专业工作流中,但辅导仍是高风险能力,现有评估仅部分覆盖。高效辅导代理不仅需给出正确答案或准确调用工具,还需从证据中推断合理教学决策,随学习者状态变化调整支持,并将教师指令通过学习管理系统(LMS)转化为可验证的干预动作。本文提出TeachArena,一个基于来源的基准,联合评估教学工作的三个互补层面:专业教学判断、情境化多轮辅导、端到端的LMS教学流程。其354个经审核的任务均围绕教学洞察构建,基于证据并由匹配的验证者评估逐轮响应、辅导轨迹及持久化产物或环境状态。对前沿模型的全面评估显示,当前模型普遍具备有限的教学判断能力,但在情境化辅导和全流程教学执行方面仍远未达到专业标准。通过统一教学判断、自适应辅导与机构行动,TeachArena为开发能支持真实教学工作的代理提供了可衡量的基础。
原文摘要 · Abstract (English)
Language agents are increasingly deployed in professional workflows, yet tutoring remains a high-stakes capability that existing evaluations only partially capture. Effective tutor agents require more than producing correct answers or executing accurate tool calls: they must infer a warranted teaching decision from evidence, adapt support as learner state changes, and carry an instructor's request through a learning-management system (LMS) to a completed, verified intervention. We introduce TeachArena, a source-grounded benchmark that jointly evaluates three complementary surfaces of teaching work: professional pedagogical judgment, situated multi-turn tutoring, and end-to-end LMS teaching workflows. Its 354 audited tasks are each built around a pedagogical insight, grounded in evidence, and evaluated with matched verifiers over observable turn-level responses, tutoring trajectories, and persistent artifacts or environment states. Across a comprehensive evaluation of frontier models, our findings reveal that current models are generally capable of bounded pedagogical judgment, but still fall short of professional teaching standards in situated tutoring and end-to-end teaching-workflow execution. By unifying teacher judgment, adaptive tutoring, and institutional action in one auditable benchmark, TEACHARENA provides a measurement foundation for developing tutor agents that can support realistic teaching work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。