让教师通过修改错误回复来设计AI助教,提升教学效果。
PromptDecipher: Supporting AI Tutor Authoring Through Editable Simulated Interactions

- 教师直接修正聊天机器人错误回复,系统自动生成优化提示词。
- 自动验证修改后在预设测试场景中的表现,确保可靠性。
- 适合教育工作者快速上手AI助教开发,降低技术门槛。
聊天机器人长期被用于支持学习,近年来大语言模型的发展使教育者能更便捷地创建AI辅导聊天机器人。然而,有效创作不仅需撰写系统提示,还需兼具学习设计、AI交互设计和质量保障(QA)角色。实际中,教师极少系统性测试其机器人。为此,我们提出PromptDecipher,将创作流程重构为基于直接修正的交互模式:教师在实时聊天预览中修改不理想回复,系统自动分析修正内容,提出针对性提示词重写,并在预定义测试场景中验证改进效果。该机制将质量保障作为核心环节,辅助教师完成其通常忽略的设计角色。PromptDecipher将部署于面向数百名高等教育教师的AI助教课程中。可访问实时原型(https://teacher-prompting.vercel.app/)、匿名代码库(https://anonymous.4open.science/r/teacher-prompting-2EDF/)及匿名演示(https://tinyurl.com/las-prompt-decipher-demo)。
原文摘要 · Abstract (English)
Chatbots have long been explored as tools to support learning, and recent advances in large language models have significantly expanded the availability of platforms for educators to author AI tutoring chatbots. Yet effective authorship demands more than writing a system prompt; it requires educators to act as learning designers, AI interaction designers, and QA engineers. In practice, however, teachers rarely fulfill these roles. Our formative study found that virtually none systematically tested their bots before deploying them to students. To address this gap, we present PromptDecipher, a system that restructures the authoring workflow around a direct correction-based interaction rather than writing abstract system prompts, teachers interact with a live chat preview and edit undesirable bot responses. An automated pipeline then analyzes the correction, proposes a targeted system prompt rewrite, and validates the change across pre-defined test scenarios. This enforces QA as a first-class activity and scaffolds teachers in roles they would otherwise skip. PromptDecipher will be deployed in an AI for Educators course enrolling hundreds of higher-education instructors. A live prototype (https://teacher-prompting.vercel.app/), an anonymized codebase (https://anonymous.4open.science/r/teacher-prompting-2EDF/), and anonymized demo (https://tinyurl.com/las-prompt-decipher-demo) are available via links in the footnote.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。