arXiv:2608.16276cs.HCcs.CL2026-08

PolyDebate用游戏化方式帮学习者练英语辩论,支持语音和动作的多模态反馈。

PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation

论文配图:PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation
图 1 · 摘自论文原文
  • 通过游戏化任务引导用户与AI对手进行分阶段1v1辩论
  • 捕捉语音与视觉表现,生成基于评分标准的实时反馈
  • 适合想提升辩论表达与应变能力的学习者或教师使用

辩论是一种结构化的说服性沟通形式,有助于培养论点构建、反驳、口头表达和观众意识等能力,广泛应用于教育、语言学习和职业沟通中。尽管近年来基于大模型的辩论系统和评判工具在论点生成与评估方面取得进展,但多数仍局限于文本交互,难以支持完整的多模态练习体验。我们提出PolyDebate,一个以游戏为架构的多模态英语辩论练习与评估系统。该系统引导学习者在分阶段的一对一(1v1)辩论中与AI对手互动,通过技能卡、道具和积分机制显式呈现说服策略,将练习转化为游戏化过程。每轮会话中,系统捕捉学习者的语音与视觉表现,生成上下文相关的对手回应,并输出基于评分量规的阶段性与整体反馈。PolyDebate提供沉浸式Unity 3D版本与网页版,共享相同工作流与评估服务。四项研究(包括AI对手质量、评估覆盖范围、AI裁判反馈及用户感知)表明,PolyDebate成功整合了辩论交互、游戏化支架、多模态评估与结构化反馈,形成可落地的辩论训练流程。演示视频见https://youtu.be/mHwBG1_8Ebk。

原文摘要 · Abstract (English)

Debate is a structured form of persuasive communication that trains argument construction, rebuttal, oral delivery, and audience awareness. These skills are valued in education, language learning, and professional communication. Recent AI debate systems and LLM-based judges have advanced argument generation and debate evaluation, but most remain text-centered and rarely support learners through a complete multimodal practice experience. We introduce PolyDebate, a game-orchestrated multimodal system for English debate practice and evaluation. PolyDebate guides learners through staged one-on-one (1v1) debates with an AI opponent, while skill cards, props, and coins make persuasive strategies explicit and turn practice into a game-like interaction. During each session, the system captures learner speech and visual delivery evidence, generates context-aware opponent responses, and produces rubric-informed stage-level and overall feedback. PolyDebate is available as both an immersive Unity 3D game version and a web platform version that share the same workflow and evaluation services. Four studies covering AI opponent quality, evaluation coverage, AI judge feedback, and user perception show that PolyDebate brings debate interaction, gamified scaffolding, multimodal assessment, and structured feedback together in a practical workflow for debate skills practice. The demonstration video is available at https://youtu.be/mHwBG1_8Ebk.

辩论训练多模态交互游戏化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。