arXiv:2603.08729cs.CYcs.CL2026-03被引 2

本地生成讲座测验题,确保质量可追溯且不依赖外部API

Self-hosted Lecture-to-Quiz: Local LLM MCQ Generation with Deterministic Quality Control

  • 用本地大模型生成选择题,全程不调用外部接口
  • 120道题全部通过严格质检,8道有潜在问题被标记
  • 适合注重隐私和可解释性的教育AI应用

我们提出一个端到端的自托管(无需API)流程,将讲座PDF转换为多选题(MCQ),使用本地大模型结合确定性质量控制(QC)。该流程设计为黑箱最小化:大模型仅辅助生成,最终输出为纯文本题库,附带明确的质量控制记录,部署时无需再调用大模型。在三个短讲座(信息论、热力学、统计力学)上进行种子遍历,共收集15次运行×8题=120个通过候选(总计122次尝试,有限重试)。所有120个通过项均满足硬性质检标准(JSON模式合规、唯一正确选项、数值/常数等价性测试);但警告层识别出8/120项存在残留风险,如干扰项重复或缺少舍入说明。报告了具体的警告分类及修复示例,并公开最终24题集合(三讲座×8题),格式为JSONL/CSV,支持导入Google Forms(可通过Apps Script或API工具)。最后,基于AI to Learn(AI2L)框架,论证自托管生成加显式质量控制在教育流程中支持隐私、问责与绿色AI。

原文摘要 · Abstract (English)

We present an end-to-end self-hosted (API-free) pipeline, where API-free means that lecture content is not sent to any external LLM service, that converts lecture PDFs into multiple-choice questions (MCQs) using a local LLM plus deterministic quality control (QC). The pipeline is designed for black-box minimization: LLMs may assist drafting, but the final released artifacts are plain-text question banks with an explicit QC trace and without any need to call an LLM at deployment time. We run a seed sweep on three short "dummy lectures" (information theory, thermodynamics, and statistical mechanics), collecting 15 runs x 8 questions = 120 accepted candidates (122 attempts total under bounded retries). All 120 accepted candidates satisfy hard QC checks (JSON schema conformance, a single marked correct option, and numeric/constant equivalence tests); however, the warning layer flags 8/120 items (spanning 8 runs) that expose residual quality risks such as duplicated distractors or missing rounding instructions. We report a warning taxonomy with concrete before->after fixes, and we release the final 24-question set (three lectures x 8 questions) as JSONL/CSV for Google Forms import (e.g., via Apps Script or API tooling) included as ancillary files under anc/. Finally, we position the work through the AI to Learn (AI2L) rubric lens and argue that self-hosted MCQ generation with explicit QC supports privacy, accountability, and Green AI in educational workflows.

自托管测验生成质量控制教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。