本地生成讲座测验题,确保质量可追溯且不依赖外部API
Self-hosted Lecture-to-Quiz: Local LLM MCQ Generation with Deterministic Quality Control
- 用本地大模型生成选择题,全程不调用外部接口
- 120道题全部通过严格质检,8道有潜在问题被标记
- 适合注重隐私和可解释性的教育AI应用
我们提出一个端到端的自托管(无需API)流程,将讲座PDF转换为多选题(MCQ),使用本地大模型结合确定性质量控制(QC)。该流程设计为黑箱最小化:大模型仅辅助生成,最终输出为纯文本题库,附带明确的质量控制记录,部署时无需再调用大模型。在三个短讲座(信息论、热力学、统计力学)上进行种子遍历,共收集15次运行×8题=120个通过候选(总计122次尝试,有限重试)。所有120个通过项均满足硬性质检标准(JSON模式合规、唯一正确选项、数值/常数等价性测试);但警告层识别出8/120项存在残留风险,如干扰项重复或缺少舍入说明。报告了具体的警告分类及修复示例,并公开最终24题集合(三讲座×8题),格式为JSONL/CSV,支持导入Google Forms(可通过Apps Script或API工具)。最后,基于AI to Learn(AI2L)框架,论证自托管生成加显式质量控制在教育流程中支持隐私、问责与绿色AI。
原文摘要 · Abstract (English)
We present an end-to-end self-hosted (API-free) pipeline, where API-free means that lecture content is not sent to any external LLM service, that converts lecture PDFs into multiple-choice questions (MCQs) using a local LLM plus deterministic quality control (QC). The pipeline is designed for black-box minimization: LLMs may assist drafting, but the final released artifacts are plain-text question banks with an explicit QC trace and without any need to call an LLM at deployment time. We run a seed sweep on three short "dummy lectures" (information theory, thermodynamics, and statistical mechanics), collecting 15 runs x 8 questions = 120 accepted candidates (122 attempts total under bounded retries). All 120 accepted candidates satisfy hard QC checks (JSON schema conformance, a single marked correct option, and numeric/constant equivalence tests); however, the warning layer flags 8/120 items (spanning 8 runs) that expose residual quality risks such as duplicated distractors or missing rounding instructions. We report a warning taxonomy with concrete before->after fixes, and we release the final 24-question set (three lectures x 8 questions) as JSONL/CSV for Google Forms import (e.g., via Apps Script or API tooling) included as ancillary files under anc/. Finally, we position the work through the AI to Learn (AI2L) rubric lens and argue that self-hosted MCQ generation with explicit QC supports privacy, accountability, and Green AI in educational workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。