用策略控制AI助教时机与成本,让工程实验更高效且有挑战性。
Policy-Governed LLM Routing with Intent Matching for Instrument Laboratories
- 通过意图匹配和策略路由,动态分配不同AI模型服务
- 挑战匹配度提升至0.98,提示干预延迟3.6轮才出现
- 适合需要精准控制教学支持的智能实验教学系统
工程实验室中的AI辅导系统面临辅助程度与学习机会之间的矛盾。现有系统对教师干预时机、内容和成本缺乏有效控制。本文提出一个基于LLM的实验辅导路由与治理系统,包含两个部分:Routiium(兼容OpenAI的网关,支持多模型管理、提示修改与使用日志记录)和EduRouter(策略感知的路由服务,支持实验室预算、审批流程及基于嵌入的提问匹配)。通过来自两个工程实验室(LED特性分析、RC电路分析)的真实数据进行轨迹驱动仿真,并以100个查询在真实模型上的回放验证。仿真中,受控策略(P1/P2)使挑战匹配指数从0.90升至0.98,覆盖一致得分从0.69升至0.87;高辅助提示出现前的自主探索窗口从1.4轮延长至3.6轮。100查询回放中,EduRouter将75%请求路由至本地模型,令牌成本降低66%($0.087 vs. $0.26),同时保持89个标准意图问题库的完整命中率(1.0)。相关代码、工具链与模拟配置已开源,支持复现与未来课堂研究。
原文摘要 · Abstract (English)
AI tutoring systems in engineering labs face a tension between providing sufficient assistance and preserving learning opportunities. Existing systems typically offer instructors limited control over assistance timing, content, or cost. This paper describes a routing and governance system for LLM-based lab assistance comprising two components: Routiium, an OpenAI-compatible gateway that manages multiple LLM backends with configurable prompt modifications and usage logging, and EduRouter, a policy-aware routing service that enforces per-lab budgets, approval workflows, and embedding-based question matching. We evaluated the system using trace-driven simulation calibrated from two engineering labs (LED characterization, RC circuit analysis) and a 100-query replay through live models. In simulations, governed policies (P1/P2) increased challenge-alignment index from 0.90 to 0.98 and overlay-adherence score from 0.69 to 0.87 compared to ungoverned operation (P0). The productive-struggle window metric increased from 1.4 to 3.6 simulated turns before high-scaffold hints appeared. In the 100-query replay, EduRouter routed 75% of queries to a local model, reducing token costs by 66% ($0.087 vs. $0.26 for all-premium routing) while maintaining canonical hit rate of 1.0 for the curated 89-intent question bank. We release Routiium, EduRouter, canonical-task tooling, and simulator configurations to support replication and future classroom studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。