离线运行的AI学习系统,让低网速地区也能用大模型辅导学习。
Arapai: An Offline-First LLM Architecture for Adaptive Learning in Low-Connectivity Environments

- 本地量化推理+硬件自适应选型,可在仅靠CPU的旧设备上运行。
- 响应时间1-3秒,支持从简单英语到专业术语的四档自适应解释。
- 适合网络差的学校或自学场景,学生和老师都认可其学习支持效果。
人工智能与大语言模型正在改变教育科技,实现对话式辅导、个性化解释和探究式学习。然而,多数AI学习系统依赖持续互联网连接和云端计算,限制了在带宽受限环境中的应用。本文提出Arapai,一种面向低连通性环境的离线优先大语言模型架构,支持本地化推理,采用量化语言模型,并结合硬件感知模型选择,可在低配置、仅含CPU的设备上部署。该系统无需依赖云基础设施,通过自然语言交互提供与课程匹配的解释和结构化学术支持。为适配不同学习阶段,系统提供四种复杂度层级的自适应回答:简单英语、初中水平、高中水平和专业级。在120名中高等教育机构的学生与9位教师参与的有限连通性测试中,系统表现出稳定的运行能力,典型查询响应时间为1-3秒,用户普遍认为其有效支持自主学习。
原文摘要 · Abstract (English)
Artificial intelligence and large language models (LLMs) are transforming educational technology by enabling conversational tutoring, personalised explanations, and inquiry-driven learning. However, most AI-based learning systems rely on continuous internet connectivity and cloud-based computation, limiting their use in bandwidth-constrained environments. This paper presents Arapai, an offline-first large language model architecture designed for AI-assisted learning in low-connectivity settings. The system performs all inference locally using quantized language models and incorporates hardware-aware model selection to enable deployment on low-specification, CPU-only devices. By removing dependence on cloud infrastructure, the system provides curriculum-aligned explanations and structured academic support through natural-language interaction. To support learners at different educational stages, the system includes adaptive response levels that generate explanations at varying levels of complexity: Simple English, Lower Secondary, Upper Secondary, and Technical. The system was evaluated with 120 students and 9 instructors from secondary and tertiary institutions under limited-connectivity conditions. Results indicate stable operation on legacy hardware, acceptable response times of 1-3 seconds for typical queries, and positive user perceptions of its effectiveness in supporting self-directed learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。