AI-VERDE让高校统一管理大模型资源,省钱省力还安全。
AI-VERDE: A Gateway for Egalitarian Access to Large Language Model-Based Resources For Educational Institutions
- 构建统一平台,整合云端与本地大模型服务
- 支持私密保护、预算管控和团队协作,试点用户活跃度高
- 适合高校教学科研人员,尤其关注成本与权限管理
我们提出 AI-VERDE,一个面向高等教育机构的统一 LLM-as-a-platform 服务,旨在无缝集成商业、云托管及本地部署的开源大模型。该平台通过强大的访问控制、隐私保护机制、原生检索增强生成(RAG)支持、第三方 LLM 服务预算管理,以及对话式网页界面和 API 接口,简化了教学与研究团队的接入流程。在一所大型公立大学的试点部署中,AI-VERDE 在多个教育与研究群体中展现出显著参与度,使原本需高额预算且管理困难的商业大模型应用成为可能。据我们所知,AI-VERDE 是首个在高等教育机构框架下同时满足学术与研究需求的大模型平台。
原文摘要 · Abstract (English)
We present AI-VERDE, a unified LLM-as-a-platform service designed to facilitate seamless integration of commercial, cloud-hosted, and on-premise open LLMs in academic settings. AI-VERDE streamlines access management for instructional and research groups by providing features such as robust access control, privacy-preserving mechanisms, native Retrieval-Augmented Generation (RAG) support, budget management for third-party LLM services, and both a conversational web interface and API access. In a pilot deployment at a large public university, AI-VERDE demonstrated significant engagement across diverse educational and research groups, enabling activities that would typically require substantial budgets for commercial LLM services with limited user and team management capabilities. To the best of our knowledge, AI-Verde is the first platform to address both academic and research needs for LLMs within an higher education institutional framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。