用小型语言模型让虚拟人边端运行思考与记忆，提升沉浸体验。
Enhancing Virtual Agents through SLMs and Edge-Computing: An Exploratory Evaluation of Think and Memory Processes
- 在边端设备上部署小模型，实现虚拟人的思考与记忆功能。
- 基于Qwen2.5的小模型在Jetson Orin NX上实测，延迟低且能处理记忆对话。
- 适合开发轻量级、持续在线的智能虚拟人系统。
具身智能虚拟代理需在复杂虚拟与元宇宙环境中持久、自适应且情境感知地运行，但实现认知能力仍具概念与技术挑战。本文基于认知具身代理架构（CEAA），探索将小型语言模型（SLMs）应用于边端计算，以支持其中“思考”与“记忆”等核心认知过程。构建了基于边缘的虚拟代理网关系统，在NVIDIA Jetson Orin NX上使用不同规模的Qwen2.5模型进行评估，测试其处理服务请求及记忆驱动对话的能力。模拟实验表明，该系统在路由准确性、记忆读取性能和延迟方面表现良好，验证了基于SLM的原型代理系统可部分实现选定的CEAA组件，为具身代理在沉浸式虚拟世界中高效、上下文相关的认知运行提供了可行路径。
原文摘要 · Abstract (English)
Embodied intelligent virtual agents are expected to operate as persistent, adaptive, and context-aware entities within complex virtual and Metaverse worlds. However, implementing cognitively capable agents in such environments is conceptually and technologically challenging. Among a range of blueprints and development approaches, the Cognitive Embodied Agent Architecture (CEAA) has been developed as an implementation-oriented framework for architecting components of perception, memory, reasoning, planning, and embodied action. Considering the recent advances in edge computing and generative AI language models, this paper explores the use of Small Language Models (SLMs) to support edge-based operation of selected CEAA components, focusing on "Think" and "Memory" as processes central to cognitive orchestration and persistence of virtual agents in interactive virtual worlds. An edge-based virtual agent gateway system was developed and evaluated on an NVIDIA Jetson Orin NX using Qwen2.5 models of different sizes, exploring the system's capability to process service requests and handle memory-driven conversations. A series of simulation experiments evaluated routing accuracy, memory-read performance, and latency, demonstrating an SLM-driven prototype agent system that partially implements selected CEAA processes to support the development of embodied agents whose cognitive "brain" can operate efficiently and contextually for interactive experiences in immersive virtual worlds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。