语音指令自动分发到边缘或云端,兼顾速度与隐私。
Adaptive Edge-Cloud Inference for Speech-to-Action Systems Using ASR and Large Language Models
- 根据系统负载动态选择语音处理路径
- 语音识别准确率62.5%,47.5%指令无需修复即可执行
- 适合资源受限的智能设备语音控制场景
基于语音的交互已成为控制物联网设备的自然方式。然而,语音驱动的边缘设备面临云方案与边缘方案的根本权衡:云方案虽具备更强的语言理解能力,但存在延迟高、依赖网络和隐私风险;边缘方案虽延迟低、隐私性好,却受限于计算能力。本文提出ASTA,一种自适应语音转动作系统,通过实时系统指标(如CPU负载、设备温度、网络延迟)动态分配语音命令在边缘与云端的推理路径。ASTA融合本地语音识别与轻量级离线语言模型推理,结合云端大语言模型处理,由度量感知路由机制决定运行时推理路径,并通过规则式指令验证与修复组件保障端到端执行成功。我们在NVIDIA Jetson平台上实现该方案,使用包含80个口语命令的多样化数据集进行评估。实验表明,ASTA成功路由所有输入指令,实现在线与离线推理的平衡分布。系统达到62.5%的语音识别准确率,仅47.5%的输入指令可直接生成可执行命令而无需修复,凸显修复机制对提升鲁棒性的关键作用。结果表明,自适应边缘-云协同是构建弹性且资源感知的语音控制物联网系统的可行路径。
原文摘要 · Abstract (English)
Voice-based interaction has emerged as a natural and intuitive modality for controlling IoT devices. However, speech-driven edge devices face a fundamental trade-off between cloud-based solutions, which offer stronger language understanding capabilities at the cost of latency, connectivity dependence, and privacy concerns, and edge-based solutions, which provide low latency and improved privacy but are limited by computational constraints. This paper presents ASTA, an adaptive speech-to-action solution that dynamically routes voice commands between edge and cloud inference to balance performance and system resource utilization. ASTA integrates on-device automatic speech recognition and lightweight offline language-model inference with cloud-based LLM processing, guided by real-time system metrics such as CPU workload, device temperature, and network latency. A metric-aware routing mechanism selects the inference path at runtime, while a rule-based command validation and repair component ensures successful end-to-end command execution. We implemented our solution on an NVIDIA Jetson-based edge platform and evaluated it using a diverse dataset of 80 spoken commands. Experimental results show that ASTA successfully routes all input commands for execution, achieving a balanced distribution between online and offline inference. The system attains an ASR accuracy of 62.5% and generates executable commands without repair for only 47.5% of inputs, highlighting the importance of the repair mechanism in improving robustness. These results suggest that adaptive edge-cloud orchestration is a viable approach for resilient and resource-aware voice-controlled IoT systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。