用脉冲神经网络实现低功耗语音治疗,自动诊断并生成训练建议。
SpikeVox: Towards Energy-Efficient Speech Therapy Framework with Spike-driven Generative Language Models
- 基于脉冲驱动的语言模型分析语音模式,实现高效检测。
- 诊断准确率达88%以上,可自动生成个性化治疗练习。
- 适合资源受限设备,推动低成本远程语音康复服务。
语音障碍严重影响患者的沟通、学习与社交能力。现有疗法(如专业治疗师或工具)成本高且覆盖不足,难以满足全球数百万患者需求。当前主流方法虽利用神经网络实现精准语音障碍检测,但缺乏治疗反馈,仅提供部分解决方案;同时因模型复杂,能耗高,难以部署于手机等低功耗设备。为此,本文提出SpikeVox框架,采用脉冲驱动的生成语言模型,实现能量高效的语音治疗。该框架包含语音识别模块,完成高精度语音转文本;通过脉冲神经网络进行语音模式分析,检测障碍并生成个性化训练任务;提供发音纠正反馈;并通过REST API实现用户无缝交互。实验表明,SpikeVox在语音障碍识别上平均达到88%置信度,且可提供完整治疗反馈。该方案为低功耗场景下的智能语音康复提供了全面可行路径,有望缓解全球语音治疗资源短缺问题。
原文摘要 · Abstract (English)
Speech disorders can significantly affect the patients capability to communicate, learn, and socialize. However, existing speech therapy solutions (e.g., therapist or tools) are still limited and costly, hence such solutions remain inadequate for serving millions of patients worldwide. To address this, state-of-the-art methods employ neural network (NN) algorithms to help accurately detecting speech disorders. However, these methods do not provide therapy recommendation as feedback, hence providing partial solution for patients. Moreover, these methods incur high energy consumption due to their complex and resource-intensive NN processing, hence hindering their deployments on low-power/energy platforms (e.g., smartphones). Toward this, we propose SpikeVox, a novel framework for enabling energy-efficient speech therapy solutions through spike-driven generative language model. Specifically, SpikeVox employs a speech recognition module to perform highly accurate speech-to-text conversion; leverages a spike-driven generative language model to efficiently perform pattern analysis for speech disorder detection and generates suitable exercises for therapy; provides guidance on correct pronunciation as feedback; as well as utilizes the REST API to enable seamless interaction for users. Experimental results demonstrate that SpikeVox achieves 88% confidence level on average in speech disorder recognition, while providing a complete feedback for therapy exercises. Therefore, SpikeVox provides a comprehensive framework for energy-efficient speech therapy solutions, and potentially addresses the significant global speech therapy access gap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。