将自然语言理解转化为翻译任务,实现边缘设备上实时多意图识别。
Transforming NLU with Babylon: A Case Study in Development of Real-time, Edge-Efficient, Multi-Intent Translation System for Automated Drive-Thru Ordering
- 把语义理解转为生成'转换码'的翻译任务,支持单轮对话中多意图处理。
- 在边缘设备上实现低延迟、低内存占用,较Flan-T5等模型提升30%以上效率。
- 适合嘈杂环境中实时语音交互系统,如无人点餐、自助售票机等场景。
实时对话式AI在自动化车道点餐等动态户外环境中面临自然语言理解(NLU)挑战,需应对背景噪声、口音多样性和多意图查询,同时受限于边缘设备的严格延迟与内存约束。此外,上游自动语音识别(ASR)输出常含噪声,对系统鲁棒性要求极高。本文提出Babylon,一种基于Transformer的架构,将NLU视为意图翻译任务,将自然语言输入转换为包含意图和槽位信息的规则语言单元序列('transcodes'),支持单轮对话中的多意图处理。同时,Babylon引入基于LSTM的词元聚合机制,预处理音素序列以缩短输入长度,优化低延迟、低内存部署,并缓解ASR错误带来的影响。尽管聚焦于车道点餐,其设计可扩展至类似噪声环境,如自助售票机。实验表明,Babylon在准确率-延迟-内存开销权衡上显著优于典型NMT模型(如Flan-T5、BART),验证了其在边缘部署中实时NLU的有效性。
原文摘要 · Abstract (English)
Real-time conversational AI agents face challenges in performing Natural Language Understanding (NLU) in dynamic, outdoor environments like automated drive-thru systems. These settings require NLU models to handle background noise, diverse accents, and multi-intent queries while operating under strict latency and memory constraints on edge devices. Additionally, robustness to errors from upstream Automatic Speech Recognition (ASR) is crucial, as ASR outputs in these environments are often noisy. We introduce Babylon, a transformer-based architecture that tackles NLU as an intent translation task, converting natural language inputs into sequences of regular language units ('transcodes') that encode both intents and slot information. This formulation allows Babylon to manage multi-intent scenarios in a single dialogue turn. Furthermore, Babylon incorporates an LSTM-based token pooling mechanism to preprocess phoneme sequences, reducing input length and optimizing for low-latency, low-memory edge deployment. This also helps mitigate inaccuracies in ASR outputs, enhancing system robustness. While this work focuses on drive-thru ordering, Babylon's design extends to similar noise-prone scenarios, for e.g. ticketing kiosks. Our experiments show that Babylon achieves significantly better accuracy-latency-memory footprint trade-offs over typically employed NMT models like Flan-T5 and BART, demonstrating its effectiveness for real-time NLU in edge deployment settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。