用AI自动分析911接线员通话,提升评估效率与准确性
LogiDebrief: A Signal-Temporal Logic based Automated Debriefing Approach with Large Language Models Integration
- 结合时序逻辑与大模型,自动判断通话是否符合应急流程
- 已处理1701通真实呼叫,节省311.85小时人工评估时间
- 适合应急指挥中心、AI质检系统研发人员参考
紧急响应服务对公共安全至关重要,9-1-1接线员在确保及时有效应急运作中起关键作用。为保障接线员表现的一致性,质量保证机制用于评估和改进其技能。然而,传统人工评估难以应对高通话量,导致覆盖不足且评估延迟。我们提出LogiDebrief,一个融合信号时序逻辑(STL)与大语言模型(LLMs)的AI驱动框架,实现9-1-1通话自动回溯分析。该框架将接线流程要求形式化为逻辑规范,支持对通话行为的系统性评估。其采用三步验证流程:(1) 上下文理解,识别响应者类型、事件分类及关键条件;(2) 基于STL的运行时检查结合LLM,确保合规性;(3) 自动生成质量保证报告。该系统已在纳什维尔市应急通信部门成功部署,协助完成1,701通真实通话的回溯分析,累计节省311.85小时人工投入。基于真实数据的实证评估验证了其准确性,案例研究与大规模用户调研进一步证明其在提升接线员表现方面的有效性。
原文摘要 · Abstract (English)
Emergency response services are critical to public safety, with 9-1-1 call-takers playing a key role in ensuring timely and effective emergency operations. To ensure call-taking performance consistency, quality assurance is implemented to evaluate and refine call-takers' skillsets. However, traditional human-led evaluations struggle with high call volumes, leading to low coverage and delayed assessments. We introduce LogiDebrief, an AI-driven framework that automates traditional 9-1-1 call debriefing by integrating Signal-Temporal Logic (STL) with Large Language Models (LLMs) for fully-covered rigorous performance evaluation. LogiDebrief formalizes call-taking requirements as logical specifications, enabling systematic assessment of 9-1-1 calls against procedural guidelines. It employs a three-step verification process: (1) contextual understanding to identify responder types, incident classifications, and critical conditions; (2) STL-based runtime checking with LLM integration to ensure compliance; and (3) automated aggregation of results into quality assurance reports. Beyond its technical contributions, LogiDebrief has demonstrated real-world impact. Successfully deployed at Metro Nashville Department of Emergency Communications, it has assisted in debriefing 1,701 real-world calls, saving 311.85 hours of active engagement. Empirical evaluation with real-world data confirms its accuracy, while a case study and extensive user study highlight its effectiveness in enhancing call-taking performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。