arXiv:2606.01483cs.LGcs.AI2026-06

Murmur通过双层优化,让长语音识别既快又准。

MURMUR: An Efficient Inference System for Long-Form ASR

论文配图:MURMUR: An Efficient Inference System for Long-Form ASR
图 1 · 摘自论文原文
  • 分块处理时调节块大小,平衡速度与准确率
  • 用滑动窗口缓存降低计算开销,延迟降4.2倍
  • 适合对实时性与精度都有要求的长语音场景

长语音自动语音识别(ASR)需兼顾高准确率和低延迟,但现有系统在二者间存在权衡。基于分块的流水线虽能实现低延迟,却丢失跨块上下文,且边界处需脆弱的启发式对齐策略;而单次通过的长上下文模型虽准确率高,但慢一个数量级。本文提出Murmur,一种双层级推理系统:在块间层面,将分块流水线重新用于现代长上下文ASR,将块大小视为可调超参数,发现中等块大小可在准确率与延迟间取得良好平衡;在块内层面,通过滑动窗口的键值缓存淘汰策略,利用注意力稀疏性,同时优化输出与语音标记。在AMI-IHM数据集上,Murmur达到单次通过的准确率,延迟降低4.2倍,进一步采用令牌淘汰仅导致小于1%的相对tcpWER下降。代码已开源。

原文摘要 · Abstract (English)

Long-form automatic speech recognition (ASR) requires both high accuracy and low latency, but existing systems force a trade-off between the two. Chunk-based pipelines process audio in parallel windows for low latency, but lose cross-chunk context and need brittle heuristics to align speakers and timestamps at boundaries. Long-context ASR models resolve everything in a single pass for better accuracy, but are an order of magnitude slower. We propose Murmur, an inference system that overcomes this trade-off by operating at two levels. At the inter-chunk level, we revisit the chunk-based pipeline for modern long-context ASR, treating chunk size as a tunable hyperparameter, and show that intermediate chunk sizes strike a good balance of accuracy and latency. At the intra-chunk level, we exploit attention sparsity through a sliding window KV cache eviction policy applied to both output and speech tokens. On AMI-IHM, Murmur matches single-pass accuracy while reducing latency by 4.2x, with further gains from token eviction at less than 1% relative tcpWER degradation. The code of Murmur is available at https://github.com/uw-syfi/Murmur.

语音识别推理加速长序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。