arXiv:2607.28175cs.AI2026-07

让语音识别实时修正口语冗余,输出清晰可读的最终文本。

AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach

论文配图:AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach
图 1 · 摘自论文原文
  • 构建可持续修订的语音-文本转换框架,随新语音动态调整先前输出。
  • 在双语评测集上超越现有系统,保持说话人意图的同时消除重复和自纠。
  • 适合需要实时精准转录的场景,如会议记录、语音助手和医疗访谈。

自动语音识别(ASR)在转录准确率上已取得显著进展,但逐字转录常保留填充词、重复、中途停顿与自我修正,增加阅读负担,模糊说话人真实意图,并将未完成内容传递至下游任务。现有方法仅处理完整音频或转录稿,无法在后续语音改变前文理解时进行修正。为此,本文提出代理式语音识别(AgenticSR),即从音频生成干净文本的任务,旨在消除不流畅表达、解决自修正并规范书写形式,同时保留说话人最终意图。AgenticASR通过ASR-Refiner架构实现:持续更新有限上下文,随音频输入不断替换对应输出片段,支持任意长度流式处理下的连续输出与修订。研究还引入AASR-Bench,一个具有细粒度原子评分标准的双语评测基准。在多个ASR前端上,AgenticASR在该基准上得分最高。人类-人工智能一致性研究显示,基于评分标准的判断与独立专家评估高度一致。消融实验分析了重构器容量、上下文长度以及在线与离线推理间的质量-延迟权衡。这些结果共同确立了AgenticASR作为实时语音中保持意图的清洁转录实用框架。代码、AASR-Bench及演示将开源于https://github.com/AnXMuy/AgenticASR。

原文摘要 · Abstract (English)

Automatic speech recognition (ASR) has achieved substantial gains in transcription accuracy, yet verbatim transcription does not necessarily produce readily usable text. It retains fillers, repetitions, false starts, and self-corrections that increase reading effort, obscure the speaker's final intent, and propagate unresolved or abandoned content to downstream tasks. Existing spoken-to-written methods process completed audio or transcripts but cannot revise emitted text when later speech changes how preceding content should be interpreted. We therefore formulate Agentic Speech Recognition (AgenticSR), an audio-to-clean-text task that removes disfluencies, resolves self-corrections, and normalizes written form while preserving the speaker's final intent. AgenticASR implements this task through an ASR--Refiner architecture that repeatedly transforms a bounded active context and replaces its corresponding output span as audio arrives. This enables continual emission and revision over streams of arbitrary duration. We also introduce AASR-Bench, a bilingual benchmark with fine-grained atomic rubrics. Across multiple ASR front ends, AgenticASR attains the highest AASR-Bench scores among evaluated systems. A human--AI agreement study shows that rubric-based judgments align with independent expert assessments. Ablations characterize Refiner capacity, context length, and the quality--latency trade-off between online and offline inference. Together, these results establish AgenticASR as a practical framework for intent-preserving clean transcription during ongoing speech. Code, AASR-Bench, and a demo will be released at https://github.com/AnXMuy/AgenticASR.

语音识别流式处理去冗余实时转录

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。