arXiv:2509.16971cs.SDeess.AS2025-09被引 12

无需训练的多智能体系统,让AI像人一样逐步推理音频内容

AudioGenie-Reasoner: A Training-Free Multi-Agent Framework for Coarse-to-Fine Audio Deep Reasoning

  • 用多智能体模拟人类由粗到精的思考过程,逐步完善文本证据链
  • 在多个基准上超越现有开源模型,实现当前最佳性能
  • 适合需要深度音频理解与逻辑推理的应用场景

音频深度推理是一项挑战性任务,需专家级感知、多步逻辑推断及上下文知识融合。现有模型因缺乏显式推理链的训练数据,且缺少主动探索与迭代优化机制,导致感知与推理能力脱节。为此,我们提出AudioGenie-Reasoner(AGR),首个统一的免训练多智能体框架,通过动态演化的文本证据链协调音频感知与推理。其核心思想是将音频深度推理转化为复杂文本理解任务,释放大语言模型潜力。AGR设计模仿人类由粗到精的认知过程:先将输入音频转为粗粒度文本文档;再引入新型主动迭代文档优化循环,结合工具增强路径与专用智能体,持续搜寻缺失信息,以粗到精方式不断扩充证据链,直至获得充分的问题相关依据进行最终预测。实验表明,AGR在多个公开基准上均达到当前最优(SOTA)性能。代码将于 https://github.com/ryysayhi/AudioGenie-Reasoner 公开。

原文摘要 · Abstract (English)

Audio deep reasoning is a challenging task that requires expert-level perception, multi-step logical inference, and the integration of contextual knowledge. However, existing models suffer from a gap between audio perception and reasoning abilities due to the lack of training data with explicit reasoning chains and the absence of mechanisms for active exploration and iterative refinement. To address these challenges, we propose AudioGenie-Reasoner (AGR), the first unified training-free multi-agent system that coordinates perception and reasoning over an evolving chain of textual evidence. Our key idea is a paradigm shift that transforms audio deep reasoning into complex text understanding task from a new perspective, thereby unlocking the full potential of large language models. Specifically, the design of AGR mimics the human coarse-to-fine cognitive process. It first transforms the input audio into a coarse text-based document. Then, we design a novel proactive iterative document refinement loop, featuring tool-augmented routes and specialized agents, to continuously search for missing information and augment the evidence chain in a coarse-to-fine manner until sufficient question-related information is gathered for making final predictions. Experimental results show that AGR achieves state-of-the-art (SOTA) performance over existing open-source audio deep reasoning models across various benchmarks. The code will be available at https://github.com/ryysayhi/AudioGenie-Reasoner.

音频推理多智能体大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。