arXiv:2606.08194cs.CLcs.AI2026-06被引 3

构建多语言多文化真实音频评估基准,检验大模型听觉理解能力。

GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models

论文配图:GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models
图 1 · 摘自论文原文
  • 由母语者基于真实音频设计5637道多选题,覆盖六种语言。
  • 开放源代码模型在低资源语言上表现显著落后于闭源模型。
  • 适合评估语音-语言模型在真实场景下的跨文化理解能力。

大型音频-语言模型(LALMs)将音频感知与语言理解整合于统一框架,支持多种实际应用。然而,现有评估仍严重偏离真实需求:多数缺乏语言与文化的自然性,或未能体现声学真实性。为此,我们提出GlobeAudio,一个面向自然主义音频理解的多语言多文化基准。该基准包含5,637个多项选择题,覆盖六种类型差异大的语言,均由母语者基于真实音频精心设计。模型需具备高级听觉推理能力和文化情境理解力才能取得好成绩。我们系统评估了代表性闭源与开源LALMs及级联式ASR-LLM流程。实验表明,在自然声学条件下存在显著性能差距,尤其体现在开源模型和低资源语言上。这些发现揭示了当前LALMs的关键局限,强调了自然主义音频评估对未来发展的重要性。GlobeAudio可访问 https://huggingface.co/datasets/iNLP-Lab/GlobeAudio。

原文摘要 · Abstract (English)

Large Audio-Language Models (LALMs) integrate audio perception and language understanding within a unified framework, enabling a wide range of real-world applications. Despite recent advances, evaluation for LALMs remains heavily underspecified relative to real-world requirements: most lack true linguistic and cultural authenticity, while others fail to capture acoustic realism. To bridge this gap, we propose GlobeAudio, a multilingual and multicultural benchmark designed to evaluate naturalistic audio understanding. GlobeAudio consists of 5,637 multiple-choice questions across six typologically diverse languages, expertly crafted by native speakers grounded on naturally occurring audio. In order to do well, models must possess higher-level auditory reasoning skills and culturally grounded interpretation. We systematically evaluate representative closed-source and open-source LALMs, as well as cascaded ASR-LLM pipelines. Our experiments reveal substantial performance gaps under natural acoustic conditions, particularly for open-source models and low-resource languages. These findings highlight critical limitations of current LALMs and underscore the importance of naturalistic audio evaluation for future audio-language systems. GlobeAudio can be found at https://huggingface.co/datasets/iNLP-Lab/GlobeAudio .

音频理解多语言评估基准跨文化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。