首个系统评估音频大模型可信度的基准,揭示声音特性如何影响模型安全。
AudioTrust: Benchmarking the Multifaceted Trustworthiness of Audio Large Language Models
- 构建六维评估框架,针对音色、口音等声学线索设计测试任务
- 涵盖26个子任务与超4400个真实场景音频样本,覆盖高风险应用
- 适用于开发者和安全研究者,助力打造更可靠的语音智能系统
音频大语言模型(ALLM)的快速发展亟需对其可信度进行严格评估。现有评测框架多针对文本设计,无法捕捉音频固有的声学特性带来的风险。我们发现,音色、口音、背景噪声等非语义声学线索可被利用以操控模型行为,构成重大可信度隐患。为此,我们提出AudioTrust——首个面向音频大模型的系统性、大规模可信度评估框架。该框架涵盖公平性、幻觉、安全性、隐私、鲁棒性和真实性六个维度,包含26个子任务,构建了超过4,420个来自真实场景(如日常对话、紧急通话、语音助手交互)的音频数据集。通过18种实验设置及经人工验证的自动化流程,实现客观、可扩展的模型输出评估。对14个先进开源与闭源ALLM的全面测试揭示其在多种高风险音频场景下的关键缺陷与失效边界,为未来音频模型的安全部署提供关键洞见。平台与基准数据已公开于https://github.com/JusperLee/AudioTrust。
原文摘要 · Abstract (English)
The rapid development and widespread adoption of Audio Large Language Models (ALLMs) demand rigorous evaluation of their trustworthiness. However, existing evaluation frameworks are primarily designed for text and fail to capture vulnerabilities introduced by the acoustic properties of audio. We find that significant trustworthiness risks in ALLMs arise from non-semantic acoustic cues, such as timbre, accent, and background noise, which can be exploited to manipulate model behavior. To address this gap, we propose AudioTrust, the first large-scale and systematic framework for evaluating ALLM trustworthiness under audio-specific risks. AudioTrust covers six key dimensions: fairness, hallucination, safety, privacy, robustness, and authenticition. It includes 26 sub-tasks and a curated dataset of more than 4,420 audio samples collected from real-world scenarios, including daily conversations, emergency calls, and voice assistant interactions, and is specifically designed to probe trustworthiness across multiple dimensions. Our comprehensive evaluation spans 18 experimental settings and uses human-validated automated pipelines to enable objective and scalable assessment of model outputs. Experimental results on 14 state-of-the-art open-source and closed-source ALLMs reveal important limitations and failure boundaries under diverse high-risk audio scenarios, providing critical insights for the secure and trustworthy deployment of future audio models. Our platform and benchmark are publicly available at https://github.com/JusperLee/AudioTrust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。