提出音视频大模型公平性评估新框架,揭示声音处理方式影响安全表现。
Evaluation of Audio Language Models for Fairness, Safety, and Security
- 按音频表示形式与语义推理位置分类,构建音视频模型结构谱系。
- 发现不同模型在拒绝率、攻击成功率和毒性上存在系统性差异。
- 适合关注语音模型安全与评估的开发者及研究者参考。
音视频大模型(ALLMs)通过融合语音处理与大语言模型,推动了语音交互的发展。然而,当前对公平性、安全性和安全性(FSS)的评估仍分散零散,主要因为ALLMs在声学信息表示方式和语义推理位置上存在根本差异,且这些差异常被忽略。这导致评估混杂了结构不同的系统,掩盖了模型设计与FSS行为之间的关系。本文提出一种结构分类法(系统级与表征级),从音频输入表示形式(如离散或连续)和语义推理位置(如级联式、多模态或音频原生)两个维度对ALLMs进行分类。基于此,我们构建统一评估框架,测试在副语言变化下的语义不变性、面对不当提示时的拒绝与毒性行为,以及对抗性音频扰动下的鲁棒性。应用于两个代表性系统后,观察到音频与文本输入在拒绝率、攻击成功率和毒性上的系统性差异。结果表明,FSS行为与声学信息融入语义推理的方式紧密相关,强调了需采用结构感知的评估方法。
原文摘要 · Abstract (English)
Audio large language models (ALLMs) have recently advanced spoken interaction by integrating speech processing with large language models. However, existing evaluations of fairness, safety, and security (FSS) remain fragmented, largely because ALLMs differ fundamentally in how acoustic information is represented and where semantic reasoning occurs. Differences that are rarely made explicit. As a result, evaluations often conflate structurally distinct systems, obscuring the relationship between model design and observed FSS behavior. In this work, we introduce a structural taxonomy (system-level and representational) of ALLMs that categorizes systems along two axes: the form of audio input representation (e.g., discrete vs. continuous) and the locus of semantic reasoning (e.g., cascaded, multimodal, or audio-native). Building on the taxonomy, we propose a unified evaluation framework that assesses semantic invariance under paralinguistic variation, refusal and toxicity behavior under unsafe prompts, and robustness to adversarial audio perturbations. We apply this framework to two representative systems and observe systematic differences in refusal rates, attack success, and toxicity between audio and text inputs. Our findings demonstrate that FSS behavior is tightly coupled to how acoustic information is integrated into semantic reasoning, underscoring the need for structure-aware evaluation of audio language models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。