arXiv:2604.09222cs.SDcs.AI2026-04

通过选择性频段注入扰动,实现更隐蔽的音频大模型越狱攻击

GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Masking

论文配图:GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Masking
图 1 · 摘自论文原文
  • 按频带贡献度与敏感度比值筛选关键频段,限制扰动范围
  • 在4个音频大模型上平均越狱成功率88.46%,同时显著降低正常任务性能下降
  • 适合研究模型安全、对抗攻击或需兼顾隐蔽性的应用开发者

语音大语言模型(ALLMs)支持语音交互,但也引入了新的越狱漏洞。现有基于扰动的越狱方法未明确控制扰动所处的频率范围。尽管这些扰动可引发不当响应,但对多种输入重复使用全频段扰动会显著降低正常任务的可用性,产生明显行为特征,易被用户或监控系统察觉,影响攻击隐蔽性。我们考察从部分频段到全频段的不同覆盖范围,发现越狱成功率(JSR)非单调变化,而可用性退化随覆盖范围增加。这一不匹配表明,选择性频段即可实现更强攻击且代价更低。基于此,我们提出GRM:一种面向实用性的频带选择性越狱框架。该框架通过计算梅尔频带的越狱贡献与转录敏感度之比进行排序,将通用扰动限制在选定频带,并正则化偏离原请求语义的情况。在四个ALLMs上的实验表明,GRM平均达到88.46%的越狱成功率,同时在良性转录和响应任务中显著降低可用性退化,优于基线方法。代码已开源。

原文摘要 · Abstract (English)

Audio Large Language Models (ALLMs) enable spoken interaction but introduce new jailbreak vulnerabilities. Existing perturbation-based jailbreaks do not explicitly control which frequency bands carry the perturbation. Although such perturbations can elicit unsafe responses, repeatedly applying a universal perturbation across diverse inputs may also degrade utility on normal tasks, leaving a conspicuous behavioral footprint that may expose the attack to users or automated monitoring systems and thereby compromise its stealthiness. To determine whether full-band perturbation is necessary, we vary coverage from partial-band to full-band. Jailbreak Success Rate (JSR) varies non-monotonically, while utility degradation grows with coverage. This mismatch shows that selected bands can yield stronger attacks with less utility degradation than full-band perturbations. Based on this observation, we propose GRM, a utility-aware, frequency-selective jailbreak framework that ranks Mel bands by the ratio between jailbreak contribution and transcript sensitivity, confines a universal perturbation to selected bands, and regularizes deviations from the intended request semantics. Experiments on four ALLMs show that GRM achieves an average JSR of 88.46\% while substantially reducing utility degradation across benign transcription and response tasks relative to baselines. Our code is available at \href{https://github.com/159753Fetter/GRM}{this repository}. Warning: This paper contains potentially sensitive content.

音频安全越狱攻击频带选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。