arXiv:2601.02983cs.SDcs.AI2026-01被引 15

用频时结构化推理提升语音伪造检测可解释性

Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learning

  • 构建频时结构化思维链,生成34万条标注数据
  • 两阶段训练使检测准确率达当前最优,且推理可解释
  • 适合需要可信决策依据的音频安全场景

近年来,音频大语言模型(ALLMs)使高质量合成音频广泛传播,增加了语音、环境声、人声演唱和音乐等各类音频伪造的风险。真实世界中的音频伪造检测(ADD)需具备跨类型泛化能力并提供可解释决策。尽管ALLMs具有强多任务泛化能力,但仅使用真实/伪造二分类标签的监督微调(SFT)会使其退化为黑箱分类器,牺牲可解释性;而原始强化学习微调(RFT)在稀疏监督下易出现奖励滥用,生成无根据的推理。为此,我们提出自动标注与优化流水线,构建频时结构化思维链(CoT)推理,生成约34万条冷启动示范数据。基于此,提出频时组相对策略优化(FT-GRPO),先通过SFT冷启动,再在基于频时规则的约束下应用GRPO。实验表明,FT-GRPO在所有类型音频伪造检测中均达到领先性能,并生成可解释、符合频时特性的推理。数据与代码已公开。

原文摘要 · Abstract (English)

Recent advances in audio large language models (ALLMs) have made high-quality synthetic audio widely accessible, increasing the risk of malicious audio deepfakes across speech, environmental sounds, singing voice, and music. Real-world audio deepfake detection (ADD) therefore requires all-type detectors that generalize across heterogeneous audio and provide interpretable decisions. Given the strong multi-task generalization ability of ALLMs, we first investigate their performance on all-type ADD under both supervised fine-tuning (SFT) and reinforcement fine-tuning (RFT). However, SFT using only binary real/fake labels tends to reduce the model to a black-box classifier, sacrificing interpretability. Meanwhile, vanilla RFT under sparse supervision is prone to reward hacking and can produce hallucinated, ungrounded rationales. To address this, we propose an automatic annotation and polishing pipeline that constructs Frequency-Time structured chain-of-thought (CoT) rationales, producing ~340K cold-start demonstrations. Building on CoT data, we propose Frequency Time-Group Relative Policy Optimization (FT-GRPO), a two-stage training paradigm that cold-starts ALLMs with SFT and then applies GRPO under rule-based frequency-time constraints. Experiments demonstrate that FT-GRPO achieves state-of-the-art performance on all-type ADD while producing interpretable, FT-grounded rationales. The data and code are available online.

音频伪造可解释性LLM检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。