通过推理导向的LoRA微调与推理时缩放,提升音频依赖问答模型性能。
Reasoning-Oriented Post-Training and Inference-Time LoRA Rescaling for Audio-Dependent Question Answering
- 设计链式思维框架分解问答推理过程,分步优化关键环节。
- 对Qwen模型微调后准确率提升至61.05%,对MOSS模型部分恢复性能。
- 适合关注音频理解与多模态推理的开发者及研究人员。
音频依赖问答(ADQA)要求大音频语言模型(LALMs)根据给定音频内容回答问题。成功实现需具备精准音频感知、识别问题相关证据及跨模态推理能力。基于DCASE 2026 Task 5官方数据集,我们研究了针对Qwen2.5-Omni和MOSS-Audio-8B-Thinking两个基座模型的推理导向后训练与推理时LoRA缩放方法。提出结构化链式思维(CoT)框架,将推理过程分解为问题分析、问题类型、音频证据与推理四阶段。分析任务特定LoRA适配对两个基座的影响,并探索训练后LoRA适配器的推理时缩放。在开发集上实验显示显著的基座依赖行为:后训练提升Qwen系统性能,但使MOSS-Audio在监督微调配置下显著下降。适度的LoRA缩放将最佳Qwen系统顶1准确率从58.93%提升至61.05%,并部分恢复微调后MOSS-Audio性能,其最优系统达67.70%顶1准确率。提交系统在挑战中总体排名第三,轻量级系统中排名第二(参数量低于10B)。
原文摘要 · Abstract (English)
Audio-Dependent Question Answering (ADQA) requires Large Audio-Language Models (LALMs) to answer questions whose correct answers depend on the given audio content. Successful ADQA requires accurate audio perception, identification of question-relevant evidence, and cross-modal reasoning. Using the official ADQA dataset of DCASE 2026 Task 5, we investigate reasoning-oriented post-training with Low-Rank Adaptation (LoRA) and inference-time LoRA rescaling for both Qwen2.5-Omni and MOSS-Audio-8B-Thinking. We introduce a structured Chain-of-Thought (CoT) framework that decomposes the reasoning process into question analysis, question type, audio evidence, and reasoning. We then analyze how task-specific LoRA adaptation affects the two backbones and further explore inference-time rescaling of trained LoRA adapters. Experiments on the development set reveal markedly backbone-dependent behavior: post-training improves the Qwen-based systems but substantially degrades MOSS-Audio under our supervised fine-tuning configuration. Moderate LoRA rescaling further improves the best Qwen system's top-1 accuracy from 58.93% to 61.05% and partially restores the performance of the fine-tuned MOSS-Audio models, while the best MOSS-Audio system achieves 67.70% top-1 accuracy. Our submitted systems ranked third overall and second among lightweight systems under 10B parameters in the challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。