用大模型推理提升和弦识别准确率,融合多工具信息
Enhancing Automatic Chord Recognition through LLM Chain-of-Thought Reasoning
- 将多个音乐分析工具输出转为文本,由大模型进行逻辑推理整合
- 在三个数据集上提升1-2.77%的和弦识别准确率(MIREX指标)
- 适合研究音乐信息检索、多模态模型融合的开发者与学者
音乐信息检索(MIR)涵盖一系列用于分析和理解音乐内容的计算技术,近年来深度学习的发展推动了显著进步。本文探索大型语言模型(LLMs)如何作为集成桥梁,连接并整合多个MIR工具的信息,以提升自动和弦识别性能。我们提出一种新方法,将基于文本的LLM作为智能协调者,处理并整合来自多种先进MIR工具(包括音乐源分离、调性检测、和弦识别和节拍跟踪)的输出。该方法将音频生成的音乐信息转换为文本表示,使LLM能够利用音乐理论知识,针对和弦识别任务进行推理与修正。我们设计了一个五阶段链式思维框架,让GPT-4o系统地分析、比较并优化和弦识别结果。在三个数据集上的实验评估表明,多个评价指标均实现持续提升,整体准确率提高1%-2.77%(基于MIREX指标)。研究结果证明,LLM可有效充当MIR流程中的集成桥梁,为多工具协同提供新方向。
原文摘要 · Abstract (English)
Music Information Retrieval (MIR) encompasses a broad range of computational techniques for analyzing and understanding musical content, with recent deep learning advances driving substantial improvements. Building upon these advances, this paper explores how large language models (LLMs) can serve as an integrative bridge to connect and integrate information from multiple MIR tools, with a focus on enhancing automatic chord recognition performance. We present a novel approach that positions text-based LLMs as intelligent coordinators that process and integrate outputs from diverse state-of-the-art MIR tools-including music source separation, key detection, chord recognition, and beat tracking. Our method converts audio-derived musical information into textual representations, enabling LLMs to perform reasoning and correction specifically for chord recognition tasks. We design a 5-stage chain-of-thought framework that allows GPT-4o to systematically analyze, compare, and refine chord recognition results by leveraging music-theoretical knowledge to integrate information across different MIR components. Experimental evaluation on three datasets demonstrates consistent improvements across multiple evaluation metrics, with overall accuracy gains of 1-2.77% on the MIREX metric. Our findings demonstrate that LLMs can effectively function as integrative bridges in MIR pipelines, opening new directions for multi-tool coordination in music information retrieval tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。