arXiv:2608.25621cs.SDcs.AI2026-08

提出音高冲突谱,显式建模频率间感知关系,提升音乐理解

Dissonance Spectrum explicitly models perceptual frequency interactions for better music understanding

论文配图:Dissonance Spectrum explicitly models perceptual frequency interactions for better music understanding
图 1 · 摘自论文原文
  • 基于对数谐波距离与容差核,构建音高冲突谱捕捉频率交互
  • 在音程、和声功能等测试中达成强序数一致,跨和弦配置仍显著有效
  • 轻量并行分支可插拔,适合音乐问答与情感识别任务

传统音乐表征仅描述时频域能量分布,未显式揭示同时频率成分间的关联。本文提出非负时频表示「音高冲突谱」(Dissonance Spectrum, DS),通过容忍度理性的音高关系核与对数谐波距离,在常数-Q谱上计算成对交互,并将总效应回传至各频率分量。受控音乐理论测试显示,音程、和声功能连接及教会调式均呈现强序数一致性,且在多种和弦配置中仍保持显著一致性。随后,采用轻量级并行分支编码DS,其零初始化残差投影在初始阶段保持基线功能。在六组随机种子的开放式音乐问答、分类与维度化音乐情感识别任务中,DS在所有指标上均优于原始基线、参数匹配的高斯输入分支及架构匹配的幅度-CQT分支。结果表明DS是一种可解释、互补的表示,但听者个体差异与更广任务覆盖仍待探索。

原文摘要 · Abstract (English)

Conventional music representations describe acoustic energy over time and frequency but do not explicitly expose relations among simultaneous frequency components. We introduce the \emph{Dissonance Spectrum} (DS), a nonnegative time--frequency representation that applies a tolerance-based rational pitch-relation kernel with logarithmic harmonic distance to a constant-Q spectrum and attributes aggregate pairwise interactions back to individual frequency bins. Controlled music-theory tests show strong ordinal agreement for intervals, harmonic-function connections, and church modes, and weaker but significant agreement across diverse chord voicings. DS is then encoded by a lightweight parallel branch whose zero-initialized residual projection preserves the baseline function at initialization. Across six paired training seeds in open-ended music question answering and categorical and dimensional music emotion recognition, DS obtains the highest mean on every reported endpoint relative to the unchanged baseline, a parameter-matched Gaussian-input branch, and an architecture-matched magnitude-CQT branch. These results support DS as an interpretable, complementary representation, while listener-specific perception and broader task coverage remain open problems.

音乐理解时频表征感知建模音频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。