提出新方法提升音乐识别模型置信度判断可靠性
$TCP_α$: Margin-Controlled Confidence estimation for reliable Music Information Retrieval

- 设计边缘控制的置信度目标,让正确与错误预测得分完全分离
- 仅剔除最低8%置信度预测,模型宏F1从0.89升至0.98
- 适用于需要高可靠性的音乐信息检索场景
深度神经网络常过度自信,对错误预测也赋予高置信度,导致用户难以判断预测可信度。后处理置信度估计通过在冻结分类器上添加轻量辅助头来解决此问题。现有方法存在固有歧义:正确与错误预测的置信度值重叠,且靠近决策边界的错误预测得分与正确预测无法区分。本文提出 $TCP_α$,一种新型置信度目标,通过引入对误分类样本的边缘控制惩罚,实现正确与错误预测目标值的完全分离,分离边缘独立于类别数,并随惩罚参数单调递增。由于准确分类器本身错误极少,学习该目标导致严重回归不平衡。因此,我们系统研究了在此不平衡下的训练策略,通过大量消融实验确定有效配置。在拉加识别任务上评估该方法,考察其在域偏移下的鲁棒性,并在帧级装饰音检测中验证其通用性,无需调整配置。所有设置下,$TCP_α$ 均显著优于现有置信度目标。仅剔除最低8%置信度预测,即可将基线模型宏F1从0.89提升至0.98;仅用新语料5%标注样本微调置信头,即可有效恢复域偏移下的性能。
原文摘要 · Abstract (English)
Deep neural networks are often overconfident, assigning high confidence even to incorrect predictions. Consequently, users lack a reliable signal for deciding when a prediction can be trusted. Post-hoc confidence estimation addresses this by training a lightweight auxiliary head over a frozen classifier. Existing targets, however, suffer from inherent ambiguity: they assign overlapping confidence values to correct and incorrect predictions, while errors near the decision boundary receive confidence scores indistinguishable from correct predictions. In this work, we propose $TCP_α$, a novel confidence target that resolves these limitations by introducing a margin-controlled penalty for misclassified samples. We prove that $TCP_α$ guarantees complete separation between the target values of correct and incorrect predictions, with a separation margin that is independent of the number of classes and increases monotonically with the penalty parameter. Since accurate classifiers naturally produce very few errors, learning these targets results in a severely imbalanced regression problem. We therefore present a systematic study of training strategies for learning under this imbalance and identify an effective training configuration through extensive ablation studies. We evaluate the proposed approach on rāga identification, investigate its robustness under domain shift, and further validate it on frame-wise ornamentation detection without modifying the selected configuration. Across all settings, $TCP_α$ consistently outperforms existing confidence targets for failure prediction. Rejecting only the least-confident 8\% of predictions improves the base model's macro-F1 from 0.89 to 0.98, while fine-tuning the confidence head with only 5\% labeled samples from a new corpus effectively restores performance under domain shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。