对比六种自监督任务,发现婴儿哭声分析标签质量是瓶颈,非模型能力问题。
Self-Supervised Pretext Tasks for Infant Cry Analysis: A Controlled Comparison and a Cautionary Result on Donateacry

- 固定编码器与数据集,比较六种自监督预训练任务的性能差异。
- 在捐赠哭声数据集上,所有模型分类准确率仅达随机水平(0.38-0.54宏AUC)。
- 评估方式改变可导致结果虚高,需警惕数据泄露与样本重复问题。
我们在固定预算下比较了六种自监督预训练任务在婴儿哭声分析中的表现:使用相同1.17M参数的紧凑编码器、115小时经许可验证的公开预训练音频,以及统一评估协议。在哭声检测任务中,重建目标占优,掩码频谱编码器线性探针达到0.988 AUC(跨受试者划分),尽管编码器从未见过哭声。但在DonateAcry数据集上进行哭声原因分类时,所有编码器表现均接近随机(5类宏AUC为0.38至0.54),即使在1.8小时真实哭声上做域适应或端到端微调也无效。即便使用参数量大80倍的HuBERT-base模型,结果仍无改善,说明瓶颈在于标签而非模型容量。我们通过仅改变评估协议便复现了文献中90%+准确率:按片段划分(clip-wise splits)使准确率达85.2%(略高于83.8%多数类基线),加入数据增强后升至97.9%,与报告的最先进水平一致——而同一模型在受试者划分下仅得0.49宏AUC。在无泄漏划分下,对标注集进行二十倍增强(声码器说话人扰动+噪声混合,共21小时)后跨受试者AUC不变,表明此任务的有效样本量等于婴儿数量。代码、种子及每片段许可证清单已公开。
原文摘要 · Abstract (English)
We compare six self-supervised pretext tasks for infant cry analysis under a fixed budget, meaning the same compact encoder of 1.17M parameters, the same 115 hours of license-verified public pretraining audio, and the same evaluation protocol for every candidate. On cry detection the reconstructive objectives dominate, and a linear probe over a masked-spectrogram encoder reaches 0.988 AUC with subject-wise splits even though the encoder never observed a cry during pretraining. On cry-reason classification over donateacry, the de facto public benchmark for cry reasons, every encoder performs at chance (0.38 to 0.54 macro AUC over 5 classes), and neither domain adaptation on 1.8 hours of real cries nor end-to-end fine-tuning moves the result. Since a frozen HuBERT-base with 80 times more parameters shows the same pattern, the bottleneck must sit in the labels and not in model capacity. We then reproduce the 90\%+ accuracies of the donateacry literature on our own system by changing nothing but the evaluation protocol: clip-wise splits raise accuracy to 85.2% (barely above the 83.8% majority-class baseline), and applying augmentation before splitting raises it to 97.9%, matching the reported state of the art, from the same model that measures 0.49 macro AUC under subject-wise splits. Under leakage-free splits, a twentyfold augmentation of the labeled set (vocoder speaker perturbation and noise mixing, 21 hours) leaves cross-subject AUC unchanged: for this task the effective sample size is the number of infants. We release code, seeds and per-clip license manifests.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。