真实家庭环境音事件检测新基准,覆盖5710段真实录音。
RealDESED: A Real-World Domestic Sound Event Detection Benchmark

- 基于652人居家录制的5710段音频,真实反映设备与声学差异。
- 多标注者标注+额外审核,保证标签质量,测试集PSDS1达0.731。
- 适合研究真实场景下鲁棒音事件检测的团队使用。
本文提出RealDESED,一个真实家庭环境下的声音事件检测(SED)基准数据集,包含由652名参与者在家中录制的5,710段音频,每段时长15至35秒,涵盖15类常见家庭声音事件,并配有精确的时间标注。与现有依赖模拟声景或网络爬取音频的SED数据集不同,RealDESED完全由自然家庭环境中的真实录音构成,真实反映了录音设备、摆放位置、声学条件、背景噪音及事件共现等多样性。数据集采用多标注者标注机制,每段音频由多位标注员独立标注,验证集和测试集经过额外审核以确保高质量标注与可靠评估。此外,数据集还提供丰富的元数据,包括录音设备、设备摆放、环境标签及文本场景描述。我们建立了一个基于Transformer的强大基线模型,研究了标注聚合策略、后处理方法、长序列推理以及录音元数据对模型性能的影响。基线模型在测试集上取得0.731的宏平均PSDS1分数。我们认为RealDESED为在真实家庭条件下开发和评估鲁棒的SED系统提供了重要基准,有助于缩小当前研究与实际部署之间的差距。
原文摘要 · Abstract (English)
This paper presents RealDESED, a real-world domestic sound event detection (SED) benchmark comprising 5,710 audio recordings collected by 652 participants in their homes. Each recording is between 15 and 35 seconds long and contains temporally precise annotations for 15 common domestic sound classes. In contrast to existing SED datasets, which typically rely on simulated soundscapes or broad web-crawled audio, RealDESED consists exclusively of recordings captured in natural domestic environments, reflecting realistic variability in recording devices, device placement, acoustic conditions, background sounds, and naturally occurring event co-occurrences. A distinguishing characteristic of the dataset is its multi-annotator labeling scheme, where each recording is independently annotated by multiple annotators, while the validation and test sets undergo an additional review process to ensure high annotation quality and reliable benchmarking. Furthermore, the dataset provides rich metadata, including recording device, device placement, environment labels, and textual scene descriptions. We establish a strong transformer-based baseline and investigate annotation aggregation strategies, post-processing methods, long-form inference, and the impact of recording metadata on model performance. Our baseline achieves a macro-averaged PSDS1 score of 0.731 on the test set. We believe RealDESED provides a valuable benchmark for developing and evaluating robust SED systems under realistic domestic conditions, helping to bridge the gap between current research benchmarks and real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。