用AI分析婴儿哭声,智能识别哭因并适配手机部署
InfantCryNet: A Data-driven Framework for Intelligent Analysis of Infant Cries
- 结合预训练模型与注意力机制,提升哭声特征提取能力
- 分类准确率比现有方法高4.4%,压缩后模型体积减少28%
- 适合育儿应用开发、移动端低资源部署场景
理解婴儿哭声的含义对新手父母具有重要意义。背景噪声和标注数据不足是实际系统中检测哭声并分析原因的主要挑战。本文提出一种名为InfantCryNet的数据驱动框架,解决上述问题。为缓解数据稀缺,采用预训练音频模型引入先验知识;提出统计池化与多头注意力池化技术以更高效地提取特征。同时,应用知识蒸馏与模型量化提升效率并减小模型规模,更好支持移动端工业部署。在真实数据集上的实验表明,该框架分类准确率优于当前最优基线4.4%。模型压缩使模型大小减少7%(无性能损失),最多减少28%(仅精度下降8%),为模型选型与系统设计提供实用参考。
原文摘要 · Abstract (English)
Understanding the meaning of infant cries is a significant challenge for young parents in caring for their newborns. The presence of background noise and the lack of labeled data present practical challenges in developing systems that can detect crying and analyze its underlying reasons. In this paper, we present a novel data-driven framework, "InfantCryNet," for accomplishing these tasks. To address the issue of data scarcity, we employ pre-trained audio models to incorporate prior knowledge into our model. We propose the use of statistical pooling and multi-head attention pooling techniques to extract features more effectively. Additionally, knowledge distillation and model quantization are applied to enhance model efficiency and reduce the model size, better supporting industrial deployment in mobile devices. Experiments on real-life datasets demonstrate the superior performance of the proposed framework, outperforming state-of-the-art baselines by 4.4% in classification accuracy. The model compression effectively reduces the model size by 7% without compromising performance and by up to 28% with only an 8% decrease in accuracy, offering practical insights for model selection and system design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。