融合声音与语言数据,智能识别奶牛叫声中的情绪状态。
Multi Modal Information Fusion of Acoustic and Linguistic Data for Decoding Dairy Cow Vocalizations in Animal Welfare Assessment
- 结合语音特征与文本转录,构建多模态融合分析框架。
- 识别出与焦虑相关的特定频率和声谱特征,准确分类叫声。
- 适合动物福利监测、智慧养殖领域的研究人员与从业者。
通过多源数据融合理解动物叫声,对精准畜牧中评估情绪状态和提升动物福利至关重要。本研究采用多模态数据融合技术解码奶牛接触叫声,整合语音转录、语义分析、上下文与情绪评估及声学特征提取。利用自然语言处理模型将奶牛叫声音频转为文字,融合频率、持续时间和强度等声学特征与文本数据,构建全面的叫声表征。基于自研本体论,将叫声分为高频(关联焦虑或兴奋)与低频(关联满足或平静)。分析20头奶牛的融合多维数据,识别出焦虑相关特征,包括特定频率测量值与声谱结果。采用随机森林、支持向量机与循环神经网络等先进机器学习算法,有效处理多源数据并分类叫声。模型优化以应对实际养殖场中的计算需求与数据质量挑战。结果表明,多源数据融合与智能处理技术在动物福利监测中具有显著效果,推动了动物情绪福祉评估的技术进步。
原文摘要 · Abstract (English)
Understanding animal vocalizations through multi-source data fusion is crucial for assessing emotional states and enhancing animal welfare in precision livestock farming. This study aims to decode dairy cow contact calls by employing multi-modal data fusion techniques, integrating transcription, semantic analysis, contextual and emotional assessment, and acoustic feature extraction. We utilized the Natural Language Processing model to transcribe audio recordings of cow vocalizations into written form. By fusing multiple acoustic features frequency, duration, and intensity with transcribed textual data, we developed a comprehensive representation of cow vocalizations. Utilizing data fusion within a custom-developed ontology, we categorized vocalizations into high frequency calls associated with distress or arousal, and low frequency calls linked to contentment or calmness. Analyzing the fused multi dimensional data, we identified anxiety related features indicative of emotional distress, including specific frequency measurements and sound spectrum results. Assessing the sentiment and acoustic features of vocalizations from 20 individual cows allowed us to determine differences in calling patterns and emotional states. Employing advanced machine learning algorithms, Random Forest, Support Vector Machine, and Recurrent Neural Networks, we effectively processed and fused multi-source data to classify cow vocalizations. These models were optimized to handle computational demands and data quality challenges inherent in practical farm environments. Our findings demonstrate the effectiveness of multi-source data fusion and intelligent processing techniques in animal welfare monitoring. This study represents a significant advancement in animal welfare assessment, highlighting the role of innovative fusion technologies in understanding and improving the emotional wellbeing of dairy cows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。