多传感器融合在牛体态分类中看似准确,实则易受时间分布偏移影响而失效。
When Multi-Sensor Fusion Fails to Generalize: Cattle Posture Classification Under Animal-Level and Temporal Distribution Shift

- 用多种传感器数据训练模型,评估其在不同年份动物上的泛化能力。
- 跨年度测试时模型性能从宏F1 0.94暴跌至0.49,显著下降。
- 揭示了模型依赖特定环境信号,适合关注真实场景鲁棒性的研究者。
自动化牛体态分类系统常报告近乎完美的准确率,但其在真实部署条件下的稳健性仍不明确。本文基于两年(2024-2025)牧场肉牛群的项圈加速度计、瘤胃胶囊传感器及环境数据,评估了姿态分类(躺卧与站立)的鲁棒性。以XGBoost为主要模型,对比逻辑回归、随机森林和长短期记忆网络。通过从常规随机划分到留一动物验证、跨年度独立动物测试等逐步严苛的评估协议,发现多模态模型虽在年内表现优异(宏F1 0.94),但在跨年度测试中性能大幅下降至0.49。可解释性分析显示,即使性能下降,模型仍持续依赖瘤胃胶囊活动和环境变量。分布偏移诊断确认了两年间特征分布存在显著差异。结果表明,常规评估协议会严重高估实际表现,且多传感器融合可能在时间分布偏移下削弱泛化能力。研究强调仅靠基准准确率不足以评估部署可行性,需建立以鲁棒性为核心的评估体系。
原文摘要 · Abstract (English)
Automated cattle posture-classification systems frequently report near-perfect accuracy, yet their robustness under realistic deployment conditions remains largely unknown. In particular, it is unclear whether multimodal sensor fusion improves generalisation or leads models to rely on context-specific signals that fail under distribution shift. Here, we evaluate the robustness of automated posture classification (lying versus standing) using collar accelerometers, rumen-bolus sensors, and environmental measurements collected from a pasture-based beef cattle herd across two consecutive years (2024-2025). XGBoost served as the primary model, with Logistic Regression, Random Forest, and Long Short-Term Memory networks evaluated as comparative baselines. Model robustness was assessed under progressively more stringent evaluation protocols, ranging from conventional random train-test splits to leave-one-animal-out validation and cross-year evaluation on an independent cohort of previously unseen animals recorded one year later. While multimodal models achieved strong within-year performance (macro-F1 0.94), the performance declined substantially under cross-year evaluation (macro-F1 0.49). Explainability analysis revealed persistent reliance on rumen-bolus activity and environmental variables even when predictive performance deteriorated. Distribution-shift diagnostics further confirmed substantial differences in feature distributions between recording years. Our findings demonstrate that commonly used evaluation protocols can substantially overestimate real-world performance and that multimodal sensor fusion may reduce, rather than improve, robustness under temporal distribution shift. More broadly, the results highlight that benchmark accuracy alone is insufficient to assess deployment readiness and underscore the need for robustness-centred evaluation in livestock-monitoring research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。