arXiv:2510.22618cs.CVcs.AI2025-10被引 1

用斑马姿态模型迁移到奶牛姿态估计,发现跨物种迁移效果有限。

Cross-Species Transfer Learning in Agricultural AI: Evaluating ZebraPose Adaptation for Dairy Cattle Pose Estimation

  • 用合成斑马数据训练的视觉变压器模型迁移到真实奶牛场景
  • 联合数据集上达到AP 0.86、AR 0.87、PCK 0.5 0.869的精度
  • 跨畜舍和牛群泛化能力差,提示需农业优先设计

姿态估计是理解动物体态、行为与福利的核心计算机视觉技术。然而,农业应用受限于大型标注数据集稀缺,尤其是奶牛数据。本研究评估了跨物种迁移学习的潜力与局限性:将基于合成斑马图像训练的视觉变压器模型ZebraPose,用于真实畜舍环境下27关键点的奶牛姿态检测。通过三个配置——一个自建农场数据集(375张图像,加拿大新不伦瑞克省苏塞克斯)、APT-36K基准数据子集及其组合,系统评估了模型在不同环境下的准确率与泛化能力。尽管联合数据集上表现良好(AP = 0.86,AR = 0.87,PCK 0.5 = 0.869),但在未见过的畜舍和牛群中出现显著泛化失败。结果揭示了从合成数据到真实场景的领域差距是农业人工智能部署的主要障碍,表明物种形态相似不足以支撑跨域迁移。研究提供了关于数据多样性、环境差异性和计算约束对实际部署影响的实用洞见,并呼吁采用农业优先的AI设计,强调农场级真实性、跨环境鲁棒性及开放基准数据集的重要性,以推动可信赖且可扩展的动物中心技术发展。

原文摘要 · Abstract (English)

Pose estimation serves as a cornerstone of computer vision for understanding animal posture, behavior, and welfare. Yet, agricultural applications remain constrained by the scarcity of large, annotated datasets for livestock, especially dairy cattle. This study evaluates the potential and limitations of cross-species transfer learning by adapting ZebraPose - a vision transformer-based model trained on synthetic zebra imagery - for 27-keypoint detection in dairy cows under real barn conditions. Using three configurations - a custom on-farm dataset (375 images, Sussex, New Brunswick, Canada), a subset of the APT-36K benchmark dataset, and their combination, we systematically assessed model accuracy and generalization across environments. While the combined model achieved promising performance (AP = 0.86, AR = 0.87, PCK 0.5 = 0.869) on in-distribution data, substantial generalization failures occurred when applied to unseen barns and cow populations. These findings expose the synthetic-to-real domain gap as a major obstacle to agricultural AI deployment and emphasize that morphological similarity between species is insufficient for cross-domain transfer. The study provides practical insights into dataset diversity, environmental variability, and computational constraints that influence real-world deployment of livestock monitoring systems. We conclude with a call for agriculture-first AI design, prioritizing farm-level realism, cross-environment robustness, and open benchmark datasets to advance trustworthy and scalable animal-centric technologies.

姿态估计农业AI跨物种迁移视觉变压器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。