arXiv:2503.14001cs.CV2025-03被引 8

用多模态图像精准预测鸭子体型和体重,免接触测量更高效。

Multimodal Feature-Driven Deep Learning for the Prediction of Duck Body Dimensions and Weight

  • 融合多视角2D图像、深度图与3D点云,提取多模态特征
  • 在1023只鸭子数据上实现6.33% MAPE,R²达0.953
  • 无需物理接触,适合智能养殖场景,首例深度学习应用

精确的体尺与体重测量对优化家禽管理、健康评估和经济效益至关重要。本研究提出一种基于深度学习的创新模型,利用多模态数据——来自不同视角的2D RGB图像、深度图像和3D点云——实现鸭子体尺与体重的非侵入式估算。构建了一个包含1,023只临武鸭、超过5,000个样本的数据集,涵盖多种姿态与状态。该方法创新性地采用PointNet++从点云中提取关键特征点,计算对应的3D几何特征,并与多视角卷积2D特征融合;随后使用Transformer编码器捕捉长程依赖关系,优化特征交互,提升预测鲁棒性。模型在8个形态参数上达到6.33%的平均绝对百分比误差(MAPE)和0.953的R²,表现优异。相比传统人工测量,该模型可实现高精度估算且无需物理接触,降低动物应激,拓展应用场景。本研究首次将深度学习应用于家禽体尺与体重估计,为畜牧产业智能化、精准化管理提供重要参考,具有广泛实践意义。

原文摘要 · Abstract (English)

Accurate body dimension and weight measurements are critical for optimizing poultry management, health assessment, and economic efficiency. This study introduces an innovative deep learning-based model leveraging multimodal data-2D RGB images from different views, depth images, and 3D point clouds-for the non-invasive estimation of duck body dimensions and weight. A dataset of 1,023 Linwu ducks, comprising over 5,000 samples with diverse postures and conditions, was collected to support model training. The proposed method innovatively employs PointNet++ to extract key feature points from point clouds, extracts and computes corresponding 3D geometric features, and fuses them with multi-view convolutional 2D features. A Transformer encoder is then utilized to capture long-range dependencies and refine feature interactions, thereby enhancing prediction robustness. The model achieved a mean absolute percentage error (MAPE) of 6.33% and an R2 of 0.953 across eight morphometric parameters, demonstrating strong predictive capability. Unlike conventional manual measurements, the proposed model enables high-precision estimation while eliminating the necessity for physical handling, thereby reducing animal stress and broadening its application scope. This study marks the first application of deep learning techniques to poultry body dimension and weight estimation, providing a valuable reference for the intelligent and precise management of the livestock industry with far-reaching practical significance.

深度学习智能养殖多模态3D点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。