用频域与空间融合提升牛发情姿势估计精度,抗遮挡更强。
FSMC-Pose: Frequency and Spatial Fusion with Multiscale Self-calibration for Cattle Mounting Pose Estimation
- 设计频域-空间融合模块,分离牛体与杂乱背景。
- 在1176个实例上达到更高精度,推理速度更快。
- 适合牧场智能监测系统部署,对遮挡鲁棒性强。
发情期的骑乘姿势是奶牛发情的重要视觉指标。然而,在复杂背景下因动物间频繁遮挡,实现可靠姿势估计仍具挑战。本文提出FSMC-Pose,一种自顶向下框架,包含轻量级频域-空间融合主干网络CattleMountNet和多尺度自校准头SC2Head。其中,SFEBlock分离牛体与杂乱背景,RABlock捕捉多尺度上下文信息;SC2Head同时建模空间与通道依赖,并引入自校准分支缓解重叠时结构错位问题。构建了符合COCO格式的MOUNT-Cattle数据集,含1176个骑乘实例,支持即插即用训练。结合公开的NWAFU-Cattle数据集,该方法在保持实时推理(商品级GPU)的同时,显著优于强基线,且计算与参数开销更低。大量实验与可视化分析表明,该模型在复杂环境中的姿态估计能力优异。代码与数据集见:https://github.com/elianafang/FSMC-Pose。
原文摘要 · Abstract (English)
Mounting posture is an important visual indicator of estrus in dairy cattle. However, achieving reliable mounting pose estimation in real-world environments remains challenging due to cluttered backgrounds and frequent inter-animal occlusion. We present FSMC-Pose, a top-down framework that integrates a lightweight frequency-spatial fusion backbone, CattleMountNet, and a multiscale self-calibration head, SC2Head. Specifically, we design two algorithmic components for CattleMountNet: the Spatial Frequency Enhancement Block (SFEBlock) and the Receptive Aggregation Block (RABlock). SFEBlock separates cattle from cluttered backgrounds, while RABlock captures multiscale contextual information. The Spatial-Channel Self-Calibration Head (SC2Head) attends to spatial and channel dependencies and introduces a self-calibration branch to mitigate structural misalignment under inter-animal overlap. We construct a mounting dataset, MOUNT-Cattle, covering 1176 mounting instances, which follows the COCO format and supports drop-in training across pose estimation models. Using a comprehensive dataset that combines MOUNT-Cattle with the public NWAFU-Cattle dataset, FSMC-Pose achieves higher accuracy than strong baselines, with markedly lower computational and parameter costs, while maintaining real-time inference on commodity GPUs. Extensive experiments and qualitative analyses show that FSMC-Pose effectively captures and estimates cattle mounting pose in complex and cluttered environments. Dataset and code are available at https://github.com/elianafang/FSMC-Pose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。