arXiv:2605.30399q-bio.QMcs.LG2026-05被引 3

用3D视觉追踪鱼尾,分析养殖网箱中鱼对入侵物的反应。

A Novel Computer Vision Approach for Assessing Fish Responses to Intrusive Objects in Aquaculture

论文配图:A Novel Computer Vision Approach for Assessing Fish Responses to Intrusive Objects in Aquaculture
图 1 · 摘自论文原文
  • 通过双目视觉与YOLOv8+ByteTrack追踪鱼尾,重建3D位置和运动参数。
  • 在真实养殖场数据上验证,可识别不同形状颜色结构对鱼行为的影响。
  • 适合水产养殖智能监控与动物福利评估研究者使用。

水产养殖业需应对可持续海产品生产挑战,其中鱼类健康与福利至关重要。本研究开发并实施了一种新方法,用于检测和追踪个体及群体鱼对入侵物体的反应。针对工业化海上网箱环境,专门设计了鱼尾跟踪算法,结合双目视觉技术,估计鱼的三维位置、速度、加速度、转向角和俯仰角。数据来自实际规模养殖场,分析了不同形状、尺寸和颜色结构对鱼行为的影响。方法基于人工标注的尾鳍训练,采用YOLOv8与ByteTrack进行目标检测与追踪,SuperGlue匹配左右图像帧,三角测量重建3D位置。测试了多种图像预处理与增强策略以提升检测精度,并对比了RAFT-Stereo在深度估计中的表现。结果验证了该方法优于已有研究,展现出在揭示网箱内鱼类行为动态方面的显著潜力。

原文摘要 · Abstract (English)

The aquaculture industry needs to address several challenges to secure sustainable seafood production that can serve an increasing global demand. One major challenge is to ensure good fish health and acceptable welfare during production since the improvement of fish welfare is of vital importance in current and future production systems. In this study, this is addressed by developing and implementing methods to identify fish behaviors in response to intrusive objects both on individual and on a group basis. A novel approach for detecting, tracking, and estimating the 3D position of individual fish has thus been developed, and specifically designed to track the caudal fins of farmed fish in industrial sea cages. The tracking data was subjected to a novel stereo-vision method adapted to estimate fish positions, velocities, accelerations, and turning and pitch angles. Datasets obtained from industrial-scale fish farms were then analyzed to identify the impact of structures of varying shapes, sizes, and colors on fish behavior. The method was trained using manually labeled caudal fins, and used YOLOv8 with ByteTrack as an object detector and tracker, SuperGlue for matching detections in the left and right frames, and triangulation to reconstruct the 3D positions of the fish. Different image pre-processing and augmentation methods for enhancing object detection accuracy were tested and their performance compared, while RAFT-Stereo was tested for depth estimation purposes. The obtained results both validate the method's performance against previous research efforts, and demonstrate the novelty and potential of this method in providing more insight into behavioral dynamics in sea-cages.

计算机视觉水产养殖行为分析3D追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。