arXiv:2506.14170cs.CVcs.AI2025-06

融合视觉音频水波数据,提升养鱼喂食强度量化可靠性

Progressive Multimodal Interaction Network for Reliable Quantification of Fish Feeding Intensity in Aquaculture

  • 分阶段融合多模态数据,统一特征表示并增强跨模态交互
  • 在7089样本上达到96.76%准确率,参数与计算开销低
  • 适合智能养殖中自动化喂食监控与精准决策场景

精确量化鱼类摄食强度对水产精准喂养至关重要,直接影响饲料利用率和养殖效率。尽管多模态融合已被证明有效,但现有方法常忽略不同模态间响应不一致和决策冲突问题,限制了结果的可靠性。本文提出渐进式多模态交互网络(PMIN),融合图像、音频与水波数据实现鱼类摄食强度量化。首先构建统一特征提取框架,将不同模态输入映射至结构一致的特征空间,减少表征差异;随后设计辅助模态增强主模态机制,通过通道感知重校准与双阶段注意力交互实现跨模态信息融合;进一步引入基于自适应证据推理的决策融合策略,联合建模各模态输出的置信度、可靠性与冲突关系,提升最终判断的稳定性与鲁棒性。在包含7089个样本的多模态摄食强度数据集上实验表明,PMIN准确率达96.76%,参数量与计算成本较低,整体性能优于同质与异质对比模型。消融实验、对比实验及实际应用结果进一步验证了方法的有效性与优越性,可为智慧水产中的自动化喂食监测与精准决策提供可靠支持。

原文摘要 · Abstract (English)

Accurate quantification of fish feeding intensity is crucial for precision feeding in aquaculture, as it directly affects feed utilization and farming efficiency. Although multimodal fusion has proven to be an effective solution, existing methods often overlook the inconsistencies in responses and decision conflicts between different modalities, thus limiting the reliability of the quantification results. To address this issue, this paper proposes a Progressive Multimodal Interaction Network (PMIN) that integrates image, audio, and water-wave data for fish feeding intensity quantification. Specifically, a unified feature extraction framework is first constructed to map inputs from different modalities into a structurally consistent feature space, thereby reducing representational discrepancies across modalities. Then, an auxiliary-modality reinforcement primary-modality mechanism is designed to facilitate the fusion of cross-modal information, which is achieved through channel aware recalibration and dual-stage attention interaction. Furthermore, a decision fusion strategy based on adaptive evidence reasoning is introduced to jointly model the confidence, reliability, and conflicts of modality-specific outputs, so as to improve the stability and robustness of the final judgment. Experiments are conducted on a multimodal fish feeding intensity dataset containing 7089 samples. The results show that PMIN has an accuracy of 96.76%, while maintaining relatively low parameter count and computational cost, and its overall performance outperforms both homogeneous and heterogeneous comparison models. Ablation studies, comparative experiments, and real-world application results further validate the effectiveness and superiority of the proposed method. It can provide reliable support for automated feeding monitoring and precise feeding decisions in smart aquaculture.

多模态融合智能养殖精准喂养

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。