arXiv:2607.26743cs.CVcs.AI2026-07

用图像和骨骼尺寸数据联合识别鸟类骨头,准确率超85%。

Multimodal fusion of visual and morphometric features for avian bone classification

  • 图像与骨骼测量数据在特征层面融合,用预训练模型提取视觉特征。
  • 骨种分类准确率达86%,家族级分类顶3准确率75%。
  • 适合考古学中大规模鸟类骨骼鉴定,结果可解释性强。

人工智能在考古学中潜力巨大,但在动物骨骼鉴定领域仍有限。本研究提出一种多模态框架,结合卷积神经网络图像分析与骨度量数据,用于鸟类骨骼分类。基于超过10,000张来自多个博物馆和研究机构的图像,开展两项任务:骨骼元素识别与科级分类。图像通过双阶段分割流程(BiRefNet与SAM2)自动处理,视觉特征由预训练EfficientNet_V2_S提取,与标准化形态测量数据在特征层融合。模型在骨种分类测试集上达到86%准确率,表明骨骼元素识别可靠;科级分类虽仅51%顶1准确率,但顶3准确率达75%,说明正确分类常位于最可能预测之中。结果证明视觉与形态信息在统一深度学习框架中的可行性,为未来AI辅助动物园考古鉴定建立方法基准。该方法推动开发可扩展、可解释且具有考古意义的鸟类遗骸分析工具。

原文摘要 · Abstract (English)

Artificial intelligence has shown considerable potential for archaeological applications, yet its use in zooarchaeology remains limited, particularly for the identification of avian skeletal remains. This study presents a proof-of-concept multimodal framework that integrates convolutional neural network-based image analysis with osteometric measurements for the classification of bird bones. Using a dataset of more than 10,000 images from multiple museum and research collections, two classification tasks were investigated: skeletal element identification and family-level taxonomic classification. Prior to classification, images were automatically segmented using a two-stage pipeline combining BiRefNet and SAM2. Visual features extracted with a pre-trained EfficientNet_V2_S backbone were fused with standardized morphometric data through a feature-level multimodal architecture. The model achieved 86% accuracy on the test set for bone-type classification, demonstrating reliable recognition of skeletal elements. Family-level classification proved more challenging, reaching 51% top-1 accuracy but 75% top-3 accuracy, indicating that correct taxa were frequently included among the most probable predictions. These results demonstrate the feasibility of combining visual and morphometric information within a unified deep-learning framework and establish a methodological baseline for future AI-assisted zooarchaeological identification. The approach contributes to ongoing efforts to develop scalable, interpretable, and archaeologically meaningful tools for the study of avian remains.

鸟类鉴定多模态融合考古AI骨骼分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。