arXiv:2608.06973cs.CV2026-08中稿 · ECCV

用无人机红光与热成像融合,自动识别红鹿的性别和年龄阶段。

When One Modality Is Not Enough: Multimodal Sex and Life-Stage Classification of Red Deer from Aerial RGB-Thermal Video

论文配图:When One Modality Is Not Enough: Multimodal Sex and Life-Stage Classification of Red Deer from Aerial RGB-Thermal Video
图 1 · 摘自论文原文
  • 融合红光与热成像,通过自监督特征提升小目标识别精度。
  • 在4次飞行中准确分类25/26只鹿,性别分类准确率达96.0%。
  • 适合需要频繁获取鹿群结构数据的野生动物管理场景。

无人机航拍日益用于野生动物种群估算,但有效普查不仅需计数,还需掌握物种组成、性别比例和年龄结构。以红鹿(Cervus elaphus)为案例,因管理者需据此决策,且雄鹿角随季节变化,难以仅凭视觉判断。航拍采用正上方视角,动物占据小而低分辨率区域。可见光下,遮蔽下的鹿易与地面混淆;热成像中则呈现为明亮光斑,细节丢失。我们不依赖单一模态,而是全程融合双模态,使用自监督DINOv3特征。处理流程包括:双模态追踪、仅当两摄像头一致时才确认个体、保留无遮挡清晰帧,并通过多帧投票确定物种与性别;年龄阶段则通过地理定位的体长差异判断。在覆盖角季的4次飞行中,融合方法正确分类25/26只检测到的个体(8只雄鹿中7只,16只雌鹿全对,2只幼鹿均对),优于任一传感器单独使用(20/26)。多模态物种分类准确率96.0%,性别分类中融合效果最显著:RGB+热成像模型在不同环境与季节间表现最鲁棒。自动化分类使一次航拍从计数变为可重复的群体结构读取,让管理者持续获取性别比与年龄结构数据。

原文摘要 · Abstract (English)

Aerial drone surveys increasingly support wildlife population estimation, yet a useful census is more than a count: population dynamics are defined by species composition, sex ratios and age structure, that is, by which species are present and how a herd splits into adult males, adult females and juveniles. We use red deer ($\textit{Cervus elaphus}$) as a test case, because managers act on these dynamics and because the visible cue defining adult males, the antlers, is seasonally variable. Surveys are flown nadir, high enough not to disturb the animals, so each deer occupies only a small, low-resolution patch. The two recording modalities fail in opposite conditions: in color a deer under canopy blends into the ground, while in thermal it becomes a bright blob that loses fine detail. Rather than trust either modality alone, we fuse them at every stage using self-supervised DINOv3 features. Our pipeline tracks animals in both modalities, treats an animal as confirmed only when the two cameras agree, keeps only the clear, non-occluded frames, and assigns species and sex by a vote across them; life stage is read separately from geo-referenced body size, since at survey resolution a juvenile often only differs from an adult female in size. Across four flights spanning the antler season the fused pipeline correctly classifies 25 of the 26 detected individuals (7 of 8 adult males, all 16 adult females and 2 juveniles), against 20 of 26 for either sensor alone. Multimodal species classification reaches 96.0%, while for sex classification fusing the two sensors matters most: the combined RGB+thermal model is the most robust across environments and seasons. Automating the demographic classification turns a drone flight from a count into a repeatable reading of herd structure, so the sex ratios and age structure that managers already act on can be gathered as often as a survey can be flown.

红鹿识别多模态融合无人机监测动物分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。