无需训练,用海量图片估算野生动物体型比例分布。
WildProp: Visual Estimation of Wildlife Body Proportions at Scale

- 基于用户标注图,通过姿态感知检索匹配关键点。
- 在鸟类和两栖类数据集上中位相对误差10%-20%。
- 适合跨物种、跨季节的生态演化研究,无需专门训练。
种群级形态测量是生态与进化研究的基础,但传统方法依赖受控成像或实体标本处理,难以规模化。我们提出WildProp,一种无需训练的框架,可直接从大规模非约束图像库中估计野生动物体型比例分布。将形态测量建模为检索驱动的对应问题:给定用户标注的标准图像,WildProp利用基础模型特征进行姿态感知检索,通过密集块级匹配转移部件端点,基于几何一致性过滤预测,并聚合多个检索图像的结果以估计种群级比例分布。相比监督关键点方法,该方法无需针对特定物种训练即可适应任意物种和自定义部位。在涵盖鸟类和两栖类的三个大型形态数据集上评估,中位相对误差为10%-20%。案例研究展示了其在鸟类、青蛙、昆虫及花朵等多样生物类群中测量多种比例的广泛适用性。消融实验表明,姿态感知检索对稳定估计至关重要,而鲁棒聚合可缓解关键点与姿态噪声。结果表明,经精心筛选的网络规模2D对应关系可为跨物种、地理和季节的比较分析提供可扩展的形态代理数据。
原文摘要 · Abstract (English)
Population-level morphometric measurements underpin ecological and evolutionary studies but traditionally require controlled imaging or physical specimen handling, limiting scalability. We present WildProp, a training-free framework that estimates wildlife body proportion distributions directly from large-scale, unconstrained image repositories. We cast morphometric estimation as a retrieval-driven correspondence problem: given a single user-annotated canonical image, WildProp performs pose-aware retrieval using foundation model features, transfers part endpoints via dense patch-level matching, filters predictions using geometric consistency, and aggregates measurements across retrieved images to estimate population-level ratio distributions. Unlike supervised keypoint pipelines, our approach adapts to arbitrary species and user-defined parts without per-species training. Evaluations on three large morphometric datasets spanning birds and amphibians show median relative errors of 10-20%. We further highlight the broad applicability of our approach through a number of case studies measuring various proportions across diverse taxa, including birds, frogs, insects, and flowers. Ablations demonstrate that pose-aware retrieval is critical for stable estimation, while robust aggregation mitigates keypoint and pose noise. Our results indicate that carefully curated 2D correspondences over web-scale imagery can provide scalable morphometric proxies for comparative and subgroup analyses across taxa, geography, and seasonality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。