arXiv:2606.02366cs.CV2026-06

用生物先验和测试时自适应提升稀有动物3D建模精度

PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation

论文配图:PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation
图 1 · 摘自论文原文
  • 引入生物特征嵌入作为先验知识,增强跨物种形状泛化能力
  • 通过2D投影约束与关键点引导实现测试时优化,提升姿态与形状估计
  • 构建大规模伪3D数据集,助力模型在罕见物种和复杂姿态上表现优异

我们提出PRIMA(PRIors for Mesh Adaptation),一个针对严重物种与姿态分布不均情况下的鲁棒四足动物3D网格重建框架。现有方法因3D监督数据有限及长尾物种分布,常回归到平均形状与姿态,导致对稀有动物和罕见动作的泛化能力差。PRIMA通过三项关键贡献解决该问题:首先,将BioCLIP嵌入作为生物先验,注入语义与形态知识,提升跨物种形状预测的准确性和泛化性;其次,提出测试时自适应(TTA)策略,结合2D重投影约束与辅助关键点指导,优化SMAL预测,同时从现有2D数据集中生成高质量伪3D标注;第三,基于此TTA框架构建Quadruped3D,一个覆盖多样物种与姿态变化的大规模伪3D数据集,系统性提升模型性能。在Animal3D、CtrlAni3D、Quadruped2D和Animal Kingdom上的实验表明,PRIMA达到当前最优结果,尤其在稀有物种和挑战性姿态上提升显著。结果凸显生物先验与自适应驱动的数据扩展对可扩展、泛化性强的动物网格重建的重要性。代码已开源。

原文摘要 · Abstract (English)

We present PRIMA (*PRI*ors for *M*esh *A*daptation), a framework for robust 3D quadruped mesh recovery under severe species and pose imbalance. Existing animal reconstruction methods often regress toward mean shapes and poses due to limited 3D supervision and long-tailed species distributions, resulting in poor generalization to underrepresented animals and rare articulations. PRIMA addresses this challenge through three key contributions. First, we incorporate BioCLIP embeddings as biological priors to inject semantic and morphological knowledge into the reconstruction process, enabling more accurate and generalizable shape prediction across diverse quadrupeds. Second, we introduce a test-time adaptation (TTA) strategy that refines SMAL predictions using 2D reprojection constraints together with auxiliary keypoint guidance, improving pose and shape estimation while enabling the generation of high-quality pseudo-3D annotations from existing 2D datasets. Third, leveraging this TTA framework, we construct Quadruped3D, a large-scale pseudo-3D dataset that covers diverse species and pose variations to systematically improve model performance. Extensive experiments on Animal3D, CtrlAni3D, Quadruped2D, and Animal Kingdom demonstrate that PRIMA achieves state-of-the-art results, with particularly strong improvements on underrepresented species and challenging poses. Our results highlight the importance of biological priors and adaptation-driven data expansion for scalable and generalizable animal mesh recovery. Code is available at https://github.com/AdaptiveMotorControlLab/PRIMA.

3D重建生物先验测试时自适应动物建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。