用元学习优化人体网格恢复,提升测试时适应性和不确定性估计。
Meta-Learned Adaptive Optimization for Robust Human Mesh Recovery with Uncertainty-Aware Parameter Updates
- 通过元学习训练更好初始参数,模拟测试优化过程。
- 减少计算开销,降低MPJPE达10.3(3DPW)和8.0(Human3.6M)。
- 支持跨域泛化,提供与误差相关的不确定性估计。
单图人体网格恢复因深度模糊性及跨域泛化能力不足而困难。现有方法结合回归与优化,但测试时优化初始化差、参数更新效率低。本文提出一种元学习框架,训练模型生成优化友好初始化,并在测试时引入不确定性感知自适应更新。核心创新包括:(1) 训练中模拟测试优化,学习更优初始参数;(2) 选择性参数缓存机制,冻结已收敛关节以降低计算负担;(3) 基于分布的自适应更新,从学习分布采样参数变化,实现鲁棒探索并量化不确定性。同时采用随机逼近处理复杂损失曲面中的不可导梯度。在标准基准上实验表明,本方法在3DPW上降低MPJPE 10.3,Human3.6M上降低8.0,跨环境性能衰减小,且不确定性估计与真实误差相关。结合元学习与自适应优化,实现高精度网格重建与强鲁棒性。
原文摘要 · Abstract (English)
Human mesh recovery from single images remains challenging due to inherent depth ambiguity and limited generalization across domains. While recent methods combine regression and optimization approaches, they struggle with poor initialization for test-time refinement and inefficient parameter updates during optimization. We propose a novel meta-learning framework that trains models to produce optimization-friendly initializations while incorporating uncertainty-aware adaptive updates during test-time refinement. Our approach introduces three key innovations: (1) a meta-learning strategy that simulates test-time optimization during training to learn better parameter initializations, (2) a selective parameter caching mechanism that identifies and freezes converged joints to reduce computational overhead, and (3) distribution-based adaptive updates that sample parameter changes from learned distributions, enabling robust exploration while quantifying uncertainty. Additionally, we employ stochastic approximation techniques to handle intractable gradients in complex loss landscapes. Extensive experiments on standard benchmarks demonstrate that our method achieves state-of-the-art performance, reducing MPJPE by 10.3 on 3DPW and 8.0 on Human3.6M compared to strong baselines. Our approach shows superior domain adaptation capabilities with minimal performance degradation across different environmental conditions, while providing meaningful uncertainty estimates that correlate with actual prediction errors. Combining meta-learning and adaptive optimization enables accurate mesh recovery and robust generalization to challenging scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。