arXiv:2602.05257cs.CVcs.RO2026-02

用强化学习加速6D姿态估计,采样效率提升明显。

RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation

  • 基于流匹配生成姿态,沿最优传输路径高效采样。
  • 在REAL275上推理速度提升4倍,误差低于1.8°和0.03米。
  • 适合需要快速高精度姿态估计的机器人交互场景。

6D物体姿态估计是计算机视觉中的基础问题,在虚拟现实与具身智能中至关重要。尽管基于分数的生成模型部分解决了类别级姿态估计中的旋转对称性难题,但其效率受限于得分扩散模型的高采样成本。本文提出RFM-Pose框架,通过流匹配生成模型沿从简单先验到姿态分布的最优传输路径生成姿态候选,并将采样过程建模为马尔可夫决策过程,利用近端策略优化(PPO)微调采样策略。具体地,将流场视为可学习策略,将评估器映射为价值网络,实现姿态生成与假设评分的联合优化。在REAL275基准测试中,该方法在保持良好性能的同时显著降低计算开销,推理速度提升4倍,平均误差为1.8°(旋转)和0.03米(平移)。此外,该方法可直接扩展至姿态跟踪任务,取得具有竞争力的结果。

原文摘要 · Abstract (English)

Object pose estimation is a fundamental problem in computer vision and plays a critical role in virtual reality and embodied intelligence, where agents must understand and interact with objects in 3D space. Recently, score based generative models have to some extent solved the rotational symmetry ambiguity problem in category level pose estimation, but their efficiency remains limited by the high sampling cost of score-based diffusion. In this work, we propose a new framework, RFM-Pose, that accelerates category-level 6D object pose generation while actively evaluating sampled hypotheses. To improve sampling efficiency, we adopt a flow-matching generative model and generate pose candidates along an optimal transport path from a simple prior to the pose distribution. To further refine these candidates, we cast the flow-matching sampling process as a Markov decision process and apply proximal policy optimization to fine-tune the sampling policy. In particular, we interpret the flow field as a learnable policy and map an estimator to a value network, enabling joint optimization of pose generation and hypothesis scoring within a reinforcement learning framework. Experiments on the REAL275 benchmark demonstrate that RFM-Pose achieves favorable performance while significantly reducing computational cost. Moreover, similar to prior work, our approach can be readily adapted to object pose tracking and attains competitive results in this setting.

6D姿态估计流匹配强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。