提出新旋转表示SARR,解决对称物体姿态估计的模糊性问题。
Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes

- 设计基于对称性的旋转表示SARR,使姿态表达唯一连续。
- 在T-LESS和ITODD数据集上,性能优于现有方法,即使无对称性先验。
- 仅需深度图或灰度图,无需3D模型,适合实际部署。
对称物体在日常生活与工业中常见,但其固有的方向模糊性阻碍了深度学习网络的姿态估计训练,而文献对此讨论较少。现有方法多依赖特定损失函数、网络结构或不变性评估指标。本文聚焦旋转本身的数值表示,利用物体形状导出的对称度修改三角恒等式,提出SARR表示法,为T-LESS和ITODD两个主流6D姿态估计数据集中的对称物体生成规范(对称可分辨)姿态。SARR在视觉外观下具有唯一性和连续性,使标准CNN可直接用于3D方向估计,并以对称敏感的余弦距离$ ext{AR}_{ ext{C}}$评估性能。实验表明,使用SARR的网络在$ ext{AR}_{ ext{C}}$上超越当前最优,且在传统不变性度量下也表现良好。本方法无需3D模型,仅需深度图,或在附加实验中使用无纹理的RGB/灰度图像。进一步证明,基于SARR训练的网络在推理时即便未知对称性,仍优于基于旋转矩阵、欧拉角、四元数、标准三角函数或近期流行的6D表示的网络。代码与可视化工具已在https://github.com/akriegler/SARR发布。
原文摘要 · Abstract (English)
Symmetric objects are common in daily life and industry, yet their inherent orientation ambiguities that impede the training of deep learning networks for pose estimation are rarely discussed in the literature. To cope with these ambiguities, existing solutions typically require the design of specific loss functions and network architectures or resort to symmetry-invariant evaluation metrics. In contrast, we focus on the numeric representation of the rotation itself, modifying trigonometric identities with the degrees of symmetry derived from the objects' shapes. We use our representation, SARR, to obtain canonic (symmetry-resolved) poses for the symmetric objects in two popular 6D pose estimation datasets, T-LESS and ITODD, where SARR is unique and continuous w.r.t. the visual appearance. This allows us to use a standard CNN for 3D orientation estimation whose performance is evaluated with the symmetry-sensitive cosine distance $\text{AR}_{\text{C}}$. Our networks outperform the state of the art using $\text{AR}_{\text{C}}$ and achieve satisfactory performance when using conventional symmetry-invariant measures. Our method does not require any 3D models but only depth, or, as part of an additional experiment, texture-less RGB/grayscale images as input. We also show that networks trained on SARR outperform the same networks trained on rotation matrices, Euler angles, quaternions, standard trigonometrics or the recently popular 6d representation -- even in inference scenarios where no prior knowledge of the objects' symmetry properties is available. Code and a visualization toolkit are available at https://github.com/akriegler/SARR .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。