arXiv:2608.15297cs.CV2026-08

轻量级端到端6D姿态估计算法,适合边缘设备实时运行。

TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers

论文配图:TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers
图 1 · 摘自论文原文
  • 基于轻量Transformer架构,单次前向传播完成检测与姿态回归
  • 在YCB-V数据集上达到85.9%的ADD-S AUC,参数量减少72.7%
  • 无需后处理,支持对称物体统一损失,适合嵌入式部署

在资源受限硬件上实现实时6DoF物体姿态估计仍具挑战,传统方法依赖不可微的PnP/RANSAC或高成本迭代优化,而基于基础模型的方法推理开销过大,难以用于边缘部署。本文提出TinyDETR-Pose,一种轻量、端到端、单阶段框架,通过联合检测与姿态回归,在一次前向传播中完成任务。基于高效的LW-DETR架构,将检测与姿态估计建模为集合预测问题,并为每个解码器查询配备专门的MLP头以回归旋转、单目深度和投影中心,避免了PnP、NMS及迭代优化。通过对所有物体统一使用ADD-S损失处理对称性,无需针对不同物体设计特定损失调度或单独的测地线/ADD监督。预测与真实值通过基于类别和2D空间线索的对称安全匈牙利匹配器分配,在对称性和深度模糊下仍保持稳定。在YCB-V数据集上,其ADD-S AUC达85.9%,相比其他DETR-based单阶段方法参数量减少最多72.7%。得益于紧凑设计,该模型可在NVIDIA Jetson Nano上以约4.5毫秒/帧的延迟实时运行,验证了基于Transformer的6D姿态估计在边缘部署中的可行性。

原文摘要 · Abstract (English)

Real-time 6DoF object pose estimation on resource-constrained hardware remains challenging, as accurate correspondence-based and refinement pipelines typically rely on non-differentiable PnP/RANSAC stages or costly iterative refinement, while recent foundation-model-based approaches incur inference costs that are prohibitive for edge deployment. We present TinyDETR-Pose, a lightweight, end-to-end, single-stage framework that jointly detects objects and regresses their full 6D pose in a single forward pass. Built on the efficient LW-DETR architecture, TinyDETR-Pose formulates detection and pose estimation as a set-prediction problem and attaches dedicated MLP heads for rotation, monocular depth, and projected object center regression to each decoder query, eliminating the need for PnP, NMS (non-maximum suppression), or iterative pose refinement. Object symmetries are handled through a ADD-S loss applied uniformly to all objects, without the need for object-specific loss schedules or separate geodesic/ADD supervision. In addition, predictions are assigned to ground truth using a symmetry-safe Hungarian matcher based on class and 2D spatial cues, yielding stable assignment under symmetry and depth ambiguity. On YCB-V, TinyDETR-Pose achieves a comparable ADD-S AUC of 85.9, while requiring up to 72.7% fewer parameters than other DETR-based single-stage pose-estimation approaches. Due to its compact design, TinyDETR-Pose runs in real time and achieves an inference latency of only ~4.5 ms per frame on an NVIDIA Jetson Nano using TensorRT, demonstrating that accurate end-to-end transformer-based 6D pose estimation can be made practical for edge deployment.

6D姿态估计轻量化模型边缘计算Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。