轻量级适配器提升航天器姿态估计精度,兼顾时序信息与模型效率。
TALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation

- 在冻结ViT的注意力层前注入轻量适配器,利用时序信息增强特征。
- 在SPADES上姿态误差降低50%,SwissCube上ADD-0.1d准确率提升21.8%。
- 仅增加不到5%参数,适合资源受限场景,支持零样本跨域迁移。
单目6-自由度航天器姿态估计方法通常只处理单帧图像,忽略机动过程中图像序列的时序信息。现有时序方法多需全模型微调或额外光流网络,易导致灾难性遗忘或计算开销增加。本文提出TALON(Token-Aligned Lightweight adapters for Orbital Navigation):在冻结的ViT视觉变换器自注意力层前注入时空3D适配器,并采用基于原型条件KL散度的块-令牌对齐损失,将中间特征几何地锚定到关键点结构。预注意力设计使冻结注意力能处理时序增强的令牌,在每块仅一个适配器的情况下性能优于后注意力方案。对齐损失促使每个关键点在令牌场中产生空间精确激活,整体参数增量低于5%。在SPADES数据集上,相比先前最优方法姿态误差降低50%;在SwissCube数据集上,ADD-0.1d准确率提升21.8%。在SPARK真实数据上的零样本跨域评估中,姿态误差降低4.7倍。消融实验分析了适配器深度在域内与跨域设置中的作用。
原文摘要 · Abstract (English)
Monocular 6-DoF spacecraft pose estimation methods predominantly process individual frames, discarding the temporal information present in an image sequence acquired during spacecraft manoeuvres. Few temporal approaches require full backbone fine-tuning or auxiliary optical flow networks, risking catastrophic forgetting or increasing computational cost, respectively. We propose TALON (Token-Aligned Lightweight adapters for Orbital Navigation): spatiotemporal 3D adapters injected before the self-attention layers of a frozen ViT vision transformer, combined with a patch-token alignment loss that geometrically grounds the adapted features to keypoint structure through a prototype-conditioned KL-divergence objective. Pre-attention placement allows the frozen attention to reason over temporally enriched tokens, achieving stronger performance with a single adapter per block than post-attention alternatives. The alignment loss shapes the intermediate representations so that each keypoint induces a spatially precise activation in the token field, while the framework adds less than 5% parameters to the frozen backbone. On SPADES dataset, TALON reduces the pose error by 50% over the prior state-of-the-art, and on SwissCube dataset it surpasses the prior best by 21.8% in ADD-0.1d accuracy. Zero-shot cross-domain evaluation from sim-to-real on SPARK real data reduces pose error by 4.7x, and ablations characterise the role of adapter depth across in-domain and cross-domain settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。