用离散几何编码提升多动物追踪的稳定性与精度
HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking

- 将位置、尺度、速度转为分层离散码本,替代不稳定的连续坐标
- 在AnimalTrack等数据集上,HOTA提升12.3%,IDF1达78.5%
- 适合高密度动物追踪场景,也适用于通用多目标跟踪任务
多动物追踪对野生动物监测和行为分析至关重要,但因外观相似、密度高、运动不规则而极具挑战。现有方法多依赖启发式几何关联或基于查询的范式:前者缺乏端到端优化,后者高度依赖外观嵌入。在该条件下,连续几何嵌入易受微小坐标扰动影响,导致跨帧注意力权重剧烈变化,损害身份关联性能。为此,我们提出HieDG——一种分层离散几何引导的追踪框架,将几何动态重构为查询追踪器中的结构化离散表示。不直接使用原始几何信号,而是通过两级残差码本对位置、尺度、速度进行离散化,将不稳定的连续几何转化为结构化、稳定的离散令牌。这些令牌与视觉嵌入对齐并融入追踪查询,增强身份一致性。在动物专用基准(AnimalTrack、BFT、BuckTales)上的大量实验表明,其在HOTA、AssA和IDF1指标上均达到领先水平,显著提升。在DanceTrack和SportsMOT等通用多目标追踪基准上的额外评估也展现出竞争力,表明离散几何建模具有超越动物特定场景的广泛适用性。
原文摘要 · Abstract (English)
Multi-animal tracking (MAT) is critical for wildlife monitoring and behavioral analysis, yet remains challenging due to uniform appearance, high density, and irregular motion. Existing methods typically follow heuristic- or query-based paradigms: the former relies on handcrafted geometric associations without end-to-end optimization, whereas the latter enables joint optimization but relies heavily on appearance embeddings. In such conditions, continuous geometric embeddings can be unstable, as small coordinate perturbations may disproportionately alter cross-frame attention weights, degrading identity association performance. To address this limitation, we propose HieDG, a Hierarchical Discrete Geometry-guided tracking framework that reformulates geometric dynamics as structured discrete representations within a query-based tracker. Instead of directly using raw geometric signals, HieDG employs a two-stage residual codebook to discretize position, scale, and velocity cues, transforming unstable continuous geometry into structured, stable discrete tokens. These tokens are aligned with visual embeddings and integrated into the tracking queries to enhance identity consistency. Extensive experiments on animal-specific benchmarks (AnimalTrack, BFT, and BuckTales) demonstrate state-of-the-art association performance with significant improvements in HOTA, AssA, and IDF1. Additional evaluations on generic multi-object tracking benchmarks, including DanceTrack and SportsMOT, show competitive performance, indicating the broader applicability of discretized geometric modeling beyond animal-specific scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。