将细胞视为点,一阶段完成高效追踪,速度提升8到32倍。
Cell as Point: One-Stage Framework for Efficient Cell Tracking
- 把细胞当作点处理,端到端直接追踪序列轨迹,无需分割预处理。
- 在真实数据集上达到90%以上追踪准确率,比现有方法快8至32倍。
- 适合需要高效率、低标注成本的生物图像追踪任务。
传统多阶段细胞追踪方法依赖每帧的检测或分割作为前提,需大量资源生成高质量分割掩码,导致整体预测时间长。为解决此问题,我们提出CAP框架,一种将细胞视为点的一阶段端到端追踪新方法。不同于传统方式,CAP不依赖显式检测或分割,而是通过利用轨迹间的内在关联,在一个阶段内联合追踪细胞序列,显著降低标注需求和流程复杂度。然而,直接处理完整序列面临细胞分裂事件数据不平衡及长序列推理挑战。为此,CAP引入两项创新:(1) 自适应事件引导采样(AEG),优先关注细胞分裂事件以缓解事件发生不平衡;(2) 滚动窗口推理策略(RAW),确保长时间序列中新生细胞的连续稳定追踪。在不依赖分割预处理的前提下,有效应对事件不平衡与长序列追踪难题,展现优异追踪性能,相较现有方法提速8至32倍。代码与模型检查点见https://github.com/YXSong000/CAP。
原文摘要 · Abstract (English)
Conventional multi-stage cell tracking approaches rely heavily on detection or segmentation in each frame as a prerequisite, requiring substantial resources for high-quality segmentation masks and increasing the overall prediction time. To address these limitations, we propose CAP, a novel end-to-end one-stage framework that reimagines cell tracking by treating Cell as Point. Unlike traditional methods, CAP eliminates the need for explicit detection or segmentation, instead jointly tracking cells for sequences in one stage by leveraging the inherent correlations among their trajectories. This simplification reduces both labeling requirements and pipeline complexity. However, directly processing the entire sequence in one stage poses challenges related to data imbalance in capturing cell division events and long sequence inference. To solve these challenges, CAP introduces two key innovations: (1) adaptive event-guided (AEG) sampling, which prioritizes cell division events to mitigate the occurrence imbalance of cell events, and (2) the rolling-as-window (RAW) inference strategy, which ensures continuous and stable tracking of newly emerging cells over extended sequences. By removing the dependency on segmentation-based preprocessing while addressing the challenges of imbalanced occurrence of cell events and long-sequence tracking, CAP demonstrates promising cell tracking performance and is 8 to 32 times more efficient than existing methods. The code and model checkpoints are available at https://github.com/YXSong000/CAP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。