开源本地工具SAMannot让视频实例分割更高效、私密且无需云端服务。
SAMannot: A Memory-Efficient, Local, Open-source Framework for Interactive Video Instance Segmentation based on SAM2
- 基于SAM2改进,通过轻量化处理层降低资源消耗,提升响应速度。
- 支持自动锁定与精修流程,结合骨架提示机制,减少人工操作。
- 适合需要高精度视频标注的研究者,尤其关注隐私与成本的团队。
当前精确视频分割的研究工作常在耗时的人工标注、昂贵的商业平台或存在隐私风险的云服务之间妥协。研究对高保真视频实例分割的需求常受限于人工标注瓶颈和云工具的隐私问题。本文提出SAMannot,一个开源、本地运行的交互式视频实例分割框架,集成Segment Anything Model 2(SAM2)。为应对基础模型的高资源需求,我们优化了SAM2依赖关系,并实现一个低开销处理层,最大化吞吐量并保证界面高度响应。核心功能包括持久化实例身份管理、基于屏障帧的自动化“锁定-精修”流程,以及基于掩码骨架的自动提示机制。SAMannot可生成适用于YOLO和PNG格式的研究级数据集,并保留结构化交互日志。经动物行为追踪案例及LVOS、DAVIS子集验证,该工具为复杂视频标注任务提供了可扩展、私密且低成本的替代方案。
原文摘要 · Abstract (English)
Current research workflows for precise video segmentation are often forced into a compromise between labor-intensive manual curation, costly commercial platforms, and/or privacy-compromising cloud-based services. The demand for high-fidelity video instance segmentation in research is often hindered by the bottleneck of manual annotation and the privacy concerns of cloud-based tools. We present SAMannot, an open-source, local framework that integrates the Segment Anything Model 2 (SAM2) into a human-in-the-loop workflow. To address the high resource requirements of foundation models, we modified the SAM2 dependency and implemented a processing layer that minimizes computational overhead and maximizes throughput, ensuring a highly responsive user interface. Key features include persistent instance identity management, an automated ``lock-and-refine'' workflow with barrier frames, and a mask-skeletonization-based auto-prompting mechanism. SAMannot facilitates the generation of research-ready datasets in YOLO and PNG formats alongside structured interaction logs. Verified through animal behavior tracking use-cases and subsets of the LVOS and DAVIS benchmark datasets, the tool provides a scalable, private, and cost-effective alternative to commercial platforms for complex video annotation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。