arXiv:2605.25538cs.CVcs.DB2026-05被引 1

通过分块采样大幅降低视频目标跟踪的计算成本,同时保持高精度。

Tetris: Tile-level Sampling for Efficient and High-Fidelity Video Object Tracking

论文配图:Tetris: Tile-level Sampling for Efficient and High-Fidelity Video Object Tracking
图 1 · 摘自论文原文
  • 将视频拆分为可变大小的区块,仅对关键区域进行检测
  • 在保持5%精度损失的前提下,速度比之前系统快17.4倍
  • 适合需要高效处理大量静态视频的应用场景

Track materialization 将原始视频转换为可复用的目标轨迹,使下游查询无需重新运行追踪,但高效且高保真的轨迹提取仍代价高昂。现有系统通过时间帧采样降低开销,但过度采样导致轨迹点间距过大,难以准确捕捉真实运动路径。在静态视频中,大部分帧不含兴趣对象,可对不同区域采用差异采样率。为此,我们提出 Tetris,一个基于多连方块(polyomino)数据模型的轨迹提取系统,实现细粒度时空剪枝,显著减少检测调用次数而几乎不损失精度。Tetris 分三步执行:首先,分类器识别相关区块并聚合成多连方块;其次,使用整数线性规划(ILP)在用户指定精度约束下剪除冗余多连方块;最后,将剩余多连方块打包至画布以最小化检测次数。在7个静态视频数据集上,Tetris 在相比全帧处理参考管道仅损失5%精度的情况下,优于3个数据集上的前序系统;同时,在5%误差限制下,其吞吐量最高达前序系统的17.4倍,甚至比参考管道快68.8倍。反之,在相同吞吐量下,Tetris 的 HOTA 准确率最高提升0.42。项目主页:https://tetris-db.github.io。

原文摘要 · Abstract (English)

Track materialization converts raw videos into reusable object tracks that downstream queries can run against without rerunning tracking, but extracting those tracks efficiently and with high fidelity remains expensive. Prior systems reduce track materialization cost through temporal frame sampling, but aggressive sampling spaces each track's detection points too far apart to faithfully capture the object's actual trajectory. In stationary video, however, large portions of each frame contain no objects of interest, and different sampling rates can be used to extract tracks from the remaining regions. Leveraging this idea, we present Tetris, a track-extraction system that decomposes videos into a tile-based polyomino data model, enabling fine-grained spatiotemporal pruning that reduces detector calls with minimal fidelity loss. Tetris implements track materialization in three steps: first, a classifier identifies relevant tiles and groups them into polyominoes. Then, we use an integer linear program (ILP) to prune redundant polyominoes under a user-specified accuracy constraint, before packing the remaining polyominoes into canvases to minimize detector calls. Across 7 stationary-video datasets, Tetris stays within a 5% tracking accuracy loss as compared to a reference pipeline that processes every frame in its entirety, while prior systems exceed this bound on 3 of the 7 datasets. Moreover, with this 5% bound, Tetris achieves up to 17.4x higher throughput than prior systems, and up to 68.8x higher than the reference pipeline. Conversely, Tetris delivers up to 0.42 higher HOTA tracking accuracy than the best prior system at matched throughput. The project page is at https://tetris-db.github.io .

视频跟踪高效推理时空剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。