AnytimeYOLO让目标检测模型随时输出结果,适合实时安全系统。
You Only Look Once at Anytime (AnytimeYOLO): Analysis and Optimization of Early-Exits for Object-Detection
- 在YOLO架构中加入可中断推理机制,支持任意时间点输出预测。
- 提出新算法优化退出顺序与低资源部署的退出组合选择。
- 提供细粒度控制和新评估指标,适配高要求实时场景。
我们提出AnytimeYOLO,一类支持任意时间输出的YOLO变体,实现可中断推理,适用于对延迟敏感的安全关键型实时应用。通过结构化探索,改进了原始YOLO架构,支持在任意阶段提前终止并获取中间结果。首次将任意时间模型形式化为一类特殊预测模型。提出一种新型反卷积版YOLO结构,提升早期预测能力并灵活调整处理顺序。进一步设计两种优化算法:一是确定最优退出执行顺序,二是针对低资源环境选择最优的早期退出子集。评估了不同设计选择下的任意时间性能与权衡,提出新的任意时间质量度量标准。特别指出当前任意时间推理部署成本高的关键挑战。
原文摘要 · Abstract (English)
We introduce AnytimeYOLO, a family of variants of the YOLO architecture that enables anytime object detection. Our AnytimeYOLO networks allow for interruptible inference, i.e., they provide a prediction at any point in time, a property desirable for safety-critical real-time applications. We present structured explorations to modify the YOLO architecture, enabling early termination to obtain intermediate results. We focus on providing fine-grained control through high granularity of available termination points. First, we formalize Anytime Models as a special class of prediction models that offer anytime predictions. Then, we discuss a novel transposed variant of the YOLO architecture, that changes the architecture to enable better early predictions and greater freedom for the order of processing stages. Finally, we propose two optimization algorithms that, given an anytime model, can be used to determine the optimal exit execution order and the optimal subset of early-exits to select for deployment in low-resource environments. We evaluate the anytime performance and trade-offs of design choices, proposing a new anytime quality metric for this purpose. In particular, we also discuss key challenges for anytime inference that currently make its deployment costly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。