首个直接处理稀疏体素的事件相机无人机检测模型,兼顾高效与高精度。
SparseVoxelDet: Fully Sparse Voxel Networks for Efficient Event-Based Drone Detection
- 全程在坐标索引特征上操作,无需构建密集网格。
- 检测头占用率从78.88%降至10.53%,推理效率提升27.5倍。
- 适合实时事件相机系统,尤其对快速小目标检测有优势。
事件相机在检测小型快速无人机方面表现优异,但现有检测器因将稀疏事件流转换为密集网格,付出了密集计算代价。我们提出SparseVoxelDet,据知是首个坐标稀疏的3D事件体素边界框检测器:主干、特征金字塔、时序融合与检测头均直接作用于坐标索引特征,全程无密集空间网格。构建过程中发现一种名为支持膨胀的隐藏失效模式:输入仅占体素格子0.0652%的中位数,逐级传播后导致标准金字塔融合使检测头局部几乎稠密。为此提出两项改进:无扩展逆卷积融合可保证活性点不超出主干支持范围,将检测头中位占用率从78.88%降至10.53%;质量对齐监督则恢复了比维持稀疏性更优的准确率。实测表明,相同训练模型以密集方式执行,中位工作量增加27.5倍,延迟增加4.65倍,且无一帧更优;而该6.22M参数模型在FRED无人机基准上达到87.01 AP50,优于匹配的密集对照组,并在保留测试集上保持领先。
原文摘要 · Abstract (English)
Event cameras excel at detecting small, fast drones, but today's detectors give away their key advantage: they convert the sparse event stream into dense grids and pay dense-processing cost on inputs that are almost entirely empty. We present SparseVoxelDet, to our knowledge the first coordinate-sparse 3D event voxel bounding-box detector: backbone, feature pyramid, temporal reduction, and detection head all operate directly on coordinate-indexed features, with no dense spatial grid at any stage. Building it exposed a hidden failure mode we name support inflation: an input filling a median 0.0652% of the voxel lattice inflates stage by stage until standard pyramid fusion leaves the detection head locally near-dense. We answer with two ideas. Expansion-free inverse-convolution fusion provably creates no active sites beyond the stored backbone supports, cutting head occupancy from a median 78.88% to 10.53%; quality-aligned supervision then recovers more accuracy than preserving sparsity costs. The payoff is measured, not assumed: executing the same trained network densely costs a median 27.5x the work and 4.65x the latency across 5,000 paired frames, with no frame cheaper dense, while the 6.22M-parameter detector reaches 87.01 AP50 on the FRED drone benchmark, ahead of matched dense controls, and holds its lead on the held-out test partition evaluated once. Sparsity, preserved by construction and supervised well, delivers the efficiency and the accuracy together.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。