用膜电位做信念状态,让3D点云识别可随时退出,省电又高效。
Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition

- 以膜电位为信念值,动态选下一块观察区域,实现自适应推理
- 在ModelNet40上达90.62%准确率,比最强基线低1.7点但更节能
- 首次实现脉冲网络的可认证任意时间输出,适用范围广
脉冲点云网络通常按固定顺序扫描空间,未充分利用膜电位随时间演化的决策潜力。主动脉冲感知(ASP)将3D识别重构为迭代决策过程:网络自身的漏积分放(LIF)膜电位作为类别信念,选择下一观察块并触发置信度阈值提前退出。轻量级切片选择策略基于膜状态与预计算几何描述符,通过直通Gumbel-Softmax端到端训练,在推理时退化为argmax,仅增加约2%主干参数。我们证明了漏积分等价于贝叶斯滤波的递归对数后验更新,退出规则在停止时刻实现无分布假设的选择性风险且无多重检验惩罚,流式状态传递等价于有界精度漂移的前缀重计算。ASP在ModelNet40和ModelNet10上分别达到90.62%和93.28%准确率,较最强脉冲基线低1.7个百分点,但引入了其他基线不具备的可认证任意时间接口。该机制可直接迁移至密集预测任务,获得ShapeNetPart上83.21的实例mIoU、S3DIS Area 5上48.50的mIoU,据知是首个脉冲模型在S3DIS Area 5的结果;当用注视替代块选择时,还可推广至非脉冲注意力模型,计算成本与观测次数严格线性相关,阈值为可测量的能耗调节器,覆盖2.8x至1.35x的能效提升。一个明确限制是:当前采样尺寸下,一个S3DIS类别无法识别,本文给出了修复建议。
原文摘要 · Abstract (English)
Spiking point cloud networks usually scan space in a fixed, input-agnostic order, which leaves the most distinctive resource of spiking computation, the temporal evolution of the membrane potential, unused as a locus of decision-making. Active Spiking Perception (ASP) recasts 3D recognition as an iterative decision process in which the network's own leaky integrate-and-fire (LIF) membrane potential, read as a running belief over the class, selects the next chunk to observe and triggers confidence-margin early exit. A lightweight Slice-Selection Policy scores unvisited farthest-point-sampled chunks from the membrane state and precomputed geometric descriptors, trains end-to-end through a straight-through Gumbel-Softmax, reduces to an argmax at inference, and adds about 2% of backbone parameters. We prove that leaky integration is the recursive log-posterior update of a Bayesian filter, that the exit rule attains distribution-free selective risk with no multiple-testing penalty at the stopping time, and that streaming state carry-forward is exactly equivalent to prefix recomputation with bounded finite-precision drift. ASP reaches 90.62% and 93.28% on ModelNet40 and ModelNet10, 1.7 points below the strongest spiking baseline at a larger backbone, while adding a certified anytime interface no baseline offers. The mechanism transfers unchanged to dense prediction, giving 83.21 instance mIoU on ShapeNetPart and 48.50 mIoU on S3DIS Area 5, to our knowledge the first spiking results on S3DIS Area 5, and, fixation replacing chunk selection, to a foveated non-spiking transformer, so the policy is not tied to spiking backbones: cost is exactly linear in observations and the threshold is a measured compute dial spanning 2.8x to 1.35x less energy. One limitation is concrete: one S3DIS class is unidentifiable at the crop size we use, and we give the prediction that would fix it.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。