用小模型实时感知双目目标3维运动,精度逼近图像分辨率极限。
3D Motion Perception of Binocular Vision Target with PID-CNN
- 将神经网络类比为PID控制,用多层卷积逐步提取空间时间特征。
- 17层小模型在仿真球体数据上达到接近图像分辨率上限的预测精度。
- 适合做低延迟视觉感知的嵌入式系统,尤其关注计算效率的场景。
本文训练了一个用于感知双目视觉目标三维运动信息的网络,可实时输出三维坐标、速度和加速度,并具备基本的时空感知能力。从PID角度理解神经网络拟合非线性问题的能力:单层网络视为用二阶差分方程与非线性描述局部问题;多层网络通过多次组合实现原始表征到目标表征的转换。分析了设计神经网络的一些参考原则。设计了一个较小型的PID卷积神经网络,共17层,参数量41.3万。通过拼接与池化实现简单但有效的特征复用。在模拟随机运动球体数据集上进行训练与测试,实验结果表明预测精度接近输入图像分辨率所能表示的理论上限。分析了实验结果与误差,指出当前不足及改进方向。最后讨论了高维卷积在提升计算效率与特征空间利用率方面的优势,以及利用PID信息实现记忆与注意力机制的潜在优势。
原文摘要 · Abstract (English)
This article trained a network for perceiving three-dimensional motion information of binocular vision target, which can provide real-time three-dimensional coordinate, velocity, and acceleration, and has a basic spatiotemporal perception capability. Understood the ability of neural networks to fit nonlinear problems from the perspective of PID. Considered a single-layer neural network as using a second-order difference equation and a nonlinearity to describe a local problem. Multilayer networks gradually transform the raw representation to the desired representation through multiple such combinations. Analysed some reference principles for designing neural networks. Designed a relatively small PID convolutional neural network, with a total of 17 layers and 413 thousand parameters. Implemented a simple but practical feature reuse method by concatenation and pooling. The network was trained and tested using the simulated randomly moving ball datasets, and the experimental results showed that the prediction accuracy was close to the upper limit that the input image resolution can represent. Analysed the experimental results and errors, as well as the existing shortcomings and possible directions for improvement. Finally, discussed the advantages of high-dimensional convolution in improving computational efficiency and feature space utilization. As well as the potential advantages of using PID information to implement memory and attention mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。