用稀疏特征共振网络实现多目标分类与追踪,无需数据增强。
Generalized multi-object classification and tracking with sparse feature resonator networks
- 通过生成模型逆推构建共振网络,同时获取不变与可变特征。
- 仅用中心化数据训练分类器,测试时可处理任意位置的未见数字形状。
- 天然注意力机制支持多目标场景分析,像素级精度追踪多个运动物体。
在视觉场景理解任务中,捕捉不变性与等变性结构至关重要。尽管神经网络常被训练为对平移等变换具有不变性,但往往损失了对象精确位置等可变信息。此外,仅靠监督学习难以自然保证不变性,许多架构在训练中未遇的输入变换下泛化能力差。本文基于分析-合成思想,采用共振网络进行分解建模。生成模型描述包含MNIST数字及其颜色、位置等变换的简单场景;共振网络反演该生成模型,提供特定对象的不变与可变信息。从训练数据中学得的稀疏特征作为基集,灵活表示对象的可变形状,使网络能处理测试集中未见过的数字形状。模块化结构包含去平移后的形状模块,使分类器可在居中数字上运行,仅需少量中心化数据训练,整体网络无需数据增强即可识别任意平移下的对象。共振网络的自然注意力机制支持多对象场景分析,动态选择并居中单个对象。特定对象的位置信息可从平移模块中提取,实验表明该网络可实现像素级精度的多对象追踪。
原文摘要 · Abstract (English)
In visual scene understanding tasks, it is essential to capture both invariant and equivariant structure. While neural networks are frequently trained to achieve invariance to transformations such as translation, this often comes at the cost of losing access to equivariant information - e.g., the precise location of an object. Moreover, invariance is not naturally guaranteed through supervised learning alone, and many architectures generalize poorly to input transformations not encountered during training. Here, we take an approach based on analysis-by-synthesis and factoring using resonator networks. A generative model describes the construction of simple scenes containing MNIST digits and their transformations, like color and position. The resonator network inverts the generative model, and provides both invariant and equivariant information about particular objects. Sparse features learned from training data act as a basis set to provide flexibility in representing variable shapes of objects, allowing the resonator network to handle previously unseen digit shapes from the test set. The modular structure provides a shape module which contains information about the object shape with translation factored out, allowing a simple classifier to operate on centered digits. The classification layer is trained solely on centered data, requiring much less training data, and the network as a whole can identify objects with arbitrary translations without data augmentation. The natural attention-like mechanism of the resonator network also allows for analysis of scenes with multiple objects, where the network dynamics selects and centers only one object at a time. Further, the specific position information of a particular object can be extracted from the translation module, and we show that the resonator can be designed to track multiple moving objects with precision of a few pixels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。