用连续流方法做分类检测,让模型像生成模型一样迭代优化。
Discriminative Flow Matching Via Local Generative Predictors
- 将分类检测建模为从噪声到目标的连续流传输过程。
- 多独立流预测器并行训练,支持不同硬件与内存约束。
- 适用于CNN和ViT,提升模型鲁棒性与推理灵活性。
传统判别式计算机视觉主要依赖静态映射,将输入特征一步映射到输出,虽高效但缺乏生物视觉与现代生成建模中的迭代优化与鲁棒性。本文提出判别流匹配(Discriminative Flow Matching),将分类与目标检测重构为条件传输过程。通过学习一个向量场,将样本从简单噪声分布连续传输至任务对齐的目标流形(如类别嵌入或边界框坐标),实现生成与判别学习的融合。该方法在共享主干网络上附加多个独立的流预测器,各块使用局部流匹配目标独立计算梯度进行训练。我们将其应用于标准图像分类,并拓展至高维、空间分布的目标检测任务。该架构支持块间顺序更新以减少激活内存,或并行更新以适配不同硬件。通过聚合多个独立流预测器的输出,框架可在多种模型结构(包括CNN与视觉变压器)上实现鲁棒、生成式启发的推理。
原文摘要 · Abstract (English)
Traditional discriminative computer vision relies predominantly on static projections, mapping input features to outputs in a single computational step. Although efficient, this paradigm lacks the iterative refinement and robustness inherent in biological vision and modern generative modelling. In this paper, we propose Discriminative Flow Matching, a framework that reformulates classification and object detection as a conditional transport process. By learning a vector field that continuously transports samples from a simple noise distribution toward a task-aligned target manifold -- such as class embeddings or bounding box coordinates -- we are at the interface between generative and discriminative learning. Our method attaches multiple independent flow predictors to a shared backbone. These predictors are trained using local flow matching objectives, where gradients are computed independently for each block. We formulate this approach for standard image classification and extend it to the complex task of object detection, where targets are high-dimensional and spatially distributed. This architecture provides the flexibility to update blocks either sequentially to minimise activation memory or in parallel to suit different hardware constraints. By aggregating the predictions from these independent flow predictors, our framework enables robust, generative-inspired inference across diverse architectures, including CNNs and vision transformers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。