提出分层实例路由的专家混合模型,提升目标检测精度,尤其改善小物体识别。
HI-MoE: Hierarchical Instance-Conditioned Mixture-of-Experts for Object Detection
- 分两阶段路由:先选场景一致专家子集,再为每个目标查询分配专家
- 在COCO上优于密集基线和简单路由方法,小物体检测提升显著
- 适合追求高精度目标检测的开发者,尤其关注小目标场景
专家混合(MoE)架构通过仅激活部分参数实现条件计算。尽管稀疏路由在语言模型中表现优异,并在视觉任务中初现潜力,但多数视觉MoE方法仍以图像或图像块为粒度。这与目标检测中以候选实例为基本推理单元的特性不匹配。本文提出分层实例条件专家混合(HI-MoE),一种基于DETR的检测架构,采用两级路由机制:轻量级场景路由器首先选择一组场景一致的专家,实例路由器再将每个对象查询分配给该子集内的少数专家。该设计在保持稀疏计算的同时,更契合检测任务中异构且以实例为中心的结构。当前版本实验集中于COCO数据集,并对LVIS进行了初步的专业化分析。结果表明,HI-MoE在性能上超越密集型DINO基线及更简单的令牌级或仅实例路由变体,尤其在小物体检测上表现突出。此外,还提供了专家专业化模式的初步可视化。本文呈现了方法、消融实验及当前局限性,旨在支持进一步验证。
原文摘要 · Abstract (English)
Mixture-of-Experts (MoE) architectures enable conditional computation by activating only a subset of model parameters for each input. Although sparse routing has been highly effective in language models and has also shown promise in vision, most vision MoE methods operate at the image or patch level. This granularity is poorly aligned with object detection, where the fundamental unit of reasoning is an object query corresponding to a candidate instance. We propose Hierarchical Instance-Conditioned Mixture-of-Experts (HI-MoE), a DETR-style detection architecture that performs routing in two stages: a lightweight scene router first selects a scene-consistent expert subset, and an instance router then assigns each object query to a small number of experts within that subset. This design aims to preserve sparse computation while better matching the heterogeneous, instance-centric structure of detection. In the current draft, experiments are concentrated on COCO with preliminary specialization analysis on LVIS. Under these settings, HI-MoE improves over a dense DINO baseline and over simpler token-level or instance-only routing variants, with especially strong gains on small objects. We also provide an initial visualization of expert specialization patterns. We present the method, ablations, and current limitations in a form intended to support further experimental validation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。