arXiv:2605.20385cs.CVcs.AI2026-05

用元强化学习让模型能分割任意概念,从物体到抽象概念都适用。

ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning

论文配图:ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning
图 1 · 摘自论文原文
  • 通过元强化学习从视觉示例中提炼可迁移的分割规则。
  • 在多领域概念分割任务上超越现有方法,尤其在复杂推理类概念表现突出。
  • 适合研究视觉理解、通用分割和具身智能的学者使用。

近期可提示分割进展推动视觉感知从物体级定位转向概念级理解。然而,概念的定义仍不明确,当前方法是否真正超越类别识别尚不清晰。本文提出三层次概念分类体系:无上下文(CI)、有上下文(CD)与上下文推理(CR),揭示认知复杂度递增下的能力差距。为此,我们提出ConceptSeg-R1,将概念分割重构为规则引导的概念定位。核心是Meta-GRPO元强化学习机制,从视觉演示中学习可迁移的任务规则,并通过代理推理验证。推断出的推理状态经轻量级转换模块生成可直接用于分割的概念提示,实现对目标图像的演绎应用。快捷路由策略保留了分割模型在简单案例上的原生效率。我们在涵盖自然、工业、医疗及高推理强度领域的多个CI、CD、CR概念分割基准上进行系统评估。无需额外技巧,ConceptSeg-R1在全概念层级均表现优异,同时保持可提示分割骨干模型的原有能力。作为迈向任意概念分割的初步尝试,我们希望ConceptSeg-R1能成为推动分割从物体预测迈向概念理解的实用基准。

原文摘要 · Abstract (English)

Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding. However, the notion of a concept remains under-specified, making it unclear whether current methods truly generalize beyond category recognition. In this work, we formalize generalized concept segmentation through a three-level taxonomy consisting of context-independent (CI), context-dependent (CD), and context-reasoning (CR) concepts, which reveals a clear capability gap across increasing levels of cognitive complexity. To address this challenge, we propose ConceptSeg-R1, a unified framework that reformulates concept segmentation as rule-induced concept grounding. At the core of our method is Meta-GRPO, a meta-reinforcement learning mechanism that learns transferable task rules from visual demonstrations and verifies them through proxy reasoning. The inferred reasoning states are then translated into segmentation-ready concept prompts via a lightweight concept translation module, enabling deductive application to target images. A shortcut routing strategy further preserves the native efficiency of segmentation models on simple cases. To systematically evaluate generalized concept segmentation, we conduct extensive experiments across diverse CI, CD, and CR concept segmentation benchmarks spanning natural, industrial, medical and reasoning-intensive domains. Without bells and whistles, ConceptSeg-R1 achieves strong performance across the full concept hierarchy while maintaining the native capability of promptable segmentation backbones. As an initial step toward segmenting any concept, we hope ConceptSeg-R1 can serve as a practical baseline for advancing segmentation from object-level prediction toward concept-level understanding.

概念分割元学习强化学习通用分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。