arXiv:2606.20161cs.CV2026-06

用智能代理动态优化模糊视频肠息肉分割的可靠性与时序一致性。

ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation

论文配图:ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation
图 1 · 摘自论文原文
  • 引入代理辩论机制筛选可靠时间锚点,双向传播提升分割精度。
  • 在SUN-SEG和CVC-ClinicDB-612上实现最新最佳性能,优于基线10%以上。
  • 适合临床低标注成本视频分割场景,对边界模糊和运动模糊鲁棒。

不完美监督视频肠息肉分割(VPS)旨在从低成本标注(如点、涂鸦)和少量密集标注帧中学习稠密且时序一致的掩码。该任务临床价值高但面临对比度弱、边界模糊、运动模糊和反光等挑战,且像素级指导稀疏。尽管SAM2可从稀疏输入生成稠密掩码,但直接伪标签常导致几何退化、边界泄漏,忽视时序一致性和可靠性。为此,我们提出ARTEMIS,一个由智能代理驱动的可靠性感知时序掩码演化框架。ARTEMIS从可用标注初始化粗略掩码:SAM2将点/涂鸦转换为掩码,密集标注作为可靠锚点。一个辩论-判断型视觉语言代理在弱监督下选择可靠的时间锚点,并通过SAM2双向传播以精修不可靠或未标注帧。最后,利用可靠性感知鲁棒学习训练分割器,包含可靠性引导的参考选择、参考原型传输模块和可靠性感知鲁棒损失。这些组件评估掩码可靠性,随时间演化锚点,跨帧传递目标身份,并降低噪声标注权重而非丢弃困难样本。在SUN-SEG和CVC-ClinicDB-612数据集上,于涂鸦、点和有限标签设置下实验表明,ARTEMIS达到当前最优性能。代码将在https://github.com/wangtong627/ARTEMIS发布。

原文摘要 · Abstract (English)

Imperfectly supervised video polyp segmentation (VPS) aims to learn dense, temporally consistent masks from inexpensive supervision, including weak annotations (points, scribbles) and semi-supervision with few densely labeled frames. This setting is clinically valuable but challenging due to weak contrast, ambiguous boundaries, motion blur, and specular highlights, compounded by sparse pixel-level guidance. While SAM2 can generate dense masks from sparse inputs, direct pseudo-labeling often yields geometry-degraded masks with boundary leakage, underutilizes temporal consistency, and ignores reliability. To address these issues, we propose ARTEMIS, a unified framework for imperfectly supervised VPS driven by agent-guided reliability-aware temporal mask evolution. ARTEMIS initializes coarse masks from available supervision: SAM2 converts points/scribbles, while dense labels serve as reliable anchors. A debate-and-judge vision-language agent selects reliable temporal anchors under weak supervision, which are propagated bidirectionally with SAM2 to refine unreliable or unlabeled frames. Finally, ARTEMIS trains the segmenter using temporal reliability-aware robust learning, incorporating reliability-guided reference selection, a Reference Prototype Transport Module, and reliability-aware robust loss. These components assess mask reliability, evolve anchors over time, transport target identity across frames, and down-weight noisy supervision instead of discarding difficult samples. Experiments on SUN-SEG and CVC-ClinicDB-612 under scribble, point, and limited-label settings demonstrate that ARTEMIS achieves state-of-the-art performance. Code will be released at https://github.com/wangtong627/ARTEMIS.

视频分割医学图像弱监督时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。