arXiv:2607.07169cs.CV2026-07

用少量涂鸦标注实现二维材料精准分割,性能接近全监督方法。

TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation

论文配图:TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation
图 1 · 摘自论文原文
  • 结合一致性学习与树结构能量约束,从涂鸦中学习像素关系。
  • 仅用不到0.6%标注数据,达到全监督96%以上性能。
  • 适合低对比度、复杂背景下的二维材料自动筛选场景。

精确的二维材料薄片像素级定位对高通量筛选至关重要。传统全监督方法依赖密集标注,成本高、耗时长,严重限制了分割模型的实际应用。本文提出TACoS,一种专为二维材料设计的涂鸦分割框架。首先,构建统一框架,融合半监督一致性学习与结构化树能量约束,包含无标签弱-强分布对齐模块和树能量正则化模块:前者通过余弦一致性约束提升多视图预测对齐性;后者利用最小生成树建立像素亲和关系,生成结构感知的软伪标签以提供在线语义引导。其次,引入非对称区域对比学习:将弱增强分支的高置信度预测与涂鸦融合生成增强标签,并在表示空间构建类别原型;同时对边界未标注区域中的困难像素施加对比约束,增强表示层面的类内凝聚与类间分离,有效缓解低对比边缘与复杂背景下的类别混淆。在自建的石墨烯与MoS2数据集上的实验表明,TACoS仅使用不足0.6%的标注数据,性能超过全监督方法的96%;在弱对比边缘与复杂背景场景下,表现出更优的结构连贯性与边界稳定性,为二维材料薄片的自动化高通量筛选提供了高效可扩展的解决方案。

原文摘要 · Abstract (English)

The precise pixel-level localization of 2D material flakes is crucial for high-throughput screening. However, traditional fully supervised methods rely on dense annotations, which are costly and time-consuming, severely limiting the practical deployment of segmentation models. This paper proposes TACoS, a specialized scribble segmentation framework tailored for 2D materials. First, we design a unified framework that integrates semi-supervised consistency learning with structured tree energy constraints. This framework comprises two core components: an unlabeled weak-strong distribution alignment module and a tree energy regularization module. The former employs cosine consistency constraints to enhance prediction alignment across views. Meanwhile, the latter utilizes minimum spanning trees to establish pixel affinity relationships and generate structure-aware soft pseudo labels for online semantic guidance. Next, we introduce asymmetric regional contrast learning. This approach fuses high-confidence predictions from the weak augmentation branch with scribbles to form augmented labels, and construct category prototypes in the representation space. Simultaneously, we prioritize contrastive constraints on challenging pixels in boundary-unlabeled regions. This strategy enhances intra-class cohesion and inter-class separation at the representation level, effectively reducing category confusion in low-contrast edges and complex backgrounds. Experiments conducted on the constructed graphene and MoS2 datasets demonstrate that our method TACoS achieves over 96% of fully supervised performance using less than 0.6% annotated data. Furthermore, it exhibits superior structural coherence and boundary stability in scenarios with weakly contrasting edges and complex backgrounds, providing an efficient and scalable solution for automated high-throughput screening of 2D material flakes.

图像分割弱监督二维材料涂鸦标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。