arXiv:2510.19955cs.CV2025-10

用视觉变压器+对比学习,提升3D形状识别准确率。

Transformed Multi-view 3D Shape Features with Contrastive Learning

  • 用视觉变压器捕捉全局形状语义,结合对比学习优化局部特征。
  • 在ModelNet10上达到90.6%的识别准确率,优于传统CNN方法。
  • 适合关注3D视觉、自监督学习和多视角分析的研究者。

本文针对3D形状特征表示学习的挑战,研究了先进骨干网络与对比监督及自监督学习目标的结合。计算机视觉在从2D图像识别3D物体时面临困难,常需大量标注数据,且依赖可能忽略关键形状关系的卷积神经网络(CNN)。本工作表明,基于视觉变压器(ViTs)的架构搭配现代对比学习目标,在下游任务中实现了多视角3D分析的优异表现,统一了对比学习与3D形状理解流程。例如,监督对比损失在ModelNet10上达到了约90.6%的准确率。该方法利用ViTs对整体形状的理解能力与对比学习的有效性,克服了对大量标注数据的依赖以及CNN在捕捉关键形状关系上的局限。成功源于通过ViTs捕获全局形状语义,并通过对比优化强化局部判别特征。该方法具有实证性,基于广泛实验验证了将ViTs与对比目标结合在3D表示学习中的有效性。

原文摘要 · Abstract (English)

This paper addresses the challenges in representation learning of 3D shape features by investigating state-of-the-art backbones paired with both contrastive supervised and self-supervised learning objectives. Computer vision methods struggle with recognizing 3D objects from 2D images, often requiring extensive labeled data and relying on Convolutional Neural Networks (CNNs) that may overlook crucial shape relationships. Our work demonstrates that Vision Transformers (ViTs) based architectures, when paired with modern contrastive objectives, achieve promising results in multi-view 3D analysis on our downstream tasks, unifying contrastive and 3D shape understanding pipelines. For example, supervised contrastive losses reached about 90.6% accuracy on ModelNet10. The use of ViTs and contrastive learning, leveraging ViTs' ability to understand overall shapes and contrastive learning's effectiveness, overcomes the need for extensive labeled data and the limitations of CNNs in capturing crucial shape relationships. The success stems from capturing global shape semantics via ViTs and refining local discriminative features through contrastive optimization. Importantly, our approach is empirical, as it is grounded on extensive experimental evaluation to validate the effectiveness of combining ViTs with contrastive objectives for 3D representation learning.

3D视觉对比学习视觉变压器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。