arXiv:2502.02558hep-excs.CV2025-02被引 8

用自监督学习从无标签数据中提取粒子轨迹特征,仅用100个标注样本就达到顶尖模型效果。

Particle Trajectory Representation Learning with Masked Point Modeling

  • 通过遮蔽点建模和体积分块,直接从原始点云学习物理有意义的轨迹表征。
  • 仅需100个标注事件,就能在轨迹/簇分割任务上媲美基于超10万事件训练的监督模型。
  • 可自动发现粒子轨迹实例,适合高能物理、粒子探测等科学领域研究者使用。

有效的自监督学习(SSL)技术是解锁大规模数据用于表征学习的关键。尽管在线语料库和带注释图像已催生多种优秀方法,但在科学领域(如高能物理)仍面临挑战,因数据蕴含高度专业化的知识。液态氩时间投影室(LArTPCs)提供高分辨率3D成像,但其稀疏复杂的点云分析通常依赖大规模模拟数据的监督训练,可能引入偏差。本文提出基于点的液态氩掩码自编码器(PoLAr-MAE),采用领域特定的体素化标记与能量预测,在未标注的LArTPC图像上应用遮蔽点建模。实验表明该方法能直接从数据中学习具有物理意义的轨迹表征。其数据效率惊人:仅用100个标注事件微调,即可在轨迹/簇语义分割任务上达到超越10万事件训练的监督基线模型性能。此外,内部注意力图展现出粒子轨迹的涌现实例分割能力。尽管精细特征仍具挑战,本工作为构建可用于所有重建任务的通用基础模型提供了切实路径。为推动进一步发展,我们发布包含100万事件的PILArNet-M数据集。

原文摘要 · Abstract (English)

Effective self-supervised learning (SSL) techniques have been key to unlocking large datasets for representation learning. While many promising methods have been developed using online corpora and captioned photographs, their application to scientific domains, where data encodes highly specialized knowledge, remains a challenge. Liquid Argon Time Projection Chambers (LArTPCs) provide high-resolution 3D imaging for fundamental physics, but analysis of their sparse, complex point cloud data often relies on supervised methods trained on large simulations, introducing potential biases. We introduce the Point-based Liquid Argon Masked Autoencoder (PoLAr-MAE), applying masked point modeling to unlabeled LArTPC images using domain-specific volumetric tokenization and energy prediction. We show this SSL approach learns physically meaningful trajectory representations directly from data. This yields remarkable data efficiency: fine-tuning on just 100 labeled events achieves track/shower semantic segmentation performance comparable to the state-of-the-art supervised baseline trained on $>$100,000 events. Furthermore, internal attention maps exhibit emergent instance segmentation of particle trajectories. While challenges remain, particularly for fine-grained features, we make concrete SSL's potential for building a foundation model for LArTPC image analysis capable of serving as a common base for all data reconstruction tasks. To facilitate further progress, we release PILArNet-M, a large dataset of 1M LArTPC events. Project site: https://youngsm.com/polarmae.

自监督学习粒子探测点云建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。