arXiv:2601.17047cs.CVcs.LG2026-01

用对比学习解码成像噪声,仅需100样本即达超前效果。

A Contrastive Pre-trained Foundation Model for Deciphering Imaging Noisomics across Modalities

  • 基于对比预训练模型,从噪声中分离出物理信号与算法伪影。
  • 仅用100样本性能超越百万样本监督模型,数据需求降1000倍。
  • 零样本泛化能力强,适合无设备校准的精准成像诊断场景。

成像噪声的表征历来依赖大量数据且高度依赖设备,因现代传感器将物理信号与复杂算法伪影纠缠。现有方法难以在缺乏大规模标注数据的情况下解耦这些因素,常将噪声视为干扰而非信息资源。本文提出“噪声组学”(Noisomics)框架,通过对比预训练(CoP)基础模型,转变思路,从抑制噪声转向系统性解码噪声。该模型利用流形假设与合成噪声基因组,采用对比学习实现语义信号与随机扰动的解耦。关键突破在于打破传统深度学习的规模定律:仅用100个训练样本,性能即优于使用10万样本训练的监督基线,使数据与计算依赖降低三个数量级。在12个跨域数据集上的广泛基准测试证实其鲁棒的零样本泛化能力,估计误差降低63.8%,决定系数提升85.1%。我们验证了CoP在多尺度下的应用价值:从消费级摄影中的非线性硬件噪声交互解码,到深层组织显微镜的光子高效协议优化。通过将噪声作为多参数足迹解码,本工作重新定义随机退化为关键信息资源,实现无需预先设备校准的精准成像诊断。

原文摘要 · Abstract (English)

Characterizing imaging noise is notoriously data-intensive and device-dependent, as modern sensors entangle physical signals with complex algorithmic artifacts. Current paradigms struggle to disentangle these factors without massive supervised datasets, often reducing noise to mere interference rather than an information resource. Here, we introduce "Noisomics", a framework shifting the focus from suppression to systematic noise decoding via the Contrastive Pre-trained (CoP) Foundation Model. By leveraging the manifold hypothesis and synthetic noise genome, CoP employs contrastive learning to disentangle semantic signals from stochastic perturbations. Crucially, CoP breaks traditional deep learning scaling laws, achieving superior performance with only 100 training samples, outperforming supervised baselines trained on 100,000 samples, thereby reducing data and computational dependency by three orders of magnitude. Extensive benchmarking across 12 diverse out-of-domain datasets confirms its robust zero-shot generalization, demonstrating a 63.8% reduction in estimation error and an 85.1% improvement in the coefficient of determination compared to the conventional training strategy. We demonstrate CoP's utility across scales: from deciphering non-linear hardware-noise interplay in consumer photography to optimizing photon-efficient protocols for deep-tissue microscopy. By decoding noise as a multi-parametric footprint, our work redefines stochastic degradation as a vital information resource, empowering precise imaging diagnostics without prior device calibration.

成像噪声对比学习零样本基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。