用滑动窗平均法消除图像拼接伪影,提升生物图像重建精度。
SWITi: Quantifying and Reducing Tiling Artifacts with Sliding Window Inner Tiling

- 通过滑动窗口重叠预测,平滑相邻区块间的差异。
- 在三个荧光显微数据集上显著减弱拼接缝,提升分辨率与保真度。
- 无需额外前向传播,适合生物医学大图推理场景。
SWITi是一种测试时方法,用于减少基于后验分布采样生成解的神经网络在分块预测中的伪影。当图像分块尺寸小于模型感受野且各块独立采样时,伪影易在拼接处产生。SWITi通过对重叠滑动窗预测结果进行平均,使相邻样本差异分散于不同位置,而非固定在拼接线上。对于后验模型,其采样数不高于最小均方误差估计所需,无需增加前向传播次数。我们还提出两种无参考指标:拒绝测试比例(FRT)和伪影严重度(ASV),通过像素梯度分布的块间置换检验,检测并量化拼接伪影。在三个2D与3D荧光显微数据集上的预训练分块模型实验表明,SWITi显著减弱拼接缝,同时提升重建保真度与分辨率。由于此类伪影常被误认为生物结构或边界,使用SWITi可有效改善大规模图像推理的下游分析,对生物医学图像尤为重要。
原文摘要 · Abstract (English)
SWITi is a test-time method for reducing artifacts in tiled predictions, particularly for neural networks that learn posterior distributions from which solutions are sampled at inference time. Tiled predictions are unavoidable for large image data, and artifacts arise whenever tiles are smaller than a network's receptive field and when tiles are independent posterior samples. SWITi averages overlapping sliding-window predictions, so discrepancies between neighboring samples are spread across shifted tile positions rather than accumulating at fixed seam coordinates. For posterior models, SWITi uses no more tile samples than an MMSE estimate requires and therefore incurs no additional forward passes. Additionally, we introduce two reference-free metrics, the Fraction of Rejected Tests (FRT) and Artifact Severity (ASV), for detecting and quantifying tiling artifacts from a per-tile permutation test that compares the distribution of pixel gradients across tile seams against the surrounding image content. On pre-trained and published image splitting models across three fluorescence microscopy datasets in 2D and 3D, we show that SWITi substantially attenuates stitching seams while also improving reconstruction fidelity and resolution. Since tiling artifacts in posterior predictions can easily be mistaken for biological structures or for boundaries between biological structures, removing or reducing them using SWITi will improve the downstream processing of large image predictions, which is particularly relevant for biomedical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。