用向量量化替代随机丢弃,实现可控的医学图像分割增强
VQ-Seg: Vector-Quantized Token Perturbation for Semi-Supervised Medical Image Segmentation
- 用向量量化构建可调控的特征扰动模块,取代依赖调参的丢弃法
- 在肺癌数据集上达到新最佳性能,半监督分割精度显著提升
- 适合需要稳定训练、减少调参负担的医疗图像分析场景
一致性学习中的特征扰动是半监督医学图像分割的常用策略。然而,现有方法多依赖丢弃(dropout),需精细调节丢弃率这一敏感超参数,难以优化且易导致正则化不足。为此,我们提出VQ-Seg,首个采用向量量化(VQ)离散化特征空间并引入新型可控的量化扰动模块(QPM)的方法,该模块通过打乱码本索引的空间位置来扰动离散表示,实现有效且可控的正则化。为缓解量化带来的信息损失,设计双分支结构,使量化后特征同时服务于图像重建与分割任务。此外,引入后量化特征适配器(PFA),融合基础模型(FM)的高层语义信息,补充量化过程丢失的语义。我们还构建了一个大规模肺癌(LC)数据集,包含828例标注为中心型肺癌的CT扫描。在该数据集及其他公开基准上的大量实验表明,本方法优于现有先进方法。代码已公开:https://github.com/script-Yang/VQ-Seg。
原文摘要 · Abstract (English)
Consistency learning with feature perturbation is a widely used strategy in semi-supervised medical image segmentation. However, many existing perturbation methods rely on dropout, and thus require a careful manual tuning of the dropout rate, which is a sensitive hyperparameter and often difficult to optimize and may lead to suboptimal regularization. To overcome this limitation, we propose VQ-Seg, the first approach to employ vector quantization (VQ) to discretize the feature space and introduce a novel and controllable Quantized Perturbation Module (QPM) that replaces dropout. Our QPM perturbs discrete representations by shuffling the spatial locations of codebook indices, enabling effective and controllable regularization. To mitigate potential information loss caused by quantization, we design a dual-branch architecture where the post-quantization feature space is shared by both image reconstruction and segmentation tasks. Moreover, we introduce a Post-VQ Feature Adapter (PFA) to incorporate guidance from a foundation model (FM), supplementing the high-level semantic information lost during quantization. Furthermore, we collect a large-scale Lung Cancer (LC) dataset comprising 828 CT scans annotated for central-type lung carcinoma. Extensive experiments on the LC dataset and other public benchmarks demonstrate the effectiveness of our method, which outperforms state-of-the-art approaches. Code available at: https://github.com/script-Yang/VQ-Seg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。