用视觉语言模型检测生物医学图像造假,提升科研可信度。
Rescind: Countering Image Misconduct in Biomedical Publications with Vision-Language and State-Space Modeling
- 结合扩散模型与视觉语言提示,实现语义可控的图像伪造生成。
- 提出Integscan框架,在Rescind数据集上达到检测与定位最优效果。
- 适用于科研审核、期刊编辑及图像真实性验证场景。
生物医学论文中的图像篡改严重威胁研究可信性与可重复性。与自然图像取证不同,生物医学伪造检测因领域特异性伪影、复杂纹理和非结构化图布局而更具挑战。本文提出首个基于视觉-语言引导的生物医学图像伪造生成与检测框架。通过融合扩散合成与视觉语言提示,方法可实现跨多种生物医学模态的语义可控伪造,包括复制、拼接和区域删除。构建了大规模基准Rescind,包含细粒度标注与模态特定划分,并提出Integscan——一种结合注意力增强视觉编码与提示条件语义对齐的结构化状态空间建模框架,实现精准伪造定位。为确保语义一致性,引入基于视觉-语言模型的验证环路,过滤与预期提示不一致的伪造图像。在Rescind及现有基准上的实验表明,Integscan在检测与定位任务上均达到当前最优性能,为自动化科研诚信分析奠定坚实基础。
原文摘要 · Abstract (English)
Scientific image manipulation in biomedical publications poses a growing threat to research integrity and reproducibility. Unlike natural image forensics, biomedical forgery detection is uniquely challenging due to domain-specific artifacts, complex textures, and unstructured figure layouts. We present the first vision-language guided framework for both generating and detecting biomedical image forgeries. By combining diffusion-based synthesis with vision-language prompting, our method enables realistic and semantically controlled manipulations, including duplication, splicing, and region removal, across diverse biomedical modalities. We introduce Rescind, a large-scale benchmark featuring fine-grained annotations and modality-specific splits, and propose Integscan, a structured state space modeling framework that integrates attention-enhanced visual encoding with prompt-conditioned semantic alignment for precise forgery localization. To ensure semantic fidelity, we incorporate a vision-language model based verification loop that filters generated forgeries based on consistency with intended prompts. Extensive experiments on Rescind and existing benchmarks demonstrate that Integscan achieves state of the art performance in both detection and localization, establishing a strong foundation for automated scientific integrity analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。