arXiv:2608.07999cs.CV2026-08

通过双向选择性聚合提升生成图像检测精度,仅用1.3%参数实现顶尖性能。

PE-Mamba: Bidirectional Selective Layer Aggregation for AI-Generated Image Detection

论文配图:PE-Mamba: Bidirectional Selective Layer Aggregation for AI-Generated Image Detection
图 1 · 摘自论文原文
  • 设计双向扫描机制,从浅层到深层逐步积累证据,再反向优化低层特征。
  • 在UniversalFakeDetect上达到96.6%准确率,优于18个现有模型。
  • 适合需要轻量化部署的生成内容安全检测场景。

AI生成图像检测因生成模型快速演进而愈发困难,真实与合成内容差异缩小。现有基于视觉变换器的检测器多采用加权求和策略融合多层特征,却忽略了从浅层纹理到深层语义的有序进展。本文提出PE-Mamba框架,基于预训练的PE-Core视觉变换器,结合轻量级LoRA微调,引入三项互补组件实现跨层特征聚合:首先,双向选择性聚合器(BSA)通过正向扫描累积浅至深的取证证据,反向扫描利用高层语义重释低层线索;其次,软最大权重聚合器(SWA)学习全局层特征摘要;最后,逻辑门融合器(SGA)通过可学习标量门动态融合两者输出。在UniversalFakeDetect(96.6% mACC, 99.5% mAP)和AIGCDetect(95.3% mACC, 98.1% mAP)上的实验表明,该方法超越18种检测器,具备优异泛化能力,且仅训练总参数的1.3%(其中LoRA仅0.13%)。

原文摘要 · Abstract (English)

AI-generated image (AIGI) detection has become increasingly challenging due to the rapid advancement of generative models and the diminishing gap between synthetic and authentic content. Existing vision transformer-based detectors commonly rely on weighted-sum strategies to aggregate intermediate representations across transformer layers, often overlooking the inherently ordered semantic progression of hierarchical features from shallow texture cues to deep semantic representations. In this work, we propose \textbf{PE-Mamba}, a novel framework built upon a pre-trained PE-Core vision transformer with lightweight LoRA adaptation that introduces three complementary components for cross-layer feature aggregation and fusion. First, a bidirectional selective aggregator (BSA) processes layer-wise classification tokens through forward and backward selective scans, where the forward scan progressively accumulates shallow-to-deep forensic evidence, and the backward scan performs deep-to-shallow contextual refinement to reinterpret low-level cues in light of high-level semantic context. Second, a softmax-weighted aggregator (SWA) computes a learned global summary of all layer tokens as a complementary aggregation path. Third, a sigmoid-gated blend (SGA) adaptively fuses the BSA and SWA outputs via a learnable scalar gate, allowing the model to dynamically balance directional sequential evidence and global layer-wise aggregation. Extensive experiments on UniversalFakeDetect (96.6\% mACC, 99.5\% mAP) and AIGCDetect (95.3\% mACC, 98.1\% mAP) demonstrate that \methodname{} outperforms 18 detectors with superior generalization across diverse generative models, while training only 1.3\% of total parameters (0.13\% for LoRA alone).

图像检测生成内容轻量化模型Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。